JP5417604B2 - Network system, portable terminal device, and device control method - Google Patents

Description

  The present invention relates to a network system, a mobile terminal device, and a device control method, and more particularly to a network system, a mobile terminal device, and a device control method in which a certain device performs processing for controlling other devices.

  2. Description of the Related Art With the development of communication technology, various technologies for remotely controlling a device at a position away from the mobile terminal device in a mobile terminal device such as a mobile phone have been disclosed.

For example, Japanese Patent Laid-Open No. 2001-336949 (Patent Document 1) discloses a technique (hereinafter also referred to as a first prior art) for controlling an image distribution server using a mobile phone.
JP 2001-336949 A

  In recent years, various devices such as home appliances have various functions, and the number of people who are not good at operating the devices is increasing. Here, a user who is familiar with the operation of the apparatus is referred to as user A. A user who is not good at operating the apparatus is referred to as user B. Further, it is assumed that each of the user A and the user B has a portable terminal device. Hereinafter, the portable terminal device possessed by the user A is referred to as a portable terminal device A. A mobile terminal device possessed by the user B is referred to as a mobile terminal device B.

  Further, in the vicinity of the mobile terminal device B, there is a device that the user B is not good at operating (hereinafter referred to as device B), and the device B can communicate with the mobile terminal device B. Further, it is assumed that the mobile terminal device A and the mobile terminal device B can communicate with each other.

  In this case, the user A who is familiar with the operation of the device is required to control the device B in the vicinity of the mobile terminal device B that the user B is not good at operating by operating the mobile terminal device A. There is a case. In the first prior art, a technology for directly controlling an image distribution server by a mobile phone is disclosed, but a technology for indirectly controlling other devices using the image distribution server by the mobile phone. Is not disclosed.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a network system, a portable terminal device, and device control that can control devices in the vicinity of devices capable of communication. Is to provide a method.

  In order to solve the above-described problem, a network system according to an aspect of the present invention includes a first mobile terminal device and a second mobile terminal device that can communicate with each other. The first mobile terminal device includes first transmission means for transmitting, to the second mobile terminal device, a search instruction for searching for a device capable of wireless communication with the second mobile terminal device in the vicinity of the second mobile terminal device. The second mobile terminal device includes a first receiving means for receiving a search instruction, and a communicable device that is a device capable of wireless communication with the second mobile terminal device based on the received search instruction. A search unit that performs a process for searching in the vicinity of the first mobile terminal device, and a search notification indicating that the communicable device has been searched is transmitted to the first portable terminal device when the search unit searches for a communicable device. The first portable terminal device further includes a second receiving unit for receiving the search notification, and the first transmission unit is a communicable device when the second receiving unit receives the search notification. System to control An instruction is transmitted to the second portable terminal device, and the second portable terminal device further includes control means for controlling the communicable device based on the received control instruction when the first receiving means receives the control instruction. Prepare.

  Preferably, the first transmission unit of the first mobile terminal device transmits a search instruction to the second mobile terminal device in response to the fact that the first mobile terminal device can talk to the second mobile terminal device.

  Preferably, the communicable device is a device capable of displaying an image, the control instruction is an instruction for causing the communicable device to display the designated image, and the control means of the second portable terminal device Based on the above, control is performed to display the designated image on the communicable device.

  Preferably, the network system further includes a server for storing image data, the control instruction indicates access information for acquiring the image data from the server, and the control means of the second portable terminal device is based on the control instruction. Then, control is performed to cause the communicable device to use the access information and acquire image data from the server.

  Preferably, the communicable device is a device capable of displaying an image, and the first transmission unit displays a display image which is an image to be displayed on the communicable device when the second reception unit receives the search notification. When the first receiving unit receives the display image, the second transmitting unit of the second portable terminal device transmits the display image to the communicable device.

  Preferably, at least one of voice, a control instruction, and an image is exchanged by packet communication between the first portable terminal device and the second portable terminal device.

  Preferably, the processing performed by at least one of the first receiving unit, the searching unit, the second transmitting unit, the second receiving unit, and the control unit is performed when the first mobile terminal device and the second mobile terminal device can talk. To be done.

  According to another aspect of the present invention, a portable terminal device that can communicate with another portable terminal device, wherein the other portable terminal device is a device that can communicate wirelessly with another portable terminal device. By receiving a search instruction for searching in the vicinity of the mobile terminal device, a process for searching for a communicable device that is a device capable of wireless communication with another mobile terminal device in the vicinity of the other mobile terminal device is performed. When a communicable device is searched, a communicable device is transmitted by transmitting a search notification indicating that a communicable device has been searched to the mobile terminal device and receiving a control instruction for controlling the communicable device. Is to control. The mobile terminal device includes a transmission means for transmitting a search instruction for searching for a device capable of wireless communication with another mobile terminal device in the vicinity of the other mobile terminal device to the other mobile terminal device, and the other mobile terminal. Receiving means for receiving a search notification transmitted from the device, and when the receiving means receives the search notification, the transmitting means sends a control instruction for controlling the communicable device to another portable terminal device. Send.

  According to still another aspect of the present invention, there is provided a device control method performed in a network system including a first mobile terminal device and a second mobile terminal device that can communicate with each other, wherein the first mobile terminal device is connected to the second mobile terminal device. Transmitting a search instruction for searching for a device capable of wireless communication in the vicinity of the second mobile terminal apparatus to the second mobile terminal apparatus; receiving a search instruction by the second mobile terminal apparatus; Performing a process for searching for a communicable device, which is a device capable of wireless communication with the second mobile terminal device, in the vicinity of the second mobile terminal device based on the received search instruction; When the second mobile terminal device searches for a communicable device, the step of transmitting a search notification indicating that the communicable device has been searched to the first mobile terminal device; A band terminal device receiving a search notification, and a first mobile terminal device transmitting a control instruction to control a communicable device to the second mobile terminal device in response to receiving the search notification; When the second portable terminal device receives the control instruction, the second portable terminal device includes a step of controlling the communicable device based on the received control instruction.

  The network system according to the present invention includes a first mobile terminal device and a second mobile terminal device. The first mobile terminal device transmits a search instruction for searching for a device capable of wireless communication with the second mobile terminal device in the vicinity of the second mobile terminal device to the second mobile terminal device. The second mobile terminal device performs processing for searching for a communicable device that is a device capable of wireless communication with the second mobile terminal device in the vicinity of the second mobile terminal device, and when a communicable device is searched, A search notification indicating that the search has been made is transmitted to the first portable terminal device. When the first portable terminal device receives the search notification, the first portable terminal device transmits a control instruction for controlling the communicable device to the second portable terminal device. The second portable terminal device controls the communicable device based on the received control instruction.

  Therefore, it is possible to control a device in the vicinity of a communicable device.

  The mobile terminal device according to the present invention can communicate with other mobile terminal devices. The mobile terminal device transmits a search instruction for searching for a device capable of wireless communication with another mobile terminal device in the vicinity of the other mobile terminal device to the other mobile terminal device. Upon receiving the search instruction, the other mobile terminal device performs processing for searching for a communicable device that is a device capable of wireless communication with the other mobile terminal device in the vicinity of the other mobile terminal device, and performs communication. When a possible device is searched, a search notification indicating that a communicable device has been searched is transmitted to the mobile terminal device. When receiving the search notification, the mobile terminal device transmits a control instruction for controlling the communicable device to another mobile terminal device. The other portable terminal device controls the communicable device by receiving the control instruction.

  Therefore, it is possible to control a device in the vicinity of a communicable device.

  In the apparatus control method according to the present invention, the following processing is performed. The first mobile terminal device transmits to the second mobile terminal device a search instruction for searching for a device capable of wireless communication with the second mobile terminal device in the vicinity of the second mobile terminal device. Based on the received search instruction, the second mobile terminal device performs processing for searching for a communicable device that is a device capable of wireless communication with the second mobile terminal device in the vicinity of the second mobile terminal device, and performs communication. When a possible device is searched, a search notification indicating that a communicable device has been searched is transmitted to the first portable terminal device. In response to receiving the search notification, the first portable terminal device transmits a control instruction for controlling the communicable device to the second portable terminal device. When the second portable terminal device receives the control instruction, the second portable terminal device controls the communicable device based on the received control instruction.

  Therefore, it is possible to control a device in the vicinity of a communicable device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to the present embodiment. Referring to FIG. 1, network system 1000 includes portable terminal devices 500.1 and 500.2, content reproduction device 600, and server 800.

  The mobile terminal devices 500.1 and 500.2 are mobile phones. Note that the mobile terminal devices 500.1 and 500.2 are not limited to mobile phones, and any device (for example, a landline phone, a PDA (for example, a fixed phone) having a telephone function and a communication function and being portable. (Personal Digital Assistance) or PC (Personal Computer)).

  The mobile terminal devices 500.1 and 500.2 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Therefore, the mobile terminal device 500.1 can make a call and data communication with the mobile terminal device 500.2 via the telephone network 60. As an example, the data communication performed using the telephone network 60 is packet communication.

  The content reproduction apparatus 600 is a television receiver as an example. The content reproduction device 600 is not limited to a television receiver, and may be any device as long as it can reproduce content. Here, it is assumed that the content reproduction device 600 is in the vicinity of the mobile terminal device 500.2. As an example, it is assumed that the distance between the position of the content reproduction device 600 and the position of the mobile terminal device 500.2 is 5 meters.

  It is assumed that the distance between the position of mobile terminal device 500.1 and the position of mobile terminal device 500.2 is a predetermined distance (for example, 1 kilometer) or more. That is, it is assumed that the mobile terminal device 500.1 and the mobile terminal device 500.2 cannot directly perform wireless communication.

  The portable terminal device 500.2 performs data communication with the content reproduction device 600 by wireless or wired.

  Further, the content reproduction device 600 has a function of performing data communication with the network 70 wirelessly or by wire. The network 70 is a wide area network such as the Internet. The network 70 can perform data communication with the telephone network 60 by wireless or wired. Therefore, the mobile terminal devices 500.1 and 500.2 can perform data communication with the network 70 via the telephone network 60.

  Hereinafter, each of the mobile terminal device 500.1 and the mobile terminal device 500.2 is also collectively referred to as a mobile terminal device 500.

  The server 800 is a PC. The server 800 is a server that accumulates content and provides content and the like. The content is, for example, a moving image, a still image, music data, or the like. The server 800 stores a plurality of contents.

  Server 800 performs data communication with network 70 in a wireless or wired manner. Therefore, each of the plurality of devices that communicate with network 70 can communicate with server 800.

(Mobile terminal device)
Next, the mobile terminal device 500 will be described in detail.

  FIG. 2 is a diagram showing the external appearance of the mobile terminal device 500 from the front. With reference to FIG. 2, the mobile terminal device 500 includes a display unit 530, an audio output unit 570, and an imaging unit 578.

  The display unit 530 has a function of displaying characters, images, and the like. Display unit 530 is provided with a display surface for displaying characters, images, and the like. The display unit 530 is a device using an LCD panel (Liquid Crystal Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The maximum resolution of an image displayed on the display surface of the display unit 530 (hereinafter also referred to as the maximum display resolution) is horizontal 480 (dots) × vertical 800 (dots). Note that the maximum display resolution of the display unit 530 is not limited to horizontal 480 (dots) × vertical 800 (dots), and may be other resolutions.

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the display surface. Display unit 530 transmits the position information of the user touching the display surface to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The audio output unit 570 is a speaker that outputs telephone voice. Audio output unit 570 outputs audio based on audio data received from control unit 510 described later.

  The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 causes the light reflected from the subject to be imaged and incident on the imaging lens or light from a light source (for example, illumination) to be input to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

The mobile terminal device 500 further includes an input unit 540.
The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are moved within the image displayed on the display unit 530, for example, by a pressing operation (hereinafter also referred to as a short pressing operation) for a short time (for example, less than 1 second) by the user. It is a button for moving a target object (for example, a cursor) vertically and horizontally. Hereinafter, a long time (for example, one second or more) button pressing operation by a user is also referred to as a long pressing operation.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A, 542B, 543A, and 543B is a button for performing an assigned process by a short press operation.

  Input unit 540 further includes a character button group 546. The character button group 546 includes 15 character buttons. Each of the plurality of character buttons included in the character button group 546 is a button for inputting numbers, characters, symbols, or the like by a short press operation.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the mobile terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  The portable terminal device 500 further includes a voice input unit 574 and a recording medium insertion unit 550A. The voice input unit 574 is a microphone that acquires voice. The recording medium insertion unit 550 </ b> A is a part for inserting a recording medium, which will be described later, into the mobile terminal device 500.

  FIG. 3 is a block diagram illustrating an internal configuration of the mobile terminal device 500. Note that FIG. 3 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  With reference to FIG. 3, portable terminal device 500 further includes a control unit 510 and a storage unit 520.

  The storage unit 520 is a memory that stores data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. Storage unit 520 is, for example, a flash memory. The storage unit 520 stores a program 180 and other various data. Storage unit 520 may be a memory that stores data in a volatile manner.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in portable terminal device 500 in accordance with program 180 stored in storage unit 520. Control unit 510 is a CPU (Central Processing Unit). Control unit 510 is not limited to a CPU, and may be another circuit having an arithmetic function.

  Control unit 510 performs data communication with display unit 530. Control unit 510 causes display unit 530 to display the generated image.

  The portable terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the portable terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520.

  The recording medium 555 is an SD (Secure Digital) memory card. Note that the recording medium 555 is not limited to the SD memory card, and may be another medium capable of recording data in a nonvolatile manner.

The mobile terminal device 500 further includes a communication unit 560.
Communication unit 560 performs data communication with control unit 510. Communication unit 560 has a function of performing data communication with content reproduction device 600.

  The communication unit 560 has a function of performing wireless communication based on the Bluetooth (registered trademark) standard. The communication unit 560 has a function of performing wireless communication using infrared rays. Note that the wireless communication is not limited to communication based on the Bluetooth (registered trademark) standard and communication using infrared rays, and may be communication of another method. Communication unit 560 performs data communication with content reproduction device 600 wirelessly in response to a control instruction from control unit 510.

The mobile terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of performing wireless communication using the antenna 564. The communication unit 566 performs wireless communication with the nearest base station (not shown). The nearest base station communicates with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station.

  Specifically, the communication unit 566 has a function of making a call and a function of receiving a call using the telephone network 60. Communication unit 566 has a function of performing data communication with telephone network 60. When the mobile terminal device 500 uses the communication unit 566 to make a call to another device and can communicate with the other device, the mobile terminal device 500 uses the communication unit 566 to perform data communication with the other device. Is possible. As an example, the data communication performed by the communication unit 566 using the telephone network 60 is packet communication. Data communication performed by the communication unit 566 using the telephone network 60 can also exchange voice data. That is, in a call performed between the mobile terminal device 500 and the other device, voice is exchanged by packet communication.

  The portable terminal device 500 can also download a program from the network 70 via the telephone network 60 and store the program in the storage unit 520 through the processing of the control unit 510 and the communication unit 566. In this case, the downloaded program is the program 180. Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70.

  The mobile terminal device 500 further includes an audio output unit 572. The audio output unit 572 is a speaker provided outside the mobile terminal device 500. Audio output unit 572 outputs audio based on the audio data received from control unit 510.

  Control unit 510 performs data communication with each of audio output unit 570 and audio input unit 574 described above. When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510. When the user utters voice to the voice input unit 574, the voice input unit 574 converts the acquired voice into voice data and transmits the voice data to the control unit 510.

The control unit 510 performs data communication with the imaging unit 578 described above.
The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. When receiving the captured image data, control unit 510 stores the captured image data in either storage unit 520 or recording medium 555.

(Content playback device)
Next, the content reproduction device 600 will be described in detail.

  FIG. 4 is a block diagram showing an internal configuration of the content reproduction apparatus 600. FIG. 4 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

  Referring to FIG. 4, content reproduction device 600 includes a display unit 630. Display unit 630 is provided with a display surface for displaying characters, images, and the like. The display unit 630 is a device that uses an LCD panel (Liquid Crystal Display Panel). Note that the display unit 630 may be a device using a panel with a display method other than the above.

  The maximum resolution of the image displayed on the display surface of the display unit 630 (hereinafter also referred to as the maximum display resolution) is 1920 (dots) × 1080 (dots) in the horizontal direction. Note that the maximum display resolution of the display unit 630 is not limited to horizontal 1920 (dots) × vertical 1080 (dots), and may be other resolutions. The size of the display surface of the display unit 630 is larger than the size of the display surface of the display unit 530. Further, the maximum display resolution of the display unit 630 is larger than the maximum display resolution of the display unit 530.

The content reproduction device 600 further includes a control unit 610 and a storage unit 620.
The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk. Storage unit 620 is not limited to a hard disk, and may be a memory having a function of storing data in a nonvolatile manner. The storage unit 620 stores a program 180A and other various data. Storage unit 620 may be a memory that stores data in a volatile manner.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in content reproduction device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The content reproduction device 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the control unit 610 via the antenna 602. The tuner 605 has a function of receiving a broadcast signal based on digital broadcasting and a broadcast signal based on analog broadcasting. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  When receiving a display instruction for causing the display unit 630 to display an image from the control unit 610, the data processing unit 607 acquires image data from the received broadcast signal and transmits the image data to the display unit 630. Upon receiving image data, display unit 630 displays an image (moving image or still image) based on the image data. Hereinafter, an image based on a broadcast signal received by the tuner 605 and displayed on the display unit 630 is also referred to as a TV image.

  Control unit 610 performs data communication with display unit 630. The control unit 610 causes the display unit 630 to display the generated image.

  Content playback apparatus 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the content reproduction apparatus 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  Recording medium 555A is an SD memory card. Note that the recording medium 555 is not limited to the SD memory card, and may be another medium capable of recording data in a nonvolatile manner.

The content reproduction device 600 further includes a communication unit 660 and a communication unit 662.
Communication unit 660 performs data communication with control unit 610. Communication unit 660 has a function of performing data communication with portable terminal device 500. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 performs data communication with control unit 610. The communication unit 662 has a function of performing data communication with the network 70 using wired technology. The wired technology is, for example, technology based on Ethernet (registered trademark). In this case, the communication unit 662 can perform data communication with the network 70 via, for example, a LAN cable. The wired technology is not limited to a technology based on Ethernet (registered trademark), and may be another wired technology.

  The communication unit 662 has a function of performing data communication with the network 70 using wireless technology. The radio technology is a technology based on, for example, IEEE 802.11g. Note that the wireless technology is not limited to the technology based on IEEE 802.11g, and may be another wireless technology. Therefore, communication unit 662 can perform data communication with network 70 wirelessly.

  Therefore, the content reproduction apparatus 600 according to the present embodiment can also download a program from the network 70 via the communication unit 662 and store it in the storage unit 620. In this case, the downloaded program is the program 180A. Control unit 610 performs predetermined processing according to a program (program 180A) downloaded from network 70.

  Hereinafter, the remote control signal for controlling the content reproduction device 600 transmitted from the communication unit 560 of the mobile terminal device 500 is referred to as an RC signal. In this case, the communication unit 660 receives the RC signal transmitted from the mobile terminal device 500 and transmits the received RC signal to the control unit 610. Control unit 610 performs a corresponding process in accordance with the received RC signal.

  The content reproduction device 600 further includes an audio output unit 670. The audio output unit 670 is a speaker provided outside the content reproduction device 600. Audio output unit 670 outputs audio based on the audio data received from control unit 610.

(server)
FIG. 5 is a block diagram showing the internal configuration of the server 800. Referring to FIG. 5, server 800 includes a display unit 830, a control unit 810, and a storage unit 820.

  The display unit 830 has a function of displaying characters, images, and the like. Since display unit 830 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. The storage unit 820 is accessed by the control unit 810. Since storage unit 820 is similar to storage unit 620 described above, detailed description will not be repeated. The storage unit 820 stores a program 180B and other various data.

  Control unit 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in server 800 in accordance with program 180B stored in storage unit 820. Since control unit 810 is similar to control unit 610 described above, detailed description will not be repeated.

  Control unit 810 performs data communication with display unit 830. The control unit 810 causes the display unit 830 to display the generated image.

Server 800 further includes an input unit 840.
A mouse 842 and a keyboard 844 are connected to the input unit 840. The user gives an instruction to server 800 using mouse 842 or keyboard 844. An input instruction from the mouse 842 or the keyboard 844 is transmitted to the control unit 810 via the input unit 840. Control unit 810 performs predetermined processing based on an input instruction from input unit 840.

Server 800 further includes a communication unit 860 and a communication unit 862.
Communication unit 860 performs data communication with control unit 810. Communication unit 860 has a function of performing data communication with another device (not shown). Communication unit 860 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 862 performs data communication with control unit 810. Since communication unit 862 has the same configuration and function as communication unit 662 described above, detailed description will not be repeated. Accordingly, the communication unit 862 can perform data communication with the network 70 wirelessly. The communication unit 862 can perform data communication with the network 70 via, for example, a LAN cable.

(Content accumulation)
Next, a process for accumulating content stored in the storage unit 520 of the mobile terminal device 500.1 in the server 800 (hereinafter also referred to as accumulation process) will be described.

  It is assumed that the content stored in the storage unit 520 of the mobile terminal device 500.1 is, for example, image data obtained by an imaging process. Hereinafter, the mobile terminal device 500.1 and the mobile terminal device 500.2 are also referred to as a mobile terminal device A and a mobile terminal device B, respectively. The image data stored in the storage unit 520 of the mobile terminal device A is also referred to as original image data. An image reproduced by original image data is also referred to as an original image. Further, it is assumed that the storage unit 520 of the mobile terminal device A stores a plurality of original image data.

  In the accumulation process, a process performed by the mobile terminal device A is also referred to as an accumulation process A. In the following, the process performed by the server 800 in the accumulation process is also referred to as an accumulation process S.

  Here, it is assumed that the server 800 publishes a Web page for storing content stored in another device (hereinafter also referred to as a stored Web page) to an external device via the network 70. .

  Here, in mobile terminal device A, a process for accessing a URL (Uniform Resource Locator) of the stored Web page is performed, and an image of the stored Web page is displayed on display unit 530 of mobile terminal device A. . Here, it is assumed that the image of the stored Web page displayed on the display unit 530 is the following list image MG100.

  FIG. 6 is a diagram showing a list image MG100 as an example. Referring to FIG. 6, list image MG100 includes a plurality of thumbnail images. The plurality of thumbnail images are images obtained by reducing and displaying images (original images) based on a plurality of original image data stored in the storage unit 520 of the mobile terminal device A. In FIG. 6, thumbnail images MG110 and MG120 that are part of the plurality of thumbnail images arranged in the list image MG100 are displayed.

  In addition, selection frame SL10 is arranged in list image MG100. The selection frame SL10 is a frame that can be moved up or down by the interface operation M. The image surrounded by the selection frame SL10 is a selected image.

  FIG. 7 is a flowchart of the accumulation process A and the accumulation process S. Referring to FIG. 7, in accumulation process A, first, the process of step S111 is performed.

  In step S111, control unit 510 determines whether or not there is a selection confirmation operation M. The selection confirmation operation M is an interface operation M for setting any one of a plurality of thumbnail images arranged in the list image displayed on the display unit 530 and confirming the selection state. Here, it is assumed that the list image displayed on display unit 530 is list image MG100 in FIG.

  If YES in step S111, the process proceeds to step S112. On the other hand, if NO at step S111, the process at step S111 is performed again. Here, assuming that there is a selection confirmation operation M, the process proceeds to step S112.

  In step S112, an image transmission process M is performed. In the image transmission process M, the control unit 510 transmits the original image data (hereinafter also referred to as original image data) of the thumbnail image selected by the selection confirmation operation M to the server 800. And the process of step S112 is complete | finished.

In the accumulation process S, first, the process of step S181 is performed.
In step S181, control unit 810 determines whether image data has been received. If YES in step S181, the process proceeds to step S182. On the other hand, if NO at step S181, the process at step S181 is performed again. Here, assuming that the original image data has been received, the process proceeds to step S182.

  FIG. 8 is a diagram illustrating information (data) and the like exchanged between the mobile terminal device A and the server 800 by the accumulation process A and the accumulation process S. Referring to FIG. 8, “server” refers to server 800.

  Again referring to FIG. 7, in step S182, an image ID issuing process S is performed. In the image ID issuing process S, the control unit 810 issues an image ID for specifying the received image data. The issued image ID (hereinafter also referred to as “issued image ID”) is a unique ID that is not currently issued by the control unit 810.

  Here, it is assumed that the received image data is original image data of the thumbnail image MG110 of FIG. In this case, it is assumed that the issued image ID is “G0001” as an example. Then, the process proceeds to step S183.

  In step S183, an image data storage process S is performed. In the image data storage process S, the control unit 810 causes the storage unit 820 to store the received image data (original image data) in association with the issued image ID. Then, the process proceeds to step S184.

  In step S184, control unit 810 transmits the image specifying information to the device (mobile terminal device A) that has transmitted the image data to its own device (server 800). The image specifying information is information indicating an issued image ID and a URL (hereinafter also referred to as an accumulated data specifying URL) for specifying original image data stored in association with the issued image ID. Then, step S181 is performed again.

In the accumulation process A, the process proceeds to step S113 after the process of step S112.
In step S113, control unit 510 determines whether image specifying information has been received or not. If YES in step S113, the process proceeds to step S114. On the other hand, if NO at step S113, the process at step S113 is performed again. Here, assuming that the image specifying information has been received, the process proceeds to step S114.

  In step S114, control unit 510 stores the received image specifying information in storage unit 520 in association with the original image data transmitted by image transmission processing M. Here, it is assumed that the original image data transmitted by the image transmission process M is the original image data of the thumbnail image MG110 in FIG. Further, it is assumed that the received image specifying information indicates the issued image ID “G0001” and the accumulated data specifying URL for specifying the original image data of the thumbnail image MG110 stored in the storage unit 820. That is, the storage unit 520 stores the original image data, the issued image ID, and the accumulated data specifying URL in association with each other. Then, this accumulation process A ends.

  Then, in mobile terminal device A, it is assumed that the processes of steps S111, S112, S113, and S114 of storage process A are performed on each of the plurality of thumbnail images arranged in list image MG100 in FIG. Further, the server 800 performs the processes of steps S181, S182, S183, and S184 each time the process of step S112 is performed in the mobile terminal device A.

  Through these processes, the storage unit 820 of the server 800 stores a plurality of original image data in association with a plurality of different issued image IDs. That is, the storage unit 820 stores a plurality of contents.

  The storage unit 520 of the mobile terminal device A stores a plurality of original image data in association with a plurality of different pieces of image specifying information. That is, the storage unit 520 of the mobile terminal device A stores a plurality of original image data in association with a plurality of different issued image IDs. Also, the storage unit 520 of the mobile terminal device A stores a plurality of original image data in association with a plurality of different stored data specifying URLs.

(Remote control)
Next, in order to control the content reproduction device 600 by performing communication between the mobile terminal device A and the mobile terminal device B during a period in which the mobile terminal device A and the mobile terminal device B can talk. Will be described (hereinafter also referred to as remote control processing).

  Hereinafter, the process performed by the mobile terminal device A in the remote control process is also referred to as the remote control process A. In remote control processing, processing performed by the mobile terminal device B is also referred to as remote control processing B. In remote control processing, processing performed by content reproduction device 600 is also referred to as remote control processing T. In remote control processing, processing performed by the server 800 is also referred to as remote control processing S.

  Here, it is assumed that a plurality of original image data is stored in the storage unit 520 of the mobile terminal device A in association with a plurality of different issued image IDs by the above-described accumulation process A and accumulation process S, respectively. . Also, assume that the storage unit 520 of the mobile terminal device A stores a plurality of original image data in association with a plurality of different stored data specifying URLs.

  In addition, by the storage process A and the storage process S described above, a plurality of original image data stored in the storage unit 520 of the mobile terminal device A are stored in the storage unit 820 of the server 800, respectively. Are stored in association with each other.

  Further, it is assumed that the mobile terminal device A has an interface operation M for making a phone call to the mobile terminal device B. Further, it is assumed that the mobile terminal device A continues to make a call to the mobile terminal device B before the following remote control processing A is performed.

  FIG. 9 is a flowchart of the remote control process A, the remote control process B, the remote control process T, and the remote control process S. Referring to FIG. 9, in remote control process A, first, the process of step S211 is performed.

  In step S211, control unit 510 determines whether or not communication with mobile terminal device B is possible. If YES in step S211, the process proceeds to step S212. On the other hand, if NO at step S211, the process at step S211 is performed again.

  Here, a mobile terminal device A and a mobile terminal device B can communicate with each other when a user who has the mobile terminal device B performs an operation on the mobile terminal device B to receive a call from the mobile terminal device A. Suppose that In this case, YES is determined in step S211, and the process proceeds to step S212.

  When the mobile terminal device A and the mobile terminal device B can talk, the mobile terminal device A and the mobile terminal device B can also perform data communication with each other using the communication unit 566 described above. It becomes possible. The data communication performed between the mobile terminal device A and the mobile terminal device B is assumed to be packet communication as an example. In the data communication, voice data can be exchanged. That is, in a call performed between the mobile terminal device A and the mobile terminal device B, voice is exchanged by packet communication.

  In step S212, control unit 510 transmits a display device search instruction to portable terminal device B. The display device search instruction is an instruction for searching for a device having a function of displaying an image (hereinafter also referred to as a display device). In addition, since the content reproduction apparatus 600 has a function of displaying an image, the content reproduction apparatus 600 is a display apparatus. The display device search instruction is an instruction for searching for a display device that can directly communicate with the mobile terminal device B in the vicinity of the mobile terminal device B. And the process of step S212 is complete | finished.

  FIG. 10 is a diagram showing information (data) and the like exchanged between the devices by the remote control process A, the remote control process B, the remote control process T, and the remote control process S. Referring to FIG. 10, “content playback device” refers to content playback device 600. The “server” is the server 800.

  Again referring to FIG. 9, in remote control process B, first, the process of step S231 is performed.

  In step S231, control unit 510 determines whether or not a display device search instruction has been received. If YES at step S231, the process proceeds to step S232. On the other hand, if NO at step S231, the process at step S231 is performed again. Here, assuming that a display device search instruction has been received, the process proceeds to step S232.

  In step S232, in response to the display device search instruction, control unit 510 transmits a function inquiry instruction through a short-distance wireless communication in the vicinity region of portable terminal device B described later. Here, the function inquiry instruction is an instruction for inquiring of the function of the instruction receiving apparatus and the apparatus ID of the instruction receiving apparatus from the apparatus that has received the function inquiry instruction (hereinafter also referred to as instruction receiving apparatus). Here, the device ID is an ID for identifying a device.

  Here, short-range wireless communication is assumed to be wireless communication based on the Bluetooth (registered trademark) standard as an example. Therefore, the function inquiry instruction transmitted by the control unit 510 reaches only within the vicinity region of the mobile terminal device B. As an example, the vicinity region of the mobile terminal device B is assumed to be a circular region having a radius of 10 meters with the mobile terminal device B as the center. When the function inquiry instruction is transmitted, the process of step S232 ends.

In the remote control process T, first, the process of step S261 is performed.
In step S261, control unit 610 determines whether a function inquiry instruction has been received or not. If YES in step S261, the process proceeds to step S262. On the other hand, if NO at step S261, the process at step S261 is performed again. Here, it is assumed that the content reproduction device 600 is in the vicinity of the mobile terminal device B. In this case, the content reproduction device 600 can receive a function inquiry instruction. Therefore, control unit 610 receives the function inquiry instruction, and proceeds to step S262.

  In step S262, in response to the received function inquiry instruction, control unit 610 transmits function information to the device (mobile terminal device B) that has transmitted the function inquiry instruction to its own device (content reproduction device 600).

  Here, it is assumed that the function information to be transmitted is information indicating the device ID of the content reproduction device 600 and the fact that there is an image display function. The image display function is a function for displaying an image. Here, the device ID of the content reproduction device 600 is assumed to be “T01” as an example. Then, the process of step S262 ends.

In the remote control process B, the process proceeds to step S233 after the process of step S232.
In step S233, it is determined whether there is a display device. Specifically, control unit 510 receives the function information within a predetermined time after transmitting the function inquiry instruction, and determines whether the received function information indicates that there is an image display function. To do. Here, the predetermined time is assumed to be 30 seconds as an example. If YES at step S233, the process proceeds to step S235. On the other hand, if NO at step S233, the process proceeds to step S234N described later.

  Here, it is assumed that control unit 510 receives function information within a predetermined time after transmitting a function inquiry instruction, and the received function information indicates that there is an image display function. In this case, YES is determined in step S233, and the process proceeds to step S235.

  In step S235, control unit 510 transmits a display device search notification to the device (mobile terminal device A) that has transmitted the display device search instruction to its own device (mobile terminal device B). The display device search notification is a notification that a display device having a function of displaying an image has been searched. That is, the display device search notification is a notification indicating that there is a communicable display device in the vicinity of the mobile terminal device B. In the display device search notification that is transmitted, the device ID (“T01”) indicated by the received function information is indicated. And the process of step S235 is complete | finished.

In the remote control process A, the process proceeds to step S212N after the process of step S212.
In step S212N, control unit 510 determines whether a non-existence notification (to be described later) has been received or not. If YES in step S212N, control unit 510 displays an error message on display unit 530 for a predetermined time (for example, 5 seconds), and this remote control process A ends. On the other hand, if NO at step S212N, the process proceeds to step S213. Here, assuming that a non-existence notification has not been received, the process proceeds to step S213.

  In step S213, control unit 510 determines whether or not a display device search notification has been received. If YES in step S213, the process proceeds to step S214. On the other hand, if NO at step S213, the process at step S212N is performed again. Here, assuming that the display device search notification is received, the process proceeds to step S214.

  In step S214, a list image display process MA is performed. In the list image display process MA, the control unit 510 generates thumbnail images generated from each of all the original image data associated with the issued image ID among the plurality of original image data stored in the storage unit 520. A list image in which is placed is generated. Then, control unit 510 causes display unit 530 to display the generated list image. By way of example, the list image displayed on display unit 530 is assumed to be list image MG100 in FIG. Then, the process proceeds to step S215.

  In step S215, control unit 510 determines whether or not there is a selection confirmation operation MA. The selection confirmation operation MA is an interface operation M for setting any one of a plurality of thumbnail images arranged in the list image displayed on the display unit 530 to a selected state and confirming the selected state. Here, it is assumed that the list image displayed on display unit 530 is list image MG100 in FIG. If YES in step S215, the process proceeds to step S216. On the other hand, if NO at step S215, the process proceeds to step S219 described later. Here, assuming that there is a selection confirmation operation MA, the process proceeds to step S216.

  In step S216, control unit 510 transmits a remote control instruction to portable terminal device B. The remote control instruction is an instruction for displaying the original image of the thumbnail image selected by the selection confirmation operation MA on the display device in the vicinity of the mobile terminal device B. That is, the remote control instruction is an instruction for remotely controlling the display device.

  The transmitted remote control instruction indicates the device ID (“T01”) indicated by the received display device search notification. The transmitted remote control instruction indicates the issued image ID and the accumulated data specifying URL associated with the original image data corresponding to the thumbnail image selected by the selection confirming operation MA in the storage unit 520.

  Here, it is assumed that the thumbnail image selected by the selection confirmation operation MA is the thumbnail image MG110 in FIG. In this case, the issued image ID associated with the original image data of the thumbnail image MG110 in FIG. 6 is “G0001”. And the process of step S216 is complete | finished.

In the remote control process B, the process proceeds to step S236 after the process of step S235.
In step S236, control unit 510 determines whether a remote control instruction has been received or not. If YES at step S236, the process proceeds to step S237. On the other hand, if NO at step S236, the process at step S236 is performed again. Here, assuming that a remote control instruction is received, the process proceeds to step S237.

  In step S237, control unit 510 performs processing based on the received remote control instruction. Specifically, control unit 510 transmits the control instruction to a display device in the vicinity of portable terminal device B that is specified by the device ID indicated by the received remote control instruction. The transmitted control instruction is an instruction for causing the display device to display an image based on the issued image ID indicated by the received remote control instruction and the original image data specified by the stored data specifying URL. The transmitted control instruction includes the issued image ID (“G0001”) and the stored data specifying URL indicated by the received remote control instruction.

  Here, it is assumed that the device ID indicated by the received remote control instruction is “T01”. In this case, it is assumed that the display device specified by the device ID “T01” is the content reproduction device 600. In this case, the control instruction is transmitted to the content reproduction device 600 in the vicinity of the mobile terminal device B. Then, the process of step S237 ends.

In the remote control process T, the process proceeds to step S263 after the process of step S262.
In step S263, control unit 610 determines whether a control instruction has been received. If YES in step S263, the process proceeds to step S264. On the other hand, if NO at step S263, the process at step S263 is performed again. Here, assuming that a control instruction has been received, the process proceeds to step S264.

  In step S264, control unit 610 performs processing based on the received control instruction. Specifically, control unit 610 transmits a data request instruction to server 800 storing original image data specified by the accumulated data specifying URL indicated by the received control instruction. The data request instruction is an instruction for requesting original image data associated with the issued image ID indicated by the received control instruction. The transmitted data request instruction indicates the issued image ID (“G0001”) indicated by the received control instruction. Then, the process of step S264 ends.

In the remote control process S, first, the process of step S281 is performed.
In step S281, control unit 810 determines whether a data request instruction has been received. If YES in step S281, the process proceeds to step S282. On the other hand, if NO at step S281, the process at step S281 is performed again. Here, assuming that a data request instruction has been received, the process proceeds to step S282.

  In step S282, a data transmission process S is performed. In the data transmission process S, the control unit 810 reads the original image data specified by the issued image ID indicated by the received data request instruction from the storage unit 820, and transmits the read original image data to the content reproduction device 600. . Then, the process of step S281 is performed again.

In the remote control process T, the process proceeds to step S265 after the process of step S264.
In step S265, control unit 610 determines whether or not original image data has been received. If YES in step S265, the process proceeds to step S266. On the other hand, if NO at step S265, the process at step S265 is performed again. Here, assuming that the original image data has been received, the process proceeds to step S266.

  In step S266, an image display process T is performed. In the image display process T, the control unit 610 causes the display unit 630 to display an image (original image) based on the received original image data.

  Then, control unit 610 transmits a display completion notification to the device (portable terminal device B) that has transmitted the control instruction to its own device (content reproduction device 600). The display completion notification is a notification that the designated image has been displayed on the display unit 630. The transmitted display completion notification indicates the issued image ID indicated by the received control instruction. Then, the process of step S263 is performed again.

In the remote control process B, the process proceeds to step S238 after the process of step S237.
In step S238, control unit 510 determines whether or not a display completion notification has been received. If YES in step S238, the process proceeds to step S239. On the other hand, if NO at step S238, the process at step S238 is performed again. Here, assuming that a display completion notification has been received, the process proceeds to step S239.

  In step S239, control unit 510 transmits (transfers) the received display completion notification to the device (mobile terminal device A) that has transmitted the remote control instruction to its own device (mobile terminal device B). The transmitted display completion notification indicates the issued image ID (for example, “G0001”).

In the remote control process A, the process proceeds to step S217 after the process of step S216.
In step S217, control unit 510 determines whether or not a display completion notification has been received. If YES in step S217, the process proceeds to step S218. On the other hand, if NO at step S217, the process at step S217 is performed again. Here, assuming that a display completion notification indicating the issued image ID has been received, the process proceeds to step S218.

  In step S218, control unit 510 displays a message indicating that the original image of the thumbnail image selected by selection confirmation operation MA is being displayed in the list image displayed on display unit 530. The message is displayed in the vicinity of the selected thumbnail image. The message is, for example, a message “Displaying on a display device near the called device”.

  Here, it is assumed that the list image displayed on display unit 530 immediately before the processing in step S218 is list image MG100 in FIG. In this case, the list image MG100 displayed on the display unit 530 becomes the following list image MG100A by the process of step S218. And the process of step S218 is complete | finished.

  FIG. 11 is a diagram showing a list image MG100A as an example. Referring to FIG. 11, list image MG100A is different from list image MG100 in FIG. 6 in that a message is displayed below thumbnail image MG110 surrounded by selection frame SL10. Other than that, it is the same as the list image MG100, and therefore, detailed description will not be repeated.

  Displaying list image MG100A on display unit 530 allows the user operating portable terminal device A to view content reproduction device 600 in the vicinity of the mobile terminal device B that is the call destination as the original image of thumbnail image MG110. Can be easily known.

  Referring to FIG. 9 again, in the remote control process A, after the process of step S218, the process proceeds to step S219.

  In step S219, control unit 510 determines whether or not there is an end operation M. The end operation M is an interface operation M for ending the remote control process A. The end operation M is, for example, an interface operation M for ending a call with the mobile terminal device B. If YES in step S219, control unit 510 deletes the list image displayed on display unit 530, and this remote control process A ends. On the other hand, if NO at step S219, the process at step S215 is performed again. Here, assuming that there is no end operation M, the process of step S215 is performed again.

  Here, it is assumed that there is a selection confirmation operation MA for selecting the thumbnail image MG120 while the list image MG100A of FIG. 11 is displayed on the display unit 530 of the mobile terminal device A. In this case, YES is determined in the step S215, and in the remote control process A, the process of the above-described step S216 is performed.

  Then, steps S236, S237, S263, S264, S281, S282, S265, S266, S238, S239, S217, and S218 in FIG. 9 are performed in the same manner as described above.

  By these processes, the original image of the thumbnail image MG120 is displayed on the display unit 630 of the content reproduction device 600 as a display device in the vicinity of the mobile terminal device B. In the list image displayed on the display unit 530 of the mobile terminal device A, a message similar to that in FIG. 11 is displayed below the thumbnail image MG120.

  Next, a process when it is determined NO in step S233 of the remote control process B and the process proceeds to step S234N will be described. If NO is determined in step S233, the display device capable of directly wirelessly communicating with the mobile terminal device B does not exist in the vicinity of the mobile terminal device B.

  In step S234N, control unit 510 transmits a non-existence notification to the device (mobile terminal device A) that has transmitted the display device search instruction to its own device (mobile terminal device B). The non-existence notification is a notification that there is no display device that can directly wirelessly communicate with its own device (mobile terminal device B). Then, the process of step S231 is performed again.

  In this case, in remote control processing A, YES is determined in step S212N, and control unit 510 displays an error message on display unit 530 for a predetermined time (for example, 5 seconds), and this remote control processing A ends. . The error message is, for example, a message “There is no display device that can communicate with the device in the vicinity of the device with which the call is made”.

  As described above, in the present embodiment, the mobile terminal device A is connected to the content playback device 600 in the vicinity of the mobile terminal device B during a period in which the mobile terminal device A and the mobile terminal device B can talk. The specified image can be displayed. That is, the portable terminal device A can control the content reproduction device 600 by remotely controlling the portable terminal device B during a period in which the portable terminal device A and the portable terminal device B can talk. That is, the mobile terminal device A has an effect of being able to control the content reproduction device 600 in the vicinity of the communicable mobile terminal device B.

  Here, the users who use the mobile terminal device A and the mobile terminal device B are user A and user B, respectively. It is assumed that the user B is a user who is not good at operating the mobile phone and the content reproduction apparatus.

  In this case, according to the present embodiment, when the user A and the user B are talking using the mobile terminal device A and the mobile terminal device B, respectively, the user A operates the mobile terminal device A, An image designated by the user A can be displayed on the content reproduction device 600 in the vicinity of the mobile terminal device B.

  Therefore, the user B can easily view the image designated by the user A on the content reproduction device 600 without performing any special operation during the call. That is, there is an effect that convenience can be improved.

  7 is performed, the original image data stored in the storage unit 520 in association with the issued image ID and the accumulated data specifying URL is performed by the remote control process A in FIG. Before being deleted, it may be deleted by the interface operation M for deleting the original image data. Thereby, the storage area of the storage unit 520 can be secured.

  In this case, in step S214 of the remote control process A, the following list image display process MB is performed instead of the list image display process MA.

  In list image display processing MB, control unit 510 transmits to server 800 a request instruction for requesting original image data corresponding to all of the issued image IDs stored in storage unit 520.

  When transmitting the request instruction, the server 800 transmits the requested original image data to the mobile terminal device A.

  The mobile terminal device A generates a list image in which thumbnail images are arranged using the received original image data, and displays the generated list image on the display unit 530.

<Second Embodiment>
In the first embodiment, the processing using the server 800 has been described. In the present embodiment, processing that does not use the server 800 will be described.

  FIG. 12 is a diagram showing a configuration of a network system 1000A in the present embodiment. Referring to FIG. 12, network system 1000A is different from network system 1000 in FIG. 1 in that server 800 is not included. Other than that, it is the same as network system 1000, so detailed description will not be repeated.

  In addition, since the configurations and functions of the mobile terminal devices 500.1 and 500.2 and the content reproduction device 600 included in the network system 1000A are the same as the configurations and functions described in the first embodiment, a detailed description will be given. Do not repeat.

  Hereinafter, the mobile terminal device 500.1 and the mobile terminal device 500.2 are also referred to as a mobile terminal device A and a mobile terminal device B, respectively.

(Remote control)
Next, in order to control the content reproduction device 600 by performing communication between the mobile terminal device A and the mobile terminal device B during a period in which the mobile terminal device A and the mobile terminal device B can talk. Will be described (hereinafter also referred to as remote control process R).

  Hereinafter, in the remote control process R, the process performed by the mobile terminal device A is also referred to as a remote control process RA. In the remote control process R, the process performed by the mobile terminal device B is also referred to as a remote control process RB. In remote control processing R, processing performed by content reproduction device 600 is also referred to as remote control processing RT.

  Here, it is assumed that a plurality of original image data is stored in the storage unit 520 of the mobile terminal device A.

  Further, it is assumed that the mobile terminal device A has an interface operation M for making a phone call to the mobile terminal device B. Further, it is assumed that the mobile terminal device A continues to make calls to the mobile terminal device B before the following remote control process RA is performed.

  FIG. 13 is a flowchart of the remote control process RA, the remote control process RB, and the remote control process RT. Referring to FIG. 13, the process with the same step number as the step number in FIG. 9 is the same as the process described in the first embodiment, and therefore detailed description will not be repeated.

  FIG. 14 is a diagram showing information (data) and the like exchanged between the devices by the remote control process RA, the remote control process RB, and the remote control process RT. Referring to FIG. 14, “content playback device” refers to content playback device 600.

  Referring to FIG. 13 again, the processes in steps S211, S212, S231, S232, S261, S262, S233, S234N, S235, S212N, and S213 in FIG. 13 are performed in steps S211, S212, S231, and S232 in FIG. Since it is the same as the processing of S261, S262, S233, S234N, S235, S212N, and S213, detailed description will not be repeated.

  It is assumed that the mobile terminal device A has received the display device search notification indicating the device ID “T01” through these processes. The device ID “T01” is a device ID that identifies the content reproduction device 600. By receiving the display device search notification, YES is determined in step S213 in FIG. 13 and the process proceeds to step S214R.

  In step S214R, a list image display process RMA is performed. In list image display processing RMA, control unit 510 generates a list image in which thumbnail images generated from each of a plurality of original image data stored in storage unit 520 are arranged. Then, control unit 510 causes display unit 530 to display the generated list image. By way of example, the list image displayed on display unit 530 is assumed to be list image MG100 in FIG.

  In step S215, the same processing as that described in the first embodiment is performed, and therefore detailed description will not be repeated. Here, assuming that there is a selection confirmation operation MA, the process proceeds to step S216R.

  In step S216R, control unit 510 transmits remote control instruction R and original image data corresponding to the thumbnail image selected by selection confirmation operation MA to portable terminal device B. The remote control instruction R is an instruction for displaying the original image of the thumbnail image selected by the selection confirmation operation MA on the display device in the vicinity of the mobile terminal device B. That is, the remote control instruction R is an instruction for remotely controlling the display device.

  The transmitted remote control instruction R indicates a device ID (“T01”) indicated by the received display device search notification. Then, the process of step S216R ends.

In the remote control process RB, the process proceeds to step S236R after the process of step S235.
In step S236R, control unit 510 determines whether remote control instruction R and original image data have been received or not. If YES in step S236R, the process proceeds to step S237R. On the other hand, if NO at step S236R, the process at step S236R is performed again. Here, assuming that the remote control instruction R and the original image data are received, the process proceeds to step S237R.

  In step S237R, control unit 510 performs processing based on received remote control instruction R. Specifically, control unit 510 transmits control instruction R and received original image data to a display device in the vicinity of mobile terminal apparatus B specified by the apparatus ID indicated by received remote control instruction R. The transmitted control instruction R is an instruction for causing the display device to display an image based on the original image data.

  Here, it is assumed that the device ID indicated by the received remote control instruction R is “T01”. In this case, it is assumed that the display device specified by the device ID “T01” is the content reproduction device 600. In this case, the control instruction R is transmitted to the content reproduction device 600 in the vicinity of the mobile terminal device B. Then, the process of step S237R ends.

In the remote control process T, the process proceeds to step S263R after the process of step S262.
In step S263R, control unit 610 determines whether control instruction R and original image data have been received or not. If YES in step S263R, the process proceeds to step S266R. On the other hand, if NO at step S263R, the process at step S263R is performed again. Here, assuming that the control instruction R and the original image data are received, the process proceeds to step S266R.

  In step S266R, image display processing RT is performed. In the image display process RT, the control unit 610 causes the display unit 630 to display an image (original image) based on the received original image data.

  Then, control unit 610 transmits display completion notification R to the device (mobile terminal device B) that has transmitted control instruction R to its own device (content reproduction device 600). The display completion notification R is a notification that the designated image has been displayed on the display unit 630. Then, the process of step S263R is performed again.

In the remote control process RB, the process proceeds to step S238R after the process in step S237R.
In step S238R, control unit 510 determines whether display completion notification R has been received or not. If YES in step S238R, the process proceeds to step S239R. On the other hand, if NO at step S238R, the process at step S238R is performed again. Here, assuming that the display completion notification R has been received, the process proceeds to step S239R.

  In step S239R, control unit 510 transmits (transfers) received display completion notification R to the device (mobile terminal device A) that has transmitted remote control instruction R to its own device (mobile terminal device B).

In the remote control process A, the process proceeds to step S217R after the process of step S216R.
In step S217R, control unit 510 determines whether display completion notification R has been received or not. If YES in step S217R, the process proceeds to step S218. On the other hand, if NO at step S217R, the process at step S217R is performed again. Here, assuming that the display completion notification R has been received, the process proceeds to step S218.

  In step S218, the same processing as that described in the first embodiment is performed, and thus detailed description will not be repeated. By this processing, the list image displayed on display unit 530 is, for example, list image MG100A in FIG.

  In step S219, the same processing as that described in the first embodiment is performed, and therefore detailed description will not be repeated.

  As described above, in the present embodiment, the mobile terminal device A is connected to the mobile terminal device B during a period in which the mobile terminal device A and the mobile terminal device B can talk without using the server 800. The designated image can be displayed on the content reproduction apparatus 600 in the vicinity. That is, the portable terminal device A can control the content reproduction device 600 by remotely controlling the portable terminal device B during a period in which the portable terminal device A and the portable terminal device B can talk. That is, the mobile terminal device A has an effect of being able to control the content reproduction device 600 in the vicinity of the communicable mobile terminal device B.

  Here, the users who use the mobile terminal device A and the mobile terminal device B are user A and user B, respectively. It is assumed that the user B is a user who is not good at operating the mobile phone and the content reproduction apparatus.

  In this case, according to the present embodiment, when the user A and the user B are talking using the mobile terminal device A and the mobile terminal device B, respectively, the user A operates the mobile terminal device A, An image designated by the user A can be displayed on the content reproduction device 600 in the vicinity of the mobile terminal device B.

  Therefore, the user B can easily view the image designated by the user A on the content reproduction device 600 without performing any special operation during the call. That is, there is an effect that convenience can be improved.

(Function block diagram)
FIG. 15 is a functional block diagram of the control unit 510 of the mobile terminal device A and the control unit 510 of the mobile terminal device B in the first embodiment and the second embodiment.

  Referring to FIG. 15, control unit 510 of portable terminal device A includes a first transmission unit 511A and a second reception unit 512A. The control unit 510 of the mobile terminal device B includes a first reception unit 511B, a search unit 512B, a second transmission unit 513B, and a control unit 514B.

  The first transmission unit 511A transmits to the mobile terminal device B a search instruction for searching for a device capable of wireless communication with the mobile terminal device B in the vicinity of the mobile terminal device B.

  The first receiving unit 511B receives a search instruction. Based on the received search instruction, search unit 512B performs processing for searching content reproduction device 600 that is a device capable of wireless communication with mobile terminal device B in the vicinity of mobile terminal device B. When the search unit 512B searches for the content reproduction device 600, the second transmission unit 513B transmits a search notification indicating that the content reproduction device 600 has been searched to the mobile terminal device A.

  The second receiving unit 512A receives the search notification. When the second reception unit 512A receives the search notification, the first transmission unit 511A transmits a control instruction for controlling the content reproduction device 600 to the mobile terminal device B.

  When the first receiving unit 511B receives the control instruction, the control unit 514B controls the content reproduction device 600 based on the received control instruction.

  Note that all or part of the first transmission unit 511A and the second reception unit 512A included in the control unit 510 of the mobile terminal device A may be configured by hardware. All or part of the first transmission unit 511A and the second reception unit 512A may be a module of a program executed by the control unit 510 of the mobile terminal device A.

  In addition, all or part of the first reception unit 511B, the search unit 512B, the second transmission unit 513B, and the control unit 514B included in the control unit 510 of the mobile terminal device B may be configured by hardware. Further, all or part of the first reception unit 511B, the search unit 512B, the second transmission unit 513B, and the control unit 514B may be a module of a program executed by the control unit 510 of the mobile terminal device B.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the portable terminal device from the front. It is the block diagram which showed the internal structure of the portable terminal device. It is the block diagram which showed the internal structure of the content reproduction apparatus. It is the block diagram which showed the internal structure of the server. It is a figure which shows the list image as an example. 5 is a flowchart of an accumulation process A and an accumulation process S. It is a figure which shows the information (data) etc. which are exchanged between the portable terminal device A and a server by the accumulation process A and the accumulation process S. 7 is a flowchart of a remote control process A, a remote control process B, a remote control process T, and a remote control process S. It is a figure which shows the information (data) etc. which are exchanged between each apparatus by the remote control process A, the remote control process B, the remote control process T, and the remote control process S. It is a figure which shows the list image as an example. It is a figure which shows the structure of the network system in this Embodiment. It is a flowchart of remote control process RA, remote control process RB, and remote control process RT. It is a figure which shows the information (data) etc. which are exchanged between each apparatus by remote control process RA, remote control process RB, and remote control process RT. It is a functional block diagram of two different control parts in a 1st embodiment and a 2nd embodiment.

Explanation of symbols

  70 network, 180, 180A program, 500, 500.1, 500.2 portable terminal device, 510, 610, 810 control unit, 520, 620, 820 storage unit, 530, 630, 830 display unit, 540 input unit, 555 , 555A recording medium, 600 content playback device, 800 server, 1000, 1000A network system.

Claims (7)

A network system including a first mobile terminal device and a second mobile terminal device capable of communicating with each other,
The first portable terminal device
The first portable terminal device can communicate with or communicate with the second portable terminal device for a search instruction for searching for a device capable of wireless communication with the second portable terminal device in the vicinity of the second portable terminal device. In response to the first transmission means for transmitting to the second portable terminal device,
The second portable terminal device
First receiving means for receiving the search instruction;
Search means for performing processing for searching for a communicable device in the vicinity of the second mobile terminal device based on the received search instruction, a communicable device that is a device capable of wireless communication with the second mobile terminal device;
A second transmission unit configured to transmit a search notification indicating that the communicable device has been searched to the first mobile terminal device when the communicable device is searched by the search unit;
The first portable terminal device further includes:
A second receiving means for receiving the search notification;
The first transmission unit transmits a control instruction for controlling the communicable device to the second portable terminal device when the second reception unit receives the search notification,
The second portable terminal device further includes:
A control means for controlling the communicable device based on the received control instruction when the first receiving means receives the control instruction;
The network system further includes a server for storing image data,
The control instruction indicates access information for acquiring the image data from the server,
The network system, wherein the control means of the second portable terminal device performs control for causing the communicable device to use the access information and acquiring the image data from the server based on the control instruction. The communicable device is a device capable of displaying an image,
The control instruction is an instruction for displaying a designated image on the communicable device,
The network system according to claim 1, wherein the control unit of the second portable terminal device performs control for displaying the designated image on the communicable device based on the control instruction.   The network system according to claim 1 or 2, wherein at least one of voice, the control instruction, and an image is exchanged by packet communication between the first portable terminal device and the second portable terminal device.   The processing performed by at least one of the first receiving means, the searching means, the second transmitting means, the second receiving means, and the control means is performed by the first portable terminal device and the second portable terminal device. The network system according to claim 1, which is performed when possible. A mobile terminal device capable of communicating with another mobile terminal device, wherein the other mobile terminal device searches for a device capable of wireless communication with the other mobile terminal device in the vicinity of the other mobile terminal device. By receiving the search instruction, a process for searching for a communicable device that is a device capable of wireless communication with the other mobile terminal device is performed in the vicinity of the other mobile terminal device. When the search is performed, the communication is enabled by transmitting a search notification indicating that the communicable device has been searched to the mobile terminal device and receiving a control instruction for controlling the communicable device. To control the device,
The mobile terminal device can communicate with or communicate with the other mobile terminal device for a search instruction for searching for a device capable of wireless communication with the other mobile terminal device in the vicinity of the other mobile terminal device. According to the transmission means for transmitting to the other mobile terminal device;
Receiving means for receiving the search notification transmitted from the other portable terminal device,
When the receiving unit receives the search notification, the transmitting unit transmits a control instruction for controlling the communicable device to the other portable terminal device,
The control instruction indicates access information for acquiring image data from a server,
The other portable terminal device performs control for causing the communicable device to use the access information and acquiring the image data from the server based on the control instruction. A mobile terminal device capable of communicating with another mobile terminal device, wherein the other mobile terminal device issues a search instruction for searching for a device capable of wireless communication with the mobile terminal device in the vicinity of the mobile terminal device. In response to the fact that the other mobile terminal device can communicate with or communicate with the mobile terminal device, the other mobile terminal device transmits to the mobile terminal device, and the other mobile terminal device receives the search notification. In this case, a control instruction for controlling the communicable device is transmitted to the mobile terminal device,
Receiving means for receiving the search instruction;
Search means for performing processing for searching for a communicable device in the vicinity of the second mobile terminal device based on the received search instruction, a communicable device that is a device capable of wireless communication with the second mobile terminal device;
When the searchable device is searched for by the search means, a transmission means for transmitting a search notification indicating that the communicable device has been searched to the first mobile terminal device;
Control means for controlling the communicable device based on the received control instruction when the first receiving means receives the control instruction;
The control instruction indicates access information for acquiring image data from a server,
The control means is a portable terminal device that performs control for causing the communicable device to use the access information and acquiring the image data from the server based on the control instruction. A device control method performed in a network system including a first mobile terminal device and a second mobile terminal device capable of communicating with each other,
The first portable terminal device sends a search instruction for causing the first portable terminal device to search for a device capable of wireless communication with the second portable terminal device in the vicinity of the second portable terminal device. Transmitting to the second portable terminal device in response to being able to talk or communicate with the terminal device;
The second portable terminal device receiving the search instruction;
Processing for searching for a communicable device, which is a device capable of wireless communication with the second mobile terminal device, in the vicinity of the second mobile terminal device based on the received search instruction. The steps of
The second mobile terminal device, when the communicable device is searched, transmitting a search notification indicating that the communicable device has been searched to the first mobile terminal device;
The first mobile terminal device receiving the search notification;
The first portable terminal device transmitting a control instruction for controlling the communicable device to the second portable terminal device in response to receiving the search notification;
When the second portable terminal device receives the control instruction, the second portable terminal device includes a step of controlling the communicable device based on the received control instruction.
The network system further includes a server for storing image data,
The control instruction indicates access information for acquiring the image data from the server,
In the step of controlling the communicable device by the second portable terminal device, control for causing the communicable device to use the access information and acquiring the image data from the server based on the control instruction. Device control method to be performed.

Images