JP2010004402A - Data output device, data output system, and control method of data output device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display data provided by a data providing device, while reproducing the data provided by the data providing device without copying the data. <P>SOLUTION: A device 200 to be operated includes: a streaming execution section 7 for stream-reproducing data stream-distributed from the remote controllers 300; and a slide show execution section 6 for displaying image data received from the remote controllers 300. The slide show execution section 6 simultaneously performs stream-reproduction and image data display, thereby displaying the image data provided from the remote controllers 300, while reproducing the data provided from the remote controllers 300 without copying any data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a data output device, a data output system, and a data output method for receiving and outputting data transmitted by a data providing device.

  Conventionally, a technique has been used in which a plurality of electronic devices are connected to a network, and data stored in each electronic device is shared between electronic devices connected to the network. For example, Patent Document 1 below discloses a technique for simultaneously reproducing still image data held by each mobile terminal simultaneously in the same order on each mobile terminal in a network composed of a plurality of mobile terminals. .

  Specifically, in the simultaneous reproduction system described in Patent Document 1, a plurality of mobile terminals connected to a network are designated based on a controller terminal that instructs other mobile terminals and an instruction from the controller terminal. The role is shared with the player terminal that plays.

  In the above simultaneous playback system, when performing simultaneous playback of still image data, the controller terminal requests a list of still image data that meets a predetermined condition from a player terminal connected to the same network.

  Subsequently, the controller terminal adds the still image data stored in the device itself to the list and generates a reproduction data order list that defines the reproduction order of the still image data included in the list. Then, the controller terminal sends a reproduction instruction to each player terminal in accordance with the reproduction data order list, and the controller terminal and the player terminal simultaneously reproduce the same still image file.

  Here, in the configuration of Patent Document 1, if the still image file can be reproduced and the music can be reproduced, the user can view the still image file with BGM. However, Patent Document 1 only describes that a still image file, an audio file, and the like are reproduced in the same reproduction order on each player terminal, and a configuration for browsing a still image file with BGM is described. Is not disclosed or suggested.

As a technique for browsing an image with BGM, for example, the following Patent Document 2 can be cited. In Patent Document 2 below, slide show playback of images is performed, and music data recorded in advance is output in accordance with the display time of each image to be played back as a slide show. According to this structure, an image can be browsed with BGM.
JP 2007-13704 A (published January 18, 2007) JP 2007-110659 A (published April 26, 2007)

  Here, when data is transmitted from a data providing device that provides data to a data output device that outputs data and output, it is possible to simultaneously reproduce audio data, moving image data, etc. and display image data. If possible, the user of the data output device can enjoy the reproduction and display of data at the same time.

  However, when the data is transmitted from the data providing device that provides the data to the data output device that outputs the data and output based on the techniques of Patent Documents 1 and 2, BGM playback and image display are performed simultaneously. Attempting to do so causes the following problems.

  That is, the configuration of Patent Document 1 has a problem in that files to be simultaneously played on a plurality of player terminals need to be copied to each player terminal. This is particularly a problem when playing music files and the like.

  That is, when a music file is played with the configuration of Patent Document 1, the music file is copied to each player terminal. This may be regarded as an act of copying a work beyond the scope of private use, ie a copyright infringement act.

  Some music files cannot be copied for copyright protection. With the technique of the above-mentioned Patent Document 1, such music files cannot be played simultaneously on a plurality of player terminals.

  Even if the data has no copyright problem, there is a problem in that the copy is generated indiscriminately. For example, it is a problem that data such as a photograph showing yourself or a friend's acquaintance is copied and passed to an unspecified number of hands. This is a problem common not only to Patent Document 1 but also to a conventional data sharing system. In other words, in a conventional data sharing system, data owned by a certain terminal is copied to a plurality of terminals, and a secondary copy is made from that terminal to another terminal. However, there is a problem that data is transferred to an unspecified number of unintended hands.

  On the other hand, in the configuration of Patent Document 2, although it is possible to enjoy a slide show with BGM, it is necessary to previously record images to be played back as a slide show and music used for the BGM. Therefore, in the technique of Patent Document 2, when performing slide show playback with BGM by bringing images and music recorded in each of a plurality of terminals, the images and music of each terminal are recorded in a personal computer or the like in advance. There is a need. This is very time consuming and copies data such as music from the terminal to a personal computer or the like, so that the problem of copyright protection remains.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to reproduce the data provided from the data providing apparatus storing the data without reproducing the data. The object is to realize a data output device or the like that displays other data provided from the providing device.

  In order to solve the above problems, a data output device of the present invention is a data output device that receives and outputs data transmitted by a data providing device, and performs streaming reproduction of data that is streamed from the data providing device. Streaming reproduction means, data display means for receiving and displaying data different from data reproduced by the streaming reproduction means from the data providing apparatus, streaming reproduction means and data display means, and controlling the streaming An output control means for performing reproduction and data display at the same time is provided.

  According to another aspect of the present invention, there is provided a data output device control method for receiving and outputting data transmitted by a data providing device, wherein the data providing device performs streaming from the data providing device. A streaming playback step for streaming playback of distributed data, a data display step for receiving and displaying data different from the data to be streamed from the data providing device, the streaming playback step, and a data display step. And an output control step to be performed at the same time.

  According to the configuration described above, the data distributed by the data providing apparatus is streamed and reproduced by the data output apparatus, and data different from the above transmitted by the data providing apparatus is displayed on the data output apparatus.

  That is, the data output device has a characteristic configuration that has not been conventionally obtained, in which data to be reproduced simultaneously is acquired by different methods. As a result, data streaming reproduction and data display output can be performed simultaneously, and data output corresponding to the data acquisition method can be performed.

  That is, according to the above configuration, since the data output device performs streaming reproduction, a copy of the data stored in the data providing device does not remain in the data output device. Therefore, according to the above configuration, since the data stored in the data providing apparatus is not duplicated indiscriminately, copyright infringement can be prevented. Furthermore, since even streaming data can be streamed, the data protected by the above configuration can be enjoyed by all persons around the data output device.

  Further, according to the above configuration, data (data that is not streamed) that the data providing apparatus transmits to the data output apparatus for display is copied to the data output apparatus. Therefore, when there are multiple data to be displayed, display the list of display data, skip the data to be displayed, display the next data, redisplay the already displayed data, display continuously It is also possible to change the display switching speed of the data to be performed.

  Furthermore, according to the above configuration, data to be transmitted and displayed by the data providing apparatus to the data output apparatus (data that is not streamed) is copied to the data output apparatus. Only the device. For this reason, the data copy chain does not pass the data to an unspecified number of hands that the data owner does not intend. In order to completely prevent the data copy chain, the data output device may delete the output data.

  Further, according to the above configuration, the data (streaming data and display data) stored in the data providing apparatus is transmitted to the data output apparatus and output. In other words, the data stored in the data providing device is output by borrowing a place called a data output device. For this reason, it is easy to cope with a case where there are a plurality of data providing apparatuses or a case where the number or capacity of data transmitted from the data providing apparatus is large.

  That is, regardless of the number of data providing apparatuses, the data transmission destination is only the data output apparatus. Therefore, as long as a capacity necessary for data output is ensured in the data output device, all the persons around the data output device can view the data stored in the data providing device.

  On the other hand, in the technique of Patent Document 1, data to be reproduced simultaneously is copied to each of a plurality of terminals, and the data is output from each terminal. That is, in the technique of Patent Document 1, since the terminal storing the data also outputs the data, as the number of terminals increases, the amount of data transmitted and received between the terminals and the number of generated copies jump. Increase.

  This has the problem of infringement of copyright due to data copying, and when performing simultaneous reproduction of a large number of data or simultaneous reproduction of large-capacity data, there is a problem that the data capacity to be transmitted / received becomes enormous, There is a problem that a large amount of data is stored in each terminal.

  For example, when data with a relatively large capacity, such as a moving image, is played back simultaneously, a terminal that cannot secure the capacity cannot participate in the simultaneous playback. Further, even when relatively small-capacity data such as still images are played back simultaneously, when the number of data is large, the process of disposing or managing those data copied to the terminal is difficult for the user. It is a burden.

  In addition, the data output device receives and outputs data from the data providing device, and thus is particularly suitable for bringing together a plurality of data providing devices and enjoying watching data together. The data (streaming data and display data) may be transmitted by the data providing apparatus independently, or may be transmitted in response to a request from the data output apparatus. . When there are a plurality of data providing apparatuses, the data providing apparatus that performs streaming distribution and the data providing apparatus that transmits data displayed by the data output apparatus may be the same or different. Good.

  For example, when the data output device is applied to a television and the data providing device is applied to a mobile phone, the music that each family has in the mobile phone is set as BGM, and each family member uses the mobile phone. You can also watch your family trip photos on the living room TV. It is also possible to use a method in which siblings gather at a grandpa in the countryside and view the photos of their grandchildren together.

  For example, when the data output device is applied to a device installed at a place where a plurality of people gather, such as a car navigation system or a street display, the people gathered at the place where the device is installed You can also enjoy the photos, music, and videos you have gathered on the spot.

  That is, in the data output device, if the data providing device that can communicate with the data output device changes, the output data also changes accordingly. For this reason, compared with the technique of the said patent document 2 which reproduces and outputs the prestored image data with the music data stored beforehand, the display and streaming reproduction of the data which are rich in change according to the situation of the place are performed It becomes possible.

  The data providing device and the data output device only need to be able to communicate bidirectionally, and the data providing device and the data output device may be connected by wire or wirelessly connected. . Further, there may be a plurality of data providing devices that provide data to the data output device. Further, the data providing device and the data output device may communicate with each other via a relay device such as a router.

  As data that the data output device performs streaming playback, for example, audio data, moving image data, game program data, and the like can be applied. As data displayed by the data output device, text data, still image data, moving image data, or the like can be applied.

  The streaming playback means preferably plays back audio data, and the data display means preferably displays image data.

  According to the above configuration, the data output device can output the audio data streamed from the data providing device while displaying the image data received from the data providing device. As a result, the user of the data output device can also enjoy browsing images with BGM.

  The image data displayed by the data display unit may be still image data or moving image data. That is, according to the above configuration, still image data can be enjoyed with BGM, and moving image data can be enjoyed with BGM.

  Further, the data output device, the data sharing means for requesting the data providing device to transmit a list of image data or audio data that can be provided by the data providing device, and the data included in the received list, It is preferable to include a data transmission request means for requesting the data providing apparatus to perform transmission or streaming distribution.

  When the volume of data transmitted from the data providing apparatus to the data output apparatus is relatively small (for example, in the case of text data or the like), there is no particular problem even if data is transmitted from the data providing apparatus to the data output apparatus. However, when the capacity of data transmitted from the data providing apparatus to the data output apparatus is large, it is expected that it takes time to transmit the data, and a large capacity for storing the received data in the data output apparatus. It is necessary to provide a storage unit.

  Therefore, according to the above configuration, the data providing apparatus is caused to transmit a list of data, and data is received by making a request to the data providing apparatus based on the list. Thereby, it is possible to prevent a large amount of data from being transmitted from the data providing apparatus to the data output apparatus at a time.

  The data sharing means requests the data providing apparatus to transmit a list of image data and audio data that can be provided by the data providing apparatus, and the data transmission requesting means includes the image data included in the received list. Output order and audio data output order, request data transmission and streaming delivery in the determined output order, and the output control means controls the streaming playback means and the data display means. Thus, it is preferable to perform streaming reproduction in the order received and display the data in the order received.

  According to the above configuration, in the data output device, the data provided by the data providing device is displayed in order, and streaming playback is performed in order. Therefore, according to the above configuration, a slide show reproduction with BGM can be performed by the data output device using the image data and the audio data stored in the data providing device.

  The data transmission requesting unit determines a candidate for data to be transmitted when the data providing apparatus determines that the streaming reproduction unit or the data display unit cannot provide data to be output next. It is preferable to change the data to be output next to the data.

  Here, according to the configuration for transmitting the list, there is a time lag after the data providing apparatus transmits the list until a data transmission request is sent to the data providing apparatus. Therefore, during this time lag, the data providing apparatus may be unable to transmit data to the data output apparatus.

  For example, when the data providing device and the data output device communicate with each other wirelessly, the data providing device may go out of the communication range of the data output device. Further, for example, when the data output device is a device driven by a battery, it is conceivable that the battery runs out after transmission of the list. Furthermore, it is conceivable that the user of the data providing apparatus refuses to transmit data requested by the data output apparatus. It is also conceivable that data transmission is physically difficult due to the data providing apparatus performing other functions such as mail transmission / reception and videophone.

  In such a case, since the requested data is not transmitted to the data output device, the data output is interrupted. Therefore, according to the above configuration, if the availability of data is confirmed in advance and if it is determined that the data cannot be provided, the data candidate requesting transmission is changed to the data to be output next to the data. ing.

  As a result, even if there is a data providing device that is in a state where data cannot be transmitted to the data output device, or when the user of the data providing device refuses to provide the data requested by the data output device, the data output device is interrupted. It is possible to output data without the need for data output.

  In addition, the data providing apparatus includes a plurality of data, and the data requesting unit transmits the list so as to transmit or stream the data included in the list received from at least one of the plurality of data providing apparatuses. It is preferable to request the original data providing apparatus.

  By using a plurality of data providing devices as in the above configuration, the range of data that can be output to the data output device is expanded. As a result, the user of each data providing apparatus can output the images and music pieces collected and stored in the data providing apparatus to the data providing apparatus and enjoy together.

  The data sharing means transmits the data selection condition when a data selection condition, which is a condition for selecting image data or audio data to be included in the list, is received from one of the plurality of data providing apparatuses. It is preferable to transmit the received data selection condition to a data providing apparatus other than the original and request transmission of a list of image data or audio data selected according to the data selection condition.

  According to the above configuration, when the data selection condition is received from the data providing apparatus, the data selection condition is transferred to another data providing apparatus, and the transmission of the list selected according to the data selection condition is requested.

  That is, according to the above configuration, a list is generated in another data providing apparatus in accordance with the data selection condition transmitted from one data providing apparatus, and the generated list is transmitted to the data output apparatus. Therefore, the data output device can collectively grasp the data satisfying the data selection condition among the data that can be provided by each data providing device, and can output these data.

  In addition, the data output device associates audio data selection conditions, which are conditions for selecting audio data to be included in the list, with image data selection conditions, which are conditions for selecting image data to be included in the list. The data sharing means is identified with reference to the storage unit when receiving the audio data selection condition or the image data selection condition from one of the plurality of data providing devices. , The image data selection condition or the audio data selection condition corresponding to the received audio data selection condition or the image data selection condition, and the received audio data selection condition or the image data selection condition, respectively. Audio data selected in accordance with the audio data selection condition and the image data selection condition to be transmitted, and It is preferred to request to send a list of the image data.

  According to the above configuration, when the image data selection condition or the audio data selection condition is received from the data providing apparatus, the audio data selection condition or the image data selection condition corresponding to the received image data selection condition or the audio data selection condition is It is determined. That is, according to the above configuration, a set of data selection conditions including the image data selection condition and the audio data selection condition is specified based on the image data selection condition or the audio data selection condition transmitted by the data providing apparatus. .

  The specified set of data selection conditions is transmitted to each of a plurality of data providing devices, and each data providing device lists audio data and image data selected based on the set of data selection conditions. To the data output device.

  That is, according to the above configuration, the list of audio data and image data is generated in all the data providing devices according to the image data selection condition or the audio data selection condition transmitted by one data providing device, and the generated list is Sent to data output device.

  Therefore, the data output device can collectively grasp the audio data and the image data satisfying the data selection condition among the data that each data providing device can provide, and can output these data. Accordingly, only by transmitting image data selection conditions or audio data selection conditions from one data providing apparatus to the data output apparatus, the image data selected based on the image data selection conditions is reproduced as a slide show while playing back the sound as its BGM. It is also possible to output audio data selected based on the data selection condition.

  When the data output device and a data transmission request from the data output device are received, the requested data is transmitted to the data output device, and a data streaming distribution request is received from the data output device. In addition, if the data output system includes a data providing apparatus for streaming the requested data to the data output apparatus, the data provided from the data providing apparatus storing the data without copying the data Can be displayed on the data output device, and the data provided from the data providing device can be displayed on the data output device.

  The data output device may be realized by a computer. In this case, a control program for causing the data output device to be realized by the computer by causing the computer to operate as each unit of the data output device, and A computer-readable recording medium on which it is recorded also falls within the scope of the present invention.

  As described above, the data output apparatus according to the present invention provides the streaming reproduction means for performing the streaming reproduction of the data distributed from the data providing apparatus and the data other than the data reproduced by the streaming reproduction means from the data providing apparatus. The data display means for receiving and displaying, and the output control means for controlling the streaming reproduction means and the data display means to perform streaming reproduction and data display at the same time.

  In addition, as described above, the data output device control method of the present invention provides a streaming playback step for streaming playback of data streamed from the data providing device, and provides the data different from the data for streaming playback as described above. A data display step for receiving and displaying from the apparatus, a streaming playback step, and an output control step for simultaneously performing the data display step.

  Therefore, the data provided from the data providing apparatus can be displayed while reproducing the data provided from the data providing apparatus storing the data without copying the data.

  An embodiment of the present invention will be described below with reference to FIGS. First, the outline of the remote control system of the present invention will be described with reference to FIG.

[Outline of remote operation system 100]
FIG. 2 is a block diagram showing a main configuration of the remote operation system (data output system) 100 of the present invention. As illustrated, the remote operation system 100 includes an operation target device (data output device) 200 and a remote operation device (data providing device) 300. The remote operation system 100 is a system for operating the operation target device 200 with the remote operation device 300. Here, it is assumed that the remote operation device 300 is a mobile phone and the operation target device 200 is a television receiver.

  The remote operation system 100 is not limited to this example as long as the operation target device 200 outputs data provided by the remote operation device 300. That is, the remote operation device 300 may be any device that can transmit data to the operation target device 200, and may be, for example, a PDA, a smartphone, a PHS (Personal handy Phone System), a notebook computer, a portable game machine, or the like. A remote controller with a display screen for operating the operation target device 200 may be used. Further, the remote operation device 300 may be a storage device that stores data to be provided to the operation target device 200.

  The operation target device 200 may be any device that can receive and output data provided by the remote operation device 300, and may be a personal computer, a music player, a car navigation system, or the like. Furthermore, it is a display device such as an LCD (Liquid Crystal Display) display device, a PDP (Plasma Display Panel) display device, an EL (Electro Luminescence) display device, a CRT (Cathode Ray Tube) display device, or a speaker that outputs sound. May be.

  The operation target device 200 and the remote operation device 300 may be the same type of device. For example, both the remote operation device 300 and the operation target device 200 may be mobile phones. Here, the data output indicates voice output when the data is voice data, and indicates display output when the data is an image, a character, or the like.

[Configuration of Operation Target Device 200]
As illustrated, the operation target device 200 includes a tuner 201, a sound output unit 202, an operation target device control unit 203, a display unit 204, an operation unit 205, a temporary storage unit 206, an operation target device storage unit 207, and an operated side device. 1 communication unit 208, operated second communication unit 209, and Web communication unit 210.

  The tuner 201 selects and receives a broadcast wave of a channel designated by the operation target device control unit 203, converts it into a predetermined signal, and outputs it. The operation target apparatus 200 outputs video and audio of the received channel by performing processing such as decoding on this signal. The tuner 201 only needs to have a function of receiving a broadcast wave and converting the received broadcast wave into a predetermined signal. For example, a terrestrial digital tuner, a BS, a CS tuner, etc. Things can also be applied.

  The sound output unit 202 outputs sound to the outside of the operation target device 200 based on the output of the tuner 201 and the instruction of the operation target device control unit 203. The audio output unit 202 can be configured by a speaker, for example.

  The operation target device control unit 203 controls the operation of the operation target device 200 in an integrated manner, and can be configured by, for example, a CPU (Central Processing Unit). The operation target device control unit 203 operates using, for example, a temporary storage unit 206 configured by a RAM (Random Access Memory) or the like as a work area. Details of processing performed by the operation target device control unit 203 will be described in detail later.

  The display unit 204 is a display device that displays an image based on an output from the tuner 201 and an instruction from the operation target device control unit 203. For example, an LCD display device, an EL display device, a PDP display device, a CRT display device, or the like can be applied as the display unit 204.

  The operation unit 205 is used by the user to input an operation to the operation target device 200. The operation unit 205 is not particularly limited as long as the user can perform a desired operation input. Here, it is assumed that operation keys corresponding to various operation inputs are provided as the operation unit 205. Specifically, it is assumed that operation keys for operation input such as channel change, volume increase / decrease, and power on / off of the operation target device 200 are provided.

  The operation target device storage unit 207 stores programs and data as illustrated. The operation target device 200 executes a predetermined operation when the operation target device control unit 203 reads the program stored in the operation target device storage unit 207 into the temporary storage unit 206 and executes the program.

  The operated-side first communication unit 208 and the operated-side second communication unit 209 are for the operation target device 200 to communicate with an external device. The operated-side first communication unit 208 is configured to be able to communicate with the operating-side first communication unit 301, and the operated-side second communication unit 209 is configured to be able to communicate with the operating-side second communication unit 302. Yes. Details of the operated-side first communication unit 208 and the operated-side second communication unit 209 will be described later.

  The Web communication unit 210 is for connecting to a network for communication. Here, it is assumed that the Web communication unit 210 has a function of connecting to the Internet to perform Web browsing, a function of streaming receiving IP broadcasts, a function of executing TCP / IP communication, and the like. Here, it is assumed that the Web communication unit 210 is connected to the Internet for communication, but the Web communication unit 210 is an intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network. (Virtual private network), or a telephone line network or the like may be used for communication.

[Configuration of Remote Operation Device 300]
As shown in the figure, the remote operation device 300 includes an operation side first communication unit 301, an operation side second communication unit 302, a telephone / web communication unit 303, a voice input unit 304, a voice output unit 305, and a remote operation device control unit 306. A display unit 307, an operation unit 308, a temporary storage unit 309, and a remote operation device storage unit 310.

  The operation side first communication unit 301 and the operation side second communication unit 302 are for the remote operation device 300 to communicate with an external device. The operation side first communication unit 301 is configured to be able to communicate with the operated side first communication unit 208, and the operation side second communication unit 302 is configured to be able to communicate with the operated side second communication unit 209. Yes. Details of the operation side first communication unit 301 and the operation side second communication unit 302 will be described later.

  The telephone / Web communication unit 303 is for making a call with another mobile phone or a general phone via a mobile phone network or the like, or for connecting to the Internet for communication. These functions are realized by a telephone network communication unit and a mobile line unit (not shown). The telephone / web communication unit 303 only needs to have at least a telephone call function, and the one used in a conventional mobile phone or the like can also be applied.

  The voice input unit 304 is for inputting a voice signal to the remote control device 300 at the time of a call, for example, and the voice output unit 305 is a voice signal received by the telephone / web communication unit 303 at the time of a call or the like. It is for outputting a sound based on it. The voice output unit 305 also outputs voice or the like indicating an incoming call such as a telephone or mail. The audio input unit 304 and the audio output unit 305 may be any units that can input and output audio, respectively, and those used in a conventional mobile phone or the like can also be applied.

  The remote operation device control unit 306 controls the operation of the remote operation device 300 in an integrated manner, and can be configured by a CPU or the like, for example. The remote operation device control unit 306 operates using a temporary storage unit 309 configured with, for example, a RAM or the like as a work area. Details of processing performed by the remote control device control unit 306 will be described later in detail.

  The display unit 307 displays an image in accordance with an instruction from the remote operation device control unit 306. Although not shown, a VDP (Video Display Processor) is provided between the remote operation device control unit 306 and the display unit 307. In addition, a configuration necessary for displaying an image such as a VRAM (video RAM) is appropriately provided. The display unit 307 can be composed of, for example, an LCD display panel or an EL display panel.

  The operation unit 308 is for the user of the remote operation device 300 to perform an operation input to the remote operation device 300, and is not particularly limited as long as the user can perform a desired operation input. Here, it is assumed that the operation unit 308 is an operation key provided on the main body surface of the remote operation device 300. Specifically, as operation keys, various menu keys for displaying a menu screen related to mail, a menu screen related to the Internet connection, and the like on the display unit 307, and up, down, left, and right for selecting items displayed on the display unit 307 are displayed. It is assumed that a plurality of operation keys including a direction key, a determination key for determining a selected item, a character input key for inputting numbers and characters, and the like are provided.

  The remote operation device storage unit 310 stores a program and data as shown in the figure. The remote operation device 300 executes a predetermined operation by the remote operation device control unit 306 reading the program stored in the remote operation device storage unit 310 into the temporary storage unit 309 and executing it. Further, for example, data such as mail received by the telephone / web communication unit 303 and data such as a telephone number and mail address recorded by the user of the remote operation device 300 are stored in the remote operation device storage unit 310. Yes.

[Summary of the Invention]
Next, the outline of the present invention will be described with reference to FIGS. FIG. 3 is a diagram illustrating an example of a system configuration of the remote operation system 100. In the illustrated example, the remote operation system 100 has a system configuration in which one operation target device 200 and four remote operation devices (300a to 300d) are connected by wireless communication. However, the number of remote operation devices 300 constituting the remote operation system 100 is not particularly limited and may be any number.

  The remote operation devices 300a to 300d all have the same configuration as the remote operation device 300 shown in FIG. Hereinafter, any or all of the remote operation devices 300a to 300d may be referred to as the remote operation device 300.

  In the remote operation system 100, the operation target device 200 and the remote operation devices 300a to 300d perform data communication by performing Bluetooth (registered trademark) communication between the operated second communication unit 209 and the operation second communication unit 302. It is assumed that transmission / reception is performed. However, the operated second communication unit 209 and the operated second communication unit 302 are not limited to this example as long as the operation target device 200 and the remote operation device 300 can perform two-way communication.

  For example, ZigBee (trademark) and UWB (Ultra Wide Band) can be applied as the second operated-side communication unit 209 and the second operation-side communication unit 302, and IEEE802.2 such as Wi-Fi (registered trademark). 11 radios can also be applied. Further, the operation target device 200 and the remote operation device 300 may be connected by wire.

  In the remote operation system 100, the data stored in each of the remote operation devices 300a to 300d can be output to the operation target device 200. This will be described with reference to FIG. FIG. 4 is a diagram illustrating an outline of processing in the remote operation system 100 for causing the operation target device 200 to output data stored in each of the remote operation devices 300a to 300d.

  FIG. 4 shows an example in which data stored in each of the remote operation devices 300a to 300d is output to the operation target device 200 in accordance with an instruction from the remote operation device 300a. The terminal to be issued may be any of the remote operation devices 300a to 300d.

  As shown in the figure, first, the remote operation device 300a selects data specifying information for specifying data that the remote operation device 300a intends to share in the remote operation system 100 and data to be shared in the remote operation system 100. Are transmitted to the operation target apparatus 200. The remote operation device 300a also transmits a display instruction for causing the operation target device 200 to display the data specifying information.

  The data specifying information is information indicating what kind of data is shared and includes terminal specifying information indicating the owner of the data (terminal storing the data). That is, the owner of each data can be specified from the data specifying information.

  Next, the operation target device 200 that has received the data specifying information, the data selection condition, and the display instruction displays the data specifying information in accordance with the received display instruction. Thereby, the user of the remote operation system 100 can confirm what kind of data the user of the remote operation device 300a intends to share in the remote operation system 100.

  In addition, the operation target device 200 requests the remote operation devices 300b to 300d to transmit the data specifying information of the data that satisfies the received data selection condition. Upon receiving this request, the remote operation devices 300b to 300d select the data satisfying the data selection condition from the data stored therein, and specify the data specifying information corresponding to the selected data as the operation target device 200. Send to.

  Thus, in the remote operation system 100, first, the data specifying information is transmitted from the remote operation devices 300a to 300d to the operation target device 200. Therefore, the amount of data transmitted from the remote operation devices 300a to 300d to the operation target device 200 can be reduced as compared with the case where the data entity is transmitted. If it is not necessary to reduce the amount of data transmitted from the remote operation devices 300a to 300d to the operation target device 200 or if the data volume of the data entity is small, the data entity may be transmitted. Good.

  The data specifying information includes terminal specifying information. As a result, the operation target device 200 stores the data shared in the remote operation system 100 and the data in any of the remote operation devices 300a to 300d based on the data specifying information transmitted from the remote operation devices 300a to 300d. Can be recognized.

  Therefore, the operation target device 200 transmits the requested data to the remote operation devices 300a to 300d by sending a data transmission request to the remote operation devices 300a to 300d based on the data specifying information, and outputs the data. be able to.

[Specific operation example]
Next, a specific example of outputting data in the remote operation system 100 will be described with reference to FIG. FIG. 5 is a diagram illustrating a specific example in which data is output in the remote operation system 100. In the figure, an example in which the operation target device 200 outputs images stored in the remote operation devices 300a and 300b is shown.

  The remote operation system 100 is not limited to images as long as the operation target device 200 can output data, and can share and output arbitrary data. Although details will be described later, in the remote operation system 100, only data that can be output by the operation target device 200 is shared, so that data in a file format that cannot be handled by the operation target device 200 is transmitted to the operation target device 200. It will not be done.

  The operation target device 200 displays which terminal stores what data based on the data specifying information received from the remote operation devices 300a and 300b. Here, since it is assumed that the data to be shared is an image, the remote operation devices 300a and 300b transmit the thumbnail image of the image stored in each terminal to the operation target device 200 as data specifying information, The operation target device 200 displays this.

  In the illustrated example, the thumbnail image of the image stored in the remote operation device 300a is displayed at the position where “A” is displayed on the display screen of the operation target device 200, and “B” is displayed. It is shown that the thumbnail image of the image stored in the remote operation device 300b is displayed at the part.

  Note that the image data specifying information is not necessarily a thumbnail image, and for example, the file name of the image may be used as the data specifying information. However, when the data specifying information is a thumbnail image, the thumbnail image is displayed on the operation target device 200, which is preferable because the user of the remote operation system can recognize the contents of the image at a glance.

  Moreover, it is preferable that the operation target device 200 displays thumbnail images and terminal identification information indicating a terminal storing an image corresponding to each thumbnail image. Thereby, the user of the remote operation system 100 can recognize at a glance the terminal that owns the actual data (high resolution image) of the displayed thumbnail image.

  Here, the user of the remote operation devices 300a and 300b can select a thumbnail image displayed on the operation target device 200 by performing an operation input to the operation unit 308 of the remote operation device 300a or 300b. ing. FIG. 5 shows an example in which the remote operation device 300a selects and determines the image “B” positioned second from the left in the first row among the thumbnail images displayed on the operation target device 200.

  When the thumbnail image is determined, the operation target device 200 requests the actual data from the determined thumbnail image transmission source, that is, the terminal storing the actual data of the thumbnail image. Here, since it is assumed that the image “B” is selected, an image transmission request is sent to the remote operation device 300b.

  Next, the remote operation device 300 b that has received the image transmission request transmits the requested image to the operation target device 200. Then, the operation target device 200 displays the received image on the display screen of the own device. In this way, in the remote operation system 100, when the operation target device 200 outputs data, the substance (actual data) of the data is transmitted from the remote operation devices 300a and 300b to the operation target device 200.

  Although details will be described later, the remote operation system 100 determines the output order of each data indicated by the data specifying information received by the operation target device 200 and transmits data to the remote control devices 300a to 300d according to the determined order. A shuffle output function is provided to output the acquired data continuously. As a result, the data stored in the remote operation device 300 can be output to the operation target device 200 so that everyone on the spot can enjoy viewing the image.

  Furthermore, in the remote operation system 100, the music stored in the remote operation device 300 can be stream-distributed to the operation target device 200 during shuffle output, and the image can be viewed with BGM (Back Ground Music). .

[Detailed Configuration of Operation Target Device 200]
Next, a more detailed configuration of the operation target device 200 will be described with reference to FIG. FIG. 1 is a block diagram illustrating the main configuration of the operation target device 200 and the remote operation device 300. As illustrated, the operation target device control unit 203 includes an operated side communication control unit 1, a reproducible data information transmission unit 2, an operated side data sharing processing unit (data sharing unit) 3, and an operated side display control unit 4. A communication availability determination unit 5, a slide show execution unit (data transmission request unit, data display unit, output control unit) 6, a streaming execution unit (streaming reproduction unit) 7, and a copy request transfer unit 8.

  The operated-side communication control unit 1 performs a connection process for establishing a communication connection with the remote operation device 300. Specifically, when the operated-side communication control unit 1 receives a connection request from the remote operation device 300, the operated-side communication control unit 1 transmits a connection permission to the remote operation device 300 via the operated-side second communication unit 209. Thereby, a communication connection is established between the operation target device 200 and the remote operation device 300 via the operated-side second communication unit 209.

  The reproducible data information transmission unit 2 transmits reproducible data information indicating a file format of data that can be output by the operation target device 200. Thereby, it is possible to prevent the remote operation system 100 from sharing data that cannot be output by the operation target device 200. Note that the reproducible data information transmission unit 2 may transmit a file format of data that cannot be output by the operation target device 200. Even in this case, data that cannot be output by the operation target device 200 can be prevented from being shared by the remote operation system 100.

  The operated-side data sharing processing unit 3 transmits data specifying information of data that can be output by the operation target device 200 selected according to the reproducible data information from among the data that can be provided by the remote operation device 300. Requests to the remote operation device 300.

  Further, when the operated-side data sharing processing unit 3 receives a data selection condition indicating a condition for selecting data specifying information from the remote operation device 300, the remote operation device 300 other than the transmission source of the data selection condition. In addition, it transmits the received data selection condition and requests to transmit the data specifying information of the data selected according to the data selection condition.

  For example, when the data selection condition is received from the remote operation device 300a, the operated-side data sharing processing unit 3 transmits the received data selection condition to the remote operation devices 300b to 300d and the remote operation devices 300b to 300b. It requests 300d to transmit the data specifying information of the data selected according to the data selection condition.

  The operated side display control unit 4 causes the display unit 204 to display an image in accordance with an instruction from the operated side data sharing processing unit 3. The operated-side display control unit 4 can display a still image or a moving image on the display unit 204.

  The communication enable / disable determining unit 5 determines whether or not communication with a terminal whose communication connection has been established by the operated-side communication control unit 1 is possible. Specifically, the communication availability determination unit 5 transmits a response request to the terminal with which communication connection is established, determines that communication with the terminal is possible when there is a response to the response request, If it cannot be confirmed, it is determined that communication with the terminal is not possible.

  As a result, the operation target device 200 recognizes that it is no longer possible to communicate with the terminal when the remote operation device 300 is disconnected from the communication range with the operation target device 200, for example. can do. Therefore, since the operation target device 200 includes the communication availability determination unit 5, it is possible to prevent unnecessary transmission of a data transmission request to the remote operation device 300 whose communication connection has been disconnected.

  The slide show execution unit 6 receives a slide show execution instruction and performs slide show reproduction. Specifically, when receiving a slide show execution instruction, the slide show execution unit 6 generates reproduction management information indicating the output order of data included in the data specifying information. Then, the slide show execution unit 6 sends a data transmission request to the remote operation device 300 according to the generated reproduction management information, and displays the data received from the remote operation device 300 on the display unit 204 in the order received.

  Further, when the slide show execution unit 6 performs the slide show reproduction, whether the remote operation device 300 storing the data can transmit the data to the operation target device 200 before a predetermined time for displaying the data. Judge whether or not.

  Specifically, the slide show execution unit 6 transmits a prior notice to the remote control device 300 that stores data to be displayed. When receiving a transmission enable notification indicating that data transmission is possible, the slide show execution unit 6 determines that the remote operation device 300 can transmit data. On the other hand, when a transmission disapproval notification indicating that data cannot be transmitted is received, or when neither a transmittable notification nor a transmit disable notification can be confirmed, the slide show execution unit 6 can transmit data using the remote operation device 300. It is judged that.

  When the remote operation device 300 determines that the data can be transmitted, the slide show execution unit 6 changes the data candidate to be transmitted to data to be output next to the data. That is, the advance notice is transmitted to the remote control device 300 that stores data to be output next to the data. Thereby, it is possible to prevent the slide show from being interrupted due to the absence of the remote operation device 300.

  The streaming execution unit 7 receives data to be distributed by streaming and causes the audio output unit 202 and / or the display unit 204 to output the data. That is, when the streaming execution unit 7 receives streaming data such as music, the streaming execution unit 7 causes the audio output unit 202 to output the received streaming data. When moving image streaming data is received, the received streaming data is output to the audio output unit 202 and / or the display unit 204.

  The streaming described here is a reproduction method in which data is downloaded and reproduced at the same time, and the data distributed by streaming is not left in the operation target device 200. That is, when music or a moving image is streamed from the remote operation device 300 to the operation target device 200, the music or moving image data does not remain in the operation target device 200 after the reproduction of the music or moving image is completed.

  As described above, in the remote operation system 100, even when a shared music or moving image is reproduced, a copy of the music or moving image data is not generated, so that the copyright is not infringed. .

  When the copy request transfer unit 8 receives a copy request for data shared in the remote operation system 100 from the remote operation device 300, the copy request transfer unit 8 refers to the data specifying information and stores the data requested to be copied And the received copy request is transferred to the identified terminal.

  Since there is a problem in copying a copyrighted music, moving image, document, or the like, the copy request transfer unit 8 determines whether the copyright is set for the copy requested data. If the copyright is set for the data requested to be copied, a message indicating that copying cannot be performed may be transmitted to the copy requesting terminal. This configuration can be realized by including information indicating whether copyright is set or not in the data specifying information.

[Detailed configuration of remote control device 300]
Next, a more detailed configuration of the remote operation device 300 will be described based on FIG. 1 as described above. As shown in the figure, the remote operation device control unit 306 includes an operation side communication control unit 21, an operation side data sharing processing unit 22, an operation side display control unit 23, a data specifying information extraction unit 24, a slide show execution instruction unit 25, and content transmission. A control unit 26, a streaming distribution unit 27, and a copy execution unit 28 are provided.

  Further, as shown in the figure, the remote operation device storage unit 310 stores content. The content is data that is a candidate for sharing in the remote operation system 100. Here, it is assumed that the remote operation device storage unit 310 stores still images and audio data as the content. The remote operation system 100 can share arbitrary data other than these (for example, moving images and text data). The content may be recorded on a recording medium that can be attached to and detached from the remote operation device 300.

  The operation side communication control unit 21 performs a connection process for establishing a communication connection with the operation target device 200. Specifically, the operation side communication control unit 21 transmits a connection request to the operation target device 200 via the operation side second communication unit 302. Then, when the connection permission is returned from the operation target device 200 in response to the transmitted connection request, a communication connection is established between the operation target device 200 and the remote operation device 300 via the operation-side second communication unit 302. The

  The operation-side data sharing processing unit 22 instructs the data specifying information extraction unit 24 to output data data that can be output by the operation target device 200 from the data (contents) stored in the remote operation device storage unit 310. Extract specific information. Then, the operation-side data sharing processing unit 22 transmits the extracted data specifying information to the operation target device 200.

  The operation side display control unit 23 displays an image for operating the remote operation device 300 on the display unit 307 in accordance with an instruction from the operation side data sharing processing unit 22. The image displayed on the display unit 307 by the operation-side display control unit 23 is a still image or a moving image.

  The data specifying information extracting unit 24 extracts the data specifying information from the content stored in the remote operation device storage unit 310 in accordance with the instruction from the operation side data sharing processing unit 22. Further, the data specifying information extraction unit 24 instructs the operation side display control unit 23 to display the extracted data specifying information on the display unit 307 as necessary.

  Thereby, the user of the remote operation device 300 can confirm what data the data specifying information extraction unit 24 has selected. Then, it is possible to change or add data to be shared (data for transmitting data specifying information to the operation target device 200) as necessary.

  The slide show execution instruction unit causes the operation target device 200 to execute slide show reproduction. Specifically, the slide show execution instructing unit 25 receives the slide show execution instruction and transmits the slide show execution instruction to the operation target device 200, thereby causing the operation target device 200 to execute the slide show reproduction.

  When the content transmission control unit 26 receives a data transmission request from the operation target device 200, the content transmission control unit 26 reads out the requested data from the remote operation device storage unit 310 and transmits it to the operation target device 200.

  The streaming delivery unit 27 performs streaming delivery of moving image data or audio data. Specifically, when receiving the streaming distribution request, the streaming distribution unit 27 reads the content requested for streaming distribution from the remote control device storage unit 310 and distributes the content to the streaming distribution request source.

  The copy execution unit 28 executes a data copy process for copying data stored in another terminal to the own device. Details of the data copy process will be described later.

[Overall process flow]
In the remote operation system 100, data sharing is first performed between the remote operation device 300 and the operation target device 200, and then the operation target device 200 outputs the shared data in accordance with an instruction from the remote operation device 300. The flow of these processes will be described with reference to FIG. FIG. 6 is a flowchart illustrating an example of processing from data sharing to output in the remote operation system 100.

  Here, the remote operation device 300a is an instruction transmission side terminal that transmits an operation instruction to the operation target device 200, the remote operation device 300b is a data providing terminal that provides data to the operation target device 200, and the operation target device 200 is This will be described as an output device that outputs data provided by the data providing terminal.

  Note that the instruction transmission side terminal also functions as a data providing terminal. That is, the instruction transmission side terminal is a terminal that transmits an operation instruction to the operation target device 200 that outputs data, and functions as a data providing terminal when a data transmission request is received from the operation target device 200. .

[Processing of Remote Operation Device 300a (Instruction Sending Terminal)]
First, the remote operation device 300a performs connection processing (on the instruction transmission terminal side) with the operation target device 200 (S1). In the connection process (instruction transmission terminal side), the operation side communication control unit 21 transmits a connection request to the operation target device 200. Then, the operation side communication control unit 21 confirms the reception of the connection permission in response to the transmitted connection request, whereby the communication connection between the operation target device 200 and the remote operation device 300a is established, and the connection process (the instruction transmission terminal side) ) Ends.

  When the connection process (instruction transmission terminal side) ends, reproducible data information indicating the file format of data that can be reproduced by the operation target device 200 is transmitted from the operation target device 200, so that the remote operation device 300a This is received (S2). Since the remote operation device 300a uses the received reproducible data information to select data specifying information to be transmitted to the operation target device 200, data that cannot be reproduced by the operation target device 200 is transmitted to the operation target device 200. Can be prevented.

  Subsequently, in the remote operation device 300a, data sharing processing (instruction transmission terminal side) is performed (S3). In the data sharing process (on the instruction transmission terminal side), the remote operation device 300a transmits data specifying information and data selection conditions for data shared by the remote operation system 100 to the operation target device 200.

  When the data sharing process (instruction transmission terminal side) ends, the remote operation device 300a waits for a slide show execution instruction, a slide show with BGM execution instruction, a data output instruction, or an end instruction (S4, S6, S8, S10). The method for receiving the above instructions by the remote operation device 300a is not particularly limited. For example, the display unit 307 may display an image as shown in FIG.

  FIG. 7 is a diagram illustrating an example of a screen displayed on the remote operation device 300a. The illustrated screen is called software keyboard display (hereinafter referred to as soft key display). In the soft key display, the operation keys of the operation unit 308 and the functions assigned to the operation keys are displayed.

  That is, by performing operation key input to the operation unit 308 according to the screen display, the remote operation device 300a can execute processing corresponding to the displayed function. For example, in the example of FIG. 7, “1. slideshow” is displayed. In this case, it is possible to cause the remote operation device 300a to execute a process for performing the slide show reproduction by performing an input to the operation key displayed as “1” on the operation unit 308. Similarly, by inputting an operation key displayed as “2”, it is possible to cause the remote operation device 300a to execute processing for performing music reproduction or slide show reproduction with BGM.

  In addition, the data specifying information displayed on the operation target device 200 can be selected by operating the up / down / left / right direction keys of the operation unit 308. Then, by operating the determination key of the operation unit 308, data corresponding to the selected data specifying information can be output to the operation target device 200 (data output processing).

  Here, when it is confirmed that there is an instruction to execute a slide show (YES in S4), the remote operation device 300a executes a slide show execution process (on the instruction transmission terminal side) (S5). Thereby, in the operation target device 200, the images stored in the remote operation devices 300a and / or 300b are sequentially displayed (shuffle display).

  If it is confirmed that there is an instruction to execute the slide show with BGM (YES in S6), the remote operation device 300a executes a slide show execution process with BGM (on the instruction transmission terminal side) (S7). Thereby, in the operation target device 200, the images stored in the remote operation devices 300a and / or 300b are sequentially displayed, and the music stored in the remote operation devices 300a and / or 300b is stream-played.

  If it is confirmed that there is a data output instruction (YES in S8), the remote operation device 300a executes a data output process (on the instruction transmission terminal side) (S9). Thereby, in the operation target device 200, data stored in the remote operation device 300a and / or 300b is output.

  Specifically, in the data output process (on the instruction transmission terminal side), the content transmission control unit 26 transmits the requested data to the remote operation device storage unit 310 when confirming reception of the data transmission request from the operation target device 200. Are transmitted to the operation target device 200. Note that there may be a case where the user of the remote operation device 300 does not want the requested data to be output to the operation target device 200. Therefore, the content transmission control unit 26 issues a request when confirming reception of the data transmission request. The user may be allowed to select whether to transmit the received data.

  On the other hand, when it is confirmed that there is an end instruction (YES in S10), the remote operation device 300a ends the operation instruction for the operation target device 200.

  Although not shown, when it is confirmed that there is an instruction to execute a slide show or a slide show with BGM, the remote operation device 300a allows the user to select whether or not to perform repeated playback. If the user selects to perform replay repeatedly, the slide show is continued from the first image even after the images displayed in the slide show have made one round. Whether or not to perform repeated reproduction can be selected by the user by, for example, displaying a selection item on the display unit 307 of the remote operation device 300a.

[Processing of Operation Target Device 200 (Output Device)]
The operation target device 200 establishes a communication connection with the remote operation device 300 by performing connection processing (on the output device side) (S11). Specifically, the operated-side communication control unit 1 waits for a connection request from the remote operation device 300a or 300b and, when confirming reception of the connection request, transmits a connection permission to the transmission source terminal of the received connection request. Then, the communication connection with the transmission source terminal of the connection request is established.

  When the connection process (output device side) ends, the reproducible data information transmission unit 2 establishes communication connection with reproducible data information indicating data reproducible in the operation target device 200 in the connection process (output device side). It transmits to the established partner terminal (S12). Here, since it is assumed that the operation target device 200 has established a communication connection with both the remote operation devices 300a and 300b, reproducible data information is transmitted to both the remote operation devices 300a and 300b. .

  The reproducible data information is data indicating a file format that can be reproduced by the operation target device 200. Here, since it is assumed that the operation target device 200 can play back files in the “jpg”, “mp3”, and “mpg” formats, the playable data information includes “jpg”, “mp3”, and “mp3”. This data indicates that an "mpg" format file can be played.

  The reproducible data information may be read and transmitted when the operation target device 200 is necessary. For example, the reproducible data information may be stored in advance in the operation target device storage unit 207 or the like. The reproducible data information is information indicating data that cannot be reproduced by the operation target device 200, as long as the remote operation devices 300a and 300b can identify data that cannot be reproduced and output by the operation target device 200. There may be.

  Here, when the remote operation device 300a executes the data sharing process (instruction transmission terminal side), the operation target device 200 executes the data sharing process (output device side) (S13). In the data sharing process (on the output device side), the operation target device 200 collects data specifying information of data shared by the remote operation system 100.

  After the data sharing process (on the output device side) is completed, the operation target device 200 waits for a slide show execution instruction, a slide show execution instruction with BGM, or a data output instruction to be transmitted from the remote operation device 300a.

  When a slide show execution instruction is received, the slide show execution unit 6 performs a slide show execution process (output device side) (S14). As a result, the images stored in the remote operation device 300a and / or 300b are sequentially displayed (shuffled display) on the operation target device 200.

  When a slide show execution instruction with BGM is received, the slide show execution unit 6 performs a slide show execution process with BGM (on the output device side) (S15). Thereby, in the operation target device 200, the images stored in the remote operation devices 300a and / or 300b are sequentially displayed, and the music stored in the remote operation devices 300a and / or 300b is stream-played.

  When the execution instruction of the data output process is received, the operation target device 200 performs the data output process (output device side) (S16). Thereby, in the operation target device 200, data stored in the remote operation device 300a and / or 300b is output.

  Specifically, in the data output process (on the output device side), the slide show execution unit 6 transmits a data transmission request to a terminal (remote operation device 300a or 300b) that stores data to be output. When the slide show execution unit 6 receives the requested data, the slide show execution unit 6 outputs the requested data from the display unit 204 and / or the audio output unit 202.

  In the data output process, the operation target device 200 receives a copy of the data stored in the remote operation device 300. The received data may be held by the operation target device 200 even after the output, but the slide show execution unit 6 may delete the data after outputting the received data. Thereby, secondary copying of data can be prevented, and a large amount of data can be prevented from being stored in the operation target device 200.

[Processing of remote operation device 300b (data providing terminal)]
Also in the remote operation device 300b functioning as a data providing terminal, first, connection processing (on the instruction transmission terminal side) with the operation target device 200 is performed (S1). Thereby, a communication connection between the remote operation device 300b and the operation target device 200 is established. Then, after establishing the communication connection, the remote operation device 300b receives reproducible data information from the operation target device 200 (S2).

  Then, when the operation target device 200 executes the data sharing process (output device side), the remote operation device 300b executes the data sharing process (data providing terminal side) (S21). In the data sharing process (on the data providing terminal side), the remote operation device 300b transmits data specifying information of data shared by the remote operation system 100 among the data stored in the own device to the operation target device 200.

  After the data sharing process (on the data providing terminal side) is completed, the remote operation device 300b transmits data to the operation target device 200 in accordance with an instruction from the operation target device 200. That is, the remote operation device 300b performs a slide show execution process (on the data providing terminal side) when the operation target device 200 executes a slide show (S22), and executes a slide show with BGM (on the data providing terminal side) when executing a slide show with BGM. (S23), when outputting data, data output processing (on the data providing terminal side) is performed (S24).

[Data sharing process]
Next, details of the data sharing process (S3, S13, S21) in the flowchart of FIG. 6 will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of the data sharing process.

[Processing of Remote Operation Device 300a (Instruction Sending Terminal)]
First, the operation-side data sharing processing unit 22 of the remote operation device 300a specifies data (file format) that can be reproduced (output) by the operation target device 200 based on the reproducible data information received in S2 of FIG. (S31). Then, the operation-side data sharing processing unit 22 performs control so that data other than the specified file format is not shared in the following processing.

  Subsequently, the operation-side data sharing processing unit 22 waits for selection of data to be shared (S32). When the user of the remote operation device 300a starts selecting shared data (YES in S32), the operation-side data sharing processing unit 22 causes the user of the remote operation device 300a to input data selection conditions (S33). ).

  The method for inputting the data selection condition is not particularly limited as long as the user can input the condition intended by the user. For example, the operation-side data sharing processing unit 22 may display data selection condition candidates prepared in advance on the display unit 307 so that the user can select a selection condition from the displayed candidates. Further, it is also possible to accept a keyword input by the user and use the accepted keyword as a data selection condition. The data selection condition or keyword may be input by operating the operation unit 308, for example. Further, when the remote operation device 300 has a voice recognition function, a data selection condition or a keyword may be inputted by voice.

  When the data selection condition is input, the operation side data sharing processing unit 22 instructs the data specifying information extracting unit 24 to extract the data specifying information of the data that matches the input data selecting condition. At this time, the operation-side data sharing processing unit 22 transmits the file format specified in S31 to the data specifying information extracting unit 24.

  The data specification information extraction unit 24 that has received the transmission of the file format specified in S31 and has received an instruction to extract the data specification information receives the input from the contents stored in the remote operation device storage unit 310. Data that matches the data selection condition and can be reproduced by the operation target device 200 is selected, and data specifying information is extracted from each selected data (S34).

  When the data specification information extraction unit 24 finishes extracting the data specification information, the data specification information extraction unit 24 instructs the operation side display control unit 23 to display the extracted data specification information on the display unit 307, and displays the data specification information displayed on the display unit 307. The user is allowed to select whether or not the corresponding data can be shared (S35). If not sharing is selected (NO in S35), the process returns to S32, and the operation-side data sharing processing unit 22 waits for the selection of shared data to start.

  On the other hand, when sharing part or all of the data specifying information displayed on the display unit 307 is selected (YES in S35), the operation side data sharing processing unit 22 is selected to share. The data specifying information, the input data selection condition, and a display instruction for displaying the data specifying information on the operation target device 200 are transmitted to the operation target device 200 (S36). Thereby, the data sharing process (on the instruction transmission terminal side) ends.

[Processing of Operation Target Device 200 (Output Device)]
The data sharing process (on the output device side) executed by the operation target device 200 is started by receiving a display instruction, data specifying information, and data selection conditions transmitted by the remote operation device 300a (instruction transmission terminal) (S41). .

  The trigger for starting the data sharing process (on the output device side) is not limited to the above example. For example, the data sharing process (output device side) may be started when only the data specifying information is received. In this case, data sharing is requested without selection conditions. Further, the data sharing process (on the output device side) may be started with the reception of only the data selection condition as a trigger. In this case, the data specifying information of the data that satisfies the received data selection condition is requested to both the remote control devices 300a and 300b.

  Furthermore, the data sharing process (output device side) may be started when an instruction to start the data sharing process (output device side) is received. For example, the data specifying information can be input from the operation target device 200 to the remote operation devices 300a and 300b so that the operation target device 200 can be input with a data selection condition and a data sharing process (output device side) can be started. The request may be transmitted.

  When the operated-side data sharing processing unit 3 confirms reception of the display instruction, the data specifying information, and the data selection condition, the operated-side data sharing processing unit 3 instructs the operated-side display control unit 4 based on the received display instruction to receive the received data specifying Information is displayed on the display unit 204 (S42). Thereby, the user of the remote operation system 100 can confirm the data that the remote operation device 300a intends to share by looking at the display unit 204. If no display instruction is transmitted from the remote operation device 300a, the process proceeds to S43 without performing the process in S42.

  When the operation target device 200 stores data that matches the data selection condition, the operated-side data sharing processing unit 3 may also display the data specifying information of the data. . That is, the operation target device 200 may also function as a data providing terminal.

  Subsequently, the operated-side data sharing processing unit 3 instructs the communication availability determination unit 5 to check whether or not communication with a terminal other than the remote operation device 300a is possible. Then, the communication availability determination unit 5 that has received an instruction to confirm communication availability transmits a response request to each terminal (in this case, the remote operation device 300b) connected to the operation target device 200, and the response is returned. It is determined whether or not communication with a terminal other than the remote operation device 300a is possible based on whether or not it comes (S43).

  If no response is returned from a terminal other than the remote operation device 300a, the communication availability determination unit 5 determines that communication with another terminal is not possible (NO in S43), and the operated side data sharing processing unit 3 is transmitted. In this case, the operated-side data sharing processing unit 3 ends the data sharing process (output device side). Therefore, in this case, only data corresponding to the data specifying information transmitted by the remote operation device 300a is shared.

  On the other hand, when a response is returned from a terminal other than the remote control device 300a, the communication availability determination unit 5 determines that communication with another terminal is possible (YES in S43), and the communication address of the terminal that has returned the response Is transmitted to the operated-side data sharing processing unit 3. In this case, the operated-side data sharing processing unit 3 transmits the received data selection condition and a data specification information request for requesting transmission of data specification information satisfying the data selection condition to the communication address ( S44).

  Next, the operated-side data sharing processing unit 3 waits for reception of the data specifying information and receives it (S45). When the data specifying information is received, the operated-side data sharing processing unit 3 instructs the operated-side display control unit 4 to receive both the data specifying information received in S45 and the data specifying information received in S41. It is displayed on the display unit 204. Thereby, the data specifying information displayed on the display unit 204 is updated (S46).

  When the data specifying information is returned from all the terminals that transmitted the data specifying information request, the operated-side data sharing processing unit 3 ends the data sharing processing (output device side). In addition, even when a predetermined period has elapsed after transmitting the data specifying information request, even when the data specifying information is not returned from the transmission destination terminal of the data specifying information request, the operated side data sharing processing unit 3 The data sharing process (output device side) is terminated.

[Processing of remote operation device 300b (data providing terminal)]
The data sharing process (on the data providing terminal side) executed by the remote operation device 300b starts by receiving the data specifying information request and the data selection condition transmitted by the operation target device 200 (S51).

  When the data specifying information and the data selection condition are received, the operation-side data sharing processing unit 22 of the remote operation device 300b can reproduce data that can be reproduced by the operation target device 200 based on the reproducible data information received in S2 of FIG. (File format) is specified (S31). Then, the operation-side data sharing processing unit 22 performs control so that data other than the specified file format is not shared in the following processing.

  Subsequently, the operation side data sharing processing unit 22 instructs the data specifying information extracting unit 24 to extract the data specifying information of the data that matches the received data selection condition. Further, the operation-side data sharing processing unit 22 transmits the file format specified in S31 to the data specifying information extraction unit 24.

  In response to the instruction to extract the data specifying information, the data specifying information extracting unit 24 includes the data stored in the remote operation device storage unit 310 that satisfies the data selection condition and can be reproduced by the operation target device 200. It is confirmed whether or not it is (S52).

  When the data specifying information extraction unit 24 determines that the data selection condition is satisfied and the operation target device 200 does not include reproducible data (NO in S52), the data sharing process on the operation side Transmitted to the unit 22. In this case, the operation-side data sharing processing unit 22 ends the data sharing process (data providing terminal side).

  On the other hand, if the data specifying information extracting unit 24 determines that the data selection condition is satisfied and data that can be reproduced by the operation target device 200 is included (YES in S52), the data specifying information is extracted from the data. And the extracted data specifying information is transmitted to the operation side data sharing processing unit 22.

  Subsequently, the operation-side data sharing processing unit 22 causes the user to select whether or not the extracted data specifying information can be shared (S53). Here, when not sharing is selected (NO in S53), the operation-side data sharing processing unit 22 ends the data sharing process (data providing terminal side).

  On the other hand, when sharing is selected (YES in S53), the operation-side data sharing processing unit 22 transmits the data specifying information received from the data specifying information extracting unit 24 to the operation target device 200 (S54). . Thereby, the data sharing process (on the data providing terminal side) ends.

  In S53, the operation side data sharing processing unit 22 displays the data specifying information extracted by the data specifying information extracting unit 24 on the display unit 307, and allows the user of the remote operation device 300b to check the data to be shared. The shared data may be changed accordingly.

[Specific examples of shared data]
Here, a specific example of data shared by the remote operation system 100 will be described. Since the remote operation system 100 performs slide show playback, the data structure of the image will be described here. The image has a data structure as shown in Table 1 below.

  As shown in Table 1, the image includes a high-resolution image as actual data, and includes a thumbnail image and content detailed information as content information. The content information is data that is generated along with the actual data when the image data is generated.

  For example, when a photograph is taken with a digital camera, a high-resolution image is generated as actual data, and the thumbnail image of the photographed photograph, the date and time of photographing, the model of the photographed digital camera, and the serial number Content information is generated. Then, image data is generated as one file including these data.

  In the remote operation system 100, at least a part of the detailed content information is used as data specifying information. Here, the detailed content information will be described based on Table 2 below. Table 2 shows an example of the detailed content information included in the image data.

  As shown in Table 2, the content detailed information includes the file name of actual data (high resolution image), the file name of the thumbnail image, the shooting date and time, the shooting location, the shooting model, the serial number of the device storing the data, Owner information for specifying the owner and means for obtaining the image are included. That is, here, it is assumed that the remote control device 300 has a photo shooting function.

  Note that the shooting location can be acquired using, for example, a GPS (Global Positioning System) mounted on a shooting machine (which may be the remote control device 300 or another shooting device). .

  In addition, here, it is assumed that there are four ways of obtaining: photographing with the own device, obtaining by infrared communication, receiving by e-mail, and obtaining by the Internet. It is assumed to be expressed in numbers. For example, in the example of Table 2, since the obtaining means is “1”, it can be seen that this image was taken by the own apparatus. Of course, the means for obtaining data is not limited to the above example.

  The remote operation system 100 selects data satisfying the data selection condition by using the content detailed information as described above. For example, when the data selection condition “image taken in August 2007” is set, the image in Table 2 is extracted as a candidate for shared data.

  The content detailed information includes terminal specifying information for specifying the terminal storing the image (in the example of Table 2, the serial number of the remote control device 300 storing the image). Accordingly, the operation target device 200 can recognize in which terminal each piece of data shared by the remote operation system 100 is stored.

  The terminal identification information is not limited to the serial number as long as it can identify the terminal storing the data (in this case, an image). For example, the telephone identification number of the remote control device 300 storing the data may be used as the terminal identification information. That is, the owner information in Table 2 can also be used as terminal specifying information. Further, a user ID, a SIM (Subscriber Identity Module) card ID, or the like can be used as the terminal specifying information.

  When extracting data specifying information of an image, the data specifying information extracting unit 24 extracts a thumbnail image of the image and picks up necessary data from the content detailed information as described above to access the image. URL (Uniform Resource Locator) is generated.

  For example, a URL such as “http: //357667005259978/2007.8.10.12: 45: 38 / 2008.2.22.12: 45: 44 / s0001.JPEG” can be generated from the detailed content information in Table 2. In this example, “http: //” indicates the URL, “357667005259978” indicates the manufacturing number (terminal identification information), “2007.8.10.12:45:38” indicates the shooting date, and “2008.2.22.12:45” : 44 ”indicates the transmission date and time of the data specifying information, and“ s0001.JPEG ”indicates the file name of the thumbnail image.

  Therefore, a thumbnail image with “s0001.JPEG” and a URL with “http: //357667005259978/2007.8.10.12: 45: 38 / 2008.2.22.12: 45: 44 / s0001.JPEG” are operated as data specifying information. In the case of transmission to the target device 200, the operation target device 200 identifies the terminal that owns the actual data (high resolution image) of the thumbnail image “s0001.JPEG” and The actual data can be requested.

  Here, the above URL includes the transmission date and time of the data specifying information. This is for identifying data having the same name. For example, when a photograph is taken with a digital camera, the file name is automatically determined by the digital camera. Therefore, when a photograph is taken with a digital camera or mobile phone of the same model (or the same manufacturer), a file with the same name is generated. If a file with the same name is shared by the remote operation system 100, it cannot be identified by the file name.

  Therefore, in the above example, information indicating the transmission date and time of the data specifying information is incorporated in the URL. As a result, the operation target device 200 can identify a file having the same name. Note that the URL is discarded when the communication connection between the operation target device 200 and the remote operation device 300 is interrupted.

  Although an example of image data specifying information has been described above, the same information can be used for moving image data specifying information. The data specifying information is information that allows the operation target device 200 to specify data shared by the remote operation system 100, and to specify a terminal storing the shared data. Anything can be used, and the present invention is not limited to the above example.

  For example, the data specifying information of the music data can be data as shown in Table 3 below. Table 3 shows an example of music data specifying information. The data specifying information in the example of Table 3 includes the file name, the title of the song, the artist name, the album name of the album in which the song is recorded, the playback time, the acquisition date and time of the song, the date and time of listening to the song, the location of listening, The serial number of the device in which the music is stored (terminal identification information) and the date and time when the data identification information is transmitted to the operation target device 200 are included.

  There are songs with the same title and different artists, and titles and artists with the same playback time but different playback times. Therefore, in the example of Table 3, the title, artist name, and playback time are included in the data identification information. It is included. Accordingly, the operation target device 200 that has received the data specifying information in Table 3 can display the title, artist name, and reproduction time based on the received data specifying information. Then, it is possible to make the user recognize what kind of music is shared by the remote operation system.

  The album name can be used for displaying on the operation target device 200, as in the case of the title name, etc., but the information on the album name can also be used when selecting a song using the data selection condition. For example, by specifying a specific album name in the data selection condition, songs included in the same album can be extracted as shared data candidates. In addition, music having an album name that matches the keyword indicated by the data selection condition can be extracted as a candidate for shared data. Note that information on album names is not included for songs that are not included in the album, such as single songs.

  The acquisition date / time of the music, the date / time of listening to the music, and the place of listening are used when selecting the music using the data selection condition. For example, when the data selection condition of “recently listened songs” is set, songs having “dates and times of listening to songs” close to the date and time at that time (for example, within one week) are extracted as candidates for shared data Is done.

  The date and time when the music was listened to may be recorded when the music is played. Further, the place where the user listens may be obtained and recorded by, for example, GPS when the music is reproduced.

[Display screen example of remote control device 300a]
Here, an example of a screen displayed on the display unit 307 of the remote operation device 300a in the data sharing process (on the instruction transmission terminal side) will be described with reference to FIG. FIG. 9 is a diagram illustrating an example of a display screen when executing the data sharing process (on the instruction transmission terminal side). FIG. 9 shows an example in which data sharing processing (on the instruction transmission terminal side) is executed as one function of application software (hereinafter referred to as a photo application) for browsing a photo with the remote control device 300a. .

  The upper left diagram of FIG. 6 shows an example of a display screen when the user of the remote operation device 300a performs an input operation on the operation unit 308 to activate the photo application. As shown in the figure, by starting the photo application, the photos (images) stored in the remote operation device storage unit 310 are displayed as thumbnails on the display unit 307.

  Further, as shown in the drawing, a cursor is placed on one of the thumbnail-displayed images. This cursor indicates a selection position, and the cursor position on the display screen can be moved by operating the up / down / left / right direction keys provided on the operation unit 308.

  Then, by operating the determination key of the operation unit 308 with the cursor placed on the displayed thumbnail image, the thumbnail image on which the cursor is placed can be determined. When the thumbnail image is determined, actual data (high resolution image) of the determined thumbnail image is displayed on the display screen.

  As shown in the figure, soft keys for selecting a submenu are displayed on the display screen. Here, when the operation unit 308 is operated to select a submenu, the display screen is switched to the upper right screen in FIG. In the submenu, it is possible to select whether to display the selected photo (the photo at the position where the cursor is placed) on the television (operation target device 200) or to perform shuffle display on the television. .

  Note that the shuffle described here refers to sharing content stored in a plurality of remote operation devices (for example, remote operation devices 300a and 300b) in a remote operation system, and sharing content to a user instruction (for example, remote operation). This means continuous playback in the operation target device 200 in accordance with an instruction input to the device 300a or 300b.

  Here, when it is selected that the selected photo is displayed on the television, the remote operation device 300a transmits the selected photo data to the operation target device 200 for display.

  On the other hand, when execution of shuffle display is selected, the operation-side data sharing processing unit 22 determines that selection of shared data has started (see S33 in FIG. 8). Then, the operation side data sharing processing unit 22 instructs the operation side display control unit 23 to display a data selection condition input screen. As a result, the display screen is switched to the lower left screen in FIG.

  In the display example at the lower left of the figure, the same date as the selected photo, the same location as the selected photo, the same owner as the selected photo, the photo taken today, the photo taken this week, the photo taken this month, the photo downloaded online, and The data selection condition that the date is specified is displayed. In the remote operation system 100, data sharing is performed based on the data selection condition selected here.

  The data selection conditions in the illustrated example are data selection conditions for sharing a photograph related to the photograph on which the cursor is placed on the upper right screen of the same figure, data selection conditions not related to the photograph on which the cursor is placed, Data selection conditions that can be changed by the user can be classified.

  In the above example, the data selection conditions with the same date as the selected photo, the same location as the selected photo, and the same owner as the selected photo are the data selection conditions for sharing the photo related to the photo with the cursor. Equivalent to. In the example shown in the drawing, the user selects a data selection condition in a state where a photo is selected, so that there is a high possibility that a photo related to the photo on which the cursor is placed is shared.

  Therefore, it is preferable to display the data selection condition for sharing the photograph related to the photograph on which the cursor is placed at a position (upper side in the illustrated example) that is easier to select than the other selection conditions. In addition, a data selection condition for sharing a photograph related to a photograph on which the cursor is placed and another data selection condition may be displayed so that the user can identify them. For example, by changing the display color, display field, font, brightness, color tone, etc., the user can easily select data selection conditions for sharing a photo related to the photo on which the cursor is placed.

  In the above example, the data selection conditions of the photograph taken today, the photograph taken this week, the photograph taken this month, and the photograph downloaded online are the data selection conditions that are displayed regardless of the photograph on which the cursor is placed. is there. The data selection condition that the date is specified is the data selection condition that allows the user to change the setting.

  Note that the data selection condition is not limited to the above example, and can be appropriately set according to the necessity and according to the data included in the data specifying information. For example, if the data specifying information does not include data on the shooting location, the data selection condition “same location as selected photo” may not be displayed. In addition, when the photo data specifying information includes information indicating the subject of the photo, a condition of a photo including the specific subject can be set as the data selection condition.

  Here, when the data selection condition “photo taken today” is selected in the illustrated example, the data specifying information extraction unit 24 searches the remote operation device storage unit 310 for an image whose shooting date is today's date. Then, a thumbnail image of the detected image is extracted, and the operation-side display control unit 23 is instructed to display the extracted thumbnail image on the display unit 307.

  As a result, as shown in the lower right of the figure, a thumbnail image of a photograph taken today by the remote operation device 300a and stored in the remote operation device storage unit 310 is displayed on the display unit 307. Further, as shown in the figure, selection items for causing the user to select whether or not shuffle display is possible are displayed.

  When the operation unit 308 is operated to input shuffle display while this screen is displayed, the operation side data sharing processing unit 22 remotely retrieves a photo corresponding to the displayed thumbnail image. It is determined that the operation system 100 may share the information. Then, the operation side data sharing processing unit 22 transmits the data specifying information including the displayed thumbnail image to the operation target device 200.

  By transmitting the data specifying information, data is shared in the remote operation system 100, so that a slide show reproduction or the like can be performed. Therefore, the operation-side data sharing processing unit 22 displays an operation screen as shown in FIG. 7 after transmitting the data specifying information, and the user of the remote operation device 300 can smoothly perform an operation input such as a slide show reproduction. It is preferable to do so.

[Display screen examples of the operation target device 200 and the remote operation device 300b]
Next, an example of a display screen displayed on the operation target device 200 and the remote operation device 300b in the data sharing process (on the output device side) in FIG. 8 will be described based on FIG. FIG. 10 shows an example of a display screen when an image is shared between the remote operation device 300a (instruction transmission terminal) and the remote operation device 300b (data providing terminal).

  When the operated-side data sharing processing unit 3 of the operation target device 200 confirms the reception of the data specifying information, the thumbnail data included in the received data specifying information is displayed on the display unit 204. At this stage, since only the thumbnail image transmitted by the remote operation device 300a which is the instruction transmission terminal is received by the operation target device 200, the thumbnail transmitted by the remote operation device 300a as shown in the upper side of FIG. Only the image is displayed.

  Subsequently, the operated-side data sharing processing unit 3 transmits a data specifying information request to the remote operation device 300b that is a data providing terminal. Upon receiving the data specifying information request, the operation side data sharing processing unit 22 of the remote operation device 300b displays, for example, an image as shown on the left side of FIG. 11 and shuffles the photos that satisfy the condition “photo taken today”. Confirm with the user whether this is possible. FIG. 11 is a diagram illustrating an example of a screen displayed by the remote operation device 300b in the data sharing process (data providing terminal side).

  Here, when an input indicating that shuffle display is permitted is performed, the data specifying information extracting unit 24 extracts data specifying information of a photo that satisfies the condition “photo taken today”. Then, the thumbnail image included in the extracted data specifying information is displayed in a manner as shown on the right side of FIG.

  Further, as shown in the figure, a selection item for causing the user to select whether or not to execute the shuffle display of the photo corresponding to the extracted thumbnail image is displayed. Thereby, the user of the remote operation device 300b can select whether or not to share the picture on which the thumbnail image is displayed.

  Here, when it is selected that the photograph is shuffled, the data specifying information of the photograph that satisfies the condition “photo taken today” is transmitted from the remote operation device 300b to the operation target device 200. At this time, the operation target device 200 may display that data is being received from the remote operation device 300b as shown in the upper side of FIG.

  Then, when the operated-side data sharing processing unit 3 of the operation target device 200 confirms reception of the data specifying information, the thumbnail image included in the data specifying information received from the remote operation device 300b and the remote operation already displayed are displayed. The thumbnail image received from the device 300a is displayed. As a result, the display of the operation target device 200 is updated, and the thumbnail image transmitted by the remote operation device 300a and the thumbnail image transmitted by the remote operation device 300b are mixedly displayed as shown in the lower side of FIG. The

  Thus, the thumbnail images transmitted by the remote operation device 300a and the thumbnail images transmitted by the remote operation device 300b are displayed on the operation target device 200, so that the users of the remote operation devices 300a and 300b are owned by each other. You can see at a glance the "photos taken today".

  Then, by selecting a thumbnail image displayed on the operation target device 200 by using the remote operation device 300a or 300b, a photo corresponding to the selected thumbnail image is displayed from the terminal storing the photo. Sent to and displayed (data output process). In addition, by instructing the operation target device 200 from the remote operation device 300a or 300b, it is possible to perform a slide show reproduction that sequentially displays photos corresponding to the displayed thumbnail images (slide show execution processing). Furthermore, by instructing the operation target device 200 from the remote operation device 300a or 300b, the music stored in the remote operation device 300a or 300b as the BGM can be played by streaming while performing slide show reproduction (with BGM). Slide show execution process).

  As described above, in the remote operation system 100, the contents stored in the remote operation device 300 owned by each person can be enjoyed by all those around the operation target device 200. In addition, since the remote operation device 300 functions as an instruction transmission terminal or a data providing terminal when connected to the operation target device 200, the remote operation device 300 and the operation target device 200 can be used even when a slide show is reproduced under the same data selection conditions. The displayed photograph differs depending on the remote control device 300 connected for communication. In other words, when the data selection condition is changed, different slide shows are reproduced depending on the members present at the place, so that everyone can enjoy the slide show according to the place.

[Slide show execution process]
Next, details of the slide show execution process executed in S5, S14, and S21 of FIG. 6 will be described based on FIG. FIG. 12 is a flowchart illustrating an example of a slide show execution process.

  When the slide show execution instructing unit 25 of the remote operation device 300a (instruction transmission terminal) confirms that the slide unit execution instruction has been input to the operation unit 308, the data specifying information of the images to be played back as the slide show is transmitted to the operation target device 200. It is confirmed whether or not (S61). Here, when the data specifying information is not transmitted (NO in S61), the slide show execution instructing unit 25 instructs the operation side data sharing processing unit 22 to execute the data sharing processing (instruction transmitting terminal side). Then, the data specifying information is transmitted to the operation target device 200 (S3).

  In addition, without transmitting the data specifying information, only the data selection condition and the slide show execution instruction are transmitted to the operation target device 200, and the operation target device 200 collects the data specifying information of the data satisfying the transmitted data selection condition. You can also run a slide show.

  After transmitting the data specifying information to the operation target apparatus 200 in S3 or when the data specifying information has already been transmitted (YES in S61), the slide show execution instructing unit 25 executes the slide show on the operation target apparatus 200. An instruction is transmitted (S62).

  Note that after transmitting the slide show execution instruction, the remote operation device 300a also functions as a data providing terminal in the same manner as the remote operation device 300b. That is, when the operation target device 200 executes the data owning terminal confirmation processing (output device side), the remote operation devices 300a and 300b execute the data owning terminal confirmation processing (data providing terminal side) (S63) When the device 200 executes the data output process (output device side), the data output process (data providing terminal side) is executed (S24).

  Here, the description shifts to the processing on the operation target device 200 side. When the reception of the slide show execution instruction is confirmed (S71), the slide show execution unit 6 starts a slide show execution process (output device side). Specifically, the slide show execution unit 6 first generates reproduction management information indicating the output order of images output in the slide show. For example, as shown in Table 4 below, the reproduction management information may be data in which the reproduction order and the file name are associated with each other.

  Note that the playback order can be changed as needed. For example, the playback order may be file name order, date order, etc., or may be set at random. Further, the playback order may be set based on the image transmitted to the operation target device 200 by the remote operation device 300a that has instructed the slide show playback. For example, the images transmitted by the remote operation device 300a may be reproduced in order from the images having the closest acquisition date and time.

  Further, the reproduction management information may be data in which information for specifying data and the reproduction order are associated with each other, and is not limited to the example in Table 4. For example, data in which the reproduction order is associated with the above-described URL may be used as the reproduction management information. In this case, the slide show execution unit 6 can identify the file with the same name based on the transmission date and time of the data specifying information included in the URL.

  The slide show execution unit 6 that has generated the reproduction management information executes a data owning terminal confirmation process (on the output device side) (S72). The data possessing terminal confirmation process (on the output device side) is performed with the remote control device 300a or 300b, thereby determining whether or not the terminal storing the image to be displayed next can provide the image. If it can be provided, it is decided to display the image next. The details of the data possessing terminal confirmation process (output device side and data providing terminal side) will be described later.

  Next, the slide show execution unit 6 performs data output processing (output device side) with a terminal (remote operation device 300a or 300b) that stores an image determined to be displayed next in the data possessing terminal confirmation processing. (S16). Specifically, the slide show execution unit 6 refers to the data specifying information, specifies the terminal storing the image, and sends an image transmission request to the specified terminal (the remote operation device 300a or 300b). Send. The content transmission control unit 26 of the terminal (remote operation device 300a or 300b) that has received the transmission request transmits the requested image to the operation target device 200. Then, the slide show execution unit 6 of the operation target device 200 displays the received image on the display unit 204.

  That is, the data output process (output device side) is a process for transmitting a data transmission request, receiving the requested data, and outputting the data, and the data output process (data providing terminal side) This is a process of receiving and returning the requested data.

  In the data output process (on the data providing terminal side), the content transmission control unit 26 receives a data transmission request or transmits data to the operation target device 200, such as sound, vibration (vibration), light You may make it alert | report to a user that data will be output (or output) from now on by (LED lamp).

  As a result, the user of the remote operation device 300a or 300b can recognize that the data that he / she owns will be output (or output). In addition, when the remote control device 300a or 300b emits sound, vibration, light, etc., the person around it recognizes which terminal the data to be output (or output) is from. Can do.

  For example, consider a case where a slide show of photos taken by the remote control devices 300a and 300b is performed when a family travels. In this case, the remote control device 300a or 300b storing a photograph to be displayed (or outputted) will emit sound, vibration, light, or the like. Thereby, since the photographer and the people around him can recognize who is the photographer of the photograph displayed (displayed) on the operation target device 200, the slide show can be more enjoyed. .

  In addition, the photographer can check the displayed image before being displayed on the operation target device 200 as a slide show. For this reason, the photographer can cancel providing the slide show at that time with respect to images that the user does not want to show.

  When the image is displayed as described above, the slide show execution unit 6 refers to the generated reproduction management information and confirms whether or not the displayed image is the last image in the slide show (S73). If it is not the last image (NO in S73), the process returns to S72, and the slide show execution unit 6 checks whether there is a terminal storing the next image.

  On the other hand, if it is the last image (YES in S73), the slide show execution unit 6 confirms the presence / absence of repeated settings (whether the user has selected to perform repeated playback) (S74). If the repetitive setting is made (YES in S74), the process returns to S72, and the slide show execution unit 6 determines whether or not there is a terminal storing the image whose playback order is first in the playback management information. Confirm. If the repeat setting is not made (NO in S74), the slide show execution unit 6 ends the slide show execution process (output device side).

  As described above, the images stored in the remote operation devices 300a and 300b are sequentially displayed on the operation target device 200 by the slide show execution process. In the remote operation system 100, it is possible to shuffle and reproduce arbitrary data such as audio data such as music and text data by the same processing as described above.

[Interrupt display during slide show playback]
Here, although not shown in FIG. 12, in the remote operation system 100, an image designated by the remote operation device 300 can be interrupted and displayed during the slide show execution process. Here, the interrupt display process will be described. Note that the interrupt display instruction may be given by either of the remote operation devices 300a and 300b, and therefore, the terminal that transmits the interrupt display instruction will be described as the remote operation device 300.

  That is, when it is confirmed that an instruction to display an image on the operation target device 200 is input to the operation unit 308 while the slide show process execution process is being performed, the slide show execution instruction unit 25 A thumbnail image of an image stored in the operation device storage unit 310 is displayed on the display unit 307, and the user selects an image to be displayed on the operation target device 200.

  Note that the thumbnail image displayed here may correspond to the data specifying information that has been transmitted to the operation target device 200, or may correspond to an image that has not been transmitted with the data specifying information. Or both.

  When it is confirmed that the image to be displayed on the operation target device 200 is selected, the slide show execution instructing unit 25 instructs the data specifying information extracting unit 24 to extract the data specifying information of the selected image. Then, the slide show execution instruction unit 25 transmits the extracted data specifying information to the operation target device 200.

  When the slide show executing unit 6 of the operation target device 200 confirms reception of the data specifying information during the slide show executing process, does the reproduction management information include an image corresponding to the received data specifying information? Confirm whether or not.

  If the image corresponding to the received data specifying information is not included in the reproduction management information, the slide show execution unit 6 adds the image to the reproduction management information. At this time, the display order of the images is set next to the currently displayed image.

  On the other hand, when the image corresponding to the received data specifying information is included in the reproduction management information, the slide show execution unit 6 causes the reproduction management information so that the display order of the images is next to the currently displayed image. Update.

  As described above, by performing the interrupt display process, the reproduction management information is updated, whereby an image corresponding to the data specifying information transmitted by the remote operation device 300 is interrupted and displayed during the slide show reproduction.

  Note that the playback order of the images corresponding to the data specifying information transmitted by the remote operation device 300 is not particularly limited as long as it is after the currently displayed image. For example, it may be displayed two after the currently displayed image, or may be displayed at the end of the slide show.

  In the interrupt display process, the remote operation device 300 may transmit and display actual data (high resolution image) instead of the data specifying information. In this case, since the operation target device 200 can display an image without performing the data output process, it is possible to promptly display the image to be interrupted.

[Data possession terminal confirmation processing]
Next, details of the data owning terminal confirmation process (on the data providing terminal side) in S63 of FIG. FIG. 13 is a flowchart illustrating an example of the data owning terminal confirmation process (data providing terminal side and output device side).

  First, the slide show execution unit 6 of the operation target device 200 refers to the reproduction management information, and specifies data to be output next to currently output data and a terminal that stores the data. Then, the slide show execution unit 6 transmits a prior notice to the identified terminal (S91). Here, since it is assumed that the remote operation devices 300a and 300b are connected to the operation target device 200, the prior notification is transmitted to the remote operation device 300a or 300b. An example in which a prior notice is transmitted to 300a is shown.

  When the content transmission control unit 26 of the remote operation device 300a confirms reception of the advance notification (S81), the content transmission control unit 26 causes the user to select whether or not the requested data can be transmitted (S82). For example, by displaying an image as shown in FIG. 14, the user can select whether or not the requested data can be transmitted.

  FIG. 14 is a diagram illustrating an example of a display screen for allowing the user to select whether transmission of requested data is possible. As shown in the figure, the data name of the requested data, the time until the data is output, and the selection items for rejecting the data output are displayed. In this case, the content transmission control unit 26 determines that data transmission is impossible when a selection item for rejecting data output is selected, and a selection item for rejecting data output. When a predetermined time (5 seconds in the illustrated example) elapses without being selected, it may be determined that data transmission is possible.

  In addition, since it is considered that the user of the remote operation device 300a does not notice the reception of the prior notification, the content transmission control unit 26, for example, when confirming the reception of the prior notification, for example, a sound (including a voice message or a melody), It is preferable to notify the user of the reception of the prior notification by vibration (vibration), light (LED lamp) or the like.

  In S82, the content transmission control unit 26 may automatically determine whether data can be transmitted. For example, if the remaining battery level of the remote control device 300a is below a predetermined threshold or if a process such as a call is being executed, the content transmission control unit 26 cannot automatically transmit data. You may make it judge. As a result, it is possible to prevent the remaining battery level from being consumed due to the transmission of data, and it is possible to prevent a process such as a call from being hindered.

  Here, when the requested data is transmitted (YES in S82), the content transmission control unit 26 transmits a transmission enable notification to the operation target device 200 (S83). If the requested data is not transmitted (NO in S82), the content transmission control unit 26 transmits a transmission impossible notification to the operation target device 200 (S84).

  On the other hand, the slide show execution unit 6 of the operation target device 200 confirms whether or not a transmission enable notification has been received (S92). Then, when it is confirmed that the transmission enable notification has been received (YES in S92), the slide show execution unit 6 determines the image that has received the transmit enable notification as an image to be displayed next, and ends the data possession terminal confirmation processing. .

  On the other hand, when the reception of the transmission enable notification cannot be confirmed (NO in S92), the slide show execution unit 6 checks whether or not the transmission disable notification is received (S93). Here, when the reception of the transmission disapproval notification is confirmed (YES in S93), the slide show execution unit 6 returns to S91, specifies the next display candidate data and the terminal storing the data, and specifies the specification. A prior notice is sent to the terminal.

  On the other hand, if neither the reception of the transmission possible notification nor the reception of the transmission impossible notification can be confirmed within a predetermined time after the advance notification is transmitted (NO in S93), the slide show execution unit 6 sends the advance notification destination terminal. And the fact that the terminal is absent is stored (S94). Then, the slide show execution unit 6 deletes the data stored in the absent terminal from the reproduction management information (S95), and returns to the process of S91.

  The data possessing terminal confirmation process is an example, and the present invention is not limited to this example. For example, the slide show execution unit 6 may first cause the communication enable / disable determining unit 5 to determine whether communication is possible, and may transmit a prior notice only to a terminal that is determined to be communicable.

  In this case, it is only necessary to exclude the data of the terminal that the communication availability determination unit 5 has determined that communication is impossible from the output candidates. Further, in this case, when a transmission impossible notification is transmitted, the data output candidate may be changed to the next candidate.

[Slideshow execution process with BGM]
Next, an outline of a slide show with BGM realized by the remote operation system 100 will be described with reference to FIG. FIG. 15 is a diagram showing an outline of a slide show with BGM.

  As described above, the remote operation system 100 can perform slide show reproduction in which images stored in the remote operation device 300 are transmitted to the operation target device 200 and the operation target device 200 sequentially displays the images.

  On the other hand, in the slide show with BGM, as shown in the figure, the music stored in the remote operation device 300a is operated while the slide show is reproduced by transferring the image from the remote operation device 300a to the operation target device 200. The apparatus 200 performs streaming distribution, and the operation target apparatus 200 outputs the sound. Thereby, the user can enjoy slide show reproduction with BGM.

  Next, details of the slide show execution process with BGM executed in S7, S15, and S23 of FIG. 6 will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of a slide show execution process with BGM (instruction transmission terminal side, output device side, and data providing terminal side). Here, the flow of processing in the remote operation device 300a (instruction transmission terminal) and the remote operation device 300b (data providing terminal) will be described first, and then the flow of processing in the operation target device 200 (output device) will be described.

[BGM slide show execution processing (instruction transmission terminal side and data providing terminal side)]
When the slide show execution instructing unit 25 of the remote operation device 300a (instruction transmission terminal) confirms that there is an instruction to execute the slide show with BGM, the operation target device 200 receives images to be played as the slide show and data specifying information of the music to be output together with the slide show. (S101).

  Here, when the data specifying information is not transmitted (NO in S101), the slide show execution instructing unit 25 instructs the operation side data sharing processing unit 22 to execute the data sharing processing (on the instruction transmitting terminal side). Then, the data specifying information of the image and music output in the slide show with BGM is transmitted to the operation target device 200 (S3).

  After transmitting the data specifying information to the operation target device 200 in S3 or when the data specifying information has already been transmitted (YES in S101), the slide show execution instructing unit 25 operates the second communication unit 302 on the operation side. The BGM slide show execution instruction is transmitted to the operation target apparatus 200 via S (S102).

  In the slide show execution process (on the instruction transmission terminal side), it is not always necessary to transmit data specifying information of music and images to the operation target device 200. For example, there is a case where a slide show with BGM can be executed even when data specifying information of one of music or images is transmitted to the operation target device 200 or when data specifying information is not transmitted to the operation target device 200.

  That is, if music and / or image data specifying information is transmitted to the operation target device 200 from another terminal (for example, the remote operation device 300b) of the remote operation system 100, the remote operation device 300a executes the slide show with BGM. By transmitting only an instruction to the operation target device 200, a slide show with BGM can be executed. Also, the execution instruction of the slide show with BGM and the data selection condition are transmitted to the operation target device 200, and the operation target device 200 provides the data specifying information to each terminal (for example, the remote operation devices 300a and 300b) of the remote operation system 100. You may make it request.

  Note that after transmitting the slide show execution instruction with BGM, the remote operation device 300a also functions as a data providing terminal in the same manner as the remote operation device 300b. That is, when the operation target device 200 executes the data output process (output device side, S16), the remote operation devices 300a and 300b execute the data output process (data providing terminal side) (S24). In the example of FIG. 16, similarly to the example of FIG. 12, the data possession terminal confirmation process (output device side and data providing terminal side) is executed before the data output process (output device side and data providing terminal side). It is preferable.

  The remote operation devices 300a and 300b also function as streaming distribution terminals after the slide show execution instruction with BGM is transmitted. That is, the slide show execution instructing unit 25 of the remote operation device 300a or 300b confirms reception of the music distribution request (S103), instructs the streaming distribution unit 27 to send the requested music to the operation target device 200. Streaming distribution is performed (S104).

  Then, when the slide show execution instruction unit 25 of the remote operation device 300a or 300b receives a streaming end instruction from the operation target device 200 (S105), the remote operation device 300a or 300b instructs the streaming distribution unit 27 to perform streaming distribution to the operation target device 200. Is terminated (S106).

[Slideshow execution process with BGM (output device side)]
In the slide show execution process with BGM (output terminal side) executed by the operation target apparatus 200, the data sharing process (output apparatus side) is executed by the slide show execution unit 6 as necessary (S13). As a result, the operation target device 200 collects data and music data identification information that each terminal (in this case, the remote operation devices 300a and 300b) included in the remote operation system 100 permits sharing.

  Here, when the slide show execution unit 6 confirms the reception of the execution instruction of the slide show with BGM (S121), it generates the reproduction management information for images as shown in Table 4, and as shown in Table 5 below. Reproduction management information for simple music is generated. Table 5 is a table showing an example of the reproduction management information for music.

  As shown in Table 5, also in the reproduction management information for music, the reproduction order and the file name are associated with each other as in the reproduction management information for images. Therefore, the slide show execution unit 6 can specify the music file to be reproduced next by referring to the reproduction management information for the music. Here, it is assumed that information such as the playback time, artist name, and title of the music is included in the data specifying information (see Table 3).

  The reproduction management information for music may be data in which information for specifying data is associated with the reproduction order, and is not limited to the example in Table 5. For example, data in which a file name is associated with a reproduction order may be used as music reproduction management information, and data in which the above-described URL is associated with a reproduction order may be used as music reproduction management information.

  Next, the slide show execution unit 6 that has generated the reproduction management information for images and the reproduction management information for music plays the slide show using the generated reproduction management information for images (S16, S73, S74). As a result, the images stored in the remote operation device 300a or 300b are sequentially displayed on the operation target device 200.

  The slide show execution unit 6 also performs processing for outputting BGM at the same time as performing slide show reproduction. That is, when the slide show execution unit 6 generates the reproduction management information for music, the slide show execution unit 6 refers to the generated reproduction management information for music and transmits a music distribution request to the terminal storing the music to be output next. (S122).

  When the music distribution request is transmitted, as described above, the music is stream-distributed to the operation target device 200 from the terminal (remote operation device 300a or 300b) that has received the music distribution request (S103). Then, when the operation target device 200 receives the music to be streamed (S123), the streaming execution unit 7 performs streaming playback of the received music. Thereby, the delivered music is output from the audio output unit 202.

  Here, when the slide show execution unit 6 confirms the reception of the music that is streamed, the slide show execution unit 6 confirms the presence or absence of the next music with reference to the reproduction management information for the generated music (S124). If there is the next music (YES in S124), the slide show execution unit 6 returns to the process of S122 and transmits a music distribution request to the terminal storing the music.

  On the other hand, when there is no next music, that is, when the music currently received is the last music in the reproduction management information for the music (NO in S124), the slide show execution unit 6 sets the first music. The music distribution request is transmitted to the terminal that stores (S125, S122).

  As described above, in the slide show execution process with BGM (on the output device side) in FIG. 16, while the slide show is being executed, the music included in the reproduction management information for the music is reproduced one after another and the streaming reproduction is repeatedly performed. Thereby, since BGM always flows during slide show reproduction, it is possible to enjoy the slide show with BGM to the end.

  Then, the slide show execution process with BGM (on the output device side) in FIG. 16 ends when the slide show reproduction ends. That is, when the last image in the reproduction management information is output and the setting is not repeated, the streaming execution unit 7 sends to the terminal (remote operation device 300a or 300b) that is performing streaming distribution at that time. A streaming end instruction is transmitted to the terminal (S126). Then, by transmitting the streaming end instruction, the slide show execution process with BGM (output device side) ends.

[BGM selection method]
As described above, in the case where the music data specifying information is transmitted from the remote operation device 300 to the operation target device 200 by the data sharing process, the user of the remote operation device 300 uses the music stored in the remote operation device 300. The music to be provided as BGM is selected from the inside.

  However, the remote operation system 100 may automatically determine BGM music according to the images to be played back as a slide show. Below, the example which determines the music of BGM automatically is demonstrated. Here, the remote operation device 300a causes the operation target device 200 to select data for selecting photos to be played as a slide show, data specifying information indicating photos that can be provided by the remote operation device 300a, and a slide show with BGM. It is assumed that an execution instruction has been sent.

  When the slide show executing unit 6 of the operation target device 200 confirms reception of the data selection information, the data specifying information, and the execution instruction of the slide show with BGM, the data selection information for BGM selection is generated based on the received data selection information. To do. The data selection information for BGM selection can be determined using correspondence information as shown in Table 6 below, for example.

  Table 6 shows an example of correspondence information in which data selection information for photo selection is associated with data selection information for BGM selection. Note that the data selection conditions for photographs are the same as those shown in FIG. As shown in Table 6, each data selection condition for photographs is associated with a data selection condition for BGM related to each data selection condition.

  For example, when the photo data selection condition “same day as selected photo” is received, the slide show execution unit 6 uses the correspondence information in Table 6 to select the BGM data selection condition “purchased near that day”. "Song" can be determined. The slide show execution unit 6 can transmit the data specifying information of “song purchased near the day” by transmitting the data selection condition “song purchased near the day” to the remote control device 300. .

  Thereby, the slide show execution unit 6 can generate the reproduction management information for the music, transmits the music distribution request to the remote control devices 300a and 300b based on the generated reproduction management information, and transmits the requested music. You can receive streaming distribution.

  In addition, by using the correspondence information, the data selection condition for the photograph can be determined from the data selection condition for the BGM. That is, the BGM data selection condition is transmitted to the operation target device 200, and the operation target device 200 determines the photo data selection condition corresponding to the BGM data selection condition and transmits it to the remote operation device 300. It is also possible to perform slide show playback with BGM.

[Viewing images]
By the way, when browsing photos with a device with a relatively small display screen, such as a mobile phone or a digital camera, a thumbnail image of a photo is displayed in addition to a method of browsing stored images one by one. A method of allowing the user to select an image to be browsed is used. Since thumbnail images have a smaller image size and data capacity than actual photo data (high-resolution images), a plurality of thumbnail images can be displayed at high speed on a small display screen.

  However, in a general mobile phone, the number of thumbnail images that can be displayed at the same time is about 10 at most. In addition, when a plurality of thumbnail images are displayed on a small display screen, the displayed thumbnail images are extremely small, and it is difficult to check the contents of the images. Therefore, conventionally, it has been difficult to search for a desired image from a large number of images with an apparatus having a small display screen.

  Here, by using the remote operation system 100, even when the remote operation device 300 stores a large number of images, the user can easily select and view a desired image from the large number of images. can do. This will be described with reference to FIG. FIG. 17 is a diagram illustrating an example in which an image stored in the remote operation device 300d is displayed on the operation target device 200.

  As described above, when an image is stored in the remote operation device storage unit 310, the remote operation device 300 transmits the thumbnail image to the operation target device 200 as data specifying information. Further, the remote operation device 300 transmits an instruction to display the data specifying information to the operation target device 200.

  In S36 of the flowchart of FIG. 8, in addition to the display instruction and the data specifying information, the data selection condition is transmitted to the operation target device 200. Here, the image of the remote operation device 300d is browsed by the operation target device 200. Therefore, transmission of the data selection condition is not essential.

  When the data specifying information (including thumbnail images) transmitted by the remote operation device 300d is received by the operation target device 200, the thumbnail images are displayed in a list on the operation target device 200 as shown in the figure.

  In addition, the thumbnail image displayed on the operation target device 200 can be selected by an operation input to the remote operation device 300d. When a thumbnail image is selected, actual data (high resolution image) of the selected thumbnail image is transmitted from the remote operation device 300d to the operation target device 200 and displayed on the operation target device 200 (data output processing). ).

  Thus, in the remote operation system 100, thumbnail images of images stored in the remote operation device 300d can be displayed on the large screen of the operation target device 200. Therefore, the user of the remote operation device 300d can easily confirm what kind of image is stored in the remote operation device storage unit 310. In addition, since thumbnail images and high-resolution images are displayed on a large screen, it is possible to enjoy browsing the images with everyone on the spot.

[Example of transmitting data specifying information to remote operation device 300]
In the example described above, the data specifying information transmitted from the remote operation device 300 is collected in the operation target device 200 and used only on the operation target device 200. However, the operation target device 200 may transmit the collected data specifying information to the remote operation device 300. As a result, the data specifying information of the data shared by the remote operation system 100 can be confirmed on the remote operation device 300.

  This will be described with reference to FIG. FIG. 18 is a diagram illustrating an example of a display screen on the operation target device 200 and the remote operation devices 300a to 300d when the data specifying information is transmitted to the remote operation devices 300a to 300d. FIG. 18 shows an example in which an image is shared.

  As illustrated, the operation target device 200 displays thumbnail images of images shared by the remote operation system 100. In each of the remote operation devices 300a to 300d, thumbnail images of images shared by the remote operation system 100 are displayed.

  Therefore, the users of the remote operation devices 300a to 300d can check the images shared by the remote operation system 100 by looking at the display screen of the operation target device 200, and display the display screens of the remote operation devices 300a to 300d. The image shared by the remote operation system 100 can also be confirmed.

  In addition, even when the operation target device 200 is displaying a high-resolution image, it is possible to check images shared by the remote operation system 100 by looking at the display screens of the remote operation devices 300a to 300d. That is, when the data specifying information is transmitted to the remote operation device 300, the data shared by the remote operation system 100 can be confirmed and selected regardless of the display state of the operation target device 200. This is convenient, for example, when copying shared data.

  As shown in the figure, terminal identification information 31 is displayed on each thumbnail image displayed on the operation target device 200. The terminal identification information 31 is information for identifying a terminal (in this case, any one of the remote operation devices 300a to 300d) that stores actual data (high resolution image) corresponding to the thumbnail image.

  By displaying the terminal specifying information 31, the user of the remote operation system 100 can recognize the terminal storing the actual data (high resolution image) of the displayed thumbnail image. The terminal identification information 31 may also be displayed on the remote control devices 300a to 300d.

[Process when data specifying information is transmitted to remote operation device 300]
The flow of processing when transmitting the data specifying information to the remote control device 300 will be described based on FIG. FIG. 19 is a flowchart illustrating an example of processing performed in the remote operation system 100 when data specifying information is transmitted to the remote operation device 300. Here, for example, it is assumed that the data specifying information is transmitted from each terminal (remote operation devices 300a and 300b) to the operation target device 200 by the data sharing process shown in FIG.

  Since the remote operation devices 300a and 300b that have completed the data sharing process (instruction transmission terminal side) or the data sharing process (data providing terminal side), the data specifying information and the display state information are sent from the operation target device 200. The remote control devices 300a and 300b receive these (S141, S142).

  Here, the operation side data sharing processing unit 22 specifies the data stored in the own device from the received data specifying information. Then, the operation side data sharing processing unit 22 sends an instruction to the operation side display control unit 23 and causes the display unit 307 to display the received data specifying information based on the received display state information (S143).

  At this time, the operation-side data sharing processing unit 22 displays the data specifying information corresponding to the specified data (data stored in the own device) and the other data specifying information in an identifiable manner. Thereby, the user of the remote operation device 300a and the user of the remote operation device 300b can easily check the data stored in the terminal owned by the user among the data shared by the remote operation system 100. Can do.

  The method for displaying the data specifying information corresponding to the specified data and the other data specifying information in an identifiable manner is not particularly limited. For example, the display color, the display field, the font, the brightness, the color tone, etc. may be changed. By displaying a mark for identifying both, it is possible to display both in an identifiable manner.

  The display state information is information indicating data being output by the operation target device 200. That is, when displaying the data specifying information, the operation side data sharing processing unit 22 displays the data specifying information corresponding to the data being output by the operation target device 200 so as to be distinguishable from the other data specifying information.

  Here, it is assumed that the operation side data sharing processing unit 22 displays a cursor for selecting the data specifying information on the data specifying information output in the operation target device 200. Thereby, the users of the remote operation devices 300a and 300b can confirm the data being output by the operation target device 200 on the display of the display unit 307.

  Note that the operation-side data sharing processing unit 22 only needs to display the data specifying information displayed on the operation target device 200 and other data specifying information in an identifiable manner, and is not limited to the example of displaying the cursor. For example, the data specifying information displayed on the operation target device 200 and other data specifying information may be distinguishable by changing the display color, display column, font, brightness, and color tone. Further, by using characters, symbols, or the like, the data specifying information displayed on the operation target device 200 and other data specifying information may be displayed in an identifiable manner.

  In this way, in the process of FIG. 19, the data specifying information is collected from the remote operation devices 300a and 300b to the operation target device 200, and the collected data specifying information is sent to the remote operation devices 300a and 300b. The data specifying information is also displayed on the display unit 307 in the remote operation devices 300a and 300b. Accordingly, the users of the remote operation devices 300a and 300b can confirm what data is shared in the remote operation system 100 by looking at the display unit 307 of the remote operation devices 300a and 300b.

  Further, according to the above processing, since the display state information is transmitted from the operation target device 200, the remote operation devices 300a and 300b display the data specifying information in conjunction with the data output from the operation target device 200. Can do. The display state information may include information indicating the arrangement of the data specifying information displayed by the operation target device 200. In this case, the arrangement of the data specifying information displayed on the remote operation devices 300a and 300b can be the same as that of the operation target device 200.

  Further, according to the above processing, the data specifying information corresponding to the data stored in each terminal and the other data specifying information are displayed so as to be identifiable, so that the user of the remote operation device 300a and the remote operation The user of the device 300b can easily check the data stored in the terminal owned by the user among the data shared by the remote operation system 100.

  Then, the remote operation devices 300a and 300b transmit an operation instruction to the operation target device 200 (S144), thereby designating the data shared by the remote operation system 100 to be output to the operation target device 200 (data). Output processing), the specified data can be taken into the terminal (data copy processing).

  Specifically, when the data specifying information displayed on the display unit 307 is selected and an input for determination is made on the operation unit 308, the slide show execution instructing unit 25 displays the determined data specifying information. Is transmitted to the operation target device 200. When the data specifying information displayed on the display unit 307 is selected and an input to copy is made to the operation unit 308, the copy executing unit 28 sets the data corresponding to the determined data specifying information. An instruction for requesting a copy of is sent to the operation target device 200.

  Note that FIG. 19 shows an example in which the remote operation device 300b transmits an operation instruction, but any terminal that is connected to the operation target device 200 by communication is an operation instruction transmission source terminal Can be. FIG. 19 shows an example in which the remote operation device 300a executes the data output process (on the data providing terminal side). However, any terminal can be used as long as it is a terminal connected to the operation target device 200 in communication. It can be an execution terminal for output processing (data providing terminal side).

  Next, processing on the operation target device 200 side will be described. When the operated-side data sharing processing unit 3 receives the data specifying information, the operated-side data sharing processing unit 3 instructs the operated-side display control unit 4 to display the data specifying information and the terminal specifying information on the display unit 204 (S151). This makes it easy to see who owns the shared data.

  Subsequently, the operated-side data sharing processing unit 3 transmits the data specifying information to each terminal (S152). In addition, the operated-side data sharing processing unit 3 also transmits the current display state information to each terminal (S153). Then, the operated-side data sharing processing unit 3 waits for an operation instruction to be transmitted from each terminal (S154). When the operation target device 200 does not output data, the operated-side data sharing processing unit 3 waits for an operation instruction to be transmitted from each terminal without transmitting display state information.

  When the operated-side data sharing processing unit 3 confirms that the operation instruction has been received (YES in S154), the received instruction content is confirmed (S155). When the received instruction is a data output instruction, the operated-side data sharing processing unit 3 instructs the slide show execution instruction unit 25 to execute the data output process (output device side) (S16). As a result, the requested data is output from the operation target device 200.

  When the data output process (output device side) is executed, the data output by the operation target device 200 changes, and the display state information also changes accordingly. Therefore, the operated-side data sharing processing unit 3 issues an instruction to execute the data output process (on the output device side), returns to the process of S153, and transmits the current display state information to each terminal.

  Thereby, the position of the cursor displayed on the display screen of each terminal moves to the position of the data specifying information corresponding to the data currently output from the operation target device 200. As a result, the user of each terminal can recognize at a glance which data is currently output from the operation target device 200.

  On the other hand, in S155, when the received instruction content is data copy, the operated-side data sharing processing unit 3 instructs the copy request transfer unit 8 to execute data copy processing (S156). After the data copy process is completed, the process returns to S154 and waits for reception of an operation instruction. Details of the data copy process will be described later.

〔Concrete example〕
A specific example of displaying an image according to the processing of the flowchart of FIG. 19 will be described based on FIGS. 20 to 23, it is assumed that the remote operation devices 300a to 300d are connected to the operation target device 200 by communication, but how many terminals are connected to the operation target device 200 by communication. There may be.

  First, the display state after the processing of S151 to S153 and S141 to S143 in FIG. 19 will be described based on FIG. FIG. 20 is a diagram illustrating an example of display states of the operation target device 200 and the remote operation devices 300a to 300d when data specifying information is transmitted from the operation target device 200 to the remote operation devices 300a to 300d.

  As described above, on the display screen of the operation target device 200, among the data stored in the remote operation devices 300a to 300d, the data specifying information indicating the data related to sharing and the owner of the image indicated by each data specifying information (Terminal storing image) is displayed.

  Here, since it is assumed that an image is shared, a thumbnail image of the shared image is displayed on the display screen of the operation target device 200. Further, terminal specific information (terminal specific information 31) as shown in FIG. 17 is displayed together with each thumbnail image.

  Then, the operation target device 200 transmits the data specifying information and the display state information to each of the remote operation devices 300a to 300d. Thereby, as shown in the drawing, the data specifying information (thumbnail image) is displayed on each of the remote control devices 300a to 300d. At this time, the terminal specifying information may be displayed together with each thumbnail image in the remote control devices 300a to 300d.

  Next, the display state when the processing after S154 in FIG. 19 is performed when data output is performed will be described with reference to FIG. FIG. 21 illustrates an example of display states of the operation target device 200 and the remote operation devices 300a to 300d when the remote operation device 300b transmits an image display instruction and the operation target device 200 displays an image for which the display instruction is received. FIG.

  As shown in the figure, here, the remote operation device 300b changes the operation target device 200 to No. It is assumed that a display instruction for 17 images (the 17th image displayed on the display screen) has been transmitted (STEP 1). As shown in FIG. The terminal storing the 17 images is “A”, that is, the remote control device 300a.

  No. The operation target device 200 that has received the 17 image display instruction sends an image transmission request to the remote operation device 300a storing the image (STEP 2), and the remote operation device 300a responds to this request by No. . 17 images are transmitted to the operation target device 200 (STEP 3).

  As a result, as shown in FIG. 17 images are displayed on the large screen of the operation target device 200 (STEP 4). The operation target device 200 transmits display state information to each terminal after executing the data output process (on the output device side). Then, the remote control devices 300a and 300b that have received the display state information move the selection position (cursor position) according to the received display state information (STEP 5).

  Further, although not shown in the example of FIG. 19, a slide show can be executed even when the operation target device 200 transmits data specifying information to each terminal. This will be described with reference to FIG. FIG. 22 is a diagram illustrating an example of a display screen when a slide show is executed when the operation target device 200 transmits data specifying information to each terminal.

  As illustrated, since the operation target device 200 transmits the data specifying information and the display state information to each terminal, the same screen as the operation target device 200 is displayed on the remote operation devices 300a to 300d.

  When a slide show execution instruction is transmitted from any of the remote operation devices 300a to 300d to the operation target device 200, the operation target device 200 generates reproduction management information, and remote operation is performed according to the generated reproduction management information. An image transmission request is sent to the devices 300a to 300d.

  In the illustrated example, the operation target device 200 displays an image stored in the remote operation device 300d. Here, when the operation target device 200 displays an image stored in the remote operation device 300d, display state information is transmitted to the remote operation devices 300a to 300d.

  Thereby, as shown in the figure, the cursor is displayed on the image being displayed on the operation target device 200 in each of the remote operation devices 300a to 300d. As described above, when a slide show is performed, the images displayed by the operation target device 200 are sequentially switched. Therefore, the position of the cursor in each of the remote operation devices 300a to 300d is also moved accordingly.

  Accordingly, the user of the remote operation device 300a to 300d can determine which image is currently displayed on the operation target device 200 among the images displayed as thumbnails on the own device, and which terminal is displayed next. It becomes possible to easily recognize which image of the image.

  Further, in the illustrated example, since it is assumed that the terminal storing the image to be displayed next is the remote operation device 300c, a prior notice is transmitted from the operation target device 200 to the remote operation device 300c ( (See FIG. 13). Then, in the remote control device 300c that has received the advance notification, for example, a screen as shown in FIG.

[Data copy processing]
Next, an outline of the data copy process will be described with reference to FIG. FIG. 23 is a diagram showing an outline of the data copy process. FIG. 23 shows an example in which the remote operation device 300b copies the data stored in the remote operation device 300a. Here, processing executed by the remote operation device 300b will be described first, and then processing executed by the operation target device 200 and the remote operation device 300a will be described.

  The remote operation device 300b (copy request source terminal) transmits a copy request to the operation target device 200 when data to be copied is selected from the data for which the data specifying information is displayed. Next, the operation target device 200 that has received the copy request transfers the copy request to the remote operation device 300a that stores the data to be copied.

  When receiving the copy request, the remote operation device 300a (copy request destination terminal) confirms with the user whether or not copying is possible. Here, when copying is possible, the remote operation device 300a transmits the data requested to be copied to the remote operation device 300b. The data transmission at this time may be performed by P2P (peer-to-peer) or may be performed via the operation target device 200.

  As described above, since the data specifying information of the data shared by the remote operation system 100 is transmitted to the remote operation device 300, the data specifying information can be designated and the data can be copied in the remote operation device 300. .

  Next, the flow of data copy processing will be described with reference to FIG. FIG. 24 is a flowchart showing an example of the data copy process. Here, as in the example of FIG. 23, an example will be described in which the remote operation device 300b copies data stored in the remote operation device 300a.

[Processing of Remote Operation Device 300b (Copy Request Source Terminal)]
When an input to start data copy is made to the operation unit 308 of the remote operation device 300b, the copy execution unit 28 causes the user to select data to be copied from the data specifying information received from the operation target device 200 ( S161). When data to be copied is selected, the copy execution unit 28 transmits a copy request for the selected data to the operation target device 200 (S162).

  When the copy execution unit 28 transmits a copy request, it waits for reception of the requested data (S163). When the reception of the requested data is confirmed (YES in S163), the copy execution unit 28 confirms whether all the requested data has been received (S164), and has received all the requested data. If YES in step S164, the data copy process ends.

  If the remote operation device 300a rejects the copy request, a disapproval notice is transmitted from the remote operation devices 300a to 300b. When the copy execution unit 28 confirms the reception of the non-permission notice, the copy execution unit 28 determines that the data reception from the remote operation device 300a is finished, and finishes the data copy process. However, when a copy request is transmitted to another terminal, the copy execution unit 28 continues to wait for reception of the requested data.

  On the other hand, if the requested data includes data that has not been confirmed to be received yet (NO in S164), the copy execution unit 28 returns to the process of S163 and waits for reception of the requested data. If the end of data reception cannot be confirmed even after a predetermined time has elapsed, the copy execution unit 28 determines that the copy request destination terminal is absent and ends the data copy process.

  In the data copy process executed by the remote operation device 300b, for example, by displaying a screen as shown in FIG. 25, the user can perform an input operation. FIG. 25 is a diagram illustrating an example of an operation screen in the data copy process. In the illustrated example, an example of a display screen when an image is copied is shown, but the data to be copied may be data shared in the remote operation system 100 and is not limited to an image.

  Here, since it is assumed that the data specifying information is transmitted from the operation target device 200 to each terminal included in the remote operation system 100, the remote operation device 300b includes a data item as shown in FIG. Specific information is displayed. Since it is assumed here that an image is copied, the displayed data specifying information is a thumbnail image. Further, in the illustrated example, selection items for selecting a submenu in addition to thumbnail images are displayed as soft keys.

  Here, when an input operation for selecting a submenu is performed on the operation unit 308, the second screen in FIG. As shown in the figure, selection items for slide show, information display, and copy are displayed as submenus. When a slide show is selected here, a slide show execution process is performed. When information display is selected, detailed data information is displayed on the display unit 307. For example, when the target data is a photograph, the shooting date and time are displayed. Note that information such as the shooting date and time is included in the data specifying information.

  On the other hand, when copy is selected, the operation screen changes to the third image in FIG. As shown in the figure, selection items for selecting whether to copy the currently selected image, select an image to copy, or copy all data are displayed as soft keys.

  Here, when the selection item of copying all data is selected, a copy request for all data corresponding to the data specifying information received from the operation target device 200 is transmitted. Thereby, since the requested data is received sequentially, the operation screen transitions to the fourth image in FIG.

  As shown in the figure, it is preferable to display the copy progress information on the operation screen because the user can grasp the approximate time required until the end of the copy. In the illustrated example, a selection item for interrupting copying is displayed. When this item is selected, the copy execution unit 28 instructs the data transmission source terminal to stop data transmission, and ends the data copy process.

  When all the requested images are received, the operation screen transitions to the fifth image in FIG. As a result, the user can confirm that the copying has ended without any problem. Here, when a part of the requested image cannot be received, a message indicating that the requested image could not be received and a thumbnail image of the image that could not be received may be displayed. As a result, the user can easily recognize an image that has failed to be copied.

[Processing of Operation Target Device 200 and Remote Operation Device 300a (Copy Request Destination Terminal)]
Next, processing executed by the operation target device 200 and the remote operation device 300a will be described. When the copy request transfer unit 8 of the operation target device 200 confirms the reception of the copy request (S171), it confirms the data requested to be copied and the terminal storing the data. Then, the copy request transfer unit 8 transfers the received copy request to the terminal storing the requested data (S172). With the transfer of the copy request, the data copy process of the operation target apparatus 200 ends.

  When the content transmission control unit 26 of the remote operation device 300a confirms the reception of the copy request (S181), the user of the remote operation device 300 selects whether to permit the copy (S182). For example, when there is an image copy request, the content transmission control unit 26 permits the copy by instructing the operation side display control unit 23 to display an image as shown in FIG. 26 on the display unit 307. Whether or not to do so may be selected.

  FIG. 26 is a diagram showing an example of a screen for allowing the user to select whether or not copying is possible. In the example of the screen shown in the upper side of the figure, a message indicating that there is a request for copying the image displayed on the large screen (operation target device 200) from the remote operation device 300b is displayed. As a result, the user of the remote operation device 300a can recognize that the data requested to be copied is all the images displayed on the operation target device 200 and the copy request source is the remote operation device 300b. it can. Therefore, the user can determine whether or not copying is possible based on such information.

  Further, as shown in the figure, since an item for permitting copying and an item for rejecting copying are displayed to be selectable by the user, the user of the remote operation device 300a can select any of the above items. By selecting, copying can be permitted or rejected.

  And when copying is permitted, the content transmission control part 26 should just display a screen as shown to the lower side of the figure, for example. As shown in the figure, by displaying a message indicating that the image transfer is being executed, the user can recognize that the image transfer is in progress.

  In addition, when the user of the remote operation device 300a needs to leave the place, it may be necessary to interrupt the image transfer. Therefore, as shown in the figure, the content transmission control unit 26 displays an item for interrupting the transfer of the image so that the user can select it so that the user of the remote operation device 300a can interrupt the transfer of the data. preferable.

  Here, the description returns to the flowchart. If permission to copy is selected (YES in S182), the content transmission control unit 26 transmits the requested data to the remote control device 300b that is the request source of the data (S183). On the other hand, when it is selected that copying is not permitted (NO in S182), the content transmission control unit 26 sends a non-permission notification indicating that copying is not permitted to the remote control device that is the request source of the data. It transmits to 300b (S184).

  As in the example of FIG. 14, the content transmission control unit 26 may transmit data based on the remaining battery level of the remote operation device 300a, other tasks currently being executed by the remote operation device 300a, and the like. If it is determined that it is not preferable, the user may be automatically notified of the disapproval notice without selecting whether to permit copying.

[Modification]
As described above, in the remote operation system 100, data that cannot be output by the operation target device 200 is not shared. Thereby, it is possible to prevent unnecessary data from being transmitted from the remote operation device 300 to the operation target device 200.

  However, in the above configuration, there is a problem in that data that cannot be output from the remote operation device 300 storing the data and the operation target device 200 among the data stored in the remote operation device 300 cannot be output. is there.

  For example, when data is downloaded from the remote operation device 300 via the Internet, when this data cannot be output by the remote operation device 300 and cannot be output by the operation target device 200, the remote operation device 300 The user cannot output the downloaded data.

  The above problem can be solved, for example, as follows. That is, each of the remote operation devices 300 transmits reproducible data information indicating a file format that can be output by each terminal to the operation target device 200.

  Next, the operation target device 200, when the reproducible data information includes a file format that the device itself cannot output, the communication address of the remote operation device 300 that can output the file format that the device itself cannot output And the file format that the remote operation device 300 can output but the operation target device 200 cannot output are stored in association with each other.

  Subsequently, the operation target device 200 transmits a file format that can be output by either the device itself or the remote operation device 300 included in the remote operation system 100 to each remote operation device 300 as reproducible data information. That is, in this case, in addition to data that can be output by the operation target device 200, data that can be output by any of the remote operation devices 300 is shared.

  When the operation target device 200 receives an instruction to output data that cannot be output by the operation target device 200, the operation target device 200 transmits the data to the remote operation device 300 that can output the data.

  As a result, data that cannot be output by the operation target device 200 is output from the remote operation device 300. Therefore, it is possible to output data that neither the remote operation device 300 storing the data nor the operation target device 200 can output. It becomes possible.

[Modification]
As described above, in the remote operation system 100, data that cannot be output by the operation target device 200 is not shared. Thereby, it is possible to prevent unnecessary data from being transmitted from the remote operation device 300 to the operation target device 200.

  However, in the above configuration, there is a problem in that data that cannot be output from the remote operation device 300 storing the data and the operation target device 200 among the data stored in the remote operation device 300 cannot be output. is there.

  For example, when data is downloaded from the remote operation device 300 via the Internet, when this data cannot be output by the remote operation device 300 and cannot be output by the operation target device 200, the remote operation device 300 The user cannot output the downloaded data.

  The above problem can be solved, for example, as follows. That is, each of the remote operation devices 300 transmits reproducible data information indicating a file format that can be output by each terminal to the operation target device 200.

  Next, the operation target device 200, when the reproducible data information includes a file format that the device itself cannot output, the communication address of the remote operation device 300 that can output the file format that the device itself cannot output And the file format that the remote operation device 300 can output but the operation target device 200 cannot output are stored in association with each other.

  Subsequently, the operation target device 200 transmits a file format that can be output by either the device itself or the remote operation device 300 included in the remote operation system 100 to each remote operation device 300 as reproducible data information. That is, in this case, in addition to data that can be output by the operation target device 200, data that can be output by any of the remote operation devices 300 is shared.

  When the operation target device 200 receives an instruction to output data that cannot be output by the operation target device 200, the operation target device 200 transmits the data to the remote operation device 300 that can output the data.

  As a result, data that cannot be output by the operation target device 200 is output from the remote operation device 300. Therefore, it is possible to output data that neither the remote operation device 300 storing the data nor the operation target device 200 can output. It becomes possible.

  In the remote operation system 100, the remote operation device 300 performs both provision of data and display control for the operation target device 200, and the operation target device 200 outputs data. Not limited. That is, a system that has the same effect as the remote operation system 100 can be configured as long as the system includes a terminal that provides data, a terminal that outputs data, and a terminal that instructs data output. .

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Finally, each block of the operation target device 200 and the remote operation device 300, in particular, the operation target device control unit 203 and the remote operation device control unit 306 may be configured by hardware logic or using a CPU as follows. It may be realized by software.

  That is, the operation target device 200 or the remote operation device 300 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and a RAM that expands the program. (Random access memory), a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is to enable a computer to read program codes (execution format program, intermediate code program, source program) of control programs for the operation target device 200 and the remote operation device 300 that are software for realizing the functions described above. This can also be achieved by supplying the recorded recording medium to the operation target device 200 or the remote operation device 300, and the computer (or CPU or MPU) reads and executes the program code recorded on the recording medium. .

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the operation target device 200 or the remote operation device 300 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  In the remote operation system of the present invention, only data that can be output by the operation target device can be shared among a plurality of remote operation devices and output to the operation target device. Therefore, the present invention can be applied to any system in which a data output device capable of outputting data and a data supply device storing data to be provided to the data output device are communicably connected.

  In particular, in recent years, mobile phones have been able to acquire various content data, and televisions have been increasing in screen size. Therefore, the present invention is applied to a system in which a mobile phone and a television are communicably connected. By applying, it is possible to provide a system in which various contents can be enjoyed on a large TV screen.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates an embodiment of the present invention, and is a block diagram illustrating main components of an operation target device and a remote operation device. It is a block diagram which shows the principal part structure of the remote operation system containing the said operation object apparatus and a remote operation apparatus. It is a figure which shows an example of the system configuration | structure of the said remote control system. In the said remote operation system, it is a figure which shows the outline | summary of the process which makes the operation object apparatus output the data which the remote control apparatus stores. It is a figure which shows the specific example in which data are output in the said remote control system. It is a flowchart which shows an example of the process from the sharing of data to an output in the said remote control system. It is a figure which shows an example of the screen displayed on the said remote control apparatus. It is a flowchart which shows an example of the data sharing process performed with the said remote control system. It is a figure which shows an example of a display screen when performing a data sharing process (instruction transmission terminal side). It is a figure which shows an example of the display screen which an operation target apparatus and a remote control apparatus display in the data sharing process (output device side) performed with the said remote control system. It is a figure which shows an example of the screen which a remote operation apparatus displays in the data sharing process (data provision terminal side) performed with the said remote operation system. It is a flowchart which shows an example of the slide show execution process performed with the said remote control system. It is a flowchart which shows an example of the data possession terminal confirmation process (the data provision terminal side and output device side) performed with the said remote operation system. It is a figure which shows an example of the display screen for making a user select whether the transmission of the requested | required data is possible in the said data possession terminal confirmation process. It is a figure which shows the outline | summary of the slide show with BGM. It is a flowchart which shows an example of the slide show execution process with BGM (the instruction transmission terminal side, the output device side, and the data provision terminal side). It is a figure which shows the example which displays the image stored in the said remote control apparatus on the said operation target apparatus. It is a figure which shows an example of the display screen in an operation target apparatus and a remote control apparatus when the said operation target apparatus transmits data specific information to the said remote control apparatus. It is a flowchart which shows an example of the process performed with a remote control system when transmitting data specific information to a remote control device. In the said remote operation system, it is a figure which shows an example of the display state of an operation target apparatus and a remote control apparatus when data specific information is transmitted to the remote control apparatus from the operation target apparatus. It is a figure which shows an example of the display state of an operation target apparatus and a remote control apparatus when the said remote control apparatus transmits the display instruction of an image, and the said operation target apparatus displays the image which received the display instruction. It is a figure which shows an example of a display screen when a slide show is performed when the said operation object apparatus transmits data specific information to each terminal. It is a figure which shows the outline | summary of the data copy process performed in the said remote control system. It is a flowchart which shows an example of the said data copy process. It is a figure which shows an example of the operation screen which a remote control apparatus displays in the said data copy process. It is a figure which shows an example of the screen for a user to select whether copying is possible, which a remote control apparatus displays in the said data copy process.

Explanation of symbols

3 Operated data sharing processor (data sharing means)
6 Slide show execution unit (data transmission request means, data display means, output control means)
7 Streaming execution unit (streaming playback means)
100 Remote operation system (data output system)
200 Operation target device (data output device)
300 Remote control device (data providing device)

Claims (10)

A data output device that receives and outputs data transmitted by a data providing device,
Streaming playback means for streaming playback of data streamed from the data providing device;
Data display means for receiving and displaying data different from the data reproduced by the streaming reproduction means from the data providing device;
A data output device comprising: output control means for controlling the streaming reproduction means and the data display means to perform streaming reproduction and data display at the same time. The streaming playback means is for streaming playback of audio data,
2. The data output device according to claim 1, wherein the data display means displays image data. Data sharing means for requesting the data providing apparatus to transmit a list of image data or audio data that can be provided by the data providing apparatus;
3. The data output apparatus according to claim 2, further comprising a data transmission requesting unit that requests the data providing apparatus to transmit or stream the data included in the received list. The data sharing means requests the data providing apparatus to transmit a list of image data and audio data that can be provided by the data providing apparatus,
The data transmission request means determines the output order of the image data included in the received list and the output order of the audio data, requests data transmission and streaming delivery in the determined output order,
4. The output control unit according to claim 3, wherein the output control unit controls the streaming reproduction unit and the data display unit to perform streaming reproduction in the order received and simultaneously display data in the order received. Data output device.   The data transmission requesting means, when the data providing apparatus determines that the streaming reproduction means or the data display means cannot provide data to be output next, selects a data candidate for requesting the transmission. 5. The data output device according to claim 4, wherein the data output is changed to data to be output next to the data. There are a plurality of the data providing devices,
The data requesting unit requests the data providing apparatus that is a transmission source of the list to transmit or stream the data included in the list received from at least one of the plurality of data providing apparatuses. The data output device according to any one of claims 3 to 5.   When the data sharing means receives a data selection condition, which is a condition for selecting image data or audio data included in the list, from one of the plurality of data providing devices, the data sharing means other than the transmission source of the data selection condition 7. The data output apparatus according to claim 6, wherein the received data selection condition is transmitted to the data providing apparatus and a list of image data or audio data selected according to the data selection condition is requested to be transmitted. . A storage unit that associates and stores audio data selection conditions that are conditions for selecting audio data to be included in the list and image data selection conditions that are conditions for selecting image data to be included in the list;
The data sharing means is configured to receive the audio data selection condition received with reference to the storage unit when the audio data selection condition or the image data selection condition is received from one of the plurality of data providing devices. Alternatively, the image data selection condition or sound data selection condition corresponding to the image data selection condition and the received sound data selection condition or image data selection condition are transmitted to each of the plurality of data providing apparatuses and transmitted. 8. The data output apparatus according to claim 7, wherein a request is made to transmit a list of audio data and image data selected according to the audio data selection condition and the image data selection condition.   The data output device according to any one of claims 1 to 8, and when receiving a data transmission request from the data output device, the requested data is transmitted to the data output device, and the data output device A data output system comprising: a data providing device for streaming the requested data to the data output device when a data streaming delivery request is received from the data output device. A data output device control method for receiving and outputting data transmitted by a data providing device,
A streaming playback step for streaming playback of data streamed from the data providing device;
A data display step of receiving and displaying data different from the data to be streamed from the data providing device;
A method for controlling a data output apparatus, comprising: an output control step for simultaneously performing the streaming reproduction step and the data display step.

Images