JP2009118448A5 - - Google Patents

Description

Image data receiving device, operating device, operating system, data structure of image data, control method, operating method, program, and recording medium

  The present invention relates to an image data receiving device that receives image data, an operating device that operates the image data receiving device, and an operating system including them. The present invention also relates to a data structure of image data used for operating the image data receiving apparatus. Furthermore, the present invention relates to a control method in which the image data receiving device controls the device itself, and an operation method in which the operating device operates the image data receiving device. The present invention also relates to a program for operating a computer as an image data receiving device, a program for operating a computer as an operating device, and a recording medium on which these programs are recorded.

  With the widespread use of digital cameras, particularly camera-equipped mobile phones having a digital camera function, it has become common to handle photographs as image data. Corresponding to this, devices such as a television that captures image data from a digital camera or a mobile phone and displays the captured image data, and a printer that prints the captured image data have been widely used.

  In addition, a technique for transferring image data by wireless communication between these apparatuses is also widespread. As a protocol for transferring image data by wireless communication, a high-speed infrared communication protocol such as IrSimple (registered trademark) or a short-range wireless communication protocol such as Bluetooth (registered trademark) is generally used. By using such wireless communication, it is possible to easily display a photograph taken with a mobile phone on a television.

  In addition, for televisions having an image data receiving function for receiving image data by infrared communication, whether the received infrared signal is image data sent from a mobile phone or the like, or an operation signal sent from an infrared remote controller. If it is an operation signal, there is one that controls its own device accordingly.

  By the way, if a television having an image data receiving function has an image processing function, there is a use case in which a photograph transmitted from a mobile phone is displayed on the television and image processing is performed on the photograph displayed on the television. is assumed.

  However, in such a use case, the user first transmits the image data to the TV using a mobile phone, then changes the mobile phone to an infrared remote controller, and further executes desired image processing using the infrared remote controller. It is necessary to operate the television so that complicated operations are required.

As a technique for solving such a problem only in a special case, a display processing apparatus described in Patent Document 1 is known. The display processing apparatus described in Patent Literature 1 receives image data, and displays an image of the received image data while scrolling or enlarging / reducing according to image display control information inserted in the received image data. To do. That is, it is possible to cause the display processing device to perform image processing such as scrolling and enlargement / reduction only by transmitting the image data in which the image display control information is inserted to the display processing device.
JP2004-310744 (released on November 4, 2004)

  When operating a conventional television having an image data receiving function, as described above, the user transmits an image data transmission device (such as a mobile phone) for transmitting image data to the television, and an infrared remote controller for operating the television. Both of them must be used, and there is a problem that the operation is complicated and user-friendliness is poor.

  Such a problem can be solved by transmitting an operation signal equivalent to that of the infrared remote controller from the mobile phone to the television. However, in this case, the mobile phone that operates the television needs to have a function of transmitting an operation signal in addition to the image data transmission function. That is, the television cannot be operated by a general mobile phone that does not have a function of transmitting an operation signal, which is inconvenient for the user. In general, the infrared remote control signal is not suitable for transmitting a large amount of data, and there is a problem that a complicated operation cannot be designated.

  In addition, even if an operation signal equivalent to that of an infrared remote controller can be transmitted from a mobile phone as described above, if an attempt is made to operate a TV in conjunction with a mobile phone and an Internet server, the server can operate the mobile phone. In order to transmit a signal, there was a problem that it was necessary to add a function capable of processing a special communication protocol to the server and the mobile phone.

  In addition, since the operation signal is not information that can be intuitively understood by the user, there is a problem that when a plurality of operation signals are stored in the mobile phone, it is difficult to select a target operation signal from among them. This problem also occurs in a configuration in which operation signals received on the television side are accumulated and the user selects later.

  In addition, the display processing device described in Patent Literature 1 performs processing according to image display control information inserted into image data, on an image displayed based on received image data. Therefore, even if the technique described in Patent Document 1 is applied to a television, the processing that can be executed by the television is limited to the image processing on the image of the image data transmitted to the television. The TV cannot be operated freely.

  Here, for convenience of explanation, the problem of the prior art has been described by taking a television as an example, but the same problem exists in general image data receiving apparatuses having an image data receiving function. For example, with respect to a printer that prints image data received from a digital camera, printing cannot be stopped from the digital camera. To stop printing, the printer can be operated directly or connected to the printer. There is a problem that it is inconvenient because it is necessary to operate the computer.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an image data receiving apparatus that can be operated freely even from an operating apparatus having only an image data transmitting function.

In order to solve the above-described problem, an image data receiving apparatus according to the present invention stores image data stored in an area for storing meta information in which process specifying information for specifying a process to be executed by the apparatus is stored. Image data receiving means for receiving from the outside, and control means for controlling the device itself to execute the process designated by the process designation information stored in the received image data immediately upon receiving the image And the processing designation information specifies at least image processing for an image other than the image stored in the received image data or processing other than image processing.

Further, in order to solve the above problems, a control method according to the present invention, the image data receiving device is a control method for controlling the own device, process specifying information for specifying a process which should be executed by its own device is meta The image data stored in the area for storing information is designated by the receiving step for receiving from the outside , and immediately after the image data is received, specified by the processing designation information stored in the received image data. And a control step for controlling the device to execute the processed processing. The processing designation information is image processing for an image other than the image stored in the received image data, or other than image processing. It is characterized by specifying at least the processing of.

  According to the above configuration, when the image data in which the process designation information is stored is received, the image data receiving apparatus controls the own apparatus to execute the process designated by the process designation information. Therefore, if the image data receiving apparatus wants to execute a certain process, the image data receiving apparatus can receive the image data storing the process designation information designating the process. Then, the process can be executed. For this reason, the user can operate the image data receiving apparatus from the outside by using the operating apparatus that transmits the image data in which the processing designation information is stored.

  Moreover, when the image data receiving apparatus receives the image data storing the process designation information, the image data receiving apparatus controls itself so as to immediately execute the process designated by the process designation information. Therefore, when the image data receiving apparatus receives the image data storing the process specifying information, the image data receiving apparatus executes the process specified by the process specifying information without delay. For this reason, the user receives the image data as if he / she operated the image data receiving device using an infrared remote controller using the operating device that transmits the image data storing the processing designation information. There is an effect that the apparatus can be operated from the outside.

  Furthermore, according to the above configuration, any device that can transmit image data in which processing designation information is stored can function as an operating device for operating the image data receiving device. The effect of becoming.

  In addition, as a communication protocol used for the transmission / reception of the image data, generally, a protocol that can transmit a large amount of data at a high speed and reliably is adopted as compared with a communication protocol for a remote control that transmits / receives a simple operation signal. Yes. Therefore, according to the said structure, there exists an effect that the complicated control which requires a lot of data can be performed.

  The image data receiving apparatus may be any apparatus provided with at least the means described in the claims, and the process specified by the process specifying information and controlled in execution by the image data receiving apparatus is as follows. Any processing that can be executed by the apparatus and that is other than image processing, or that can be executed by the apparatus and that is an image processing for an image other than the image stored in the received image data. Any processing may be used. In other words, the processing that can be executed by the apparatus may be any processing other than the image processing on the received image.

For example, if the image data receiving device is a television receiver that receives broadcast content broadcast on a specified channel and outputs video and / or audio of the broadcast content, the broadcast content is received. It is possible to control the channel to be switched to the channel designated by the processing designation information. Further, if the television receiver has a viewing reservation function or a recording reservation function, execution of the viewing reservation or recording reservation registration process may be controlled based on the above processing designation .

Also, the image data receiving device, if has a data communication function, it is also possible to configure the data communication function to be controlled on the basis of the image data.

  That is, the image data receiving apparatus according to the present invention is a data receiving means different from the image data receiving means, further comprising a data receiving means for receiving data from another communication device, and the control means includes the processing described above. You may comprise so that the said data receiving means may be controlled to receive the data designated by the said process designation | designated information from the communication apparatus designated by designation | designated information, or a predetermined communication apparatus.

The image data receiving apparatus according to the present invention further includes data transmitting means for transmitting data to another communication apparatus, and the control means is a communication apparatus designated by the process designation information or predetermined. You may comprise so that the said data transmission means may be controlled so that the data designated by the said process designation | designated information may be transmitted to a communication apparatus .

To solve the above SL problem, the operating device according to the present invention is a operating device for operating the image data receiving device, process specifying information and the electronic signature specifying the processing the image data receiving device to be executed Means for obtaining image data stored in an area for storing meta information via a network, and data not included in the electronic signature among the data stored in the image data as the meta information It means for rewriting the, the image data, for the image and the image data transmitting means for transmitting to the data receiving apparatus comprises a, the process specifying information, images other than an image stored in the transmitted said image data It is characterized in that at least image processing or processing other than image processing is designated.

The operation method according to the present invention, the operation device is an operation method for operating the image data receiving device, an image data with an electronic signature is stored in the area for storing the meta information via a network acquisition A step of rewriting data that is not the target of the electronic signature among the data stored as the meta information, and image data including processing designation information for designating processing to be executed by the image data receiving device. a transmission step of transmitting to the image data receiving device, includes a, the process specifying information, the image processing on the image other than the image stored in transmitted the image data, or a process other than the image processing It is at least specified.

  According to the above configuration, it is possible to transmit process designation information designating a process to be executed by the image data receiving apparatus to the image data receiving apparatus. Therefore, the operation device has an effect that the image data receiving device can be operated by image data.

  The operation device includes an image data storage unit that stores the image data in which the processing designation information is stored, an image data acquisition unit that acquires the image data in which the processing designation information is stored, or the image data The image data generating means for generating the image data including the process specifying information specifying the process to be executed by the receiving apparatus together with the image may be included.

The operation device according to the present invention includes an image data storage unit that stores a plurality of pieces of image data that stores processing designation information that designates a process to be executed by the image data reception device, and the plurality of pieces of image data stored in the image data storage unit. Image display means for displaying on the display unit a list of images included in each of the image data for identifying the process specified by the process specifying information stored in each image data, and the list display Image data selection means for selecting image data to be transmitted to the image data receiving device from the image data stored in the image data storage means based on a user operation acquired while includes, Do the image display means, an image included in each of the plurality of image data that stores the process specifying information, it is the process specifying information is stored Image and identifiably displayed and included in the image data, the image data transmission means, the image data selected by the image data selecting means, and transmits to the image data receiving device, it is preferable.

  According to the above configuration, images of image data stored in the operation device and including processing specification information specifying processing to be received by the image data receiving device are displayed in a list on the display unit. The Therefore, the user can select the image data to be transmitted to the image data receiving device based on the list-displayed images.

In addition, the images displayed as a list on the display unit are images representing processes specified by the process specification information. Therefore, the user can easily recognize what kind of processing the image data corresponding to each image displayed in the list on the display unit is. Play .

To solve the above SL problems, a data structure of image data according to the present invention is a data structure of image data including image, specify a process to be image data receiving device that has received the image data to be executed Processing specification information, which is image processing for an image other than the image stored in the image data, or processing specification information for specifying at least processing other than image processing, and an electronic signature for the image stores meta information. The image included in the image data is an image displayed on the operating device that operates the image data receiving device by transmitting the image data to the image data receiving device. The image is for identifying the process designated by the process designation information.

According to the above arrangement brings about in the image data receiving device, by receiving the image data, the effect that it is possible to perform the processing specified by the process specifying information.

  Moreover, according to the said structure, the said operation apparatus can display the image expressing the process designated by the said process designation | designated information. Accordingly, a user who intends to operate the image data receiving device using the operation device can visually check the contents of processing executed by the image data receiving device by transmitting the image data. Has the effect of becoming.

  An operation system including the image data receiving device and the operation device is also included in the scope of the present invention.

That is, the operating system according to the present invention is an operating system including an image data receiving device and an operating device that operates the image data receiving device, and the operating device should be executed by the image data receiving device. Image data transmitting means for transmitting image data stored in an area for storing processing information to specify processing to the image data receiving device, the image data receiving device, image data receiving means for receiving the image data transmitted from the image data transmitting device, immediately upon receiving the image data, the process specified by the process specifying information stored in the image data received Control means for controlling the own device so as to execute the processing, and the processing designation information is transmitted from the operating device to the image data receiving device. Image processing, or with respect to the image other than the image stored in the image data to be transmitted, at least specifying processing other than image processing, it is characterized in that.

  Note that each of the image data receiving device and the operation device may be realized by a computer. In this case, an image display program for realizing the image display device in the computer by operating the computer as each of the above means, and a computer-readable recording medium recording the program also fall within the scope of the present invention.

  Note that the control means provided in the image data receiving apparatus verifies the validity of the electronic signature included in the image data in which the processing designation information is stored, and the electronic signature is valid. For example, the apparatus itself may be controlled to execute the process designated by the process designation information.

  According to the above configuration, when the image data has been tampered with, the image data receiving device may execute an unexpected process designated by the process designation information stored in the image data. Can be prevented.

  Further, the control means determines whether or not the image data in which the processing designation information is stored includes an electronic signature. If the electronic signature is not included, a user operation permitting the execution is performed. It may be configured to control the own apparatus so as to execute the process specified by the process specifying information only when the is input.

  According to the above configuration, it is possible to reduce the possibility of executing an unexpected process designated by the process designation information stored in the image data even for image data that does not include an electronic signature. it can.

Further, the image data receiving apparatus does not subject the data stored in the image data as the meta information to the verification of the validity of the electronic signature in the verification of the validity of the electronic signature in the control means. The data may be included.

Further, the image data receiving device, the process specifying information is information that specifies the registration processing of the registration process of the viewing reservation or recording reservation, it may be configured so.

The data structure may be configured such that data stored in the image data as the meta information includes data that is not subject to the electronic signature.

In addition, when the process designation information is stored in the received image data, the image data receiving device executes a process designated by the process designation information, and the process designation information is included in the received image data. When not stored, the image stored in the received image data may be displayed.

The image data receiving device may be configured to display a part or all of the processing designation information stored in the received image data on the display unit.

As described above, the image data receiving apparatus according to the present invention receives the image data stored in the area for storing the process information, which specifies the process to be executed by the own apparatus, from the outside. image data receiving means for, immediately upon receiving the image, the process specified by the process specifying information stored in the image data received, own so that immediately executed upon receiving the image data Control means for controlling the apparatus.

Further, as described above, the control method according to the present invention is a control method in which the image data receiving apparatus controls the own apparatus, and the process specifying information for specifying the process to be executed by the own apparatus stores the meta information. A reception step of receiving image data stored in an area to be received from the outside, and processing specified by the processing specification information stored in the received image data immediately upon reception of the image data And a control step for controlling the device itself so as to be executed immediately when the image data is received.

On the other hand, the operating device according to the present invention is an operating device that operates the image data receiving device as described above, and the processing designation information and electronic signature that specify the processing to be executed by the image data receiving device are meta information. Means for acquiring the image data stored in the area for storing the image data via the network, and data that is not subject to the electronic signature among the data stored in the image data as the meta information. and means for rewriting, the image data, and a, and image data transmitting means for transmitting to the image data receiving device.

In addition, the operation method according to the present invention is an operation method in which the operation device operates the image data receiving device as described above, and the image data stored in the area for storing the digital information by the electronic signature is stored. A step of acquiring via the network, a step of rewriting data not subject to the electronic signature among the data stored as the meta information, and process designation information for designating a process to be executed by the image data receiving apparatus image data including, includes a transmission step of transmitting to the image data receiving device.

  Therefore, by using the operation device to transmit image data in which processing designation information is stored to the image data receiving device, it is possible to cause the image data to execute a desired process. That is, the image data receiving device can be freely operated by causing the operation device to function as if it were a remote controller.

[Embodiment 1]
An embodiment of the present invention will be described below with reference to the drawings.

(Operation system)
First, the configuration of the operation system 1 according to the present embodiment will be described with reference to FIG.

  FIG. 2 is a schematic configuration diagram illustrating a schematic configuration of the operation system 1. As shown in FIG. 2, the operating system 1 includes at least an image data receiving device 100 that receives image data and an operating device 200 that operates the image data receiving device 100.

  In the operation system 1, the image data receiving device 100 is realized as a television receiver (hereinafter abbreviated as “TV”). Therefore, hereinafter, the image data receiving device 100 is referred to as a television 100. The television 100 has at least an image data receiving function for receiving image data, in addition to a basic function as a television for receiving and displaying broadcast content. It is assumed that the television 100 is usually installed in the user's home.

  In the operation system 1, the operation device 200 is realized as a mobile phone terminal. Therefore, in the following, the operation device 200 is referred to as a mobile phone terminal 200. The mobile phone terminal 200 has at least an image data transmission function for transmitting image data, in addition to a basic function as a mobile phone such as making a voice call with another mobile phone terminal. Note that the mobile phone terminal 200 is normally assumed to be held by a user in the vicinity of the television 100.

  The television 100 and the mobile phone terminal 200 are configured to transfer image data from the mobile phone terminal 200 to the television 100 at least. For this image data transfer, for example, a high-speed infrared communication protocol such as IrSimple (registered trademark) or a short-range wireless communication protocol such as Bluetooth (registered trademark) is suitable. When using IrSimpleShot (registered trademark) that transmits image data at high speed using IrSimple, the transfer rate of the image data reaches 4 Mbps. For this reason, image data can be instantaneously transferred from the mobile phone terminal 200 to the television 100.

  If it is not necessary to consider the decrease in usability due to the connection means for connecting the television 100 and the mobile phone terminal 200, the television 100 and the mobile terminal 200 are connected by a connection means such as a conductor or an optical fiber, The image data may be transferred by wired communication via the.

  As will be described in detail later, the mobile phone terminal 200 can transmit the operation image data 500 to the television 100. The operation image data 500 is normal image data having a general format such as a JPEG format or a TIFF format, but includes process designation information that designates a process to be executed by the television 100. On the other hand, the television 100 immediately executes the process designated by the process designation information stored in the operation image data 500 received from the mobile phone terminal 200 when the operation image data 500 is received.

  Therefore, the cellular phone terminal 200 can cause the television 100 to execute a desired process by transferring the operation image data 500 storing the process designation information designating the process to be executed to the television 100. That is, the mobile phone terminal 200 functions as a remote controller that remotely operates the television 100. For example, when the user wants to rotate the image displayed on the television 100 by 90 degrees to the right, the user designates an image process of “rotate the image by 90 degrees to the right” as shown in FIG. The operation image data 500 in which the designation information is stored may be transmitted from the mobile phone terminal 200 to the television 100.

  The process designation information for controlling the television 100 is stored in the image data and transferred to the television 100 as described above. Therefore, in order to control the television 100, it is sufficient that there is only a transmission path for transferring image data to the television 100. In other words, any device that can transfer image data to the television 100 using a transmission path for transferring image data basically functions as a remote controller for operating the television 100. be able to. As a result, the present invention provides various image data acquisition methods that have been provided so far, such as downloading images from the Internet, attaching images to e-mails, downloading images from the Internet using a barcode reader, and from other mobile phones. It has the feature that it can be used without changing image transfer.

  Note that the television 100 may be operable by a normal infrared remote controller separately from the mobile phone terminal 200. However, in the operation system 1, since the television 100 can be operated by the mobile phone terminal 200, for example, a photograph is transmitted from the mobile phone terminal 200 to the television 100 and displayed, and the photograph displayed on the television 100 is displayed in 90. In the use case of rotating the camera 100 degrees, the user can freely operate the television 100 using only the mobile phone terminal 200.

  In the operation system 1 according to the present embodiment, the image data receiving device operated by the operation device is realized as the television 100, but the present invention is not limited to this. That is, the operation system according to the present invention can be configured even if the television 100 is replaced with an arbitrary device having an image data receiving function. As an example, an operation system that receives image data and operates a printer that prints the received image data can be configured.

  In the operation system 1 according to the present embodiment, the operation device that operates the image data receiving device is realized as the mobile phone terminal 200, but the present invention is not limited to this. That is, the operation system according to the present invention can be configured even if the mobile phone terminal 200 is replaced with an arbitrary device having an image data transmission function. As an example, an operation system using a digital camera having an image data transmission function as an operation device can be configured.

  When the image data receiving apparatus as described above, for example, a television or a printer is shipped as a product, a CD-ROM or a memory card in which operation images for controlling the product are bundled is provided. It is effective to plan for the following.

(Operation image data)
Next, the data structure of the operation image data 500 transferred from the mobile phone terminal 200 to the television 100 in the operation system 1 will be described with reference to FIGS.

  FIG. 3 is a data structure diagram schematically showing the data structure of the operation image data 500. As shown in FIG. 3, the operation image data 500 is roughly JPEG format image data including an image area 510 and an EXIF area 520.

The image area 510 is an area for compressing and storing image information to be displayed. On the other hand, the EXIF area 520 is an area for storing meta information related to the image information stored in the image area 510. The EXIF area 520 includes a manufacturer note area 521 that can be freely used by a manufacturer such as a digital camera. The EXIF area 520 includes a thumbnail image area 522 for storing a thumbnail image obtained by reducing the main image stored in the image area 510.

  The operation image data 500 used for operating the television 100 is realized by storing processing designation information in the maker note area 521 described above.

  Note that the image area 510 and the thumbnail image area 522 may store an image representing a process designated by the process designation information stored in the maker note area 521, that is, a so-called icon image. Thus, when the operation image data 500 is displayed in the same manner as normal and image data on the mobile phone terminal 200, the user is presented with what the processing stored in the operation image data 500 is. Is possible.

  However, the image area 510 and the thumbnail image area 522 may store image information such as a photo to be displayed, just like normal image data. In this case, the television 100 that has received the operation image data 500 displays the image of the operation image data 500 (image information stored in the image area 510) and performs the operation on the image. It is possible to perform image processing designated by the processing designation information of the image data for use.

  The main feature of the operation image data 500 is processing designation information stored in the maker note area 521. Therefore, the configuration of the maker note area 521 will be described in a little more detail based on FIG.

  FIG. 4 is a diagram showing the configuration of the manufacturer note area 521 described above. The manufacturer note area 521 is composed of a plurality of small areas (area 0, area 1, area 2,... In order from the top) divided for each byte. The information stored in each small area of the maker note area 521 will be described as follows based on FIG.

  In the areas 0 to 12, an identification code (in this case, a character string “TV CONTROL”) that declares that the maker note area 521 includes processing designation information is stored.

  A manufacturer code is stored in areas 13 to 14, a system code is stored in the lower 4 bits of area 15, and a device code is stored in area 16. The device to be operated (here, the television 100) is designated by the manufacturer code, the system code, and the device code. For the association between these codes and the operation target device, for example, the association conventionally used in the infrared remote controller can be used as it is.

  The manufacturer note area 521 is referred to in any one of the remote control compatibility mode, the display control mode, the URI mode, or the application mode in the operation target device. The upper 4 bits of the area 15 are used for designating which of the four modes should refer to the maker note area 521. The correspondence between the value stored in the upper 4 bits of the area 15 and the mode is as illustrated in FIG.

  In areas 17 to 18, command codes referred to in the remote control compatibility mode or the display control mode are stored. The command codes stored in the areas 17 to 18 are 2-byte codes that specify processing to be executed by the operation target device. Each command code is associated with some process in advance.

  The correspondence between the command code and the process is different between the remote control compatibility mode and the display control mode. That is, one command code can specify different processing in the remote control compatibility mode and the display control mode. For this reason, the operation target device first identifies the mode by referring to the upper 4 bits of the area 15, and identifies the process specified by the command code by interpreting the command code in the identified mode.

  FIG. 5 is a table listing command codes and processing associated with each command code in the display control mode.

  As shown in FIG. 5, for example, the command code 0059 (hexadecimal display) is interpreted as designating a process for rotating the image 90 degrees relative to the current display state in the display control mode. The Further, the command code 005B is interpreted as designating a process of rotating the image 270 ° counterclockwise (that is, 90 ° clockwise) relative to the current display state.

  In FIG. 5, command codes 001x to 004x are command codes that specify processing for enlarging or reducing an image at a magnification indicated by x. The correspondence between the value of x and the magnification in these command codes is as shown in FIG. For example, the command code 0044 (hexadecimal display) specifies image processing that minimizes the display size of the image under the condition that the image is displayed so as to cover the entire display screen. The command code 0034 designates processing for maximizing the display size of an image under the condition that the entire image is displayed on the display screen.

  In association with the command code and the process in the remote control compatibility mode, the correspondence between the operation signal and the process in the conventional infrared remote control is used. Therefore, all processes that can be controlled by the conventional infrared remote controller can be designated as command codes.

  In the area 21, extension data having a variable data size is stored. The areas 19 to 20 preceding the area 21 are used for designating the data size of the extension data. As information stored in the area 21 as the extended data, first, a URL (Uniform Resource Locator) referred to in the URL mode can be cited.

  For example, when the URL “http: //www.sharp.co.jp \ 0” is stored in the area 21 as the extended data, 23 (decimal number display) is stored in the areas 19 to 20 as the data size of the extended data. Is done. Note that a character code 0 character (indicated by \ 0) indicating the end of the URL is appended to the URL stored as extension data. The data size stored in the areas 19 to 20 is the data size of the extended data counted including the character code 0.

  In addition, an application name referred to in the application mode and an argument given to the application can also be stored in the area 21 as extension data. As an example, an application name “tv-album” and an argument “1234333398762345” may be stored in the area 21 as extension data “tv-album \ 01234333398762345 \ 0”. Here, the character code 0 is added to the end of the application name and the end of the argument. Also in this case, 26 (decimal number display), which is the data size of the extended data including the character code 0, is stored in the areas 19-21.

  The application named “tv-album” exemplified here is an application for using the network album service. The argument given to the application is an album ID for designating an album to be browsed in the network album service. The network album service mentioned here will be described in a little more detail in the description of the television 100 described later.

  In the above, for convenience of explanation, the operation image data is assumed to be image data in JPEG format. However, the operation image data may be any image data in a format that can store processing designation information. The manufacturer note area 521 may be embedded in the TIFF image data. Further, it may be realized by storing and embedding processing designation information in a text chunk of PNG (Portable Network Graphics) format image data.

(Image data receiver)
Next, the configuration of the image data receiving device 100, that is, the television 100 will be described with reference to FIG.

  FIG. 1 is a block diagram illustrating a main configuration of the television 100. As shown in FIG. 1, the television 100 includes a storage unit 101, a decoding unit 102, an image processing unit (image processing unit) 103, a display unit 104, an image data receiving unit (image data receiving unit) 105, and processing designation information extraction. A unit 106 and a control unit (control means) 107 are included.

  The television 100 has an image display function for displaying an image included in the image data stored in the storage unit 101 on the display unit 104. This image display function is realized by the cooperation of the storage unit 101, the decoding unit 102, the image processing unit 103, and the display unit 104.

  The storage unit 101 is means for storing image data, and is configured by, for example, a RAM (random access memory). The storage unit 101 may be configured by a non-volatile memory such as a flash memory. Further, the storage unit 101 may be fixedly incorporated in the television 100, or may be a removable memory (memory card) attached to the television 100, such as an SD card. Good.

  The decoding unit 102 is means for developing image information included in the image data. More specifically, the compressed (or encoded) image information included in the image data stored in the storage unit 101 is read, and the read image information is expanded (or decoded) into a format that can be displayed immediately. ) The decoding unit 102 supports image data in various formats such as JPEG format and TIFF format, and executes a decompression process according to the format of the image data to be decompressed. The image information developed by the image processing unit 103 is supplied to the image processing unit 103.

  The image processing unit 103 is means for processing image information included in the image data by image processing. More specifically, the developed image information supplied from the decoding unit 102 is an image such as image rotation, enlargement, reduction, upside down, left / right inversion, scrolling, color change, monochromeization, fade-in, fade-out, etc. Process by processing. The image processing executed by the image processing unit 103 is selected according to an instruction from the control unit 107, as will be described later. The image processed by the image processing unit 103 is supplied to the display unit 104.

  The display unit 104 is means for displaying image information included in the image data. More specifically, the processed image information supplied from the image processing unit 103 is displayed. The display unit 104 is configured by a liquid crystal display panel, for example. The display unit 104 may be configured by other display devices such as a cathode ray tube. However, by using a large liquid crystal display panel as a display device, a high-definition image such as a photograph can be clearly displayed.

  In addition, the television 100 has an image display control function for controlling the above image display function based on received image data. This image display control function is realized by the cooperation of the image data receiving unit 105, the processing designation information extracting unit 106, and the control unit 107.

  The image data receiving unit 105 is a means for receiving image data transmitted from the mobile phone terminal 200. More specifically, the image data receiving unit 105 is configured to include an infrared receiving unit that receives infrared rays emitted from the mobile phone terminal 200 and converts them into electrical signals, and is obtained by the infrared receiving unit. The image data transmitted from the mobile phone terminal 200 is obtained by converting the electrical signal into digital data according to a predetermined infrared communication protocol (for example, IrSimple). The image data received by the image data receiving unit 105 is stored in the storage unit 101.

  The process designation information extraction unit 106 is a means for extracting process designation information from the image data received by the image data reception unit 105. Specifically, it is determined whether or not the processing designation information is included in the image data stored in the storage unit 101. If the processing designation information is included, the processing designation information is read out. Then, the read processing designation information is transmitted to the control unit 107. If the processing designation information is not included in the stored image data, the processing designation information extraction unit 106 indicates that the processing designation information is not included, that is, the received image data is display image data. The control unit 107 is notified of the presence.

  The control unit 107 is a means for controlling the own device (the television 100) so as to execute the process specified by the process specifying information included in the image data received by the image data receiving unit 105. Specifically, the image display function of the own apparatus is controlled by giving an instruction to the image processing unit 103 to execute the image processing designated by the processing designation information transmitted from the processing designation information extracting unit 106. .

  Upon receiving this instruction, the image processing unit 103 processes the image information supplied from the decoding unit 102 by the image processing specified by the processing specifying information and supplies the processed image information to the display unit 104. As a result, the image displayed on the display unit 104 is updated to an image processed by the image processing specified by the processing specification information.

  The image data received by the image data receiving unit 105 is assumed to be operation image data in which processing designation information is stored and normal image data not including the processing designation information (hereinafter referred to as display image data). Is done. In addition, the image information included in the operation image data may be image information to be displayed on the television 100 such as a photograph, or the television 100 such as an icon image representing a process designated by the process designation information. In some cases, it is image information that does not need to be displayed.

  When the image size of the image data received by the image data receiving unit 105 is large (for example, a horizontal resolution of 640 or higher or a vertical resolution of 480 or higher), the image data includes image information to be displayed regardless of the presence / absence of processing designation information. It is assumed that

  Accordingly, the decoding unit 102 determines that the image size of the newly received image data is larger than a predetermined threshold value (for example, horizontal resolution 640 or higher or vertical resolution 480 or higher), or newly received image data. When is the display data, the image information of the image data may be developed.

  Thereby, when the image size of the newly received image data is larger than a predetermined threshold, the image information input to the image processing unit 103 is updated to the image information of the newly received image data, and the newly received image When the image size of the data is smaller than the predetermined threshold, the image information input to the image processing unit 103 is maintained as before. Even when the newly received image data is display image data, the image information input to the image processing unit 103 is updated to the image information of the newly received image data.

  Further, when the newly received image data is the operation image data, the image processing unit 103 executes the image processing specified by the process specifying information stored in the operation image data, When the received image data is display image data, it may be configured to execute preset default image processing.

  Accordingly, (1) when the newly received image data is display image data, an image obtained by performing default image processing on the image information of the image data is displayed regardless of the image size, and (2) When the newly received image data is operation image data and the image size of the image data is larger than the predetermined threshold, the image information of the image data is designated by the processing designation information of the image data. (3) If the newly received image data is operation image data and the image size of the image data is smaller than the predetermined threshold value, the image data is displayed. Thus, an image that has already been displayed at the time of reception of the image and subjected to the image processing specified by the processing specification information of the image data is displayed.

  The processing of the television 100 according to the type of image data described above can be summarized as shown in Table 1 below.

  In addition to the image data, the image data receiving unit 105 may be configured to be able to receive the processing designation information itself that is not stored in the image data as digital data. In this case, when any digital data received by the image data receiving unit 105 is stored in the storage unit 101, first, the name or header information of the digital data is analyzed to determine whether the digital data is image data. What is necessary is just to comprise the process designation | designated information extraction part 106 so that it may determine whether it is designation | designated information itself. If the digital data is the process designation information itself, the process designation information extraction unit 106 reads out the entire digital data stored in the storage unit 101, and sends the read process designation information to the control unit 107. Notification should be made.

  Next, processing executed when the television 100 receives image data will be described with reference to FIGS.

  FIG. 7 is a flowchart showing a flow of processing executed when the television 100 receives image data.

  When detecting an infrared ray emitted from the mobile phone terminal 200, the image data receiving unit 105 starts receiving image data. The image data receiving unit 105 stores the received image data in the storage unit 101 (S101).

  When the received image data is stored in the storage unit 101, the decoding unit 102 determines the image size of the received image data based on the JPEG header information of the image data (S102). When the image size of the received image data is smaller than a predetermined threshold value (less than horizontal resolution 640 and less than vertical resolution 480) (S102: No), the processing designation information extraction unit 106 further receives the received image. The presence / absence of processing designation information in the data is determined (S103).

  When the image size of the image data received in S101 is larger than the predetermined threshold (S102: Yes), or the image size of the image data received in S101 is smaller than the predetermined threshold (S102: No), and When the image data is display image data that does not include processing designation information (S103: No), the decoding unit 102 expands the image information of the image data received in S101, and performs the image processing on the expanded image information. It supplies to the part 103 (S104).

  Next, the image processing unit 103 processes the image information supplied from the decoding unit 102 by default image processing, and outputs the processed image information to the display unit 104. In FIG. 7, the default image processing is image processing that rotates an image that corrects the tilt of the image due to the tilt of the camera at the time of imaging.

  Specifically, it is determined whether or not the shooting angle information is included in the EXIF information of the image data received in S101 (S105). If the shooting angle information is included (S105: Yes), the shooting angle information is included in the shooting angle information. Image processing for rotating the display angle calculated based on the image is executed (S106). If the image data received in S101 does not include the shooting angle information (S105: No), the image processing unit 103 uses the image information supplied from the decoding unit 102 as it is in the display unit 104. Output (S107).

  Next, the processing designation information extraction unit 106 determines again whether the processing designation information is stored in the image data received in S101 (S108). Step S108 is a determination step provided in consideration of the case where the image size of the image data received in S101 is equal to or larger than a predetermined threshold value and the image data is operation image data including processing designation information. is there. If it is determined in step S108 that the processing designation information is not stored in the received image data (S108: No), a series of processing ends.

  When the image size of the image data received in S101 is smaller than the predetermined threshold (S102: No) and the processing designation information is stored in the image data (S103: Yes), or received in S101 When the image size of the image data is larger than the predetermined threshold (S102: Yes) and the process designation information is stored in the image data (S108: Yes), the process designation information extraction unit 106 receives the received image data. The process designation information is extracted from the information, and the extracted process designation information is transmitted to the control unit 107 (S109). Consequently, after all, when the image data received in S101 is operation image data, the processing designation information of the image data is always transmitted to the control unit 107.

  The control unit 107 gives an instruction to the image processing unit 103 to execute the image processing designated by the processing designation information transmitted from the processing designation information extracting unit 106. Based on the instruction from the control unit 107, the image processing unit 103 executes the image processing designated by the processing designation information (S110).

  FIG. 8 is a flowchart illustrating the flow of image display control (S109 in FIG. 7) executed by the television 100 based on the processing designation information.

  Image display control based on processing designation information extracted from received image data is realized by the image processing unit 103 and the control unit 107.

  When the command code included in the processing designation information is 0059 (hexadecimal display) (S201: Yes), the control unit 107 executes image processing for rotating the image 90 degrees to the left relative to the current display state. An instruction is given to the image processing unit 103. The image processing unit 103 given this instruction executes image processing for rotating the image by 90 ° relative to the current display state, and outputs the processing result to the display unit 104 (S205).

When the command code included in the processing designation information is 005B (hexadecimal number display) (S202: Yes), the control unit 107 executes image processing for rotating the image by 90 ° relative to the current display state. An instruction is given to the image processing unit 103. The image processing unit 103 that received this instruction, executes the image processing for relatively right by 90 ° rotated image from the current display state and outputs the processed result to the display unit 104 (S 206).

  When the command code included in the processing designation information is 0034 (hexadecimal display) (S203: Yes), the control unit 107 satisfies the condition that the entire image is displayed on the display screen without changing the aspect ratio of the image. The image processing unit 103 is instructed to execute image processing that maximizes the display size of the image. Upon receiving this instruction, the image processing unit 103 calculates the ratio α of the vertical width of the display screen to the vertical width of the image and the ratio β of the horizontal width of the display screen to the horizontal width of the image, and the ratio values α and β Then, image processing for enlarging or reducing the image is executed using the smaller value as the display magnification (S207 to S209).

  When the command code included in the processing designation information is 0044 (hexadecimal display) (S204: Yes), the control unit 107 displays the image so as to cover the entire display screen without changing the aspect ratio of the image. An instruction is given to the image processing unit 103 to execute processing for minimizing the image under the conditions. Upon receiving this instruction, the image processing unit 103 calculates the ratio α of the vertical width of the display screen to the vertical width of the image and the ratio β of the horizontal width of the display screen to the horizontal width of the image, and the ratio values α and β The image processing for enlarging or reducing the image is executed with the larger value of the display magnification as the display magnification (S210 to S212).

  Note that the flowchart shown as FIG. 8 shows the flow of image display control originally executed on the television 100 in a simplified manner by limiting the number of command codes that can be handled to four for convenience of explanation. That is, the command codes that can be handled by the television 100 are not limited to the four shown in FIG. Also, as shown in FIG. 8, the television 100 does not need to be able to process all commands. For commands that cannot be processed, the image display control is terminated without performing any operation as in S204: No. May be. In this case, it may be configured to output a caution indicating that processing cannot be performed.

  As described above, in the television 100, the image data receiving unit 105 receives from the mobile phone terminal 200 the operation image data in which the process designation information that designates the process to be executed by the own device (the television 100) is stored. It functions as image data receiving means for receiving.

  Further, the control unit 107 serves as a control unit that controls the own apparatus so that the process specified by the process specifying information stored in the received operation image data is immediately executed when the operation image data is received. Function. In particular, the television 100 includes an image processing unit 103 that processes an image of image data by image processing, and the control unit 107 controls the image processing unit 103 to execute image processing specified by the processing specification information. Functions as a control means.

  Therefore, when it is desired that the television 100 execute certain image processing, if the television 100 receives the operation image data storing the processing designation information designating the image processing, the television 100 performs the image processing. Can be executed. For this reason, the user can control the image display function of the television 100 from the outside by transmitting the operation image data from the mobile phone terminal 200.

  In addition, although the example which controls the image display function of the television 100 using the operation image data has been described above, the function of the television 100 that can be controlled based on the operation image data is limited to the image display function. is not. That is, the function of the television 100 that can be controlled using the operation image data is not limited to the image display function described above, but extends to any function of the television 100.

  For example, the channel for receiving the broadcast content may be switched to the channel designated by the processing designation information. In addition, if the television 100 has a viewing reservation function or a recording reservation function, the execution of the viewing reservation or recording reservation registration process may be controlled based on the above processing designation.

  Note that the television 100 may employ an operation system in which an image display mode for displaying received images and a broadcast reception mode for viewing broadcast content are clearly separated. In this case, the television 100 receives image data for operation designating processing (for example, channel switching) related to viewing of broadcast content in the image display mode, or performs processing related to image display in the broadcast reception mode. When the designated image data for operation is received, the operation intended by the user cannot be executed immediately.

Therefore, for example, when image data for channel switching operation is received in the image display mode, at least one of a procedure for switching to the broadcast reception mode and a message indicating that the channel switching operation can be performed by switching to the broadcast reception mode. Is preferably output to the display unit 104. Similarly, when image data to be displayed is received in the broadcast reception mode, at least one of a procedure for switching to the image display mode and a message indicating that the image is displayed larger when switched to the image display mode. Is preferably output to the display unit 104. In the broadcast reception mode, when operation image data for instructing image processing is received, at least one of a procedure for switching to the image display mode and a message indicating that image processing can be executed by switching to the image display mode Is preferably output to the display unit 104.

  Further, if the television 100 has a data communication function, the data communication function may be controlled using the operation image data. In the following, an example in which the data communication function of the television 100 is controlled using the operation image data will be described with reference to FIG.

  FIG. 9 is a block diagram illustrating a configuration of the television 100 capable of controlling the data communication function based on the operation image data. In FIG. 9, the decoding unit 102 and the image processing unit 103 illustrated in FIG. 1 are omitted, and a communication unit (data receiving unit, data transmitting unit) 111 and a display screen generation unit 112 included in the television 100 are newly added. Show. Note that the storage unit 101, the display unit 104, the image data reception unit 105, the processing designation information extraction unit 106, and the control unit 107 are the same as those shown in FIG.

  URL (Uniform Resource Locator) is included in the process designation information of the operation image data received by the image data receiving unit 105, and the process designation information instructs to display a web page whose location is designated by this URL. If the URL mode is designated in the maker note area of the operation image data, the control unit 107 instructs the communication unit 111 to acquire display data for displaying the web page. give.

  The communication unit 111 is a means for performing data communication with other communication devices via the Internet. The communication unit 111 that has received the above instruction from the control unit 107 transmits a data acquisition request for acquiring the display data to the HTTP server 300, and acquires display data as a response. The display data received by the communication unit 111 is supplied to the display screen generation unit 112.

  The display screen generation unit 112 is means for generating a display screen based on display data received by the communication unit 111 from another communication device. For example, if the display data received by the communication unit 111 is an HTML (Hypertext Markup Language) document, character information and the like are laid out based on the HTML document and a display screen for displaying as a web page is generated. The display screen generated by the display screen generation unit 112 is supplied to the display unit 104 and displayed on the display unit 104.

  As described above, the television 100 can display the web page by causing the television 100 to receive the operation image data in which the processing designation information including the URL of the desired web page is stored. At this time, the control unit 107 receives the display data specified by the URL included in the processing designation information from the communication device specified by the URL included in the processing designation information of the operation image data. It functions as a control means for controlling.

  In addition, various web services can be used on the television 100 by the same method. Hereinafter, this will be described by taking the case of using the network album service on the television 100 as an example.

  The network album service is a network album server that classifies and manages photo data into a plurality of albums, downloads a photo data group belonging to a desired album from the network album server, and downloads the photos of the downloaded photo data group. This is a kind of web service realized by a client that displays a list or a slide show.

  When the processing specification information of the operation image data received by the image data receiving unit 105 includes an album ID, and the processing specification information instructs to display the album specified by the album ID (that is, the operation When the application mode is specified in the maker note area of the image data for use and “tv-album” is specified as the application name), the control unit 107 acquires the photo data group of the album from the network album server 400. An instruction is given to the communication unit 111.

  Upon receiving this instruction, the communication unit 111 transmits a data acquisition request including the album ID to the network album server 400, and acquires the photo data group of the album designated by the album ID as a response. The photograph data group received by the communication unit 111 is supplied to the display screen generation unit 112. The display screen generation unit 112 generates a display screen for displaying a list of photos of the photo data group acquired by the communication unit 111 or as a slide show. The display screen generated by the display screen generation unit 112 is displayed on the display unit 104.

  As described above, by causing the television 100 to receive the operation image data in which the processing designation information including the album ID of the desired album is stored, the photo of the album can be displayed on the television 100. At this time, the control unit 107 functions as a control unit that controls the communication unit 111 so as to receive a photo data group designated by an album ID included in the processing designation information from a predetermined network album server 400.

  Further, the album ID is included in the processing designation information of the operation image data received by the image data receiving unit 105, and the processing designation information instructs to add the image data to the album designated by the album ID. In this case, the control unit 107 instructs the communication unit 111 to upload the image data to the network album server 400.

  Upon receiving this instruction, the communication unit 111 transmits the image data to the album network server 400 together with the album ID. The network album server 400 manages the image data transmitted from the television 100 by classifying the image data into albums specified by the album ID transmitted together with the image data.

  As described above, the image data can be uploaded to the network album server 400 by causing the television 100 to receive the operation image data storing the process designation information that designates the process of uploading the image data. At this time, the control unit 107 functions as a control unit that controls the communication unit 111 so as to transmit image data to a predetermined network album server 400.

  Finally, in the television 100, the control unit 107 checks whether or not the received image data includes a pre-authenticated electronic signature, and the pre-authenticated electronic signature is embedded in the image data. Only in some cases, the apparatus may be configured to control the apparatus to execute the process specified by the process specifying information stored in the image data.

  In addition, a list of processes that are permitted to be executed on the television 100 is stored in the storage unit 101 in advance, and the control unit 107 performs processing specified by the process specification information stored in the received image data. It is determined whether the process is included in the list, and only when the process specified by the process specifying information is a process included in the list, the process specified by the process specifying information is executed. As such, it may be configured to control its own device.

  As a result, it is possible to make it impossible to execute a process designated by the process designation information included in the image data created by a malicious third party or a dangerous process not included in the list. For this reason, the danger that the television 100 will perform an unexpected process can be reduced, and the operation system 1 can be made more secure. This configuration can also be used for a purpose of executing processing designated only by operation image data acquired by paying a fee.

  A system in which a single high-quality photograph is displayed on the television 100 can be configured with the same configuration. For example, when “tv-photo” is designated as the application name, the control unit 107 performs communication so as to obtain one photo designated by the control data (processing designation information) from the network album server 400. An instruction is given to the unit 111. The operation image data embedded in the control data and stored in the mobile phone 200 is preferably an image obtained by reducing a photograph acquired from the network album server 400, but does not necessarily need to match. An image obtained by cutting out a part of the acquired photograph may be used. Further, when an advertisement image is used as operation image data, and the advertisement image is acquired and transferred to the television 100, a high-definition image desired by the user (for example, an album or a photograph of a talent appearing in a television commercial) is displayed. Such usage is also possible.

  Further, when the television 100 accesses the network album server 400, the product name, serial number, setting information, etc. of the television 100 itself are transmitted together, and the albums and photos are added to the television 100 after changing according to these information. The network album server 400 may be configured to send it back to. As a simple example, it may be configured to send back an album or photo optimized for the resolution of the display unit 104 of the television 100. There are a plurality of methods for transmitting such information, but a method of storing the information in the user agent included in the header of the HTTP protocol is simple and effective.

  In the above description, the network album server 400 is described as a server on the Internet. However, the present invention is not limited to this, and may be a server connected to a home LAN. In this case, a combination with DLNA (Digital Living Network Alliance) (registered trademark) is effective, but DLNA also adopts a protocol based on HTTP for data transfer, and details thereof will not be repeated. In this case, when image data (for example, a photograph) including control information (processing designation information) is sent from the mobile phone 200, the display input of the television 100 is switched to an input terminal to which a server (including a recording function) is connected. May be configured to play back recorded video.

  As described above, in the television (image data receiving device) 100, the control unit 107 confirms whether or not the operation image data received from the mobile phone terminal (operation device) 200 includes an electronic signature. Only when the electronic image is included in the operation image data, the own apparatus is controlled to execute the process specified by the process specifying information stored in the operation image data. it can.

  First, the advantages of configuring the television 100 as described above will be described with reference to FIG. 2 again.

  As shown in FIG. 2, the mobile phone terminal 200 displays the icon image stored in the image area or the thumbnail image area of the operation image data 500. This icon image represents a process designated by the process designation information stored in the operation image data 500. The user transmits the operation image data 500 to the television 100 after confirming the icon image. At this time, the user directly refers to the processing designation information described in a language that is difficult for the user to understand what operation the operation image data 500 to be transmitted to the television 100 corresponds to. And can be visually recognized by the icon image.

  However, as in the case of phishing scams that exploit the functions of mailers and Web browsers, there is a risk that processing designation information that does not correspond to icon images may be maliciously embedded in the operation image data 500. Specifically, if the icon image that the user sees does not represent the processing designation information that designates the processing that the television 100 actually makes, and the user believes the icon image and uses the operation image data 500, An unexpected process may be executed on the television 100.

  In particular, the operation image data 500 can be distributed to an operation device such as the mobile phone terminal 200 through various routes such as copying from a media medium, downloading from a Web server, and receiving by e-mail. For this reason, a malicious third party may have an opportunity to falsify the processing designation information in the operation image data 500. Therefore, it is preferable to increase the reliability of the operation image data 500 using an electronic signature so that the user can use the operation image data 500 with peace of mind.

  FIG. 14 is a diagram schematically showing a method for improving the reliability of the operation image data 500 using an electronic signature.

  As shown in FIG. 14, the content creator generates an electronic signature for the operation image data 500 using a secret key. The digital signature generated here is a hash value calculated from the secret key and the operation image data according to the signature generation algorithm. The content creator adds the generated electronic signature to the operation image data 500 to generate operation image data 500 ′ with an electronic signature.

  The television 100 extracts the operation image data 500 and the electronic signature from the operation image data 500 ′ with an electronic signature acquired via the mobile phone terminal 200, and the electronic signature is a valid electronic signature for the operation image data 500. Verify that there is a public key. Specifically, the electronic signature is decrypted using the public key, and a match between the decrypted hash value and the hash value calculated from the operation image data is confirmed. When it is verified that the electronic signature is a valid electronic signature for the operation image data 500, that is, when it is confirmed that the operation image data 500 has not been tampered with, the television 100 performs the operation. The own apparatus is controlled to execute the process designated by the process designation information stored in the image data 500 (for example, if a URI is stored in the process designation information, the URI is accessed).

  Note that the public key used by the television 100 for verifying the electronic signature may be a public key that is paired with the private key used by the content creator for generating the electronic signature. A method for the television 100 to obtain the public key is as follows. It doesn't matter. That is, the public key used by the television 100 may be acquired via a network, or may be stored in advance in a storage unit (for example, incorporated at the time of factory shipment). When dealing with operation image data created by a plurality of different content creators, a plurality of public keys paired with the secret keys of the respective content creators may be stored in the television 100 in advance. In addition, the content creator embeds an electronic certificate in which the public key is stored in the operation image data 500 in the operation image data 500 separately from the electronic signature, and the TV 100 confirms the electronic certificate before operating. A configuration in which a public key embedded in the image data 500 is used may be employed.

  Next, the data structure 500 ′ of the operation image data with the electronic signature that can be used to increase the reliability of the operation image data will be described with reference to FIG.

  FIG. 15 is a data structure diagram illustrating a configuration example of 500 ′ of operation image data with a digital signature. As shown in FIG. 15, a metadata area 523 is provided in the empty area at the end of the maker note area 521. A signature data area 524 for storing an electronic signature is provided at the end of the metadata area 523, and a user data area 525 is provided immediately before the signature data area 524. The electronic signature stored in the signature data area 524 is an electronic signature for information (hereinafter also referred to as signature target data) stored in an area excluding the signature data area 524 and the user data area 525 from the operation image data 500 ′. is there.

  Usually, image data is intended for visual confirmation, and the larger the data size, the higher the visual effect. On the other hand, the operation image data 500 allows the user to visually confirm the icon image, and it is important that the mobile phone terminal 200 or the like does not give stress to the user when the operation image data 500 is acquired. It is necessary to determine the data size and format in consideration of this point. In particular, when the mobile phone terminal 200 is used as a transmission terminal for transmitting operation image data to the television 100, the display screen resolution of the mobile phone terminal 200 is about QVGA, and the communication speed of the mobile phone terminal 200 is limited. It is necessary to consider that the communication cost is a burden on the user. Also, in some image data communication services of mobile phone networks, the image data communication server converts image data having a data size exceeding a predetermined value and provides the user with data for the purpose of reducing stress on the user. There are cases like this. For the above reasons, it is considered that the upper limit of the data size of the operation image data 500 is 10 KB. As a format example in which the data size of the operation image data 500 falls within this upper limit, a format in which the resolution of the image data is set to QVGA or a thumbnail image area is not used can be considered.

  As shown in FIG. 15, the operation image data 500 ′ may include a user data area 525 for storing user data. Since the user data stored in the user data area 525 is not subject to an electronic signature, it can be rewritten without impairing the validity of the operation image data 500 ′, and the operation image data 500 ′ is received by the television 100. It can be added or edited by a person other than the creator of the operation image data 500 ′ at any point in time. For example, when the operating device that operates the television 100 is configured by the mobile phone terminal 200 or the PC, the user data may be data input by the user using the user interface of these operating devices. As information stored in the operation image data 500 ′ as user data, for example, an e-mail address of a mobile phone or a comment related to the operation image data input by the user is assumed. Note that the user data area 525 is preferably arranged immediately before or immediately after the signature data area 524 in which the electronic signature is stored so that the process of adding the electronic signature or the process of extracting the electronic signature is facilitated.

  The metadata area 523 may include an area for storing each piece of information shown in FIG. 15 in addition to the signature data area 524 and the user data area 525 described above. Each information that can be included in the metadata area 523 is described as follows.

  The data signature is information indicating that the data is an operation image data format. Version information is also included in the data signature. The data signature is described as, for example, “EMAPV100”: Embedded Meta-data for Affixing on Picture Version 1.00.

  The extension data size is information indicating the size of the extension data area. The user data size is information indicating the size of the user data area 525. The signature data size is information indicating the size of the signature data area 524.

  The provider information is a UTF-8 character string terminated with “¥ 0” and indicates the provider. The message is a UTF-8 character string terminated with “¥ 0” and indicates an arbitrary message. The television 100 is preferably capable of displaying 16 characters or more from the beginning of the provider information and / or message.

  The usage information is a UTF-8 character string terminated with “¥ 0”. Although the usage method of the usage information depends on the specification of the television 100, for example, it can be used to select an application to be started. The URI is a character string terminated with “¥ 0” and indicates the URI of data to be acquired by the television 100.

  The extension data is arbitrary binary data. In order to support this extension data, it is desirable that the television 100 is mounted so as to handle extension data of at least 2048 bytes. A portion of the extended data exceeding 2048 bytes may not be processed by the television 100.

  The user data is arbitrary binary data. In order to support this user data, it is desirable that the television 100 be mounted so that it can handle user data of at least 2048 bytes.

A portion of user data exceeding 2048 bytes may not be processed by the television 100. The difference between the extended data and the user data is that the extended data is data that is the target of the electronic signature, whereas the user data is data that is not the target of the electronic signature. The signature data is an electronic signature and conforms to pkcs # 7 / DER. In addition to the electronic signature, any certificate in the authentication chain other than the root certificate can be included in the signature data. By including a certificate other than the root certificate (intermediate certificate) in the signature data and storing the root certificate in the television 100, the validity of the electronic signature can be verified without accessing the Internet. With such a data structure, the time required for verification of the electronic signature can be shortened. Further, the operation image data is also effective in applications such as conveying operation information such as the extraneous recording reservation from the Internet, even if the television 100 is not connected to the Internet, reliability by verifying the electronic signature Can be increased.

  In addition, there is a communication path for deleting an EXIF area unnecessary for image display in order to reduce the capacity of image data. Even when the EXIF area is deleted, in order to enable extraction of the process designation information in the image data receiving apparatus (television), only information corresponding to a subset of the process designation information stored in the EXIF area, for example, the URI of FIG. It can be considered to embed as redundant information in an area other than the EXIF area, for example, a JPEG comment area. In order to indicate that the data in the comment area is redundant information of the processing designation information, it is desirable to add a data signature similar to that in FIG. For example, add the digital signature and a termination character to the URI “http://www.sharp.co.jp” and add the data “ELAP100http: //www.sharp.co.jp \ 0” to the comment area. To store. In this case, the data structure is as shown in FIG. A difference from the data structure shown in FIG. 3 is that a redundant information area 531 for embedding a URI as redundant information is provided in the comment area 530.

  Next, the television 100 corresponding to the operation image data with the electronic signature will be described with reference to FIGS.

  FIG. 16 is a block diagram illustrating a configuration example of the television 100 corresponding to operation image data with a digital signature.

  In the configuration shown in FIG. 16, in addition to each configuration shown in FIG. 9, the television 100 has an electronic signature extraction unit 121 that extracts an electronic signature from operation image data with an electronic signature stored in the storage unit 101, and A UI unit 122 for detecting a user operation is provided. In order to deal with user data, the television 100 may further include a user data extraction unit (not shown) that extracts user data from the image data for operation.

  FIG. 17 is a flowchart showing a flow of processing executed by the television 100 on the operation image data with a digital signature. FIG. 18 is a diagram showing a display screen displayed on the television 100 in the processing shown in FIG.

  As illustrated in FIG. 17, when the operation image data is stored in the storage unit 101, the control unit 107 determines whether the operation image data stored in the storage unit 101 includes an electronic signature. (S301). If the electronic signature is not included (S301: No), the display screen creation unit 112 displays a confirmation screen for confirming to the user whether or not to execute processing based on the operation image data not including the electronic signature. The information is displayed on the unit 104 (S302). The UI unit 122 detects an operation input by the user and notifies the control unit 107 of the detection result. FIG. 18A shows a configuration example of the confirmation screen displayed in step S302.

  When the UI unit 122 detects a predetermined user operation that permits execution of processing based on operation image data that does not include an electronic signature (S303: Yes), the control unit 107 stores the operation image data. The process designated by the process designation information is executed (S304). On the other hand, when the UI unit 122 detects a predetermined user operation that rejects execution of processing based on operation image data that does not include an electronic signature (S303: No), the control unit 107 stores the operation image data in the operation image data. The series of processes is terminated without executing the process specified by the specified process specification information.

  When the digital image is included in the operation image data stored in the storage unit 101 (S301: Yes), the control unit 107 uses the digital signature extracted by the digital signature extraction unit 121 as the operation image data. Whether or not the data to be signed is a valid electronic signature is verified by using the public key stored in the electronic certificate (S305). If the electronic signature is invalid (S305: No), the display screen creation unit 112 causes the display unit 104 to display a warning screen that prompts the user to issue a warning (S306), and specifies the processing included in the operation image data. A series of processes are terminated without executing the process specified by the information. FIG. 18B shows a configuration example of the warning screen displayed in step S306.

  On the other hand, when the electronic signature is valid (S305: Yes), the control unit 107 further determines whether or not the issuer of the electronic certificate storing the public key is a highly reliable site ( S307). This determination can be realized, for example, by storing a list of highly reliable sites in advance in the storage unit 101 and determining whether the issuer of the electronic certificate is a site included in this list. .

If the issuer of the electronic certificate is a trusted site (S307: reliable), the control unit 107 executes the process specified by the process specifying information stored in the operation image data (S304). . On the other hand, if the issuer of the electronic certificate is not a reliable site (S307: no reliability ), the user determines whether or not to execute the processing based on the operation image data as shown in FIG. A confirmation screen to be confirmed is displayed on the display unit 104 by the display screen creation unit 112 (S308). As shown in FIG. 18C, the confirmation screen displayed in step S308 displays a confirmation message such as “Do you want to execute the operation?” And CN information (signer, certificate issuance) included in the electronic signature. The display screen is preferably displayed together with the original information.

  When the UI unit 122 detects a predetermined user operation that permits execution of processing based on the operation image data in a state in which the confirmation screen as illustrated in FIG. 18C is displayed (S309: Yes), control is performed. The unit 107 executes the process designated by the process designation information stored in the operation image data (S304). On the other hand, when the UI unit 122 detects a predetermined user operation that refuses to execute the process based on the operation image data (S309: No), the control unit 107 specifies the process using the process specification information stored in the operation image data. The series of processes is terminated without executing the processed processes.

When the control unit 107 determines that the electronic signature is valid (S305: Yes), it immediately executes the process specified by the process specification information or displays a confirmation screen. Depending on the signer (content creator) of the electronic signature, it may be switched whether to execute from the first. In this case, stores the table associating processing Description signer of the digital signature in the storage unit 101, after determining the presence or absence of an electronic signature may be determined process contents by referring to this table .

  FIG. 17 shows a preferable process example in the case where the public key used for verification of the electronic signature by the television 100 is stored in the electronic certificate (public key certificate). The processing to be performed is not limited to this. For example, when the television 100 verifies the electronic signature using a public key that is not stored in the electronic certificate, steps S307 to S309 may be omitted.

  Furthermore, in FIG. 18A and FIG. 18C, instead of selecting “Yes” or “No”, if the same operation image data is received again, the processing corresponding to “Yes” is performed for a while. The television 100 may be configured to execute a process corresponding to “No” if data is not received for a period (for example, about 10 seconds).

  Next, an example of a network service system using operation image data with a digital signature will be described with reference to FIG.

  FIG. 19 is a system configuration diagram showing a schematic configuration of a network service system 1000 using a public key infrastructure (PKI) framework.

  As shown in FIG. 19, the network service system 1000 includes a service server 1100 and an operation image data server 1200 managed by a service provider that operates a network service, and a television 100 owned by a user who uses the network service. And a mobile phone terminal 200 used by the user to operate the television 100.

  The operation image data server 1200 creates operation image data with an electronic signature in which a URI for specifying a resource under the management of the service server 1100 is embedded as processing designation information, and the created operation image data with an electronic signature is created. The information is provided to the mobile phone terminal 200 via the Internet. In the case of a service for customizing operation image data for each user, the operation image data server 1200 generates operation image data according to the user, generates an electronic signature for the generated operation image data, and generates The digital signature is added to the created operation image data.

  A user of the television 100 obtains the operation image data with the electronic signature created by the operation image data server 1200 using the mobile phone terminal 200, confirms the icon image, and uses the obtained operation image data to the television. To 100. The television 100 verifies the validity of the electronic signature stored in the received operation image data, and if the electronic signature is valid, the service server 1100 sends a resource indicated by the URI embedded as processing designation information. get.

  The television 100 constituting the network service system 1000 has an electronic certificate verification function for verifying an electronic certificate in addition to an electronic signature verification function for verifying an electronic signature. An electronic certificate verification unit 123 included in the television 100 has an electronic certificate verification function. The configuration of such a television 100 is the same as that of a client of an e-mail system using S / MIME. Accordingly, the television 100 can use the public key after obtaining the public key with the electronic certificate via the network and verifying the reliability of the electronic certificate.

  FIG. 19 shows a configuration in which the operation image data server 1200 and the television 100 respectively acquire a secret key and a public key generated by the certificate authority 1300, but the configuration of the network service system 1000 is not limited to this. Absent. For example, the operation image data server 1200 may generate a secret key and a public key, and provide the generated public key to the television 100. Further, a configuration may be adopted in which a public key that is paired with a secret key used by the operation image data server 1200 to generate an electronic signature is stored in the television 100 in advance. In a configuration in which the television 100 obtains a public key via a network, it is desirable to guarantee the reliability of the public key by embedding the public key in the root certificate.

  The network service system 1000 described above provides the user with operation image data including a URI as process designation information, but process designation information designating a process other than access to the URI is embedded. The same effect can be expected when the operation image data is provided to the user.

  The icon image stored in the operation image data can also be used for displaying a message from the television 100 to the user. Conventionally, in various devices, user interfaces that display icons are used to notify that processing takes time. However, these icons are, for example, images previously incorporated in a device such as an hourglass, and it has not been possible to present to the user what processing is taking time. On the other hand, the television 100 according to the present invention can realize a user interface that clearly presents to the user what processing is taking time by using an icon image embedded in the operation image data. it can.

  FIG. 20 is a diagram illustrating an example of a message displayed on the television 100.

  FIG. 20A shows a message display dialog displayed on the television 100 when receiving the operation image data storing the process designation information for instructing the reserved program recording. As shown in FIG. 20 (a), an icon image corresponding to a program to be reserved for recording and an image of the contents of the program, and a message character string embedded in the operation image data (here, “ "Saturday early theater ... Scheduled recording") is embedded in the message display dialog, and the processing contents can be shown more specifically.

FIG. 20 (b), when the process specifying information instructing access to the network album has received the operation image data stored, a dialog for message display by the television 100 displays. As shown in FIG. 20 (b), an icon image corresponding to the album to be accessed is used to image the contents of the album, and a message character string embedded in the operation image data (here, “Net TV album”). ... "is displayed by embedding it in a message display dialog.

  When the television 100 receives these operation image data, the television 100 starts the processing (recording reservation processing and access to the network album) designated by the processing designation information by the same processing as described in FIGS. . In parallel with this, the television 100 develops the icon image stored in the operation image data using the decoding unit 102, and develops the developed icon image and message using the image processing unit 103 (display control means). The character string is output to the display unit 104. By such processing, the user who has transmitted the operation image data to the television 100 can immediately receive feedback by the icon image and the message on the dialog, and the operational feeling of the television 100 is improved. The icon image displayed in the dialog is image data stored in the operation image data. The message is a character string stored in the same operation image data. For example, the message is a character string stored in the message field of the metadata area 523 of the JPEG data (operation image data) 500 ′ shown in FIG. It is.

  Depending on the size and design of the display unit 104, a configuration in which the icon image is reduced or enlarged and only the icon is displayed without displaying a message is also conceivable.

  In the above, the configuration in which the process specified by the process specifying information stored in the received operation image data is executed immediately after reception has been described. However, the received operation image data is accumulated and the received operation is stored. The television 100 may be configured so that the process designated by the process designation information stored in the image data for use can be executed afterwards.

  FIG. 21 shows an operation image data storage unit 131 for storing received operation image data, and operation image data is selected based on a user operation from a group of operation image data stored in the operation image data storage unit 131. FIG. 2 is a block diagram illustrating a configuration of a television 100 including an operation image data selection unit 132 to be operated. FIG. 22 is a diagram illustrating an example of a user interface (display screen) displayed on the display unit 104 by the television 100 when selecting operation image data.

  In the television 100 shown in FIG. 21, when the processing designation information is extracted from the received image data by the processing designation information extraction unit 106, the extracted processing designation information is sent to the control unit 107, and the processing designation information is extracted by the processing designation information. The designated process is executed, and the image data is stored in the operation image data storage unit 131. That is, the process designation information stored in the image data designates a process to be executed by the television 100 and is also used as a judgment material for judging whether or not to save the image data in the operation image data storage unit 131. (If the processing designation information is stored, the television 100 stores the image data in the operation image data storage unit 131, and otherwise does not store it). With such a configuration, the television 100 can store the received operation image data in the operation image data storage unit 131.

  Further, the television 100 is configured to be able to display the user interface as shown in FIG. 22 on the display unit 104 at an arbitrary time. In this user interface, icon images and message character strings stored in the operation image data stored in the operation image data storage unit 131 are listed, and the user can select desired operation image data from this list. Can be selected. In response to this user operation, the operation image data selection unit 132 selects operation image data from the operation image data group stored in the operation image data storage unit 131. The operation image data selected by the operation image data selection unit 132 is sent to the processing designation information extraction unit 106 via the storage unit 101. The process designation information extraction unit 106 extracts process designation information from the selected operation image data, and passes the extracted process designation information to the control unit 107. Thus, when the user selects operation image data from the list shown in FIG. 22, the process designated by the process designation information stored in the selected operation image data is executed.

  In the user interface shown in FIG. 22, the scroll bar displayed at the right end indicates that the stored operation image data is other than the two operation image data displayed on the screen. The down scroll mark is displayed in a display state different from the normal state, for example, in a filled state, in order to indicate that the operation image data below can be displayed on the screen by pressing the down button. ing. By configuring the user interface in this way, even when a large number (three or more in this case) of operation image data is stored in the operation image data storage unit 131, the user can easily select desired operation image data. can do. The icon image possessed by the operation image data is indispensable for constructing a user interface that is easy to handle as shown in FIG.

  Note that the function that the operation image data itself serves as a remote control signal is lost, but when the operation image data is received, the operation image data is not immediately executed without performing the operation specified by the processing specification information. It is also conceivable to add an operation mode only for storing data to the television 100.

(Operating device)
Next, the operation device 200 that operates the television 100, that is, the mobile phone terminal 200 will be described.

  FIG. 10 is a block diagram showing a main configuration of the mobile phone terminal 200. As shown in FIG. 10, the mobile phone terminal 200 includes a storage unit (image data storage unit) 201, a display screen generation unit (image display unit) 202, a display unit 203, and an image data selection unit (image data selection unit) 204. , And an image data transmission unit (image data transmission means) 205.

  The storage unit 201 is means for storing image data, and is configured by, for example, a RAM. The display screen generation unit 202 is a means for generating a thumbnail list display screen for displaying a list of images of image data stored in the storage unit 201, particularly thumbnail images. The display unit 203 is a unit that displays the thumbnail list display screen generated by the display screen generation unit 202, and is configured by, for example, a liquid crystal display panel.

  The image data selection unit 204 is means for selecting image data to be transmitted to the television 100 from the image data group stored in the storage unit 201. The image data selection unit 204 selects image data based on a user operation input when the above-described thumbnail list display screen is displayed.

The image data transmission unit 205 reads out the image data selected by the image data selection unit 204 from the storage unit 201, and transmits the read image data to the television 100. More specifically, the image data transmission unit 205 includes an infrared light emitting unit, and transmits an infrared carrier wave carrying image data from the infrared light emitting unit. Protocol image data transmitting unit 205 employed in the transmission of the image data is the same as the protocol in which the image data receiving section 105 of the television 100 is used to receive image data, such as IRS im ple.

  FIG. 11 is a screen configuration diagram illustrating the configuration of the thumbnail list display screen 1000 displayed on the display unit 203 of the mobile phone terminal 200. As shown in FIG. 11, the thumbnail list display screen 1000 includes a thumbnail list display area 1000a for displaying thumbnails as a list and an operation guidance display area 1000b for displaying operation guidance.

  In the thumbnail list display area 1000a, thumbnails of image data stored in the storage unit 201 are displayed as a list. In the example shown in FIG. 11, thumbnails 1001 to 1004 of operation image data and thumbnails 1005 to 1009 of display image data are displayed.

  In the operation image data, in addition to the process designation information, an icon image representing the process designated by the process designation information is stored. Therefore, as thumbnails 1001 to 1004 of the operation image data, icon images corresponding to the processing designation information stored in each operation image data are displayed. As a result, the user can easily recognize on the thumbnail list display screen 1000 what kind of processing each image data for operation is image data for causing the television 100 to execute.

  Further, in each of the thumbnails 1001 to 1004 of the operation image data, a mark 1010 indicating that the image data is operation image data including processing designation information is displayed overlapping the icon image. Accordingly, the user can easily identify the thumbnails 1001 to 1004 of the operation image data from the thumbnails 1005 to 1009 of the display image data.

  The mark 1010 displayed on the thumbnails 1001 to 1004 of the operation image data may be written in advance on the icon image of each operation image data, or the mobile phone terminal 200 may display the image data. It is also possible to recognize and display that the processing designation information is stored.

  By writing the mark 1010 on the icon image in advance, even when a device that cannot recognize that the processing designation information is stored in the operation image data is used as the operation device, the image data is used as the operation image data. There is a merit that the user can recognize it. On the other hand, when the mark 1010 is displayed on the thumbnail image of the image data in which the processing designation information is stored, there is an advantage that the user can be informed accurately whether the processing designation information is stored in the image data. is there.

  While the display screen 1000 is displayed, the user uses an input unit such as a cross button provided on the mobile phone terminal 200 to select a desired thumbnail from a list of thumbnails displayed in the thumbnail list display area 1000a. Can be selected. A frame line 1011 is displayed around the currently selected thumbnail so that the user can easily confirm which thumbnail is currently selected. In the example shown in FIG. 11, it can be seen that the thumbnail 1006 is selected.

  When the user presses the infrared transmission button with one thumbnail selected, the image data selection unit 204 selects image data corresponding to the thumbnail selected at that time as image data to be transmitted. Then, the selected image data is transmitted to the television 100 by the image data transmission unit 205. It should be noted that the operation that the user should perform to transmit the image data described here is the same whether the operation image data is transmitted or the display image data is transmitted. is there.

  11 shows an example in which the thumbnails 1001 to 1004 of the operation image data and the thumbnails 1005 to 1009 of the display image data are displayed as a list on the same screen, but the icon image of the operation image data is displayed. The display method is not limited to this. That is, only the operation image data is stored in a specific folder, and the icon data of the operation image data is displayed by displaying a list of the image data (or thumbnail images) stored in the specific folder. Only a list may be displayed. At this time, the operation image data may be stored in a specific folder manually by the user or automatically by the mobile phone terminal 200.

  FIG. 12 is a screen configuration diagram showing a configuration example of another more preferable display screen 2000 displayed on the display unit 203. As shown in FIG. 12, the display screen 2000 includes an icon image display area 2001 for displaying a list of icon images of operation image data, and a thumbnail list display area 2002 for displaying a list of thumbnails of display image data. And an operation guidance display area 2003 for displaying operation guidance.

The icon image displayed in the icon image display area 2001 is displayed with a display size smaller than the thumbnail of the display image data. As a result, even when a large number of operation image data is stored in the storage unit 201, a sufficient number of icon images can be displayed in the icon image display area 2001 having a limited area. Yes. Note that the image is to the user may be restricted to the stored operation image data in the image folder currently viewing or operation image across a plurality of folders to be displayed in the icon image display region 2001 It may be a list of data search results.

  Further, an up page feed button 2101 is displayed at the top of the icon image display area 2001, and a down page feed button 2106 is displayed at the bottom of the icon image display area 2001. When a large number of image data for operation is stored in the storage unit 201 and all icon images cannot be displayed in the icon image display area 2001, the user presses the * or # button (the push for inputting the telephone number). By pressing one of the buttons corresponding to * or #, the display of the icon image display area 2001 is switched so that an icon image that cannot be displayed is displayed.

  Further, on the left side of each icon image, the number of a numeric button corresponding to the icon image (corresponding to the numbers 0 to 9 among the push buttons for inputting a telephone number) is displayed. For example, when the user presses the 1 button, the image data selection unit 204 selects operation image data corresponding to the icon image 2102, and when the user presses the 2 button, the image data selection unit 204 selects the icon image. The image data for operation corresponding to 2103 is selected. Accordingly, the user simply presses the number button corresponding to the number displayed on the left side of the icon image representing the process to be executed on the television 100, and the operation image storing the process designation information designating the process is stored. Data can be transmitted to the television 100.

  By displaying the display screen 200 shown in FIG. 12 in place of the thumbnail list display screen 1000 that is also used in conventional mobile phone terminals that are not supposed to transmit operation image data, the mobile phone terminal The operability when operating the television 100 using 200 can be further improved.

  As described above, the mobile phone terminal 200 has the image data transmission unit 205 that functions as the image data transmission unit that transmits the image data storing the process designation information for designating the process to be executed by the television 100 to the television 100. It is comprised including.

  In addition, the mobile phone terminal 200 is stored in the storage unit 201 and a storage unit 201 that functions as an image data storage unit that stores a plurality of operation image data that stores processing designation information that specifies processing to be executed by the television 100. An image that is included in each of the plurality of operation image data and that causes the display unit 203 to display a list of icon images that represent the process specified by the process specification information stored in each operation image data Based on the display screen generation unit 202 functioning as a display unit and the user operation input while the list display is performed, the operation image data stored in the storage unit 201 should be transmitted to the television 100. The image data selection unit 204 functions as image data selection means for selecting image data.

  IrSimple (registered trademark) can transmit data by switching between different communication methods. The communication method corresponding to a transmission rate from 2400 bps to 115.2 kbps differs from the communication method corresponding to a transmission rate exceeding 4 Mbps, and the communication method corresponding to a low transmission rate is a reaching distance. Is long. On the other hand, since image data storing processing designation information is considered to play a main role as an icon, it is expected that the data size tends to be relatively small. Therefore, when sending image data that contains processing specification information, select a low-speed and long reach communication method, and when sending image data that does not contain processing specification information, select a high-speed and short reach communication method. It is possible to do. Such selection is automatically performed by the image data transmission unit 205 of the mobile phone terminal 200, so that an image for control can be transmitted from a remote location, and convenience for the user is improved.

(Use Case)
Finally, the display image data is transmitted from the mobile phone terminal 200 to the television 100, and then the operation image data is transmitted from the mobile phone terminal 200 to the television 100, whereby the image of the display image data transmitted earlier is transmitted. On the other hand, a use case of performing image processing using operation image data transmitted later will be described with reference to FIG.

  First, the user operates the mobile phone terminal 200 to select display image data to be transmitted from the mobile phone terminal 200 to the television 100. Here, it is assumed that image data storing a picture of 1024 × 768 pixels expressed by the thumbnail 1006 is selected. The image data selected here is transmitted to the television 100 by infrared communication.

  In the television 100, when the reception of the image data is completed, the decoding unit 102 determines the image size of the received image data, and the processing designation information extraction unit 106 determines whether or not there is processing designation information. Since the image size of the received image data is 1024 × 768 pixels, which is larger than a predetermined threshold value, the decoding unit 102 executes expansion of the received image data. At this time, since the processing designation information is not included in the received image data, the image processing unit 103 performs default image processing on the developed image data, and displays an image of the received image data on the display unit 104. indicate. FIG. 13A shows a display screen displayed on the display unit 104 of the television at this time. As can be seen from FIG. 13 (a), the photograph of the image data transmitted from the mobile phone terminal 200 is taken with the camera tilted by 90 °, so that the person is displayed in a rollover state. .

  An arbitrary image can be set as the default image processing described above, but here, under the condition that the entire image is displayed in the display unit 104, the display size of the image is maximized. Assume that image processing for enlarging or reducing an image is set by default.

  In addition, when the shooting angle information indicating that the image was taken with the camera tilted by 90 ° is embedded in the image data, the television 100 displays the display angle based on the shooting angle information as described above. May be automatically corrected and displayed. However, with existing digital cameras and camera-equipped mobile phones, shooting angle information is often not correctly added, and as shown in FIG. 13A, a photograph can be displayed in a rollover state. .

  Therefore, based on the display screen 2000, the user operates the mobile phone terminal 200 so as to select an icon image 2103 that represents image processing that rotates the image 90 ° to the right. Receiving this operation, the mobile phone terminal 200 selects operation image data corresponding to the selected icon image 2103 and transmits it to the television 100.

  The operation image data corresponding to the icon image 2103 is image data in which processing designation information for designating image processing for rotating the image 90 ° to the right is stored. Therefore, the television 100 that has received the operation image data gives an instruction to the image processing unit 103 to execute image processing for rotating the image designated by the processing designation information 90 ° to the right. Upon receiving this instruction, the image processing unit 103 executes image processing for rotating the image of the previously received image data currently being displayed by 90 ° to the right, and outputs the rotated image to the display unit 104. FIG. 13B shows a display screen displayed on the display unit 104 at this time. As a result, the photograph that has been displayed in a rollover manner in FIG. 13A is displayed correctly.

  In the mobile phone terminal 200, the operation image data stored in the storage unit 201 may be stored in advance in the storage unit 201 at the time of shipment from the factory, or acquired by the mobile phone terminal 200 from the outside. It may be a thing. In the latter case, the manufacturer who sells the television 100 distributes the operation image data attached to a mail magazine distributed to the user of the television 100, or the user of the mobile phone terminal 200 uses the mobile phone. For example, a case where operation image data is downloaded from a website of a manufacturer that sells the television 100 using the terminal 200 is assumed.

  As described above, according to the present invention, when the controller device acquires image data in which processing designation information is stored from an outside, for example, an Internet server, an image generally used for handling image data. A transmission / reception function and a communication protocol, for example, an image attachment function to an e-mail or an image download function from a Web page can be used as they are for acquiring processing designation information.

In addition, the image data acquired in this way can include image information obtained by visualizing stored processing designation information. Therefore, a function generally used for selecting image data, for example, an image of a mobile phone There is also an effect that the viewer designation function can be used as it is for selecting the processing designation information for the purpose of the viewer function.
[Embodiment 2]
The following describes the second embodiment of the present invention with reference to the drawings.

  FIG. 24 is a block diagram showing the configuration of the operation system 1 ′ according to this embodiment. As shown in FIG. 24, the operation system 1 ′ is configured to include a television (image data receiving device) 100 ′ as an operated device and a mobile phone terminal 200 ′ as an operating device. The television 100 ′ includes a short-range wireless communication unit 101 ′, a reception data processing unit 102 ′, a network communication unit 103 ′, a reception data storage unit 104 ′, and a display unit 105 ′.

  The short-range wireless communication unit 101 ′ is a means for receiving image data in which processing designation information is stored from the mobile phone terminal 200 ′. The network communication unit 103 ′ is a means for executing a process designated by the process designation information stored in the image data received by the short-range wireless communication unit 101 ′. The reception data processing unit 102 ′ is a means for displaying the image of the image data received by the short-range wireless communication unit 101 ′ on the display unit 105 ′, and the short-range wireless communication unit 101 ′ is receiving image data. And information indicating that the network communication unit 103 ′ is executing the process designated by the process designation information is displayed on the display unit 105 ′.

  In the present embodiment, two types of process designation information are assumed as the process designation information stored in the image data received by the short-range wireless communication unit 101 ′. The first process designation information designates an acquisition / display process for acquiring a specific resource (such as an HTML document) on the Internet via the network and displaying content (such as a web page) based on the acquired resource. To do. The second process designation information designates a transmission process for transmitting the image data received by the short-range wireless communication unit 101 ′ to a specific web server on the Internet. The image data in which the first processing designation information is stored may be referred to as “invitation” in the UI so that the user can easily become familiar with the image data.

  By the way, the short-range wireless communication unit 101 ′ includes an infrared light receiving unit that receives infrared rays emitted from the mobile phone terminal 200 ′ and converts them into electrical signals. The image data is converted into image data in accordance with a predetermined protocol (for example, IrSimpleShot). Accordingly, the operator of the mobile phone terminal 200 ′ needs to point the infrared light emitting unit of the mobile phone terminal 200 ′ toward the television 100 ′ until the transmission of the image data is completed.

  For this reason, the television 100 ′ provides information indicating that image data is being received to the operator of the mobile phone terminal 200 ′ until the short-range wireless communication unit 101 ′ completes reception of the image data. It is preferably configured to present. This is because the operator of the mobile phone terminal 200 ′ can know how long the infrared light emitting unit 100 ′ of the mobile phone terminal 200 ′ should be directed toward the television 100 ′.

In addition, the short-range wireless communication unit 101 ′ is configured to store the received image data in the reception data storage unit 104 ′. Further, the network communication unit 103 ′ reads the processing designation information of the image data stored in the received data storage unit 104 ′, executes the process designated by the read processing designation information, or receives the received data storage unit 104 ′. The image data itself stored in is read out and the read image data is transmitted to a web server. Therefore, the image data received by the short-range wireless communication unit 101 ′ until the network communication unit 103 ′ completes the process specified by the process specifying information (particularly the process of transmitting the received image data to the web server). Must be stored in the received data storage unit 104 ′.

For this reason, the television 100 ′ stops waiting for image data, for example, by stopping the function of the short-range wireless communication unit 101 ′ until the network communication unit 103 ′ completes the process specified by the process specification information. It is preferable to do. This eliminates the need to simultaneously store two or more pieces of image data in the reception data storage unit 104 ′, so that the reception data storage unit 104 ′ can be configured with a smaller-capacity memory, thereby reducing the cost of the television 100 ′. Can be made.

  Also, in this case, the television 100 ′ gives information indicating that image data cannot be received to the operator of the mobile phone terminal 200 ′ until the network communication unit 103 ′ completes the process designated by the process designation information. It is preferable to present. Thereby, although the image data is transmitted, the process designated by the process designation information stored in the transmitted image data is not executed, thereby reducing the stress on the operator of the mobile phone terminal 200 ′. Can do.

  FIG. 25 is a flowchart showing a flow of processing executed by the television 100 ′ when image data is received from the mobile phone terminal 200 ′. Each step constituting the process shown in FIG. 25 will be described as follows.

When the short-range wireless communication unit 101 ′ starts to receive the image data transmitted from the mobile phone terminal 200 ′ , the short-range wireless communication unit 101 ′ notifies the reception data processing unit 102 ′ of the reception start. Receiving this notification, the received data processing unit 102 ′ displays information indicating that it is being received on the display unit 105 ′ (S101 ′). FIG. 26A is a diagram illustrating a display screen displayed on the display unit 105 ′ at this time. In the display screen illustrated in FIG. 26A, a character string “receiving” is displayed as information indicating that reception is in progress.

  The short-range wireless communication unit 101 ′ stores the received image data in the reception data storage unit 104 ′ (S102 ′). When the reception of the entire image data is completed (S103 ′: Yes), the reception completion is notified to the reception data processing unit 102 ′. Receiving this notification, the received data processing unit 102 ′ stops the function of the short-range wireless communication unit 101 ′ in order to stop waiting for new image data (S104 ′) and indicates that it is receiving. The information is deleted from the display unit 105 ′ (S105 ′).

Subsequently, the reception data processing unit 102 ′ displays, on the display unit 105 ′ , information indicating that the process designated by the process designation information is being executed, and information indicating that image data cannot be received. It is displayed (S106 ′). FIG. 26B is a diagram illustrating a display screen displayed on the display unit 105 ′ at this time. In the display screen illustrated in FIG. 26B, information indicating that the process specified by the process specifying information is being executed and that image data cannot be received is simultaneously displayed as “processing in progress”. "The invitation cannot be received" is displayed.

Subsequently, the reception data processing unit 102 ′ instructs the network communication unit 103 ′ to start processing. Network communication section 103 'that has received the instruction, reads out the process specifying information stored in the image data stored in the received data storage unit 104' in step S102 ', specified by the read process specifying information processing Is executed (S107 '). Details of this process will be described later with reference to another drawing.

  When the network communication unit 103 ′ completes the execution of the process designated by the process designation information (S108 ′: Yes), the received data processing unit 102 ′ performs short-range wireless communication in order to resume waiting for new image data. The function of the unit 101 ′ is activated (S109 ′).

Subsequently, the reception data processing unit 102 ′ displays information indicating that the process specified by the process specification information displayed in S106 ′ is being executed and information indicating that new image data cannot be received. The information is deleted from the unit 105 ' and information indicating that the image data can be received is displayed on the display unit 105 ' (S110 '). FIG. 26C illustrates the display screen displayed on the display unit 105 ′ at this time. In the display screen illustrated in FIG. 26C, a character string “I can receive an invitation” is displayed as information indicating that image data can be received.

  Next, details of step S107 ′ included in the flowchart shown in FIG. 26 will be described with reference to FIG.

  First, the received data processing unit 102 ′ reads out image data (hereinafter referred to as “received image data”) stored in the received data storage unit 104 ′ (S201 ′), and reads the header information of the read received image data. Analysis is performed (S202 ′). Here, the received image data is JPEG data, and the header information refers to meta information stored in the EXIF area of the JPEG data.

  When the processing designation information is not included as meta information in the EXIF area of the received image data (S203 ′: No), the received data processing unit 102 ′ decodes the received image data (S204 ′), and receives the decoded received data. The image data is expanded in the memory (S205 ′).

  On the other hand, when the process designation information is included as meta information in the EXIF area of the received image data (S203 ′: Yes), the received data processing unit 102 ′ performs the execution of the process designated by the process designation information via network communication. To the unit 103 '. The network communication unit 103 ′ reads the processing designation information from the received image data stored in the received data storage unit 104 ′, and executes processing according to the read processing designation information (S206 ′ to S208 ′).

  Here, FIG. 28 shows an implementation example of the processing executed by the network communication unit 103 ′ in step S207 ′. Refer to FIG. 30 for the processing executed by the network communication unit 103 ′ in step S208 ′.

  FIG. 28A shows an implementation example in which a confirmation screen is displayed and the process is terminated when reading of a URL (process designation information) from the received image data stored in the received data storage unit 104 ′ is completed. In this case, when the reading of the URL is completed, the television 100 ′ displays a confirmation screen as shown in FIG. 29A and resumes waiting for new image data.

  FIG. 28B is an implementation example in the case where the processing is completed when acquisition of the designated resource designated by the read URL is started. In this case, the television 100 ′ resumes waiting for new image data when starting to acquire the designated resource (see FIG. 29B).

  FIG. 28C is an implementation example in the case where the processing is completed when the display of the specified content is completed based on the specified resource. In this case, the television 100 ′ resumes waiting for new image data when the display of the designated content is completed (see FIG. 29C).

  FIG. 28D shows an implementation example when the processing is completed when all the information included in the designated content is displayed by scrolling to the end of the page. In this case, the television 100 ′ resumes waiting for new image data when all the information included in the designated content has been displayed. Such a configuration has an advantage for the invitation (received image data) provider that all information included in the designated content can be reliably presented to the user of the television 100 '.

  Also in step 208 ′, a confirmation screen as shown in FIG. 31 may be displayed. By using such a confirmation screen, the user can cancel transmission of image data as necessary. When such a confirmation screen is displayed, the flowchart shown in FIG. 30 may be changed as shown in FIG. 32, for example.

(Additional notes)
If the image data receiving apparatus according to the present invention has an image processing function, the image processing function can be configured to be controlled based on the image data.

In other words, the image data receiving apparatus according to the present invention further includes image processing means for processing an image by image processing, and the control means includes the processing designation information other than the image stored in the received image data. When the image processing for the image is designated, the image processing means may be controlled to execute the image processing designated by the processing designation information.

The image data receiving apparatus according to the present invention is an operation signal receiving means for receiving an operation signal for operating the image data receiving apparatus from the outside, and communicates infrared rays, which is different from the image data receiving means. It is preferable to further include an operation signal receiving means as a medium.

The operation signal receiving means receives an operation signal for operating the own apparatus from the outside, and does not need to receive image data. For this reason, for example, by using a communication protocol for a remote controller, it is possible to receive an operation signal issued from an operating device located several meters away from the image data receiving device. On the other hand, the image data receiving means uses, for example, a high-speed infrared communication protocol or a short-range wireless communication protocol to transmit an image transmitted from the image data transmitting device located about 1 meter away from the image data receiving device. Data can be configured to be received at high speed.

That is, according to the above configuration, the image data receiving means for receiving the image data transmitted from the nearby image data transmitting apparatus at a high speed, and the operation signal receiving means for receiving the operation signal emitted from the distant operation apparatus. Can be made to function by dividing roles.

The controller device according to the present invention selects a different communication method for transmitting image data storing the process specifying information and for transmitting image data not storing the process specifying information. It may be configured.

The image data may be configured to further include an electronic signature for the processing designation information.

According to said structure, when the image data receiving apparatus using the said image data has an electronic signature verification function, the reliability of the said image data can be improved. That is, when the image data has been tampered with, it is possible to prevent the image data receiving apparatus from executing an unexpected process designated by the process designation information stored in the image data. it can.

In the image data receiving apparatus, while the image data receiving unit receives the image data in which the processing designation information is stored, information indicating that the image data is being received is displayed on the display unit. It is preferable that display control means is further provided.

When the image data receiving means is configured to receive image data transmitted by being superimposed on a directional carrier wave, the operator of the transmitting device that transmits the carrier wave completes transmission of the image data. In the meantime, it is necessary to point the transmitting device toward the image data receiving means. Even in such a case, according to the above configuration, the operator of the transmission apparatus can know how long it is necessary to point the transmission apparatus in the direction of the image data receiving unit. I don't feel stress.

In the image data receiving apparatus, it is preferable that the image data receiving unit does not receive new image data while the process designated by the process designation information is being executed.

According to the above configuration, the image data receiving unit does not receive new image data while the process specified by the process specifying information is being executed. Therefore, a plurality of image data will not be accumulated in an unprocessed state in the memory for storing the image data received by the image data receiving means.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  Finally, each block of the image data receiving apparatus (television) 100 may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the image data receiving apparatus 100 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and a RAM (random access memory) that expands the program. ), A storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a recording medium in which a program code (execution format program, intermediate code program, source program) of a control program of the image data receiving apparatus 100, which is software that realizes the functions described above, is recorded in a computer-readable manner. Can also be achieved by supplying the image data to the image data receiving apparatus 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the image data receiving apparatus 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  Each block of the operation device (mobile phone terminal) 200 may also be configured by hardware logic, or may be realized by software using a CPU, as described above for the image data receiving device 100. .

  Each block of the television 100 ′ (image data receiving device 100 ′) may also be configured by hardware logic, or may be realized by software using a CPU as described above for the image data receiving device 100. May be.

  The present invention can be applied to an arbitrary device having an image data receiving function and an operating device for operating the device. In particular, it can be suitably used for an image data receiving device that can receive image data by a high-speed infrared communication protocol, such as IrSimple, and an operation device that can transmit image data by the same protocol.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a block diagram illustrating a main configuration of an image data receiving device (television). 1 is a block diagram illustrating a schematic configuration of an operation system according to an embodiment of the present invention. FIG. 2 is a data structure diagram showing an embodiment of the present invention and showing a data structure of image data used for operating an image data receiving device (television). FIG. 4 is a diagram illustrating an example of processing designation information stored in the maker note area of the image data illustrated in FIG. 3 according to the embodiment of the present invention. FIG. 4 is a diagram illustrating an embodiment of the present invention and a list of command codes stored as processing designation information in the image data illustrated in FIG. 3 and processes assigned to the command codes. FIG. 6 illustrates an embodiment of the present invention, and is a diagram illustrating a correspondence relationship between a display magnification and a code expressing the display magnification in the command code illustrated in FIG. 5. 4 is a flowchart illustrating an embodiment of the present invention and illustrating a flow of processing executed when an image data receiving device (television) receives image data. 5 is a flowchart illustrating an embodiment of the present invention and illustrating a flow of image display control executed by an image data receiving device (television) based on processing designation information. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a block diagram illustrating a main configuration of an image data receiving device (television). BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a block diagram showing a main configuration of an operating device (mobile phone terminal). BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a screen configuration diagram illustrating a configuration example of a display screen displayed on an operation device (mobile phone terminal). FIG. 7 is a screen configuration diagram illustrating another configuration example of a display screen displayed on the operation device (mobile phone terminal) according to the embodiment of the present invention. FIG. 13A shows an embodiment of the present invention, and FIG. 13A is an explanatory diagram for explaining how the received display image data is displayed on the image data receiving device (television), and FIG. These are explanatory drawing explaining a mode that the image in which the image processing based on the received operation image data was performed is displayed on an image data receiver (television). FIG. 7 is a diagram schematically illustrating a method for improving the reliability of image data for operation using an electronic signature, according to an embodiment of the present invention. FIG. 3 is a data structure diagram illustrating an example of the configuration of image data for operation with a digital signature according to the embodiment of this invention. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates an embodiment of the present invention, and is a block diagram illustrating a configuration example of an image data receiving device (television) corresponding to operation image data with a digital signature. 4 is a flowchart illustrating an embodiment of the present invention and a flow of processing executed by the image data receiving apparatus (television) on the operation image data with a digital signature. FIG. 18, showing the embodiment of the present invention, is a diagram illustrating a configuration example of a display screen displayed by the image data receiving device (television) in the process illustrated in FIG. 17. FIG. 17A illustrates a display screen that is displayed when there is no electronic signature, FIG. 17B illustrates a display screen that is displayed when the electronic signature is invalid, and FIG. The display screen displayed when the issuer of the electronic certificate is not a reliable issuer is illustrated. 1, showing an embodiment of the present invention, is a system configuration diagram showing a schematic configuration of a network service system using a public key infrastructure. FIG. FIG. 20 (a) and FIG. 20 (b) show an example of the configuration of a display screen displayed by the image data receiving device (television), respectively. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates an embodiment of the present invention, and is a block diagram illustrating a configuration example of an image data receiving device (television) capable of storing operation image data. FIG. 22 is a diagram illustrating a configuration example of a display screen displayed by the image data receiving device (television) illustrated in FIG. 21 according to the embodiment of the present invention. FIG. 2 is a data structure diagram showing an embodiment of the present invention and showing a data structure of image data used for operating an image data receiving device (television). FIG. 2 is a data structure diagram showing an embodiment of the present invention and showing a data structure of image data used for operating an image data receiving device (television). It is a block diagram which shows the 2nd Embodiment of this invention and shows the principal part structure of a television. 12 is a flowchart illustrating a flow of processing executed by the television set that has received the image data according to the second embodiment of the present invention. FIG. 10 is a diagram illustrating a display screen displayed on a television when image data in which processing designation information is stored is received according to a second embodiment of the present invention. FIG. 27A is a display screen displayed until the reception of the image data is completed, and FIG. 27B is displayed while executing the process specified by the process specifying information. FIG. 27C shows a display screen that is displayed after the process designated by the process designation information is completed. FIG. 4 illustrates a second embodiment of the present invention, which is executed by a television set when processing designation information is not stored in received image data and when processing designation information is stored in received image data It is the flowchart which showed the detail of the process to perform. It is a flowchart which shows the 2nd Embodiment of this invention and showed the example of the acquisition / display process which a network communication part performs. FIG. 29A is an implementation example in the case where the processing is completed when acquisition of the designated resource designated by the read URL is started, and FIG. 29B is designated based on the designated resource. FIG. 29C shows an implementation example in which processing is completed when content display is completed. FIG. 29C shows that processing is completed when all information included in the specified content is displayed. This is an implementation example. It is a flowchart which shows the 2nd Embodiment of this invention and showed the example of the transmission process which a network communication part performs. FIG. 10 is a diagram illustrating a display screen displayed on a television when receiving image data in which processing designation information for designating transmission processing is received according to a second embodiment of the present invention. It is a flowchart which showed the 2nd Embodiment of this invention and showed the modification of the transmission process which a network communication part performs.

1 Operation System 100 Television (Image Data Receiver)
101 Storage Unit 102 Decoding Unit 103 Image Processing Unit (Image Processing Unit)
104 display unit 105 image data receiving unit (image data receiving unit)
106 Process designation information extraction unit (process designation information extraction means)
107 Control unit (control means)
111 Communication unit (data receiving means, data transmitting means)
112 Display screen generation unit 200 Mobile phone terminal (operation device)
201 Storage unit (image data storage means)
202 Display screen generation unit (image display means)
203 display unit 204 image data selection unit (image data selection means)
205 Image data transmission unit (image data transmission means)

Claims (20)

Image data receiving means for receiving, from the outside, image data stored in an area for storing processing information for specifying processing to be executed by the own device;
Control means for controlling the device itself to execute the process designated by the process designation information stored in the received image data immediately after receiving the image,
The processing designation information designates at least image processing for an image other than the image stored in the received image data, or processing other than image processing,
An image data receiving apparatus characterized by the above. A data receiving means different from the image data receiving means, further comprising a data receiving means for receiving data from another communication device,
The control means includes
Controlling the data receiving means so as to receive data designated by the process designation information from a communication apparatus designated by the process designation information or a predetermined communication apparatus;
The image data receiving apparatus according to claim 1 , wherein: Further comprising data transmission means for transmitting data to another communication device;
The control means includes
Controlling the data transmission means to transmit the data designated by the process designation information to a communication apparatus designated by the process designation information or a predetermined communication apparatus;
The image data receiving device according to claim 1 , wherein the image data receiving device is an image data receiving device. The control means includes
The validity of the electronic signature included in the image data in which the process designation information is stored is verified, and the process designated by the process designation information is executed only when the digital signature is valid. Control the device,
The image data receiving apparatus according to claim 1 , wherein the image data receiving apparatus is an image data receiving apparatus. The control means includes
It is determined whether or not the image data in which the processing designation information is stored includes an electronic signature. If the electronic signature is not included, only when a user operation permitting the execution is input. Control the device to execute the process specified by the process specification information.
The image data receiving apparatus according to claim 1 , wherein the image data receiving apparatus is an image data receiving apparatus. Display control means for displaying the image stored in the received image data on the display unit to indicate that the process designated by the process designation information is being executed;
The image data receiving apparatus according to claim 1 , wherein the image data receiving apparatus is an image data receiving apparatus. An operating device for operating an image data receiving device,
Means for obtaining, via a network, processing designation information for designating processing to be executed by the image data receiving apparatus and image data stored in an area for storing an electronic signature in a meta information ;
Of the data stored in the image data as the meta information, a means for rewriting data that is not subject to the electronic signature;
The image data comprises a an image data transmitting means for transmitting to the image data receiving device,
The processing designation information designates at least image processing for an image other than the image stored in the transmitted image data, or processing other than image processing,
An operating device characterized by that. Image data storage means for storing a plurality of pieces of image data storing process specifying information specifying a process to be executed by the image data receiving device;
An image included in each of the plurality of image data stored in the image data storage means for identifying a process designated by the process designation information stored in each image data is displayed on the display unit. Image display means for displaying a list;
Image data selection means for selecting image data to be transmitted to the image data receiving device from image data stored in the image data storage means based on a user operation acquired while the list display is being performed; Further comprising
The image display means displays an image included in each of the plurality of image data storing the process specifying information so as to be distinguishable from an image included in image data not storing the process specifying information,
The image data transmission means includes
Transmitting the image data selected by the image data selecting means to the image data receiving device;
The operating device according to claim 7 . A data structure of image data including an image,
Process designation information designating a process to be executed by the image data receiving apparatus that has received the image data, and at least an image process for an image other than the image stored in the image data, or a process other than the image process The processing designation information to be designated and the electronic signature for the image are stored in the area for storing the meta information,
The image included in the image data is an image displayed on the operating device that operates the image data receiving device by transmitting the image data to the image data receiving device, and is designated by the processing designation information. It is an image for identifying
A data structure of image data characterized by the above. An operating system including an image data receiving device and an operating device for operating the image data receiving device,
The operating device is
Image data transmitting means for transmitting, to the image data receiving device, image data stored in an area for storing meta information in which processing specification information for specifying processing to be executed by the image data receiving device is stored. And
The image data receiving device
Image data receiving means for receiving the image data transmitted from the image picture data transmission apparatus,
Control means for controlling the device itself to execute the process designated by the process designation information stored in the received image data immediately upon reception of the image data,
The processing designation information designates at least image processing for an image other than an image stored in the image data transmitted from the operating device to the image data receiving device, or processing other than image processing.
An operation system characterized by that. A control method in which the image data receiving device controls its own device,
A reception step of receiving image data stored in an area for storing process information, which specifies process to be executed by the own apparatus, from the outside;
A control step for controlling the device itself to execute the process specified by the process specification information stored in the received image data immediately after receiving the image data,
The processing designation information designates at least image processing for an image other than the image stored in the received image data, or processing other than image processing,
A control method characterized by that. An operating method in which the operating device operates the image data receiving device,
Acquiring image data stored in an area for storing electronic information by the electronic signature via a network;
Rewriting the data that is not the target of the electronic signature among the data stored as the meta information;
The image data including the process specifying information for specifying a process which should the image data receiving apparatus executes, includes a transmitting step of transmitting to the image data receiving device,
The processing designation information designates at least image processing for an image other than the image stored in the transmitted image data, or processing other than image processing,
The operation method characterized by this. The data stored in the image data as the meta information includes data that is not subject to verification of the validity of the electronic signature in the verification of the validity of the electronic signature in the control means. The image data receiving device according to claim 4. 2. The image data receiving apparatus according to claim 1, wherein the process designation information is information for designating a registration process of a viewing reservation or a recording reservation registration process. 10. The data structure according to claim 9, wherein the data stored in the image data as the meta information includes data that is not subject to the electronic signature. When the process designation information is stored in the received image data, the process designated by the process designation information is executed,
2. The image data receiving apparatus according to claim 1, wherein when the processing designation information is not stored in the received image data, an image stored in the received image data is displayed. The image data receiving apparatus according to claim 6, wherein a part or all of the processing designation information stored in the received image data is displayed on the display unit . A program for operating a computer as the image data receiving apparatus according to any one of claims 1 to 6, 13, 14, 16, and 17 ,
A program for causing the computer to function as each means provided in the image data receiving apparatus. A program for causing a computer to operate as the operating device according to claim 7 or 8 ,
A program for causing the computer to function as each means provided in the operation device. A computer-readable recording medium in which the program according to claim 18 or 19 or the image data having the data structure according to claim 9 or 15 is recorded.