JP2010198302A - Content remote control system and remote control terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content remote system capable of remotely controlling contents which are reproduced by an electronic signboard or the like. <P>SOLUTION: After projecting the image of an icon in which the operation content of content is represented, a remote control terminal 2 photographs a display part 32 of a content control device 3, and specifies content in which the images of icons are overlapped. Then, when an operation button 250 is depressed, the remote control terminal 2 transmits an operation event message including the identifier of the icon whose image has been projected and the identifier of the content to be operated to the content control device 3 by using radio communication. When receiving the operation event message, the content control device 3 executes command processing to be specified by the identifier of the command associated with the identifier of the icon included in the operation event message. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention is an invention for remotely controlling content reproduced on an electronic signboard or the like.

  With recent advances in digitization technology, electronic signboards using large displays and projectors have been installed in various places such as amusement facilities and hospitals, instead of signboards using paper media.

  As an advantage of adopting an electronic signboard, in addition to being able to easily and quickly change the content to be reproduced on the electronic signboard, the electronic signboard user can operate the content.

  In order to operate the content played on the electronic signboard, a physical operation interface (for example, a touch panel) used for the operation of the content may be provided on the electronic signboard. Has been.

  For example, in Patent Document 1, a portable radio terminal connected to a street monitor terminal device that reproduces content by short-range wireless communication is used, and a route guidance image to a destination selected by the portable radio terminal is displayed on the street monitor terminal device. A playback system is disclosed.

  Further, in Patent Document 2, icons corresponding to various commands are displayed on the screen together with contents, the area where the icons are displayed is photographed at least by the camera, and the tip of the pointing bar is analyzed by analyzing the image photographed by the camera. An apparatus for specifying a position and executing a command (for example, a screen scrolling process) corresponding to an icon indicated by a pointer is disclosed.

  However, according to the invention disclosed in Patent Document 1, the user can select and operate the content to be played back on the street monitor terminal device by remote operation using the portable wireless terminal. Users other than operating cannot check the status (for example, the destination selection status) in which the content is being operated.

  Furthermore, according to the invention disclosed in Patent Document 2, it is possible to execute a command (for example, a screen scrolling process) corresponding to the icon indicated by the pointing bar. It is necessary to display icons and lacks operability when there are many commands.

Japanese Patent Laid-Open No. 2003-85176 Japanese Patent Laid-Open No. 7-49748

  Therefore, the present invention provides a new content remote system and remote operation terminal for operating content reproduced on an electronic signboard, etc., and can execute various commands such as scroll processing, and the content is operated. The user other than the operator can check the current status (for example, the destination selection status) and prevent all icons corresponding to the content from being displayed.

  A first invention that solves the above-described problem is a content remote operation that includes a remote operation terminal that is used when content is remotely controlled, and a content control device that controls the content in accordance with an instruction from the remote operation terminal. The remote operation terminal includes a wireless communication unit for wirelessly communicating with the content control device, a projector unit for projecting an image of an icon representing content operation details, and a projection range of the projector unit A camera unit in which a shooting range is set so as to include content information, content information in which specific information for identifying the content is associated with the identifier of the content, and icon information in which the icon image is associated with the identifier of the icon Generating a data storage device and an icon event for setting the icon An icon event generation unit, an operation event generation unit for generating an operation event for operating the content, and a process for causing the user to select an image of the icon to be projected by the projector unit when the icon event is detected Analyzing the image captured by the camera unit using means for instructing the projector unit to project the icon image that has been projected, and the specific information included in the projected image of the icon and the content information Thus, the first process of acquiring the identifier of the content that overlaps the image of the icon, and the operation including the identifier of the icon on which the image is projected and the identifier of the content to be operated when the operation event is detected The event message is transmitted to the content control device using a wireless communication unit. The content control device includes a communication unit for communicating with the remote operation terminal, a display unit for displaying the content, and the display content of the content is changed. A data storage device that stores command information in which the icon identifier is associated with the identifier of the command to be played, the content is reproduced on the display unit, and the operation event message is received from the remote operation terminal. A content control unit that executes command processing specified by an identifier of a command associated with the identifier of the icon included in the icon, and changes display content of the content specified by the identifier of the content included in the operation event message Content remote characterized by comprising Operation system.

  According to the content remote operation system described in the first invention, since the remote operation terminal is used for the operation of the content, it is not necessary to provide a physical interface for operating the content on the content control device side. The operator can remotely operate the content from a location away from the content control device.

  If a plurality of icons corresponding to various commands such as scroll processing are prepared, it is possible to cause the content control apparatus to execute various commands such as scroll processing using a remote operation terminal. In addition, since the image of the icon indicating the content is projected by the remote operation terminal, a user other than operating the content can check the status of the content being operated.

  Furthermore, since the image of the icon indicating the content is projected by the remote operation terminal, there is no need to display a plurality of icons corresponding to the command on the display unit, and the content to be operated on the remote operation terminal side is not displayed. In order to specify, even when a plurality of contents are reproduced, it is possible to operate for each content using the same icon image.

  Further, according to a second aspect, in the content remote operation system according to the first aspect, the operation event generation unit of the remote operation terminal generates the operation event according to a user operation, and the control unit In the second process, an identifier of the detected operation event is included in the operation event message, and the content control unit uses the operation parameter included in the operation event message as a command parameter of the command. A content remote control system characterized by the above.

  According to the second invention described above, it is possible to change the command processing depending on the operation event that occurs even for the same icon.

  Furthermore, according to a third aspect, in the content remote control system according to the second aspect, the control unit of the remote control terminal can identify the content overlapping the icon image in the second processing. The content remote operation system is characterized in that only when the operation event message is transmitted.

  According to the third aspect described above, when the content overlapping the icon image cannot be specified, the process of transmitting the operation event message can be interrupted.

  Further, according to a fourth aspect, in the content remote control system according to the second or third aspect, the icon information is projected in association with the icon identifier in the icon information. The identifier of the operation event that can be accepted is stored, and the control unit is configured to associate the detected identifier of the operation event with the identifier of the icon on which the image is projected in the second process. The content remote operation system is characterized in that only the operation event message is transmitted.

  According to the fourth aspect described above, when the identifier of the detected operation event is not associated with the identifier of the icon on which the image is projected, the process of transmitting the operation event message can be interrupted.

  Further, according to a fifth aspect, in the content remote control system according to any one of the second to fourth aspects, the content information is reproduced in association with an identifier of the content. The identifier of the icon that can be accepted at the time of storage is stored, and the control unit associates the identifier of the icon projecting the image with the identifier of the content to be operated in the second process. The content remote operation system is characterized in that the operation event message is transmitted only when the operation event message is received.

  According to the fifth aspect described above, when the identifier of the icon projecting the image is not associated with the identifier of the content to be operated, the process of transmitting the operation event message can be interrupted.

  Furthermore, a sixth invention is the content remote operation system according to the fifth invention, wherein the content information includes the operation event associated with an identifier of the icon that can be accepted when the content is being reproduced. An identifier is stored, and the control unit of the remote operation terminal detects, in the second process, the identifier of the icon projecting the image is associated with the identifier of the content to be operated and further detected The content remote operation system is characterized in that the operation event message is transmitted only when the operation event identifier is associated with the icon identifier.

  According to the sixth aspect described above, the identifier of the icon projecting the image is associated with the identifier of the content to be operated, and the detected operation event identifier is not associated with the identifier of the icon. In this case, the process of sending an operation event message can be interrupted.

  Furthermore, a seventh invention is the content remote control system according to any one of the first to sixth inventions, wherein the content control unit reproduces the content by the first content that identifies the content. The content information stored in the data storage device of the remote control terminal includes feature information as a mark, and a second mark common to the icon is included at a predetermined position of the icon image. The image of the first mark included in the content and the size of the content are stored in association with the identifier of the content, and the icon information includes the image of the second mark, its size, and the identifier of the icon. The image of the icon and its size are stored in association with each other, and the control unit uses the first mark in the first process. Then, the identifier of the content included in the image captured by the camera unit and the coordinates of the content on the projected image are specified, and further, the second mark is used to display the content on the video. The content remote control system identifies the content that overlaps the icon image by identifying the coordinates of the icon.

  According to the seventh aspect described above, the control unit of the remote control device can execute the first process.

An eighth invention is a content remote operation system including a remote operation terminal used when remotely operating content, and a content control device that controls content according to an instruction from the remote operation terminal, The remote operation terminal includes a wireless communication unit for wirelessly communicating with the content control device, a projector unit for projecting an icon image representing content operation details, and a shooting range so as to include a projection range of the projector unit. Is associated with the content information in which specific information for identifying the content is associated with the identifier of the content, the icon information in which the icon image is associated with the identifier of the icon, and the identifier of the icon Set the data storage device that stores command information and the icon An icon button for generating an icon event, an operation button for generating an operation event for operating the content, and a process for causing the user to select an image of the icon to be projected by the projector unit when detecting the icon event, Using the means for instructing the projector unit to project the image of the selected icon and the specific information included in the projected image of the icon and the content information, the image captured by the camera unit is analyzed When the operation event is detected, the first process of acquiring the content identifier that overlaps the icon image is detected, and a command associated with the icon identifier is transmitted to the content using a wireless communication unit. A control unit that executes a second process to be transmitted to the control device;
The content control device, a communication unit for communicating with the remote operation terminal, a display unit for displaying the content, playing the content on the display unit, and receiving a content identifier and a command from the remote operation terminal A content control unit that executes processing specified by the command for the content corresponding to the content identifier and changes the display content of the content,
The content remote control system is characterized by the above.

  The ninth aspect of the present invention is the content remote operation system according to the eighth aspect, wherein the remote operation terminal includes a plurality of the operation buttons that generate the different operation events, and the control unit performs the second process. And selecting a command corresponding to the detected identifier of the operation event and the identifier of the icon.

  A tenth aspect of the invention is a remote control terminal used when remotely controlling content, wherein the remote control terminal includes a wireless communication unit for wirelessly communicating with a device that controls the content, and content operation details. Content information in which a projector unit that projects an image of the represented icon, a camera unit in which a shooting range is set to include the projection range of the projector unit, and specific information that identifies the content are associated with the identifier of the content And a data storage device for storing icon information in which the icon image is associated with the icon identifier, an icon event generating unit for generating an icon event for setting the icon, and an operation event for operating the content When an operation event generation unit to detect the icon event, A process of causing the user to select an image of the icon to be projected by the projector unit is executed, and the projector unit is instructed to project the icon image of the selected icon. Then, the projected icon image and the content information are displayed. First processing for obtaining an identifier of the content that overlaps the image of the icon by analyzing the image captured by the camera unit using the specific information included, and when the operation event is detected, the image is projected. A control unit that executes a second process of transmitting an operation event message including the identifier of the icon being operated and the identifier of the content to be operated to the device using a wireless communication unit. This is a featured remote control terminal.

  Further, an eleventh invention is the remote operation terminal according to the tenth invention, wherein the operation event generation unit of the remote operation terminal generates the operation event according to a user operation, and the control unit includes: In the second process, an identifier of the detected operation event is included in the operation event message, and the content control unit of the command control device uses the operation parameter included in the operation event message as a command parameter of the command. It is a remote control terminal characterized by being used as

  Furthermore, the twelfth invention is the remote operation terminal according to the eleventh invention, wherein the control unit of the remote operation terminal can identify the content overlapping the icon image in the second process. Only the remote operation terminal is characterized by transmitting the operation event message.

  Furthermore, a thirteenth invention is the remote operation terminal according to the eleventh invention or the tenth invention, wherein the icon information is projected in association with the icon identifier in the icon information. The identifier of the operation event that can be accepted is stored, and the control unit, in the second process, only when the detected identifier of the operation event is associated with the identifier of the icon on which the image is projected. A remote operation terminal that transmits the operation event message.

  Furthermore, the fourteenth invention is the remote operation terminal according to any one of the eleventh to twelfth inventions, wherein the content is reproduced in association with an identifier of the content in the content information. The identifier of the icon that can be received when the icon is stored is stored in the second processing, and the identifier of the icon that is projecting the image is associated with the identifier of the content to be operated. The remote operation terminal is characterized in that the operation event message is transmitted only when the remote control terminal is on.

  The fifteenth aspect of the invention is the remote operation terminal according to the fourteenth aspect of the invention, wherein the content information includes the operation event associated with an identifier of the icon that can be accepted when the previous content is being reproduced. An identifier is stored, and the control unit of the remote operation terminal detects, in the second process, the identifier of the icon projecting the image is associated with the identifier of the content to be operated and further detected The remote operation terminal transmits the operation event message only when the identifier of the operation event is associated with the identifier of the icon.

  Furthermore, the sixteenth invention is the remote control terminal according to any one of the tenth to fifteenth inventions, wherein the content reproduced by the content control unit is a first mark for identifying the content. In addition, the content information stored in the data storage device of the remote operation terminal includes, as feature information, a second mark common to the icon at a predetermined position of the icon image. The image of the first mark included in the content and the size of the content are stored in association with the identifier of the content, and further, the icon information includes the image of the second mark, its size, and the identifier of the icon. The image of the icon and the size thereof are stored in association with each other, and the control unit uses the first mark in the first process, An identifier of the content included in the image photographed by the camera unit and the coordinates of the content on the projected image are specified, and further, the coordinates of the icon on the video are determined using the second mark. By specifying the remote control terminal, the content that overlaps the icon image is specified.

  The tenth to sixteenth inventions relate to remote control terminals.

  As described above, according to the present invention described above, various commands such as scroll processing can be executed, and a situation in which content is operated (for example, a destination selection situation) can be confirmed by a user other than the operator. In addition, it is possible to provide a content remote control system and a remote control terminal that do not display all icons corresponding to the content.

The figure explaining a content remote control system. The figure which showed an example of the external appearance of a remote control terminal. The block diagram of a remote control terminal. The figure explaining an event table. The figure explaining icon information. The figure explaining content information. The flowchart which showed the procedure of the 1st process which projects the image of an icon and specifies the content used as operation object. The figure which showed an example of the camera image containing a 1st marker and a 2nd marker. The flowchart which showed the procedure of the 2nd process which transmits an operation event message to a content control apparatus. The block diagram of a content control apparatus. The figure explaining command information. The flowchart explaining the operation | movement which performs the command corresponding to an operation event message. The figure which showed the display part before a command is performed. The figure which showed the display part after performing the command to scroll. The figure which showed the display part after performing the command to zoom. The figure which showed the display part after performing the command to rotate.

  From here, this invention is demonstrated to such an extent that it can implement, showing embodiment of this invention. FIG. 1 is a diagram for explaining a content remote operation system 1 according to the present embodiment.

  As shown in FIG. 1, the content remote control system 1 according to the present embodiment reproduces a content with a remote control terminal 2 that is used for operating the content (for example, scrolling, enlarging / reducing and rotating), It is comprised at least from the content control apparatus 3 which controls a content according to the instruction | indication of the remote control terminal 2. FIG.

  The remote operation terminal 2 is provided with a wireless communication unit for wirelessly communicating with the content control device 3, and can remotely operate the content reproduced by the content control device 3. In order to remotely control the content being played back by the content control device 3, the remote control terminal 2 includes a projector unit 22 for projecting an icon image representing the operation details of the content, and a projection range of the projector. The camera unit 23 in which the shooting range is set to include, an icon button 240 for generating an icon setting event for setting an icon, and an operation button 250 for generating an operation event for operating content are provided.

  When the remote operation terminal 2 detects an icon setting event that occurs when the icon button 240 is pressed, the remote operation terminal 2 executes a process of causing the user to select an icon image to be projected by the projector unit 22 and projects the selected icon image. Is instructed to the projector unit 22, and then the identifier of the content that overlaps the icon image is obtained by analyzing the image captured by the camera unit 23.

  When the remote operation terminal 2 detects an operation event that occurs when the operation button 250 is pressed, the remote operation terminal 2 transmits an operation event message including the identifier of the icon on which the image is projected and the identifier of the content to be operated, via wireless communication. The content is transmitted to the content control device 3 using the unit.

  The content control device 3 includes a communication unit for communicating with the remote operation terminal 2 and a display unit 32 for displaying the content. When the content is reproduced on the display unit 32, an operation event is received from the remote operation terminal 2. When the message is received, processing of the command specified by the identifier of the icon included in the operation event message is executed, and the display content of the content is changed.

  As described above, according to the content remote operation system 1 according to the present embodiment, since the remote operation terminal 2 is used for content operation, a physical interface for operating content is not provided on the content control device 3 side. The person who operates the content can remotely operate the content from a location away from the content control device 3.

  If a plurality of icons corresponding to various commands such as scroll processing are prepared, it is possible to cause the content control device 3 to execute various commands such as scroll processing using the remote operation terminal 2. In addition, since the image of the icon indicating the content is projected by the remote operation terminal 2, a user other than operating the content can check the status of the content being operated.

  Furthermore, since the image of the icon indicating the content is projected by the remote operation terminal 2, there is no need to display a plurality of icons corresponding to the command on the display unit 32, and the remote operation terminal 2 side selects the operation target. Therefore, even when a plurality of contents are reproduced, the same icon image can be used for each content.

  First, the remote operation terminal 2 constituting the content remote operation system 1 shown in FIG. 1 will be described in detail. FIG. 2 is a diagram showing an example of the external appearance of the remote operation terminal 2, and FIG. 3 is a block diagram of the remote operation terminal 2.

  The remote operation terminal 2 is shaped like a handy projector, and a projection lens 22d for projecting an icon on the content reproduced by the content control device 3 on the front of the remote operation terminal 2 and the content An imaging lens 23c used for shooting content reproduced by the control device 3 is provided, and an icon button 240 used for setting an icon to be projected on the content is provided on the upper surface of the remote operation terminal 2. , An operation button 250 used for content operation is provided, and the remote operation terminal 2 has, as the operation button 250, an upward direction key 250a, a downward direction key 250b, a right direction key 250c, and a left direction. In addition to the direction key 250d and the center button 250e, a power button 28 is provided.

  As shown in FIG. 3, the remote control terminal 2 can be electrically rewritten with a control unit 20 including a CPU 20a (Central Processing Unit), a RAM 20b (Random Access Memory), a ROM 20c (Read-Only Memory), and the like. A data storage unit 26 realized by a flash memory which is a non-volatile memory, a wireless communication unit 21 for wirelessly communicating with the content control device 3, a projector unit 22 for projecting icons, and a projector unit 22 A camera unit 23 whose imaging range is designed to include a projection range, an icon event generation unit 24 that generates an icon event, and an operation event generation unit 25 that generates an operation event are provided.

  Specific contents of realization of the wireless communication unit 21 of the remote operation terminal 2 depend on a communication form with the content control device 3. For example, when the remote operation terminal 2 communicates directly with the content control device 3, the wireless communication unit 21 is realized by an infrared communication circuit including an infrared light projecting element or a Bluetooth (Bluetooth) communication circuit including an antenna. When the remote control terminal 2 communicates with the content control device 3 indirectly via the network, the wireless communication unit 21 is realized by a wireless LAN communication circuit for wireless communication with the wireless LAN router.

  The projector unit 22 of the remote operation terminal 2 includes a projection lens 22d, a projection image processing circuit 22b, a projection light source 22a, a projection element 22c (for example, a liquid crystal panel), and the like, like a general projector. This is used to project an icon image stored in the data storage unit 26.

  The camera unit 23 of the remote control terminal 2 includes a photographic lens 23c, a photographic image processing circuit 23a, a photographic element 23b (for example, CCD), and the like. An image is taken and the taken image is stored in the RAM 20b of the control unit 20.

  As shown in FIG. 1, the projection range 22e of the projector unit 22 is included in the shooting range 23d of the camera unit 23, and the shooting range 23d of the camera unit 23 is larger than the projection range 22e of the projector unit 22. Thus, the optical system of the camera unit 23 and the projector unit 22 is designed.

  The icon event generator 24 of the remote operation terminal 2 is realized by an icon button 240 and an electric circuit 241 that generates an event signal corresponding to the icon event each time the icon button 240 is pressed. 2 is input to the second control unit 20.

  Further, the operation event generating unit 25 of the remote operation terminal 2 presses one of the operation buttons 250 (here, the four direction keys 250a to 250d on the upper, lower, left, and right sides and the center button 250e) and the operation buttons 250. And an electric circuit 251 that generates an event signal corresponding to the pressed operation button 250, and the event signal is input to the control unit 20 of the remote operation terminal 2.

  The data storage unit 26 of the remote operation terminal 2 includes an event table 260 in which an identifier of an event corresponding to the event signal is described, icon information 261 including an icon image, and feature information indicating image characteristics of the content. Content information 262 including is stored.

  FIG. 4 is a diagram for explaining the event table 260 stored in the data storage unit 26 of the remote operation terminal 2. In the event table 260, a record is provided for each event signal, and an identifier of the event signal corresponding to the record is associated with the record.

  As shown in FIG. 2, the control unit of the remote operation terminal 2 is generated by pressing an icon button 240 and operation buttons 250 (four directional keys 250 a to d and five center buttons 250 e). 4 is input to the event table 260 shown in FIG. 4 for each event signal corresponding to the icon button 240, the up / down / left / right direction keys 250a to 250d, and the center button 250e. The corresponding event identifier is described.

  For example, in FIG. 4, the event identifier corresponding to the event signal generated when the icon button 240 is pressed is “OnIconButton”, and corresponds to the event signal generated when the up direction key 250a is pressed. The event identifier is “OnUpButton”, and the remote operation terminal 2 refers to the event table 260 and determines that an icon event has occurred when an event with the identifier “OnIconButton” is detected, and the identifier is other than “OnIconButton”. When an event (for example, “OnUpButton”) is detected, it is determined that an operation event corresponding to the identifier has occurred.

  FIG. 5 is a diagram illustrating icon information 261 stored in the data storage unit 26 of the remote operation terminal 2. In the data storage unit 26 of the remote operation terminal 2, icon information 261 is stored for each icon that the remote operation terminal 2 supports. In FIG. 5, icon information 261a of icons for scroll operation (FIG. 5 (a) )), Icon information 252b (FIG. 5B) of icons for zoom operation, and icon information 262c (FIG. 5C) of icons for rotation operation.

  One icon information 260 includes an icon identifier, an image file name of the icon specified by the identifier, and an identifier of an operation event that can be accepted when the icon specified by the identifier is projected. ing.

  According to FIG. 5, the file name of the scroll operation icon image is “scroll.bmp”, the zoom operation icon image file name is “zoom.bmp”, and the rotation operation icon file name. Is "rotate.bmp".

  In addition, according to FIG. 5, identifiers of operation events that can be accepted when an image with the file name “scroll.bmp” is projected are “OnUpButton”, “OnDownButton”, “OnRightButton”, “OnLeftButton” And “OnCenterButton”. Further, there are two identifiers of operation events that can be accepted when an image with the file name “zoom.bmp” is projected, “OnUpButton” and “OnDownButton”. Furthermore, the identifiers of operation events that can be accepted when an image with the file name “rotate.bmp” is projected are “OnRightButton” and “OnLeftButton”.

  FIG. 6 is a diagram for explaining the content information 262 stored in the data storage unit 26 of the remote operation terminal 2. The content information 262 is stored for each content played back by the content control device 3 in the data storage unit 26 of the remote operation terminal 2, and the content information 262 includes the content identifier and the size of the content specified by the identifier ( (Number of vertical and horizontal pixels), feature information indicating the image characteristics of the content specified by the identification information, an identifier of an icon that can be used to operate the content specified by the identifier, and an icon specified by the identifier of the icon The identifier of the operation event that can be accepted when the image is projected is included. Note that the feature information included in the content information 262 depends on the embodiment, and an example where the feature information is a marker will be described later.

  For example, in the case of content that supports scroll operation and zoom operation but does not support rotation operation, the identifier of the icon for scroll operation (“icon01”) is used as the identifier of the icon that can be used for content operation. And the icon identifier for zoom operation (“icon02”) are included in the content information, and for each icon identifier for scroll operation (“icon01”) and icon identifier for zoom operation (“icon02”), An identifier of an operation event that can be accepted (for example, “OnUpButton”) is described.

  The control unit 20 of the remote operation terminal 2 is means for executing processing according to an event input to the control unit 20, and a computer program for causing the CPU 20 a of the control unit 20 to execute the function described below is stored in the ROM 20 c of the control unit 20. Has been.

  The control unit 20 of the remote operation terminal 2 refers to the event table 260 and determines that an operation event has occurred when the event identifier corresponding to the event signal input to the control unit 20 is “OnIconButton”. The first process of projecting the icon image and specifying the content to be operated is executed. Further, the control unit 20 of the remote operation terminal 2 determines that an operation event has occurred when the event identifier corresponding to the event signal input to the control unit 20 is other than “OnIconButton”, and transmits the operation event message as a content. A second process to be transmitted to the control device 3 is executed.

  FIG. 7 is a flowchart showing a procedure of a first process for projecting an icon image and specifying content to be operated. In the first process, first, the control unit 20 of the remote operation terminal 2 executes a process (S1) for allowing the user to select an icon image to be projected. When the image of the icon to be projected is selected, the control unit 20 of the remote operation terminal 2 holds the icon identifier of the icon information corresponding to the icon image.

  A method for realizing the process of causing the user to select an icon image to be projected is arbitrary. For example, every time an operation event is detected, the icon information 261 stored in the remote operation terminal 2 is cyclically switched, and the icon image specified by the switched icon information 261 is projected as an icon image. The user can also select an image of the icon to be projected.

  Further, text indicating the operation content (for example, the file name of the icon image) is included in the icon information 261, and when an operation event occurs, the text of all the icon information 261 stored in the remote operation terminal 2 is stored. By displaying (projecting) and allowing the user to select the text, the user can also select an icon image to be projected.

  When the control unit 20 of the remote operation terminal 2 executes processing for causing the user to select an icon image to be projected, the control unit 20 instructs the projector unit 22 to project the icon image selected by the user, and causes the icon image to be projected. Process (S2) is executed.

  When the control unit 20 of the remote operation terminal 2 projects the icon image, the control unit 20 performs a loop process L1 for identifying the content to be operated in a certain cycle (for example, 0.5) while the icon image is being projected. Run every second).

  When performing an operation of specifying content to be operated, first, the control unit 20 of the remote operation terminal 2 operates the camera unit 23 to capture an image within the imaging range of the camera unit 23 (hereinafter, camera image). In step S3, the camera image is subjected to image processing to detect a coordinate range (hereinafter, icon coordinates) of the icon image in the camera image.

  The control unit 20 of the remote operation terminal 2 branches the process according to the icon coordinate extraction result (S5). If the icon coordinate cannot be detected, the process proceeds to S11 in FIG. 7 and instead of the identifier of the content to be operated. When the error code is stored in the RAM 20b and the icon coordinates can be extracted, the operation of specifying the content to be operated is continued.

  Note that the processing is branched according to the icon coordinate extraction result when the icon image cannot be recognized depending on the projection state of the icon image, such as when there is a person between the remote control terminal 2 and the content control device 3. Because there is.

  When the control unit 20 of the remote operation terminal 2 detects the icon coordinates, it uses the feature information included in the content information of the remote operation terminal 2 to identify the content captured in the camera image, and then identifies each identified content. In addition, a process (S6) of detecting a content coordinate range (hereinafter, content coordinates) in the camera image is executed.

  The control unit 20 of the remote operation terminal 2 branches the process according to the content identification result (S7), and when the content coordinates cannot be detected, the process proceeds to S11 in FIG. 7 to replace the identifier of the content to be operated. When the error code is stored in the RAM 20b and the content coordinates can be detected, the operation of specifying the content to be operated is continued.

  When detecting the content coordinates, the control unit 20 of the remote operation terminal 2 executes a process (S8) of detecting content coordinates overlapping with the icon coordinates.

  The control unit 20 of the remote operation terminal 2 branches the process according to the detection result of the content coordinates overlapping with the icon coordinates (S9), and when the content coordinates overlapping with the icon coordinates can be detected, the content corresponding to the content area is selected as the operation target. The content identifier is stored in a predetermined area of the RAM 20b (S10).

  Further, the process proceeds to S11 in FIG. 7, and when the content coordinates overlapping the icon coordinates cannot be detected, an error code is stored in the RAM 20b instead of the identifier of the content to be operated.

  Here, the remote operation device 2 acquires the identifier of the icon to be projected in (S1), but separately prepares an icon-related file in which the icon image, the feature amount of the icon image, and the icon identifier are associated with each other. A feature amount of icon data obtained by photographing an icon with the camera unit 23 of the remote operation terminal 2 in step S4) is calculated, and the feature amount described in the icon-related file is compared, and the feature amount is a close value. The icon identifier may be acquired. Alternatively, as described later, when a marker is added to the upper left of the icon image, the marker may be used for icon identifier information.

  The method for realizing the process of specifying the content to be operated is arbitrary, but here, as an example, a method using a marker used in augmented reality is described.

  When realizing processing for specifying content to be operated using markers used in augmented reality, a first for identifying content for each content played by the content control device 3 Is included in a predetermined position of the content (here, the upper left corner), and a second marker indicating the icon image is projected onto the predetermined position of the icon image (here, the upper left corner). Keep it like that.

  FIG. 8 is a diagram illustrating an example of a camera image including a first marker and a second marker. In the camera image 230 illustrated in FIG. 8, the content 230a is identified as the first marker 231a of the content 230a. Is included in the upper left corner of the content 230a, and as the first marker 231b of the content 230b, a square frame with the character “B” identifying the content 230b is included in the content 230b. As a second marker 234 indicating the icon image 233, which is included in the upper left corner, a thick square frame without a character is included in the upper left corner of the icon image 233.

  When executing the process of specifying the content to be operated using the marker, the content information 262 of the content 230a stores the image and size (number of vertical and horizontal pixels) of the first marker 231a as feature information. The content information 262 of the content 230b stores the image and size (number of vertical and horizontal pixels) of the first marker 231b as feature information.

  In addition, so that the second marker 234 can be detected from the camera image 230, the remote operation terminal 2 stores the image of the second marker 234 and its size (vertical and horizontal pixel numbers), and further includes the first marker 234. In order to detect the icon coordinates 236 and the content coordinates 235a, b from the markers 231a, b and the second marker 234, the size (number of vertical and horizontal pixels) of the projection element 22c included in the projector unit 22 is stored.

  When the control unit 20 of the remote control terminal 2 detects the icon coordinates 236, for example, the augmented reality described in “Augmented Reality System Based on Marker Tracking and Its Calibration” (TVRSJ Vol.4 No.4, 1999). The second marker 234 stored in the remote operation terminal 2 is extracted from the camera image 230 by using the technology of feeling (Augmented Reality).

  Then, from the size ratio of the second marker 234 in the camera image 230 and the size ratio of the second marker 234 stored in the remote operation terminal 2 and the size of the icon image 233 stored in the remote operation terminal 2, The size of the icon image 233 in the camera image 230 is calculated, and the icon coordinates 236 are calculated from the position of the second marker 234 in the camera image 230.

  When detecting the content coordinates, the control unit 20 of the remote operation terminal 2 first identifies the first markers 231a and 231b included in the camera image 230 by using a pattern matching technique.

  Then, similarly to the second marker 234, the size ratio of the first marker 231a and the first marker 231a stored in the remote operation terminal 2 in the camera image 230 and the content stored in the remote operation terminal 2 are stored. The content coordinate of the content 230a corresponding to the first marker 231a is calculated from the size of, and the content coordinate 235a of the content 230a is calculated from the position of the second marker 234 in the camera image 230. For the content 230b, the content coordinate 235b of the content 230b is calculated using the first marker 231b.

  When the remote operation terminal 2 obtains the icon coordinates 236 and the content coordinates 235a, b, it determines whether any of the content coordinates 235a, b overlaps with the icon coordinates 236 using a coordinate system calculation or the like. Since the icon coordinate 236 overlaps the content coordinate 235a, the identifier of the content 230a is acquired as the content ID of the content to be operated.

  Next, a second process for transmitting an operation event message to the content control apparatus will be described with reference to FIG. FIG. 9 is a flowchart showing a second processing procedure for transmitting an operation event message to the content control apparatus.

  In the second process of transmitting the operation event message to the content control device 3, first, the control unit 20 of the remote operation terminal 2 confirms the identifier of the content to be operated stored in the RAM 20b of the control unit 20. (S20) is executed.

  The process branches according to the confirmation result of the identifier of the content to be operated (S21), and when the identifier is an error code, the control unit 20 stops the operation of transmitting the operation event message. If the identifier is not an error code, the operation event message transmission operation is continued.

  When the stored content identifier is not an error code, the remote operation terminal 2 executes processing (S22) for confirming the icon information 261 of the icon on which the image is projected, and the identifier of the generated operation event is the icon. By confirming whether it is included in the information 261, it is confirmed whether the operation event can be accepted by the icon.

  The control unit 20 of the remote operation terminal 2 branches the process according to the confirmation result of the generated operation event (S23), and if it is not an operation event that can be accepted by the icon on which the image is projected, a process of transmitting an operation event message is performed. If it is an operation event that can be accepted by an icon that is projected and the image is projected, the process of sending an operation event message is continued.

  For example, according to FIG. 5, if the identifier of the generated operation event is “OnUpButton”, and the file names of the projected icon images are “scroll.bmp” and “zoom.bmp”, the operation event message If the file name is “rotate.bmp”, the process of transmitting the operation event message is interrupted.

  Next, the control unit 20 of the remote operation terminal 2 executes processing (S24) for confirming the content information 262 corresponding to the stored content identifier, and the identifier of the icon on which the image is projected is the content identifier. By confirming whether the content information 262 specified by the identifier is included in the content information 262, it is confirmed whether the icon is an identifier of an icon that can be used for the operation of the content specified by the identifier. By confirming whether the icon is associated with the identifier of the icon, it is confirmed whether the identifier of the operation event is acceptable when the icon image specified by the identifier of the icon is projected.

  The control unit 20 of the remote operation terminal 2 branches the process depending on the confirmation result of the content information 262 (S25), and the identifier of the icon that can be used for the operation of the content and the icon image specified by the identifier of the icon are projected. If it is not the identifier of the operation event that can be accepted when the operation is being performed, the processing of sending the operation event message is stopped, and the icon identifier that can be used for the operation of the content and the icon image specified by the identifier of the icon are displayed. If the operation event identifier is acceptable when projected, the remote operation terminal 2 generates an operation event message including at least the identifier of the icon, the identifier of the operation event, and the identifier of the content to be operated, Using the wireless communication unit 21, the operation event message is sent to the content system. And send to the device 3 (S26), and ends this procedure.

  From here, the content control apparatus 3 is demonstrated in detail. FIG. 10 is a block diagram of the content control apparatus 3.

  As shown in FIG. 12, the content control device 3 includes a communication unit 31 for communicating with the remote operation terminal 2 via a network, a display unit 32 for displaying content, and a designated area of the display unit 32. A content control unit 30 having a command for reproducing content and operating the content in the area, and a data storage unit 33 for storing the content and the like are provided.

  The content realized by the communication unit 31 of the content control device 3 naturally corresponds to the wireless communication unit 21 provided in the remote operation terminal 2. For example, if the wireless communication unit 21 of the remote operation terminal 2 is an infrared communication circuit, the communication unit 31 of the content control device 3 is an infrared communication circuit including an infrared projector. If the wireless communication unit 21 of the remote operation terminal 2 is a wireless LAN communication circuit, the communication unit 31 of the content control device 3 is realized by a LAN communication circuit that communicates with the wireless LAN router in a wired or wireless manner.

  The display unit 32 of the content control device 3 is a display device that displays content, and is realized by, for example, a liquid crystal display.

  The data storage unit 33 of the content control device 3 is realized by a large-capacity hard disk, a semiconductor memory, or the like. The data storage unit 33 stores command information 330 for each command for operating the content.

  The content reproduced by the content control device 3 may be stored in the data storage unit 33, and may be received from the server (not shown) storing the content using the communication unit 31. It may be.

  FIG. 11 is a diagram for explaining the command information 330 stored in the data storage device 33. In FIG. 11, command information 330a-c corresponding to the icon information 261a-c of FIG. 5 is illustrated.

  As shown in FIG. 11, in the command information 330, an identifier of one icon is associated with the identifier of the command, and further, an identifier of at least one operation event is associated with the identifier of the icon. , One operation event identifier is associated with at least one command parameter.

  In FIG. 11A, the command information 330a of the command for scrolling the content, the command identifier in the command information 330a is “scroll”, and the identifier of the icon corresponding to the command is “icon01”.

  In the command information 330a, a command parameter is associated with each operation event corresponding to the command. For example, an operation event with the name “OnUpButton” is associated with “up, 10pixel” as a command parameter to perform a process of scrolling up by 10 pixels, and a command with an operation event with the name “OnCenterButton” As a parameter, “initialize” for performing a process of returning the content display to the initial state is associated.

  In FIG. 11B, the command information 330b of the command for zooming the content, the command identifier in the command information 330b is “zoom”, and the identifier of the icon corresponding to the command is “icon02”.

  In the command information 330b, a command parameter is associated with each operation event corresponding to the command. For example, an operation event whose name is “OnUpButton” is associated with “in, 1” as a command parameter, which performs a process of moving the zoom level by level 1 in the direction of enlarging.

  In FIG. 11C, the command information 330c of the command for zooming the content, the command identifier in the command information 330c is “rotate”, and the identifier of the icon corresponding to the command is “icon03”.

  In the command information 330c, a command parameter is associated with each operation event corresponding to the command. For example, the operation event whose name is “OnRightButton” is associated with “right, 10 °” as a command parameter for performing a process of rotating 10 ° to the right of the current angle.

  The content control unit 30 of the content control device 3 is realized by a circuit on which a CPU 30a, a RAM 30b, a ROM 30c, and the like are mounted. The ROM 30c of the content control unit 30 stores program codes for causing the CPU 30a to execute the functions described below. Has been.

  When the content control unit 30 of the content control apparatus 3 receives an instruction to reproduce the content, the content control unit 30 reproduces the designated content in the designated area in the designated display unit 32. The content to be played back may be a still image or a moving image.

  Further, when the content control unit 30 of the content control device 3 receives the operation event message from the remote operation terminal 2 using the communication unit 31, the content control unit 30 refers to the command information 330 stored in the data storage unit 33, and operates the operation event message. A command corresponding to the message is executed, and the display content of the content reproduced on the display unit 32 is changed.

  FIG. 12 is a flowchart for explaining the operation of executing the command corresponding to the operation event message.

  When the communication unit 31 of the content control device 3 receives the operation event message (S30), the content control unit 30 of the content control device 3 refers to the command information 330 stored in the data storage unit 33, and the operation event message A process (S31) for specifying the identifier of the command indicated by is executed.

  As can be seen from FIG. 11, since the identifier of the command is uniquely determined by the identifier of the icon, the content control unit 30 searches and searches the command information 330 including the identifier of the icon included in the operation event message. The command identifier of the command information 330 is acquired.

  When the content control unit 30 of the content control device 3 specifies the identifier of the command indicated by the operation event message, next, the process of specifying the command parameter corresponding to the identifier of the operation event included in the operation event message (S32) Execute.

  As can be seen from FIG. 11, since the command parameter is uniquely determined by the operation event identifier, the content control unit 30 determines the command corresponding to the operation event identifier included in the operation event message from the retrieved command information. Get parameters.

  When the content control unit 30 of the content control device 3 acquires the command identifier and the command parameter, the content control unit 30 targets the content corresponding to the content identifier included in the operation event message, and is specified by the command identifier using the command parameter as an argument. Command processing is executed, the display of the content reproduced on the display unit 32 is changed (S33), and the procedure of FIG. 12 ends.

  From here, the processing when executing the above-described command will be briefly described. 13 is a diagram showing the display unit 32 before the command is executed, FIG. 14 is a diagram showing the display unit 32 after executing the command for scrolling the content, and FIG. 15 is for zooming the content. FIG. 16 is a diagram showing the display unit 32 after executing the command for rotating the content.

  When the operation button 250 (in this case, the operation button 250c) is pressed in a state where the scroll icon image 40a is overlapped with the content 4 in FIG. 13, a command for scrolling the content 4 in FIG. The display area in the content is changed in a direction according to the parameter (here, “right”), the display area in the content 4 displayed in FIG. 13 moves to the right, and the content 40 is displayed as shown in FIG. The

  When the operation button 250 (in this case, the operation button 250a) is pressed with the zoom icon image 41a overlapped with the content 4 in FIG. 13, a command for zooming the content 4 in FIG. 13 is executed. According to the parameter (here, “up”), the display area of the content 4 in FIG. 13 is enlarged or reduced (here, reduced), and the display area of the content displayed on the display of FIG. Like the content 41, the central portion of the content 4 in FIG. 13 is enlarged and displayed.

  When the operation button 250 (in this case, the operation button 250c) is pressed while the rotation icon image 42a is overlapped with the content 4 in FIG. 13, a command for rotating the content 4 in FIG. The display area of the content 4 in FIG. 13 is tilted (90 ° here) in the direction according to the parameter (here “right”), and the content 4 in FIG. ° Rotated and displayed.

In the embodiment, the command corresponding to the icon identifier and the operation event identifier transmitted from the remote operation terminal 2 is specified by the command information 330 stored in the data storage device 33 of the content control device 3, and the content is processed. ing. For this reason, the remote operation terminal 2 and the content control device 3 only need to share the icon identifier and the operation event identifier, and the process of scrolling the content displayed on the display unit 32 of the content control device 3 can also display the icon. Depending on the type, commands with different scrolling speeds can be set.

In addition to this, as a method for instructing the processing command for the content displayed on the display unit 32 of the content control device 30, the remote operation terminal 2 designates the command, transmits the command and the content identifier to the content control device 3, and performs processing. There is a way to do it.

Specifically, the command information 330 is stored in the data storage unit 26 of the remote operation terminal 2, and the remote operation is performed when an operation event occurs when the user of the remote operation terminal 2 operates the operation button 250. A content identifier and an icon identifier are obtained from the feature information and icon of the content photographed by the camera unit 23 of the terminal 2, and a command to be transmitted from the command information 330 to the content control device 3 is set. The content identifier and the icon identifier can be obtained by the processing described in FIG. 7 by performing image processing on the icon. A corresponding command can be selected by referring to the command information 330 of the data storage unit 26 from the icon identifier and the event operation identifier obtained here. The selected command and the content identifier can be transmitted to the content control apparatus 3 to process the target content with the content of the command.

DESCRIPTION OF SYMBOLS 1 Content remote operation system 2 Remote operation terminal 20 Control part 21 Wireless communication part 22 Projector part 23 Camera part 24 Icon event generation part 240 Icon button 25 Operation event generation part 250 Operation button 26 Data storage part 260 Event table 261 Icon information 262 Content Information 3 Content control device 30 Content control unit 31 Communication unit 32 Display unit 33 Data storage unit 330 Command information

Claims (16)

A content remote operation system comprising a remote operation terminal used when remotely operating content, and a content control device for controlling content according to an instruction from the remote operation terminal,
The remote operation terminal is photographed so as to include a wireless communication unit for wirelessly communicating with the content control device, a projector unit that projects an image of an icon that represents the content operation content, and a projection range of the projector unit. A data storage device for storing a camera unit in which a range is set, content information in which specific information for identifying the content is associated with the identifier of the content, and icon information in which the icon image is associated with the identifier of the icon; , An icon button for generating an icon event for setting the icon, an operation button for generating an operation event for operating the content, and an image of the icon projected by the projector unit when the icon event is detected is selected by the user The selected eye is executed. It means for instructing the projection of emissions of the image to the projector unit,
The identifier of the content that overlaps the icon image is acquired by analyzing the image captured by the camera unit using the specific information included in the content information and the projected image of the icon When processing and the operation event are detected, an operation event message including the identifier of the icon on which the image is projected and the identifier of the content to be operated is transmitted to the content control device using a wireless communication unit. A control unit for executing the second process;
The content control device includes a communication unit for communicating with the remote operation terminal, a display unit for displaying the content, and command information in which the identifier of the icon is associated with an identifier of a command for changing the display content of the content. When the content is reproduced on the display unit and the operation event message is received from the remote operation terminal, the identifier of the command associated with the identifier of the icon included in the operation event message is used. A content control unit that executes a specified process and changes a display content of the content specified by an identifier of the content included in the operation event message;
Content remote control system characterized by that.   2. The content remote operation system according to claim 1, wherein the remote operation terminal includes a plurality of the operation buttons that generate the different operation events, and the control unit detects the operation detected in the second process. An event identifier is included in the operation event message, and the content control unit uses the operation parameter included in the operation event message as a command parameter of the command.   3. The content remote operation system according to claim 2, wherein the control unit of the remote operation terminal transmits the operation event message only when the content overlapping with the icon image can be specified in the second process. A content remote control system characterized by:   4. The content remote operation system according to claim 2, wherein the icon information includes an identifier of the operation event that can be accepted when the icon image is projected in association with the identifier of the icon. The control unit transmits the operation event message only when the identifier of the detected operation event is associated with the identifier of the icon on which the image is projected in the second process. Content remote control system.   The content remote operation system according to any one of claims 2 to 4, wherein the content information includes, in association with an identifier of the content, an icon that can be accepted when the content is being played back. An identifier is stored, and the control unit sends the operation event message only when the identifier of the icon projecting the image is associated with the identifier of the content to be operated in the second process. A content remote control system characterized by transmitting.   6. The content remote operation system according to claim 5, wherein an identifier of the operation event is stored in the content information in association with an identifier of the icon that can be accepted when the previous content is being played back. In the second process, the control unit of the terminal associates the identifier of the icon projecting the image with the identifier of the content to be operated, and further detects the identifier of the detected operation event as the icon. The content remote operation system is characterized in that the operation event message is transmitted only when it is associated with the identifier.   The content remote operation system according to any one of claims 1 to 6, wherein the content reproduced by the content control unit includes a first mark for identifying the content, and further, the icon A second mark common to the icons is included at a predetermined position of the image, and the content information stored in the data storage device of the remote operation terminal includes the first mark included in the content as feature information. The image and the size of the content are stored in association with the content identifier, and the icon information includes the second mark image and its size, and the icon image and its size in association with the icon identifier. In the first processing, the control unit uses the first mark to capture the image. Identifying the content identifier contained in the image and the coordinates of the content on the projected image, and further identifying the coordinates of the icon on the video using the second mark, , A content remote control system for specifying the content that overlaps the icon image. A content remote operation system comprising a remote operation terminal used when remotely operating content, and a content control device for controlling content according to an instruction from the remote operation terminal,
The remote operation terminal is photographed so as to include a wireless communication unit for wirelessly communicating with the content control device, a projector unit that projects an image of an icon that represents the content operation content, and a projection range of the projector unit. A range-set camera unit is associated with content information in which specific information for identifying the content is associated with the identifier of the content, icon information in which the icon image is associated with the identifier of the icon, and the identifier of the icon A data storage device for storing the command information; an icon button for generating an icon event for setting the icon; an operation button for generating an operation event for operating the content; and detecting the icon event, the projector unit The icon image to be projected It executes processing to select the The, means for instructing the projector unit projecting the image of the icon selected,
The identifier of the content that overlaps the icon image is acquired by analyzing the image captured by the camera unit using the specific information included in the content information and the projected image of the icon And a control unit that executes a second process of transmitting a command associated with the identifier of the icon to the content control device using a wireless communication unit when detecting the operation event.
The content control device, a communication unit for communicating with the remote operation terminal, a display unit for displaying the content, playing the content on the display unit, and receiving a content identifier and a command from the remote operation terminal A content control unit that executes processing specified by the command for the content corresponding to the content identifier and changes the display content of the content,
Content remote control system characterized by that.   9. The content remote operation system according to claim 8, wherein the remote operation terminal includes a plurality of operation buttons that generate different operation events, and the control unit detects the operation detected in the second process. A content remote operation system, wherein an event identifier and a command corresponding to the icon identifier are selected. A remote control terminal used for remote control of content,
The remote operation terminal includes a wireless communication unit for wirelessly communicating with an apparatus for controlling content, a projector unit for projecting an icon image representing the content operation content, and a projection range of the projector unit. A data storage device for storing a camera unit in which a photographing range is set, content information in which specific information for identifying the content is associated with the identifier of the content, and icon information in which the icon image is associated with the identifier of the icon An icon button for generating an icon event for setting the icon, an operation button for generating an operation event for operating the content, and an image of the icon projected by the projector unit to the user when the icon event is detected. Execute the process to select, and select the selected After instructing the projector unit to project an image of the image, the icon is analyzed by analyzing the image captured by the camera unit using the projected image of the icon and the specific information included in the content information. When the operation event is detected, an operation event message including the identifier of the icon on which the image is projected and the identifier of the content to be operated is detected. A control unit that executes a second process of transmitting to the device using a wireless communication unit;
A remote control terminal characterized by that.   The remote operation terminal according to claim 10, further comprising a plurality of the operation buttons that generate different operation events, wherein the control unit uses an identifier of the operation event detected in the second process as the operation event. The remote operation terminal characterized in that the content control unit of the command control device uses the operation parameter included in the operation event message as a command parameter of the command.   10. The remote operation terminal according to claim 9, wherein the control unit of the remote operation terminal transmits the operation event message only when the content overlapping the icon image can be specified in the second process. A remote control terminal characterized by that.   13. The remote operation terminal according to claim 11, wherein the icon information stores an identifier of the operation event that can be accepted when the icon image is projected in association with the identifier of the icon. In the second processing, the control unit transmits the operation event message only when the detected identifier of the operation event is associated with the identifier of the icon on which the image is projected. Remote control terminal featuring.   14. The remote operation terminal according to claim 11, wherein the content information includes an identifier of the icon that can be received when the content is being reproduced in association with the identifier of the content. And the control unit transmits the operation event message only when the identifier of the icon projecting the image is associated with the identifier of the content to be operated in the second process. A remote operation terminal characterized by   15. The remote operation terminal according to claim 14, wherein the content information stores an identifier of the operation event in association with an identifier of the icon that can be accepted when the previous content is being reproduced. In the second process, the control unit is configured such that the identifier of the icon projecting the image is associated with the identifier of the content to be operated, and the detected operation event identifier is the icon of the icon. The remote operation terminal transmits the operation event message only when associated with an identifier. The remote operation terminal according to any one of claims 10 to 15, wherein the content reproduced by the content control unit includes a first mark for identifying the content, and further, an image of the icon The content information stored in the data storage device of the remote control terminal includes, as characteristic information, the first mark included in the content as a second mark common to the icons at a predetermined position. The image and the size of the content are stored in association with the content identifier, and the icon information includes the image of the second mark and its size, and the image of the icon and its size in association with the identifier of the icon. The control unit stores an image captured by the camera unit using the first mark in the first process. By identifying the content identifier and the coordinates of the content on the projected image, and further identifying the coordinates of the icon on the video using the second mark, the icon A remote operation terminal for identifying the content overlapping with the image of.