JP2015038661A - Remote controller, display unit, television receiver, and program for remote controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which a remote controller employing a conventional technique for performing operation input through a touch sensor by reference to a GUI screen merely sends coordinate information on a user's touch position and cannot perform processes associated with a touch operation while taking features and differences of various GUI screens into consideration.SOLUTION: There is provided a remote controller which selects an icon in a GUI screen to be operated by utilizing a touch sensor, and the remote controller includes a function of acquiring arrangement information representing an icon arrangement positions in the GUI screen so as to perform processing associated with a touch operation while taking features and differences of various GUI screens into consideration, for example, such that no operation signal is output on a touch operation at an irrelevant position represented with the arrangement information.

Description

  The present invention relates to a remote controller that performs operation input via a GUI (graphical user interface) screen using a touch sensor.

  Conventionally, a remote control is generally used as an input device for remote operation in home appliances such as a television and other electronic devices. Recently, a remote controller that can be operated by detecting a touch by providing a touch sensor is also provided. In such a remote control capable of touch operation, in order to select a selection item displayed on the GUI screen to be operated, a region on the touch surface corresponding to the display position of the selection item on the GUI screen is tapped. To do. Specifically, for example, thumbnail images of four recorded programs as a recording list are displayed in a 2 × 2 array on the GUI screen. Therefore, if the thumbnail of the program to be deleted is displayed at the lower left in the GUI screen, the user taps the lower left area on the touch surface of the remote controller accordingly.

  In addition, if “Yes” and “No” are arranged and displayed on the left and right as the GUI screen for confirming whether the recorded program data selected in this way may be deleted, the user can move the left side of the touch surface of the remote control. To delete the recorded program data.

  In this way, the remote control that can be touch-operated by the touch sensor can be operated universally, that is, can be used for totally different operations according to the GUI, and therefore the number of operation buttons is increased even when the types and targets of operations are complicated and diverse. It is characterized by being able to respond without any problem.

  Patent Document 1 discloses a remote control having a touch panel which is a touch sensor having an information display function, and information on operation button images corresponding to an operation target (for example, a channel button and a volume adjustment button if the operation target is a television device). In the case of a printer, a technique for receiving an operation input by holding a print button or the like and displaying an operation button image on a touch panel according to an operation target is disclosed.

JP 2001-022508 A

  However, in the technology that performs operation input via the touch sensor with reference to the GUI screen, the remote controller simply sends coordinate information of the user's touch position, and takes into account the characteristics and differences of various GUI screens. There is a problem that the process related to the touch operation cannot be performed. Specifically, for example, in a certain GUI screen A, even when there is no operation item on the right half and it is meaningless to touch, if the right half of the touch surface is touched, the position coordinates invalid for the operation are mechanically determined. Will be sent.

  Further, the technique of Patent Document 1 does not perform a touch operation by referring to a GUI screen displayed on an operation target such as a television. Therefore, the user can understand the operation content only by an operation button on the remote control. Need to be shown as follows. Therefore, the remote control of Patent Document 1 needs to use a touch panel having an information display function instead of a mere touch sensor, and there are problems such as high cost or high power consumption.

  In order to solve the above problems, the present invention is a remote controller that selects an icon in a GUI screen to be operated using a touch sensor, and has a function of acquiring arrangement information indicating an icon arrangement position in the GUI screen. For example, in the touch operation to the unrelated position indicated by the arrangement information, the operation signal is not output, and the process related to the touch operation in consideration of the features and differences of various GUI screens is performed. Provide remote control to do. Specifically, a remote controller having a function of selecting an icon on a GUI screen displayed on the display of the display device, and acquiring a touch surface including a touch sensor and icon arrangement information on the GUI screen on the display device There is provided a remote controller having an icon arrangement information acquisition unit that performs and a selection output unit that outputs a selection signal of an icon on the corresponding GUI based on icon arrangement information by touching the touch sensor portion on the touch surface. .

  Furthermore, the present invention is a remote controller that selects an icon in a GUI screen to be operated using a touch sensor, and illuminates, for example, a touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen. The remote control is characterized in that the correspondence can be easily identified by the user. Specifically, in addition to the above-described configuration, the identification for prompting the touch on the touch sensor portion on the touch surface corresponding to the icon arrangement on the GUI screen is output on the touch surface based on the acquired icon arrangement information. A remote control having an identification output unit is also provided. In addition, the icon arrangement information acquisition unit includes a depth arrangement acquisition unit that displays a plurality of icons on the screen and acquires depth arrangement information indicating the arrangement, and the identification output unit acquires the acquired depth arrangement information. A remote control having depth identification output means for displaying the identification on the touch surface as a depth is also provided.

  In addition to the above configuration, the image information acquisition unit has a screen information acquisition unit that acquires screen information from the display, and the icon arrangement information acquisition unit has a screen analysis unit that acquires icon arrangement information based on the acquired screen information. Provide a remote control. In addition, a display device and a television receiver including a remote controller having the above-described configuration are also provided.

  A program for controlling such a remote control is also provided. Specifically, it is a program for a remote controller having a function of selecting an icon in a GUI screen displayed on a display of a display device and having a touch surface provided with a touch sensor. An icon arrangement information acquisition step of acquiring the icon arrangement information of the image, and a selection output step of outputting a selection signal of the icon on the corresponding GUI based on the icon arrangement information by touching the touch sensor portion on the touch surface, A remote control program is also provided to allow the computer to execute.

  According to the present invention having the above-described configuration, for example, in a touch operation to an invalid position by acquiring icon arrangement information in a remote controller that selects an icon in a GUI screen to be operated using a touch sensor. Can perform processing related to the touch operation in consideration of the characteristics and differences of various GUI screens, such as not outputting an operation signal. In addition, since it can be configured without using a touch panel having an information display function, it is possible to reduce the cost of remote control components and to reduce power consumption.

The figure showing an example of the functional block in the remote control of Example 1. The figure showing an example of the touch surface in the remote control of Example 1. The figure showing an example of the table data for acquiring icon arrangement information in the remote control of Example 1. The figure showing an example of the functional block in the display apparatus utilized with the remote control of Example 1. The figure showing an example of the hardware constitutions in the remote control of Example 1. 7 is a flowchart illustrating an example of a process flow in the remote controller according to the first embodiment. The figure showing an example of the functional block in the remote control of Example 2 The figure showing an example of the identification output in the remote control of Example 2 A flowchart showing an example of a flow of processing in the remote controller of the second embodiment. The figure showing an example of the functional block in the remote control of Example 3 Conceptual diagram showing an example of a depth display of identification of a touch surface in the remote control according to the third embodiment A flowchart showing an example of a flow of processing in the remote controller according to the third embodiment. Conceptual diagram for explaining an example of acquisition of icon arrangement information by the remote controller according to the fourth embodiment The figure showing an example of the functional block in the remote control of Example 4 A flowchart showing an example of a flow of processing in the remote controller of the fourth embodiment. Conceptual diagram for explaining an example of warning performed by the remote controller according to the fifth embodiment The figure showing an example of the functional block in the remote control of Example 5 A flowchart showing an example of a flow of processing in the remote controller of the fifth embodiment. The figure showing an example of the screen for calibration (calibration) in the remote control of Example 6 The figure showing an example of the functional block in the remote control of Example 6. A flowchart showing an example of a flow of processing in the remote controller of the sixth embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention. In the first embodiment, claims 1, 7, 8, and 9 will be mainly described. In the second embodiment, claim 2 will be mainly described. In the third embodiment, claim 3 will be mainly described. In the fourth embodiment, claim 4 will be mainly described. In the fifth embodiment, claim 5 will be mainly described. In the sixth embodiment, claim 6 will be mainly described.

Example 1
<Overview>
The remote controller according to the present embodiment is a remote controller that selects an icon in a GUI screen to be operated using a touch sensor, and has a function of acquiring arrangement information indicating an icon arrangement position in the GUI screen in the operation target. It is characterized by that. Specifically, for example, on a certain GUI screen, an icon for selection operation is arranged only in the left half, and no icon is arranged in the right half.

  Then, in the remote controller of this embodiment, it is determined that the touch operation to the right half of the touch sensor is an invalid operation by acquiring the icon arrangement information for the selection operation, and the coordinate information is operated. Do not execute the process to send to the target device. Alternatively, processing such as informing the user of the remote controller that the touch operation is invalid by blinking lights or outputting a warning message is performed.

<Functional configuration>
FIG. 1 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. Note that the functional blocks of the remote controller and the operating system using the remote controller described below can be realized as a combination of hardware and software. Specifically, if a computer is used, a CPU, a main memory, a bus, or a secondary storage device (a hard disk, a non-volatile memory, a storage medium such as a CD or a DVD, a read drive for the medium, etc.), information Input devices used for input, printing equipment, display devices, other hardware components such as external peripheral devices, interfaces for external peripheral devices, communication interfaces, driver programs for controlling these hardware, Other examples include application programs and user interface applications. Then, by CPU processing according to the program developed on the main memory, the data input from the input device or other interface and held in the memory or hard disk is processed and stored, An instruction for controlling the software is generated. Alternatively, each functional block of the remote controller may be realized by dedicated hardware.

  The present invention can be realized not only as a remote controller but also as a method. A part of the invention can be configured as software. Furthermore, a software product (remote control program) used for causing a computer to execute such software and a recording medium on which the product is fixed are naturally included in the technical scope of the present invention (the entirety of the present specification). And so on).

  The “remote controller” of the present invention is a remote controller having a function of selecting an icon in a GUI screen displayed on the display of the display device. The operation target of the remote controller of the present embodiment is not limited to a display device provided with a display, or a television receiver provided with a television broadcast reception and display function. For example, a recording / playback device connected to the display device, Other electronic devices such as a microwave oven with a display may be used.

  The “GUI screen” is a GUI (graphical user interface) screen that is displayed on the display and displays selectable item icons indicating operation contents, and the user can display the GUI screen on the GUI screen. By selecting the displayed selection item, it is possible to visually grasp the operation content and perform the operation. The “icon selection function” refers to a function for selecting an icon indicating a selection item displayed on the GUI screen. Note that this icon includes not only a symbolic figure or a picture but also a character string.

  As shown in FIG. 1, the “remote control” (0100) of this embodiment includes a “touch surface” (0101), an “icon arrangement information acquisition unit” (0102), and a “selection output unit” (0103). And).

  The “touch surface” (0101) includes a touch sensor. The “touch sensor” is a sensor that detects contact with a finger or a stylus pen. As a detection method, for example, a resistive film method, a surface / projection type capacitance method, an electromagnetic induction method, an infrared sensor There are various methods such as a method, a surface acoustic wave method, and an image recognition method. The touch sensor constituting the touch surface may be configured by arranging a plurality of physical detection elements, for example. If reading is performed by a light shielding method or an image recognition method, depending on the method. It may be composed of a plurality of virtual sensing elements that are read while distinguishing the coordinates. In addition, each detection range of the touch sensor (including a virtual one) may be configured by one detection element, or may be configured by a set of a plurality of detection elements.

  FIG. 2 is a diagram illustrating an example of this touch surface. As shown in this figure, on the touch surface, for example, a plurality of touch sensors (square regions indicated by horizontal lines) are arranged in a lattice pattern. When the user touches, for example, the touch sensor A with a finger, a stylus pen, or the like, the coordinate information is acquired and the tap operation is performed at that position. Further, as shown in this figure, a light emitter such as an LED (light emitting diode) may be embedded in the vicinity of the touch sensor, for example, for “discrimination for prompting” to be described later.

  The “icon arrangement information acquisition unit” (0102) has a function of acquiring icon arrangement information in the GUI screen on the display device, and can be realized by, for example, an arithmetic device, a communication circuit, an icon arrangement information acquisition program, or the like. it can. There are various specific information contents of the icon arrangement information indicating the icon arrangement position on the GUI screen. For example, the position information (coordinate information) of the icon in the GUI screen itself may be used. Alternatively, the detection area of the touch surface is divided into areas such as upper right, upper left, lower right, and lower left, and the identification information of each area is associated with the position information included in the area as shown in FIG. The table information is held. And it is good also as a structure which acquires the identification information of the area | region where the icon is arrange | positioned as icon arrangement information, and identifies the arrangement information of an icon with reference to the said table.

  Also, for example, a 3 × 2 thumbnail image (icon) is displayed for a “recording list”, and left and right icons are displayed for a two-choice selection screen. The icon layout can also be shown in response to. Therefore, as shown in FIG. 3B, table information that associates the GUI identification information with the position information of the icon used in the operation is stored in advance. And it is good also as a structure which acquires GUI identification information as icon arrangement | positioning information, and identifies the arrangement | positioning information with reference to the said table.

  In addition, about the acquisition method of the above icon arrangement | positioning information, the structure acquired by receiving the icon arrangement | positioning information transmitted from a display apparatus, for example is mentioned. Alternatively, if the icon position information can be identified by the GUI identification information, the “recording list button” arranged on the remote controller of the present embodiment or displayed on the touch sensor to display the GUI screen of the recording list. It is good also as a structure which acquires the GUI identification information by receiving input of ", and acquires icon arrangement information.

  Further, as will be described in detail in a later embodiment, there is a method of acquiring an icon arrangement position by analyzing a GUI screen itself displayed on a display by an illuminance sensor, an image recognition camera, or the like.

  The “selection output unit” (0103) has a function of outputting a selection signal of an icon on the corresponding GUI based on the icon arrangement information by touching the touch sensor portion on the touch surface. It can be realized by a selection output program, a selection signal output circuit, or the like. The “output of the icon selection signal based on the icon arrangement information” includes, for example, the following processing. Specifically, for example, the user contacts the touch sensor portion on the touch surface using a finger, a stylus pen, or an indicator corresponding thereto. Then, the coordinate information of the touch position output from the touch sensor according to the contact and the arrangement coordinates indicated by the icon arrangement information are compared by the arithmetic processing of the arithmetic device. Then, when the coordinate information of the touch position deviates from the arrangement position indicated by the position information by the predetermined value or more, the touch operation is invalid and the process of not outputting the icon selection signal is executed. . Alternatively, in order to warn the user of the remote controller that the touch operation is invalid, for example, a light control signal for blinking the light in a predetermined form, an output signal of a warning message, an output signal of a warning icon to the touch panel, etc. And so on.

  Moreover, the following output forms are also mentioned as an example of the output of the icon selection signal based on the icon arrangement information in the selection output unit. Specifically, for example, the coordinates (1, 1) of the GUI screen are the channel 1 button, and the information that associates the icon arrangement coordinates with the operation content of the icon is acquired as icon arrangement information. Then, the operation device refers to the information to identify the operation content at the touch position, and obtains a remote control code indicating the specified operation content from a remote control code table held in advance. Then, instead of the coordinate information of the touch position, the remote control code is transmitted to the operation target device.

<Functional configuration of display device>
As described above, there is a configuration in which icon arrangement information is output from the display device used in the remote controller of the present embodiment, and a configuration in which the operation content of the selection signal output from the remote controller is interpreted on the display device side. An example of a functional configuration of such a display device will be described with reference to FIG. As shown in this figure, the “display device” (0400) includes a “display” (0401), a “GUI information acquisition unit” (0402), a “GUI identification information transmission unit” (0403), and a “selection signal”. A "reception unit" (0404), a "selection signal determination unit" (0405), and a "processing unit" (0406).

  The “display” (0401) has a function of displaying a GUI screen, and the display method is not limited. Examples thereof include a liquid crystal display, a plasma display, an organic EL display, and a cathode tube display.

  The “GUI information acquisition unit” (0402) has a function of acquiring GUI information for displaying a GUI screen to be displayed on the display and receiving operation information, and is realized by, for example, a calculation device or a GUI information acquisition program. be able to. Specifically, when an operation signal indicating an instruction to display a predetermined GUI screen by the remote controller is received, GUI information related to the GUI indicated by the signal is acquired. In addition, when there is a screen transition accompanying the transition of the operation content, GUI information for the GUI to be displayed next specified according to the transition rule is acquired.

  Then, in accordance with the GUI information acquired in this way, a GUI screen on which icons indicating the operation contents can be selected is displayed on the display, and an operation input can be accepted.

  The “GUI identification information transmitting unit” (0403) has a function of acquiring GUI identification information and transmitting it to the remote controller, and can be realized by, for example, an arithmetic device, a GUI identification information acquisition program, and a signal output circuit. The “GUI identification information” refers to information for identifying the GUI currently displayed on the display. For example, “ID: A” for a channel selection screen and “ID: A” for a yes / no selection screen. Information such as “ID: B” may be used. Alternatively, the area identification information of an area obtained when the GUI is divided into predetermined areas, or the coordinate information of icons arranged in the GUI may be transmitted as GUI identification information. Note that the GUI identification information is preferably obtained by acquiring GUI identification information for identifying the GUI acquired by the GUI information acquisition unit. In addition, as described above, when the GUI identification information can be acquired in response to an operation input (such as pressing a recording list button) by the remote controller itself, this GUI identification information transmission unit may be omitted.

  The “selection signal receiving unit” (0404) has a function of receiving a selection signal output from the selection output unit of the remote controller. For example, if the remote controller outputs a selection signal by infrared rays, an infrared receiver or other type is used. If there is, it can be realized by a receiving circuit adapted to the format.

  The “selection signal determination unit” (0405) has a function of determining the operation content indicated by the selection signal received by the selection signal reception unit, and can be realized by, for example, an arithmetic device and a selection signal determination program. Specifically, if the coordinate information of the icon is indicated by the selection signal, the operation content indicated by the icon at the position is determined with reference to the GUI information. Alternatively, the selection signal determination unit includes a remote control code, and the arithmetic device refers to the remote control code to acquire the operation content indicated by the selection signal.

  The “processing unit” (0406) has a function of executing processing according to the operation content determined by the selection signal determination unit. For example, the arithmetic device, the processing program, and each hardware configuration and control program related to the operation content Can be realized.

<Hardware configuration>
FIG. 5 is a schematic diagram illustrating an example of a configuration of the remote controller according to the present embodiment when the above functional components are realized as hardware. The operation of each hardware component in the output processing of the icon selection signal based on the icon arrangement information will be described using this figure. As shown in this figure, the remote controller of this embodiment includes an “arithmetic unit” (0501). This arithmetic device is an icon arrangement information acquisition unit, and has a hardware configuration for executing other various arithmetic processes. Further, this arithmetic unit may have a built-in primary memory for work, or may have a separate memory outside. In addition, a “touch memory” (0502) that constitutes the touch surface, other “button input mechanism” (0503), and “flash memory” that stores table data in which GUI identification information and coordinate information of the touch sensor are associated with each other. (0504) and a “wireless communication circuit” (0505) as a selection output unit. Alternatively, other communication mechanisms such as an “infrared light emitter” may be provided. They are connected to each other via a data communication path such as a “system bus” to transmit / receive information and process information.

  The “primary memory” reads the program, and the “arithmetic unit” refers to the read program and executes various arithmetic processes according to the procedure indicated by the program. In addition, a plurality of addresses are assigned to each of the “primary memory” and “flash memory”, and in the arithmetic processing of the “CPU”, the addresses are specified and accessed to store the data. It is possible to perform arithmetic processing using.

  Here, for example, when the user edits the recording list, operation input for displaying the recording list on a display device to which the recording device is connected (built-in) is made using “touch sensor” or “button input mechanism”. Do. Then, the “arithmetic unit” interprets the icon arrangement information acquisition program, acquires GUI identification information indicating that an operation using the recording list displayed in accordance with the operation input is performed, and a primary memory built in the arithmetic unit Is stored at address 1 of.

  Alternatively, for example, when a screen for accepting operation input using a recording list is displayed, the GUI identification information is output from the recording device that is the operation target, which is received by the “wireless communication circuit” of the remote controller, and is primary It may be stored at address 1 of the memory. If a table as shown in FIGS. 3A and 3B is held in the flash memory of the recording apparatus, information indicating the area of the touch surface instead of the GUI identification information, or the coordinates of the direct touch sensor. The information may be transmitted from the recording device, and the received information may be stored at the address 1 of the primary memory as icon arrangement information.

  If the information stored in the primary memory is GUI identification information or information indicating the area of the touch surface, a table as shown in FIGS. 3A and 3B held in the “flash memory”. The coordinate information of the associated touch sensor is specified with reference to, and stored in the address 2 of the primary memory.

  After that, the “arithmetic unit” interprets the selection output program and waits for a touch operation input. Further, if there is a transition or change of the GUI screen during that time, the icon arrangement information corresponding to the GUI screen currently displayed on the display is acquired by acquiring the GUI identification information to be displayed next accordingly. When contact with the touch sensor is detected, the coordinate information of the touch position is stored in address 3 of the primary memory. Further, for example, if the resolution and aspect ratio of the touch sensor and the GUI screen of the display device are different, a process of converting the coordinate information of the touch position with a predetermined conversion formula may be performed so that the positional relationship between the two can be compared. .

  Then, the “arithmetic unit” compares the coordinate information of the user's touch operation stored at the address 3 of the primary memory with the coordinate information of the icon on the GUI screen stored at the addresses 1 and 2 to determine a predetermined value. Judgment processing is performed to determine whether or not both are substantially the same within the touch error range. If it is determined that they do not match, for example, the touch operation is invalid and no icon selection signal is output. Alternatively, for example, a light control signal for blinking a light (not shown) in a predetermined manner is output to the blinking control circuit of the light, or a speaker control such as a warning message output signal or a warning icon output signal to the touch panel. Output to the display circuit of the circuit or touch panel.

  Alternatively, if the result of the determination is that they do not match, the arithmetic device refers to the information that associates the icon arrangement coordinates indicated by the acquired icon arrangement information with the operation content of the icon, and the arithmetic device performs an operation at the touch position. Identify content. Next, a remote control code indicating the specified operation content is obtained from the remote control code table stored in the “flash memory” in advance, and the remote control code is sent via the “wireless communication circuit” instead of the coordinate information of the touch position. May be transmitted to the recording device that is the operation target.

<Process flow>
FIG. 6 is a flowchart showing an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care. The remote controller has a function of selecting an icon in a GUI screen displayed on the display of the display device, and has a touch surface provided with a touch sensor.

  Then, as shown in this figure, icon arrangement information in the GUI screen on the display device is acquired (step S0601). The icon arrangement information may be acquired by various methods. For example, as described in the icon arrangement information acquisition unit, the GUI identification information input by the operation of the remote controller is acquired, and the icon arrangement coordinates are acquired by referring to the table as shown in FIG. May be. In addition, GUI identification information, information indicating a corresponding area on the touch surface, or coordinate information of the touch sensor may be directly acquired from the electronic device that is the operation target of the remote controller.

  Thereafter, an icon selection signal on the corresponding GUI is output based on the icon arrangement information by touching the touch sensor portion on the touch surface (step S0602). Specifically, for example, the coordinate information of the touch position output from the touch sensor and the arrangement coordinates indicated by the icon arrangement information are compared by the arithmetic processing of the arithmetic device. Then, when the coordinate information of the touch position deviates from the arrangement position indicated by the position information by the predetermined value or more, the touch operation is invalid and the process of not outputting the icon selection signal is executed. . Alternatively, in order to warn the user of the remote controller that the touch operation is invalid, for example, a light control signal for blinking the light in a predetermined form, an output signal of a warning message, an output signal of a warning icon to the touch panel, etc. May be performed.

  Further, for example, as icon arrangement information, information obtained by associating the icon arrangement coordinates with the operation content of the icon is acquired together. Then, the operation device refers to the information to identify the operation content at the touch position, obtains a remote control code indicating the identified operation content from the remote control code table held in advance, and coordinates information of the touch position Instead of this, the remote control code may be transmitted to the operation target device.

<Simple explanation of effect>
As described above, by using the remote controller of this embodiment to select icons in the operation target GUI screen using the touch sensor, by acquiring icon arrangement information, for example, in a touch operation at an invalid position, Can perform processing related to the touch operation in consideration of the characteristics and differences of various GUI screens, such as not outputting an operation signal.

<< Example 2 >>
<Overview>
This example is based on the above example, based on the acquired icon arrangement information so that the user can easily identify which position on the touch surface of the remote control the icon arrangement position on the GUI screen corresponds to. For example, the remote control further has a function of causing a touch sensor at the same position as an icon on the GUI screen to shine.

<Functional configuration>
FIG. 7 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. As shown in this figure, the “remote control” (0700) of the present embodiment is based on the above-described embodiment, based on the “touch surface” (0701), “icon arrangement information acquisition unit” (0702), and “selection output”. Part "(0703). Since these constituent elements have already been described in the above embodiment, the description thereof is omitted. The remote controller according to the present embodiment further includes an “identification output unit” (0704).

  The “identification output unit” (0704) outputs, on the touch surface, identification for prompting the user to touch the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen based on the acquired icon arrangement information. It has a function and can be realized by an arithmetic device, an identification output program, and various mechanisms for identification (for example, a light emitting mechanism). Specifically, the identification information output unit executes the following processing. That is, the coordinates of the touch surface corresponding to the display coordinates of the icon on the GUI screen specified by the icon arrangement information using a correspondence table of the display coordinates of the icons on the GUI screen and the coordinates of the touch surface, a predetermined mapping function, or the like. Compute information. For example, the touch sensor arranged at the coordinate position of the touch surface determined by the calculation is instructed to output for identification such as lighting.

  FIG. 8 is a conceptual diagram for explaining an example of the identification output. As shown in FIG. 8A, for example, “Yes” and “No” selection items are arranged on the left and right sides of the GUI screen. In this case, the left and right regions (shaded portions) that match the icon arrangement of the screen on the touch surface of the remote controller are configured to shine. Alternatively, as shown in FIG. 8B, selection items for various functions are arranged near the top, bottom, left, and right sides in the GUI screen. In this case, the region (shaded portion) along the four sides on the touch surface of the remote controller is configured to shine.

  In the above description, “output by light” is described as an example of the output for identification for prompting the touch, but the structure of the touch sensor for that purpose is not particularly limited. For example, as shown in FIG. 2, there is a structure in which a touch sensor (near) shines by making a hole or the like in a part of each touch sensor and embedding a light emitting body such as an LED therein. Alternatively, a structure in which the touch sensor itself emits light, a laminated structure in which the touch sensor is made of a light-transmitting material, and a light emitter is placed under the light-transmitting material can be used.

  Further, the output for identification is not limited to the output by light. For example, the touch sensor is provided with a mechanism for raising / lowering each, thereby raising the touch sensor at the corresponding position of the icon on the GUI screen (or On the contrary, the touch sensor other than the corresponding position may be depressed, and the output may be performed so as to be identifiable for prompting the touch. Alternatively, the touch sensor is made of a material that can be controlled to transition between a hardened state and a softened state, and the touch sensor at the corresponding position of the icon on the GUI screen is hardened, so that an output is identifiable for prompting the touch. The method of performing is also mentioned.

  If the user satisfies the premise that the user can easily grasp the relationship between the icon on the GUI screen and the identification output on the touch surface, the arrangement coordinates, shape, and size of the icon on the GUI screen, The output coordinates, shape, and size of the identification on the touch surface do not necessarily coincide completely. For example, as shown in FIG. 8, when the oval “Yes” and “No” selection icons are arranged on the left and right sides of the GUI screen, the identification output on the touch surface is square and larger than the icons on the GUI screen. It may be output.

  With the above-described configuration, in the remote controller that uses the touch sensor to select an icon on the operation target GUI screen, the user can associate the position of the icon on the GUI screen with the position on the touch surface of the touch sensor. It is possible to perform a touch operation on the touch surface after the user grasps the above.

<Process flow>
FIG. 9 is a flowchart illustrating an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care. The remote controller has a function of selecting an icon in a GUI screen displayed on the display of the display device, and has a touch surface provided with a touch sensor.

  Then, as shown in this figure, icon arrangement information in the GUI screen on the display device is acquired (step S0901). Then, identification (for example, identification by light emission in the vicinity of the touch sensor) for prompting the touch on the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen is performed on the touch surface based on the acquired icon arrangement information. (Step S0902).

  Thereafter, an icon selection signal on the corresponding GUI is output based on the icon arrangement information by touching the touch sensor portion on the touch surface (step S0903).

<Simple explanation of effect>
As described above, the user can easily grasp which position on the touch surface of the remote controller corresponds to the position of the icon on the GUI screen by using the remote controller according to the present embodiment. Therefore, the user can accurately perform a touch operation on the touch surface.

Example 3
<Overview>
This embodiment is based on the above embodiment, and when the icon arrangement on the GUI screen is a depth display (pseudo three-dimensional display) such as, for example, overlapping icons, the identification output of the touch surface is output in accordance with the depth display. It is a remote control characterized by performing.

<Functional configuration>
FIG. 10 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. As shown in this figure, the “remote control” (1000) of the present embodiment is based on the second embodiment and includes a “touch surface” (1001), an “icon arrangement information acquisition unit” (1002), and an “identification output unit”. (1003) and a “selection output unit” (1004). In addition, since these structural requirements have already been described in the above embodiment, description thereof will be omitted. The feature point of the remote controller of this embodiment is that the icon arrangement information acquisition unit further includes a “depth arrangement acquisition unit” (1005), and the identification output unit further includes a “depth identification output unit” (1006). is there.

  The “depth arrangement acquisition unit” (1005) has a function of acquiring depth arrangement information. “Depth arrangement information” refers to information indicating the arrangement when a plurality of icons are displayed in depth on the screen. The depth arrangement information acquired here may include identification information indicating that the icon is a depth arrangement in addition to the information indicating the arrangement coordinates of the icon. Then, the remote controller determines whether or not there is identification information indicating the depth arrangement, and the icon arrangement information acquired when it is a result of the determination is processed as the depth arrangement information. Alternatively, using the information such as the coordinates, size, and shape of the icon indicated by the acquired arrangement information, it is determined whether or not the icons overlap each other, and the icon arrangement information acquired when the determination result indicates that the icons overlap. May be processed as depth arrangement information.

  The “depth identification output means” (1006) has a function of displaying the identification in the depth on the touch surface based on the acquired depth arrangement information. FIG. 11 is a conceptual diagram showing an example of the depth display of this identification. As shown in FIG. 11 (a), for example, a form of identifying and displaying on the touch surface as in the overlapping display of icons on the GUI screen can be cited. Alternatively, as shown in FIG. 11 (b), the largest frame corresponding to the icon at the forefront of the overlay is output, and the smallest frame corresponding to the icon at the back is output, corresponding to each icon. The form which displays so that a depth can be identified by displaying the frame which did not overlap like an annual ring is also mentioned.

  In this way, in correspondence with the icons on the GUI screen that are arranged in a pseudo three-dimensional depth, the arrangement can be output on the touch sensor so as to be identifiable. Therefore, even when the depth of the icon is displayed, it is possible to reduce an operation error due to a shift in the touch position.

<Process flow>
FIG. 12 is a flowchart illustrating an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care.

  And as shown in this figure, depth arrangement | positioning information is acquired as icon arrangement | positioning information in the said GUI screen in a display apparatus (step S1201). As described above, it is preferable to perform processing such as determination of depth arrangement information or other icon arrangement information by identification information or overlay determination processing. If the acquired arrangement information is depth arrangement information, identification for prompting a touch on the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen (for example, identification by light emission near the touch sensor) ) Is output so that the depth is displayed on the touch surface based on the acquired depth arrangement information (step S1202). Then, an icon selection signal on the corresponding GUI is output based on the acquired depth arrangement information by contact with the touch sensor portion on the touch surface performed according to the identification (step S1203).

<Simple explanation of effect>
As described above, the remote control according to the present embodiment can output the arrangement in an identifiable manner on the touch sensor in correspondence with the icon on the GUI screen arranged in a pseudo three-dimensional depth. Therefore, even when the depth of the icon is displayed, it is possible to reduce an operation error due to a shift in the touch position.

Example 4
<Overview>
The remote controller according to the present embodiment is characterized in that the GUI screen displayed on the display is identified by, for example, image recognition or an illuminance sensor, and acquired using the icon arrangement information in the above-described embodiment. . FIG. 13 is a conceptual diagram for explaining an example of acquisition of icon arrangement information by the remote controller of the present embodiment. As shown in FIG. 13A, for example, a GUI screen on which icons “Yes” and “No” as selection items are arranged is displayed on the screen. Then, the remote controller of the present embodiment identifies that two icons are arranged on the left and right in the GUI screen using the image recognition process and the sensor result from the illuminance sensor. Then, using that information, for example, as shown in FIG. 13B, control is performed so as to output only the touch operation to the touch sensors in the corresponding regions γ1, γ2 on the touch surface.

<Functional configuration>
FIG. 14 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. As shown in this figure, the “remote control” (1400) of the present embodiment is based on the first embodiment and includes a “touch surface” (1401), an “icon arrangement information acquisition unit” (1402), and a “selection output unit”. (1403). Further, on the basis of the remote controller of another embodiment, an “identification output unit” (not shown), or “depth arrangement acquisition unit” or “depth identification output unit” (not shown) may be provided. The remote controller of the present embodiment further includes a “screen information acquisition unit” (1404), and the icon arrangement information acquisition unit includes a “screen analysis unit” (1405).

  The “screen information acquisition unit” (1404) has a function of acquiring screen information from the display of the display device. “Screen information” refers to information related to the GUI screen displayed on the display, and is information that can identify the display position of an icon in the GUI screen operated by the remote controller. As a method for acquiring such screen information, for example, a method in which a remote control includes a camera and image data of the screen of the camera is acquired as screen information can be given. Alternatively, the remote controller may include an illuminance sensor and measure the illuminance on the screen to obtain the measured value as screen information.

  The “screen analysis unit” (1405) has a function of acquiring icon arrangement information based on the acquired screen information. Specifically, for example, if the screen information is captured by a camera, an item that matches a typical icon image or frame image stored in advance by referring to the image recognition program and performing arithmetic processing of the arithmetic device. Determine if it is in the image. Then, the coordinate information is acquired using the item in the image determined to match as an icon. Alternatively, since the icons are exclusively displayed brighter than the background screen, the screen illuminance distribution by the illuminance sensor is determined by the arithmetic processing of the arithmetic device. Then, a bright area is identified with a difference equal to or greater than a threshold value than the illuminance at an adjacent location, and coordinate information is acquired using the area as an icon.

  Thus, in the present embodiment, for example, screen information can be acquired by image recognition processing or illuminance detection processing by an illuminance sensor, and accordingly, coordinate information of icons in the GUI screen can be acquired as icon arrangement information.

<Process flow>
FIG. 15 is a flowchart illustrating an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care. Then, as shown in this figure, first, screen information of the display of the display device is acquired by, for example, image recognition processing or screen illumination detection processing by an illumination sensor (step S1501). Subsequently, the screen information is subjected to image analysis, illuminance distribution analysis, and the like by arithmetic processing of the arithmetic device, and icon arrangement information is acquired according to the analysis result (step S1502). Finally, an icon selection signal on the corresponding GUI is output based on the icon arrangement information acquired in the previous period by touching the touch sensor portion on the touch surface (step S1503).

<Simple explanation of effect>
As described above, the screen information can be obtained by the image recognition process or the illuminance detection process by the illuminance sensor, for example, and the icon arrangement information can be obtained accordingly.

Example 5
<Overview>
FIG. 16 is a conceptual diagram for explaining an example of a warning (touch position detection deviation warning) performed by the remote controller of the present embodiment. As described in the above embodiment, in the remote controller of this embodiment, the area on the touch sensor corresponding to the “icon” in the GUI screen on the display (the hatched area in FIG. 16) is changed to another area based on the icon arrangement information. It is configured to be distinguished from the area. Here, as shown in FIG. 16A, the user touches a position α outside the icon corresponding area indicated by the oblique lines on the touch surface due to his / her misidentification, for example. Alternatively, as shown in FIG. 16B, the user is touching the icon corresponding area indicated by the diagonal lines on the touch surface, but the touch position β outside the area is detected due to a malfunction of the detection mechanism of the touch sensor. It was. Then, as shown in FIG. 16C, the remote controller of the present embodiment displays a warning message indicating that the touch position detected by the user is shifted on a display or the like.

  As described above, in the remote control of the present embodiment, the user touches a position different from the desired touch position due to his / her misidentification or the like, or a position different from the original touch position is detected due to a malfunction on the touch sensor side or the like. Or the like can be notified to the user.

<Functional configuration>
FIG. 17 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. As shown in this figure, the “remote control” (1700) of the present embodiment is based on the first embodiment and includes a “touch surface” (1701), an “icon arrangement information acquisition unit” (1702), and a “selection output unit”. (1703). Also, based on the remote control of other embodiments, it has an “identification output unit” (not shown), or “depth arrangement acquisition unit”, “depth identification output unit”, “screen information acquisition unit”, and “screen analysis unit”. May be. The remote control device according to the present embodiment further includes a “deviation notification information output unit” (1704).

The “deviation notification information output unit” (1704) has a function of outputting deviation notification information for notifying the operator that the touch position is shifted when a deviation touch is detected. This can be realized by a main memory and a deviation notification information output program. The “displacement touch” refers to a touch on an area other than the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen, which is caused by a user's misconception as described above, or a touch sensor malfunction. It is assumed that this is the cause. However, in any case, the CPU determines whether or not the touch position information 1 (X ₁ , Y ₁ ) detected by the touch sensor is included in the region coordinates indicated by the icon arrangement information. By doing so, it can be determined whether or not the touch is shifted.

  The deviation notification information output unit outputs deviation notification information when the touch detected by the calculation processing of the CPU is determined to be a deviation touch, and notifies the operator of the fact. Note that the output form of the shift notification information is not particularly limited. For example, a voice message such as “touch position is shifted” or “invalid touch area” is output from a voice output means such as a speaker provided on the remote control. A form is mentioned. Or the form which notifies the operator of the shift | offset | difference of a touch position may be sufficient by blinking light-emitting bodies, such as LED provided in the remote control, with a predetermined pattern. Alternatively, a signal indicating that a touch error has been detected is transmitted to the display device that is the operation target, and a text message such as “touch position is shifted” is displayed on the display device of the display device.

  In this way, in the remote control of this embodiment, the user is touching a position different from the desired touch position due to misidentification or the like, or a position different from the original touch position is detected due to a malfunction on the touch sensor side or the like. In such a case, the user can be notified of this.

<Other examples>
In addition, regarding the output of the shift notification information, the remote controller of the present embodiment may output the shift notification information when a shift touch is detected continuously for a predetermined number of times or more. You may have. That is, “first deviation number determination means” that counts the number of times that a discontinuous touch is continuously detected within a predetermined time and determines whether the number is a predetermined number of times or more, and the determination is a predetermined number of times that the disagreement touch has occurred This is a configuration in which the deviation notification information output unit includes “number-of-times-dependent output means” that outputs deviation notification information when the determination result is that Alternatively, instead of the first deviation number determination means, a “second deviation number determination means” that counts the number of times that a deviation touch to substantially the same position is continuously detected and determines whether the number is equal to or greater than a predetermined number of times. The deviation notification information output unit may be provided.

  And, when the touch is shifted multiple times in this way, it is not a simple erroneous operation (so-called touch error) by the operator, but the operator shows the correspondence between the icon on the GUI screen of the display and the area on the touch sensor. There is a possibility that it is not accurately grasped, or the user is touching an accurate position, but the detection mechanism of the touch position cannot detect the position correctly. In other words, since reproducibility is high, it is necessary to take appropriate measures. Therefore, in such a case, output misalignment notification information that prompts the operator to take some action, such as “Please check the touch position correctly again” or “There may be a problem with the touch sensor”. You may comprise as follows. Alternatively, a so-called “calibration” function described in the sixth embodiment may be executed.

<Process flow>
FIG. 18 is a flowchart illustrating an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care. Then, as shown in this figure, the remote controller obtains icon arrangement information in the GUI screen on the display device (step S1801). Thereafter, when contact with the touch surface is detected (step S1802), the detected touch position is included in the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen indicated by the acquired icon arrangement information. Whether or not the touch is a displacement touch (step S1803). If the determination result indicates that it is included, the selection signal for the icon on the corresponding GUI is displayed by touching the touch sensor portion on the touch surface as shown in the first embodiment although not shown. Output based on the placement information.

  On the other hand, if it is not included and the result is a determination result of touching an area other than the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen, the detected touch operation is a shift touch operation. Is output (step S1804), and a voice / text message such as “the touch position is shifted” is displayed on the speaker of the remote controller or the display of the display device according to the notification information.

  In addition, although not shown, in the determination process of step S1803, the number of times that the touch is continuously detected within a predetermined time may be counted, and it may be determined whether the number is equal to or greater than the predetermined number. Alternatively, it is possible to perform processing for counting the number of times a touch of displacement to substantially the same position is continuously detected and determining whether the number of touches is a predetermined number or more.

<Simple explanation of effect>
As described above, the remote controller of the present embodiment detects a position different from the original touch position due to a touch sensor side malfunction or the like when the user touches a position different from the desired touch position due to misidentification or the like. In such a case, the user can be notified of this.

Example 6
<Overview>
FIG. 19 is a diagram illustrating an example of a calibration screen in the remote controller according to the present embodiment. As shown in FIG. 19A, for example, an image indicating a designated touch area on the touch surface of the remote controller is displayed together with a message for designating a touch area such as “Please touch the right area” on the display of the display device. . Also, icon arrangement information indicating the coordinates of the designated touch area is transmitted to the remote controller. Then, as shown in FIG. 19B, the remote controller compares the coordinate information of the position α touched by the operator and the icon arrangement information in accordance with the screen display. If the touch position is shifted, the touch is shifted. Correction information to be corrected to the touch position γ included in the area whose position is indicated by the icon arrangement information is generated and recorded and held in a flash memory or the like. In the subsequent touch detection with the remote controller, a process of correcting the detected touch position information using the stored correction information is performed.

<Functional configuration>
FIG. 20 is a diagram illustrating an example of functional blocks in the remote controller according to the present embodiment. As shown in this figure, the “remote control” (2000) of the present embodiment is based on the first embodiment and includes a “touch surface” (2001), an “icon arrangement information acquisition unit” (2002), and a “selection output unit”. (2003). In addition, based on the remote control of other embodiments, an “identification output unit” (not shown), “depth arrangement acquisition unit”, “depth identification output unit”, “screen information acquisition unit”, “screen analysis unit”, “shift” You may have a notification information output part. The remote controller according to the present embodiment further includes a “deviation touch position information acquisition unit” (2004) and a “correction information acquisition unit” (2005).

  The “deviation touch position information acquisition unit” (2004) has a function of acquiring deviation touch position information, and can be realized by, for example, a CPU, a main memory, a deviation touch position information acquisition program, and the like. Further, “deviation touch position information” refers to position information of a touch with respect to an area other than the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen.

  Specifically, as described in the above outline example, the remote controller may be executed in the calibration mode, and the coordinate information of the touch position detected in the calibration mode may be acquired as the shifted touch position information. In this case, for example, a separate mode change switch may be provided in the remote controller, and the normal operation mode and the calibration mode may be switched by operating the switch. In addition, as described in the fifth embodiment, the remote control is automatically changed to the calibration mode when a touch is detected continuously for a predetermined number of times within a predetermined time, or continuously for a predetermined number of times at substantially the same place. It is good also as a structure. When the remote control is changed to the calibration mode, the change signal is transmitted to the display device, and the display device that has received the change signal displays a calibration screen as shown in FIG. The arrangement information may be sent back to the remote controller. Alternatively, instead of the calibration screen displayed on the display of the display device, identification display indicating the touch area for calibration is performed on the touch surface with an LED or the like, and the coordinate information of the corresponding contact is obtained as the shifted touch position information. May be.

Alternatively, instead of providing such a calibration mode separately, a configuration may be adopted in which shifted touch position information is acquired using input information in an actual touch operation in the normal operation mode. In this case, for example, as described in the fifth embodiment, it is determined whether or not the touch position in the actual operation is a shift touch, and when the determination result is a shift touch, the coordinate information of the detected touch position is determined. Are acquired as touch position information.
Also, when there are a plurality of icons indicated by the icon arrangement information, it is determined that a touch on one icon area α is not a touch on an area other than the area indicated by the icon arrangement information, but a shift touch related to another icon area β. May be acquired as the touch position information. Specifically, for example, after detecting a touch on a certain icon area α, when receiving an operation input for canceling the previous operation such as an operation to return within a predetermined time or a cancel operation, the previous touch position information is obtained. That is, it is acquired as misaligned touch position information.

  The “correction information acquisition unit” (2005) has a function of acquiring correction information based on the acquired displacement touch position information and icon arrangement information, and can be realized by, for example, a CPU, a main memory, a correction information acquisition program, and the like. . “Correction information” refers to information for correcting the relative positional relationship between an actual touch position and a position calculated as a touched position on the GUI screen.

Specifically, the coordinates (X ₁ , Y ₁ ) indicated by the displacement touch position information acquired as described above and the coordinates (X ₂ , Y _{2) of the} nearest end point of the area coordinates indicated by the icon arrangement information, for example. ) Is calculated by the arithmetic processing of the CPU. Further, for example, a plurality of types of calibration screens may be prepared to acquire a plurality of misplaced touch position information, a plurality of difference values with corresponding icon arrangement information, and the average difference value may be acquired. The difference value and the average difference value (a, b) obtained in this way are recorded and held in the flash memory or the like as correction information, and the touch position (X ₃ , Y ₃ ) detected in the subsequent normal operation mode is stored. Is corrected with the correction information, and (X ₃ + a, Y ₃ + b) is acquired as touch position information.
In addition, as described above, when there are a plurality of icons and it is determined that a touch on one icon region α is a shift touch related to another icon region β based on a return operation or the like, and the shift touch position information is acquired, The coordinates of the end points of the icon region β may be the target coordinates for the difference calculation. Further, when there are a plurality of other icon areas, it may be configured to determine the area closest to the touch position shifted from among them as the difference calculation target, or accept the designation information input by the user and designate the area. The area indicated by the information may be determined as a difference calculation target.

  In this way, the remote controller of the present embodiment detects, for example, the calibration of the calibration mode or the shift of the touch position in the normal operation, and uses the correction information acquired accordingly to correct the touch position coordinates thereafter. It can correct | amend to the coordinate information which shows a position.

<Process flow>
FIG. 21 is a flowchart illustrating an example of a process flow in the remote controller of the present embodiment. The steps shown below may be steps executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. I do not care. Then, as shown in this figure, the remote controller acquires icon arrangement information specified in, for example, a calibration screen on the display device (step S2101). Thereafter, when contact with the touch surface is detected (step S2102), the detected position information of the contact is acquired as shifted touch position information (step S2103). Here, if it is a normal operation, as described in the above embodiment, whether or not the detected touch position is included in the touch sensor portion on the touch surface corresponding to the designated icon indicated by the acquired icon arrangement information. You may comprise so that it may judge.

  Subsequently, correction information for correcting the relative positional relationship between the actual touch position and the position calculated as the touched position in the GUI screen is acquired based on the acquired shift touch position information and icon arrangement information. (Step S2104). In the subsequent touch detection, the detected touch position information is corrected with the correction information.

<Simple explanation of effect>
As described above, the remote control according to the present embodiment detects, for example, a calibration in the calibration mode or a touch position shift in a normal operation, and corrects the subsequent touch position coordinates using correction information acquired accordingly. It can correct | amend to the coordinate information which shows a touch position.

0100 Remote control 0101 Touch surface 0102 Icon arrangement information acquisition unit 0103 Selection output unit

Claims (9)

A remote control having an icon selection function in a GUI screen displayed on a display of a display device,
A touch surface with a touch sensor;
An icon arrangement information acquisition unit for acquiring icon arrangement information in the GUI screen on the display device;
A selection output unit that outputs a selection signal of an icon on the corresponding GUI based on the icon arrangement information by touching the touch sensor portion on the touch surface;
With remote control.   The identification output part which outputs the identification for urging the touch with respect to the touch sensor part on the touch surface corresponding to the icon arrangement | positioning in the said GUI screen on a touch surface based on the acquired icon arrangement | positioning information. Remote control. The icon arrangement information acquisition unit
Depth arrangement acquisition means for displaying a plurality of icons on the screen and acquiring depth arrangement information indicating the arrangement,
The identification output unit
The remote control according to claim 2, further comprising a depth identification output unit configured to display the identification as a depth on the touch surface based on the acquired depth arrangement information. While having a screen information acquisition unit for acquiring screen information from the display,
The remote control according to any one of claims 1 to 3, wherein the icon arrangement information acquisition unit includes a screen analysis unit that acquires icon arrangement information based on the acquired screen information.   Misalignment notification for notifying the operator that the touch position is deviated when a misalignment touch that is a touch to an area other than the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen is detected. The remote control according to any one of claims 1 to 4, further comprising a deviation notification information output unit that outputs information. A shift touch position information acquisition unit that acquires shift touch position information that is position information of a touch with respect to an area other than the touch sensor portion on the touch surface corresponding to the icon arrangement in the GUI screen;
Correction information for acquiring correction information for correcting a relative positional relationship between an actual touch position and a position calculated as a touched position in the GUI screen based on the acquired misaligned touch position information and icon arrangement information. The remote control according to claim 1, further comprising an acquisition unit.   A display device comprising the remote control according to claim 1.   A television receiver including the remote control according to any one of claims 1 to 6. A program for a remote control having an icon selection function in a GUI screen displayed on a display of a display device and having a touch surface provided with a touch sensor,
An icon arrangement information acquisition step of acquiring icon arrangement information in the GUI screen on the display device;
A selection output step of outputting a selection signal of the icon on the corresponding GUI based on the icon arrangement information by touching the touch sensor portion on the touch surface;
Remote control program that causes a computer to execute.

Images