JP2015039084A - Image display device set - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device set with touch remote control such that almost all operations can be performed intuitively and simply by finger gestures.SOLUTION: There is provided an image display device set comprising: a touch remote controller having an image display device including means of detecting a finger touch or approach and generating a detection signal, means of acquiring the detection signal and acquiring finger gesture information, and means of transmitting the finger gesture information to an image display device; and an image display device having image display means, means of receiving the finger gesture information, and means of controlling the image display means to perform one of slide-in display or slide-out display, momentary display or momentary erasure, and face-in display or face-out display of an operation menu related to functions of the image display device according to a finger gesture represented with the finger gesture information when the finger gesture information is received.

Description

  The present invention relates to a technique for displaying an operation menu by a finger gesture in an intuitive and simple manner on a television operated by a touch remote controller.

  Since portable devices such as mobile phones have become smaller and more multifunctional, techniques for intuitively performing various instructions with a small operation area have been sought. Among these techniques, a finger gesture recognition technique is attracting attention in recent years. This can be done by selecting a specific function by touching a button displayed on the touch panel, turning a page by moving a finger on the screen, scrolling the selection menu, or expanding two fingers. This is a technique for enlarging the screen.

  In recent years, the spread of portable devices employing such a technology has expanded, and inspired by this, attempts have been made to adopt finger gesture recognition technology even in home appliances such as televisions. Such attempts also reflect the situation in recent years that home appliances such as televisions have become multifunctional, and as a result, the number of operation buttons on the remote control has increased, and the operation method has become very difficult to understand. . The touch remote control eliminates the buttons associated with the individual operation menu from the remote control as much as possible to make it small and simple, and the operation menu is called on the TV screen with a finger gesture as necessary, making it intuitive and simple. The operation is to be realized.

  Patent Document 1 discloses a technique for realizing an operation on a touch remote controller.

JP 2008-153732 A

  Generally, there are two types of means for receiving a touch operation: a touch panel and a touch pad. A touch panel is a sensor that is attached to a screen such as a liquid crystal panel, and is operated by touching a menu displayed on the screen with a finger. On the other hand, the touch pad does not have such a screen display and is operated by touching or rubbing a predetermined area.

  The remote control device of Patent Document 1 employs a touch panel. It is assumed that the user can operate the television by calling the menu with the menu button and selecting the menu on the touch panel or calling the pull-down menu on the television screen.

  The remote control device of Patent Document 1 has a button unit, and the first menu is called by pressing a button arranged on the button unit. Subsequent menu selection is performed by selecting a menu displayed on the touch panel unit and, if necessary, further calling a lower menu to select a target function. However, if emphasis is placed on intuitive operations using finger gestures, even button operations on the button section should be eliminated as annoying for the user, and almost all operations can be completed with only operations on the touchpad. It is considered to be good.

  In addition, the remote control device of Patent Document 1 employs a touch panel, and the viewer must move the line of sight from the television screen to the remote control in order to select a menu displayed on the touch panel. Such movement of the line of sight is troublesome. TV enthusiasts do not want to take their eyes off the TV screen at any one time. A touch remote that can complete all operations without looking at the remote is considered ideal.

  The first invention is an image display device set comprising an image display device and a touch remote control for operating the functions of the image display device, wherein the touch remote control detects a contact or proximity of a finger and outputs a detection signal. A touch detection unit for generating, a finger gesture information acquisition unit that acquires finger gesture information that is information indicating a finger gesture by analyzing the detection signal, and a transmission unit that transmits the finger gesture information to an image display device The image display device includes an image display unit, a receiving unit that receives finger gesture information, and when the receiving unit receives the finger gesture information, the image display device displays an image according to the finger gesture indicated by the finger gesture information. In the image display section, an operation menu associated with the function of the device is displayed in the slide-in display or slide-out display, the instantaneous display or the instantaneous erasure, or , To provide an image display device set and an operation menu display control unit that performs control such fade-display or fade-out display, the one at least one or.

  The second invention is based on the first invention, and the operation menu display control unit of the image display device, when the receiving unit receives the finger gesture information, according to the direction of the finger gesture indicated by the finger gesture information, There is provided an image display device set having a slide operation menu display control means for performing control so that an operation menu associated with a function of an image display device is displayed in a slide-in or slide-out manner in the image display unit.

  In a third aspect based on the second aspect, the slide operation menu display control means includes: a hierarchy information holder for holding hierarchy information for making the operation menu display a hierarchy display; and a slide-in display operation menu. In the case of having a plurality of submenus, an image display device set including a submenu scroll controller that controls to scroll the submenu according to the direction indicated by the finger gesture information is provided.

  According to a fourth aspect based on the second aspect or the third aspect, the slide operation menu display control means slides the headline display associated with the operation menu of the highest hierarchy in accordance with the finger gesture information. Provided is an image display device set having a heading display controller for displaying or hiding at a place where the user enters the screen.

  5th invention provides the image display apparatus set which has the switch which switches the active operation menu or heading display according to the said finger gesture information on the said slide operation menu display control means on the basis of 4th invention.

  According to a sixth aspect of the invention, on the basis of any one of the second to fifth aspects, the slide operation menu display control means performs a step-in slide-in controller or / and a step-out step-out. An image display device set having a stage slide-out controller is provided.

  According to a seventh aspect based on the first aspect, the operation menu display control unit of the image display device, when the receiving unit receives the finger gesture information, positions of the finger gesture indicated by the finger gesture information on the touch remote controller In response, an instantaneous operation menu display control means for performing control so as to instantaneously display or instantaneously delete the operation menu associated with the function of the image display device at a position corresponding to the position on the touch remote controller of the image display unit. An image display device set is provided.

  According to an eighth aspect based on the first aspect, the operation menu display control unit of the image display device, when the receiving unit receives the finger gesture information, applies pressure to the touch remote controller by the finger gesture indicated by the finger gesture information. Alternatively, an image display device set having fade operation menu display control means for performing control so that an operation menu associated with the function of the image display device is displayed in a fade-in or fade-out manner in the image display unit according to the contact area is provided. To do.

  A ninth invention provides an image display device included in the image display device set of the second to eighth inventions.

  According to these inventions, a television set including a touch remote controller capable of intuitively and concisely performing most operations with a finger gesture is provided.

FIG. 3 is a diagram illustrating a concept of an image display device set according to the first embodiment. 2 is a block diagram illustrating an example of a functional configuration of an image display device set according to Embodiment 1. FIG. FIG. 3 is a diagram illustrating an example in which a plurality of menus are arranged in the image display device set according to the first embodiment. An example of the operation menu which has a hierarchical structure. The figure showing an example in which the operation menu arrange | positioned at one of the corners of the screen in the image display apparatus set of Example 1 slides in. FIG. 3 is a diagram illustrating an example of a hardware configuration of a touch remote control according to the first embodiment. FIG. 3 is a flowchart illustrating an example of a process flow of the image display device set according to the first embodiment. FIG. 10 is a diagram illustrating an example when a sub-menu scroll operation is performed in the image display device set according to the second embodiment. FIG. 9 is a block diagram illustrating an example of a functional configuration of an image display device set according to a second embodiment. FIG. 10 is a flowchart illustrating an example of a process flow of the image display device set according to the second embodiment. FIG. 14 is an example of a screen in which operation menu headings are displayed at corresponding locations in the image display device set according to the third embodiment. FIG. FIG. 14 is an example of a screen in which operation menu headings are displayed at corresponding locations in the image display device set according to the third embodiment. FIG. FIG. 10 is a block diagram illustrating an example of a functional configuration of an image display device set according to a third embodiment. FIG. 5 is a diagram illustrating a concept of an image display device set according to a second embodiment. The figure of the state by which the channel list menu and the volume menu were displayed simultaneously in the image display apparatus set of Example 4. FIG. 10 is a block diagram illustrating an example of a functional configuration of an image display device set according to a fourth embodiment. FIG. 10 is a diagram illustrating a concept of an image display device set according to a fifth embodiment. FIG. 10 is a block diagram illustrating an example of a functional configuration of an image display device set according to a fifth embodiment. FIG. 10 is a diagram illustrating a concept of an image display device set according to a sixth embodiment. 2 is a block diagram illustrating an example of a functional configuration of an image display device set according to Embodiment 1. FIG. FIG. 20 is a diagram illustrating an example of an operation menu display in the image display device set according to the seventh embodiment. FIG. 10 is a block diagram illustrating an example of a functional configuration of an image display device set according to a seventh embodiment. The figure showing an example of the display in the case of performing instantaneous display of the operation menu in steps in the image display device set of Example 7 FIG. 20 is a diagram illustrating an example of an operation menu display in the image display device set according to the eighth embodiment. FIG. 10 is a block diagram illustrating an example of a functional configuration of an image display device set according to an eighth embodiment.

0101 TV 0102 Channel list menu 0103 Touch remote control 0104 Touch pad

  Examples of the present invention will be described below. The relationship between the embodiments and the claims is as follows. The first embodiment mainly relates to an image display device set according to claims 1 and 2. The second embodiment mainly relates to the image display device set according to claim 3. The third embodiment mainly relates to the image display device set according to claim 4. The fourth embodiment mainly relates to the image display device set according to claim 5. The fifth embodiment mainly relates to the image display device set according to the sixth aspect. The sixth embodiment mainly relates to the image display device set according to claim 2. The seventh embodiment mainly relates to the image display set according to the seventh aspect. The eighth embodiment mainly relates to the image display set according to the eighth aspect. The image display device appearing in Examples 1 to 8 is the image display device according to claim 9. In addition, this invention is not limited to these Examples at all, and can be implemented in various modes without departing from the gist thereof.

<Concept of Example 1>
FIG. 1 is a diagram illustrating the concept of the image display device set according to the first embodiment. At the time of starting the operation, only the video of the program flows on the TV screen (this state is hereinafter referred to as “initial state”), and the channel list menu as shown in the figure is not displayed. A touch pad 0104 is provided on the operation surface of the touch remote control 0103. When the viewer points the touch remote control in the direction of the TV 0101 and traces the touch pad to the left with a finger, the touch screen 0104 is aligned with the touch screen. The channel list menu 0102 is slide-displayed so as to flow from the right end toward the left side of the screen.
<Configuration of Example 1>
(General)
FIG. 2 is a block diagram illustrating an example of a functional configuration of the image display device set according to the first embodiment. The image display device set 0201 includes a touch remote controller 0202 and an image display device 0203. The touch remote control includes a touch detection unit 0204, a finger gesture information acquisition unit 0205, and a transmission unit 0206. The image display device includes a receiving unit 0207, an operation menu display control unit 0208, and an image display unit 0209. Each configuration will be described below.

  “Image display device” refers to a general device having a function of displaying an image, and includes a personal computer and a projector in addition to a television. Moreover, even if the video deck itself does not have a function of displaying an image, it includes one that displays an image indirectly using a television. In this case, the video deck and the television are integrated. It shall be regarded as an image display device. In addition, the image display device is not only intended for viewing images and the like such as television and video, but also other than image display such as a room air conditioner having an operation panel equipped with a liquid crystal panel. The main purpose of these functions is also included.

  The “touch remote controller” is a controller for remotely controlling the functions of the image display device, detects a finger gesture such as touching and tracing, and converts the detected finger gesture into a certain signal, which is then transferred to the image display device. It has the function to transmit to.

  The “touch detection unit” detects contact or proximity of a finger and generates a detection signal. “Contact” of a finger means that the finger touches the touch sensor, and “proximity” means that the finger is very close to the touch sensor. To be precise, the touch sensor may emit a certain signal immediately before the finger actually touches or immediately after the finger leaves, so that it includes proximity as well as contact.

  The touch detection unit usually has a large number of touch sensors. Each of the touch sensors is arranged in a certain area (hereinafter referred to as a finger gesture operation area) that can be easily operated by a finger on the touch remote controller, and is the same size or smaller than the flat of the finger. The finger gesture operation area may be square like the touch pad 0104 of the touch remote controller of FIG. 1, or may be circular or oval, but the finger that requires a certain movement on the surface like a tracing action. Sufficient space must be reserved to make the gesture. Further, the certain area may be a flat surface or a curved surface partially raised.

  There may be a plurality of finger gesture operation areas. For example, finger gestures are more difficult to convey minute movements than a PC mouse, so they represent minute movements on the screen separately from the finger gesture operation area for detecting large movement finger gestures. In order to do this, another method of arranging finger gesture operation areas with reduced sensitivity speeds side by side on the touch remote control can be considered.

  In view of the object of the present invention, it is desirable that the finger gesture operation area is the aforementioned touch pad. However, it does not exclude that a touch sensor is attached to the surface of a liquid crystal screen or the like to form a touch panel.

  The touch sensor is sometimes called a touch switch. One that has such a function is a “capacitance switch”, which is a switch based on the principle of detecting a change in capacitance of a capacitor composed of a metal detection panel provided on the sensor and a finger. is there. Even if it is a switch, it does not generate an intermittent signal of 1.0, but outputs it as a change in voltage. In addition to this, various systems have been put into practical use, and any system having a function of detecting a finger contact or proximity and generating a certain signal can be employed in the present invention.

  The “finger gesture information acquisition unit” is connected to the touch detection unit via an internal wiring or the like, receives a detection signal from the touch detection unit via the internal wiring or the like, and analyzes the information to indicate a finger gesture Get the finger gesture information.

  The “finger gesture” is a human action mainly performed by a finger and is performed for the purpose of operating an electronic device or the like. Finger gestures are classified into various forms by designers of such electronic devices. Each form is associated with a specific function of the electronic device or the like according to the operation status, and the user can realize these functions by executing a finger gesture.

  Some of the classifications proposed by electronic device manufacturers include “tap”, “drag”, “swipe”, “flick”, etc. The operation will be defined and the invention will be described. “Trace operation” refers to an operation of moving a finger or the like on a surface of a finger gesture operation area from one point to another point. In this case, any trajectory of movement may be used. For example, the movement may be a straight line from one point to another point, or may be an action of drawing an arc (otherwise, an action of drawing an S-shaped curve, a zigzag line, etc. Also good). The “striking operation” refers to an operation in which a finger or the like is brought into contact with a point of the finger gesture operation area for a very short time (for example, less than 0.5 seconds) and released. The “pushing operation” refers to an operation of bringing a finger or the like into contact with one point of the finger gesture operation area for a certain period of time (for example, 0.5 seconds or more). The difference between the “tracing motion” and other motions is that the former moves the finger etc. on the finger gesture operation area, while the latter only touches the finger etc. at one point on the finger gesture operation area (that is, the movement) Not). The difference between the “striking operation” and the “pushing operation” is that the former has a very short contact time with a finger or the like, whereas the latter has a longer time. Note that the “striking operation” involves an operation of releasing a finger after making contact, but the “pushing operation” does not require the releasing operation. Therefore, if a predetermined time elapses with a finger or the like kept in contact, display control according to the “pushing operation” can be performed in that state. Further, there is no limitation on the area where both the “striking operation” and the “pushing operation” are in contact. Therefore, when touching a certain large area without moving, a “striking operation” or a “pushing operation” is performed depending on the difference in contact time. Moreover, there is no limitation also in the strength (pressure) to strike. Therefore, all of the operations of applying a strong pressure to the operation of gently applying a finger etc. are included in each of the “striking operation” and “pushing operation”. For example, an operation that gently touches for a moment (for example, less than 0.5 seconds) is a “tapping operation”. However, with the above as a rule, as an exception, even when the contact time is very short (for example, less than 0.5 seconds), when there is a change in which the pressure increases more than a predetermined amount during that time, or the contact area May be determined to be a “push operation” when there is a change that expands beyond a predetermined level.

  The “finger gesture information” is information relating to the finger gesture and includes at least “classification information” relating to the classification of the finger gesture. That is, even if a finger gesture is performed in the same screen situation, the function realized in association with the finger gesture depends on whether it is a “tracing motion”, “hitting motion”, or “pressing motion”. Because of the difference, it is first determined what type of finger gesture the user has made.

  The finger gesture information further includes “motion mode information” related to the mode of motion of the finger gesture. The specific content of the movement mode information is predetermined for each finger gesture classification. For example, in the case of a tracing action, information such as the speed, direction, and moving distance of the tracing action is included. However, information such as a direction and a moving distance is not included for a hitting operation or a pressing operation. On the other hand, in the hitting operation, for example, information related to the time that the finger or the like is in contact may be included, and information such as a hitting strength (pressure) may be included. In the case of a pushing operation, for example, information on the time and area of contact with a finger or the like, or the strength (pressure) to be pushed is included.

  As a specific method of acquiring finger gesture information by analyzing a detection signal generated by a touch sensor, various methods are employed in various products, and the present invention may employ any of them. it can.

  The “transmission unit” is connected to the finger gesture information acquisition unit via an internal communication path or the like, acquires finger gesture information from this, and transmits it to the image display device. The communication means for transmitting may be wired or wireless.

  The “image display unit” acquires a video signal from a tuner, a video playback device, or the like, and displays it as an image that can be visually recognized on a cathode ray tube, a liquid crystal panel, or the like while being controlled by a video circuit.

  The “reception unit” receives finger gesture information from the touch remote controller.

  The “operation menu display control unit” is connected to the receiving unit via an internal communication path or the like, and when the receiving unit receives the finger gesture information, the slide-in display or the finger gesture information indicated by the finger gesture information is displayed. Control is performed to perform at least one of slide-out display, instantaneous display or instantaneous erasure, and fade-in display or fade-out display. In the following, an example of controlling to perform slide-in display or slide-out display will be described first, and then another example will be described.

(Control of slide-in display or slide-out display)
FIG. 19 is a block diagram illustrating another example of the functional configuration of the image display device set according to the first embodiment, and illustrates an example including a unit for controlling to perform slide-in display or slide-out display. is there. The operation menu display control unit 1908 of the image display device 1903 of the image display device set 1901 has a slide operation menu display control means 1910. When the reception unit receives the finger gesture information, the slide operation menu display control means displays the operation menu associated with the function of the image display device according to the direction of the finger gesture indicated by the finger gesture information. Control is performed so that slide-in display or slide-out display is performed. Other configurations are the same as those shown in FIG.

The “direction of the finger gesture indicated by the finger gesture information” includes, for example, operation mode information related to the direction of the tracing operation when the classification information of the finger gesture information is the tracing operation. The finger gesture information in this case refers to a finger gesture in an aspect including at least information related to the direction of the finger gesture, and does not include a finger gesture in an aspect not including this, such as a hitting operation. In addition, the “tracing direction” referred to above includes a straight line from the tracing start point to the tracing end point in an arc, an S-shaped curve, a zigzag line, etc., in addition to the tracing direction in the case of a linear tracing operation. The direction of tying is included.
Further, the direction along the trajectory from the tracing start point to the tracing end point in an arc, an S-shaped curve, a zigzag line, etc. is also included in the “tracing operation direction” referred to herein. In other words, the “direction” in this case includes one in which the azimuth angle (for example, the azimuth angle when the upper direction of the screen is 0 degree) changes according to the trajectory. Accordingly, it is possible to display the operation menu so as to move in accordance with the tracing motion trajectory (for example, if the tracing motion trajectory is an arc, the operation menu can be moved to draw an arc). In this case, the direction of the operation menu may be translated according to the trajectory without changing, or may be moved while changing the direction according to the trajectory (for example, the trajectory of the tracing operation is In the case of an arc, it may be one that translates on the arc without rotating the operation menu, or may be one that moves on the arc while rotating).
Further, instead of associating the trajectory of the tracing operation with the trajectory of the operation menu, the tracing operation trajectory may be associated with the display mode (type) of the operation menu. For example, when the trajectory of the tracing motion is an arc, it is conceivable to associate this with the display mode (type) of “display to slide in while rotating” in the operation menu. In this case, it does not matter what kind of locus the operation menu draws. For example, the operation menu may be displayed in a straight line in a specific direction. That is, in this case, when a tracing operation for drawing an arc is performed, the operation menu is displayed in a straight line in a specific direction while rotating.

  The “function of the image display device” refers to a function of changing a channel and a function of adjusting a volume in a television, for example. The function is not limited to the original function of the television, and may be a peripheral function such as an Internet browsing function. The “operation menu associated with the function of the image display device” is, for example, the channel list menu 0102 in FIG. 1 and refers to a list of options related to a specific function.

  The channel list menu in FIG. 1 slides in from the right side of the screen, but other menus may be arranged at other locations on the screen. FIG. 3 is a diagram illustrating an example in which a plurality of menus are arranged in the image display device set according to the first embodiment. In this example, in addition to the channel list menu arranged on the right side of the screen, a volume adjustment menu is arranged at the top of the screen. When the finger gesture operation area 0304 of the touch remote controller 0303 is traced downward in the initial state, the image display device A volume adjustment menu 0302 is displayed in a slide-in manner from the top of the screen 0301.

  The operation menu may have a hierarchical structure. FIG. 4 shows an example of an operation menu having a hierarchical structure (background screen is omitted). The “setting menu” 0402 slide-in-displayed from the initial state has already been displayed at the left corner of the screen of the image display device 0401, and the touch remote controller is in a state where the “screen mode” 0405 is highlighted and activated. When the finger gesture operation area 0404 of 0403 is traced to the right, the lower layer menu 0406 is displayed in a slide-in manner from around the operation menu in the screen mode.

  “Slide-in display” means that the operation menu appears in such a manner as to slide out from the edge of the image display surface. The reason why the slide-in is not simply displayed is that the operation menu is moved in accordance with the movement of the finger on the touch remote control, as if the finger physically pulls out the operation menu from the edge of the screen. It is to provide a user with a comfortable operation feeling, and as a result, an intuitive and easy-to-understand operation is possible. In other words, slide-in can be said to be a display method that can give such a feeling of operation, and is not only a precise horizontal movement of the operation menu, but also a mode in which the page is flipped and opened. May be. “Slide-out display” means disappearing from the screen in such a manner as to slide into the edge of the image display surface. Note that “slide out” and “slide in” modes in “slide-in display” and “slide-out display” include, for example, a curve or zigzag in addition to the case of sliding in a straight line or sliding in one direction. A mode of sliding and sliding while drawing a straight line and a mode of sliding and sliding while rotating are also included.

  “The control is performed so that the operation menu is displayed in the slide-in display or the slide-out on the image display unit in accordance with the direction of the finger gesture” is, for example, the following processing.

  When the tracing operation is performed in the initial state, the operation menu associated with the direction of the tracing operation slides in. For example, if the touch remote control is traced to the left, the channel list menu slides in from the right end of the screen as shown in FIG. 1, and the volume adjustment menu moves downward from the top of the screen as shown in FIG. If the slide-in display is performed and the user traces to the right, the setting menu is displayed in a slide-in direction from the left end of the screen as shown in FIG.

  When a tracing operation is performed when not in the initial state, control of slide-in display or slide-out display associated with the screen state is performed. For example, when the setting menu 0402 is displayed in FIG. 4 and the lower layer menu 0406 is not displayed, the lower layer menu 0406 appears as a slide-in when the finger gesture operation area 0404 of the touch remote control 0403 is traced to the right. If you trace to the left, the setting menu will slide out and disappear. Alternatively, when the selection of the menu is confirmed by a hitting operation, the operation menu may be instantaneously disappeared from the screen. This is because there is no need to slide out the operation menu.

  When there is no slide-in or slide-out associated with the stroking action, the stroking action is ignored. For example, when the lower layer menu 0406 in FIG. 4 does not have any further lower layer menus, the operation of tracing in the right direction from the state in the figure is ignored.

As described above, “controls the operation menu to be displayed in slide-in or slide-out on the image display unit according to the direction of the finger gesture” is associated with the direction of the finger gesture in the screen state. This means that slide-in display or slide-out display processing is performed.
In the above description, the operation menu is displayed in a linear slide-in display or slide-out display according to the tracing operation in one direction. However, for example, in response to the tracing operation such as drawing an arc. The operation menu may be displayed as a slide-in display or a slide-out display while rotating. In this case, for example, when the operation menu is displayed, the operation menu appears to slide out from the edge of the image display surface while rotating, and when the operation menu is turned off, the operation menu is displayed in the reverse direction. In accordance with a tracing operation such as drawing an arc, a mode in which the operation menu disappears from the screen in such a manner that the operation menu slides while rotating in the tracing direction at the edge of the image display surface is conceivable.

  “According to the direction” does not have to be exactly the same direction. Even though the direction of the tracing operation performed by a person is intended to be the left direction, strictly speaking, it is rare that the tracing operation is performed in a completely horizontal direction. Therefore, a certain threshold value is given to the direction. For example, when a straight slide-in display is performed, a process may be performed in which the image is included in the left direction within a range of 30 degrees from the left horizontal direction. Similarly, for example, when a slide-in display is performed along a trajectory of drawing an arc, a buffer with a certain width is set on both sides of the reference arc line, and the traced trajectory is within the range of this buffer. If it falls within the range, it may be considered that the operation is to draw a circular arc.

  Returning to the example in which the operation menu shown in FIG. 1, 3 or 4 is linearly displayed in slide-in display or slide-out display, the operation menus are arranged on the top, bottom, left and right of the screen in these examples. The slide-in or slide-out was performed in the left-right direction. However, the position of the operation menu is not limited to the top, bottom, left and right of the screen. Also, the direction in which they slide in or slide out is not limited to up, down, left and right, and any direction may be used.

  FIG. 5 is a diagram illustrating an example in which an operation menu arranged at one of the corners of the screen slides in the image display device set according to the first embodiment. In this example, a TV input list menu is arranged in the upper right corner of the screen, and when the finger gesture operation area 0504 of the touch remote control 0503 is traced to the lower left side, the TV input list menu 0502 is displayed from the upper right portion of the screen of the image display device 0501 in the lower left direction of the screen. Slide-in display as if pulled out. Although the TV input list menu in FIG. 5 is located on the right side of the screen after sliding in, it may be arranged at the top of the screen or may occupy the upper right corner of the screen.

  FIG. 6 is a diagram illustrating an example of a hardware configuration of the touch remote controller according to the first embodiment. The touch remote controller includes “MPU” 0611, “RAM” 0612, “nonvolatile memory” 0613, a plurality of “touch sensors” 0614, and “communication interface” 0615. This configuration is connected to each other by a data communication path of “system bus” 0616, and performs transmission / reception and processing of information. Programs and data for realizing the functions of the touch remote controller are stored in a nonvolatile memory, and are expanded in a RAM as necessary. The MPU implements processing by the conversion unit by sequentially reading and executing the programs expanded in the RAM. The hardware configuration described above is common throughout the first embodiment and other embodiments.

  FIG. 7 is a flowchart illustrating an example of a process flow of the image display device set according to the first embodiment. First, the touch detection unit of the touch remote controller detects the contact or proximity of a finger and generates a detection signal (step 0701). Next, the finger gesture information acquisition unit analyzes the detection signal and acquires finger gesture information that is information indicating the finger gesture (step 0702). Next, the transmission unit transmits finger gesture information to the image display device (step 0703). Next, the receiving unit of the image display apparatus receives finger gesture information (step 0704). Next, the operation menu display control unit displays the operation menu associated with the function of the image display device in the slide-in display or the slide-out display in the image display unit according to the direction of the finger gesture indicated by the finger gesture information. Control is performed (step 0705). As described above, whether the slide-in display or slide-out display is selected or which operation menu is controlled is related to the direction of the finger gesture for each screen state. The displayed slide-in display or slide-out display is performed. Finally, the image display unit displays the operation menu as a slide-in display or a slide-out display according to the control of the operation menu display control unit (step 0706).

(Other control)
In the above description, the example in which the operation menu is displayed in the slide-in display or the slide-out display according to the direction of the finger gesture in the case of the “tracing operation” has been mainly described. Thus, by making the movement of the operation menu correspond to the movement of the finger, the user can obtain an intuitive and easy-to-understand operational feeling. However, the display that gives an intuitively easy-to-understand operational feeling for the user is not limited to the slide-in / slide-out display corresponding to such a “tracing operation”. For example, by causing an operation menu to be instantaneously displayed or deleted at a position on the screen (for example, the left area) corresponding to an operation of hitting a specific area (for example, the left area of the touch pad) of the remote control. In addition, an intuitive and easy-to-understand operation feeling can be given to the user. In addition, the user can also display the operation menu in a fade-in display or fade-out display at a position on the screen (for example, the left region) corresponding to an operation of pressing a specific region (for example, the left region of the touch pad) of the remote controller. Can give an intuitive and easy-to-understand operational feeling. All of these are included in the display control in this embodiment.

Note that the combination of finger gesture and display control is a slide-in display or slide-out display for “tracing action”, an instantaneous display or erase for “tapping action”, and a fade for “pushing action”. In-display or fade-out display is generally considered to fit the user's intuition most, but it is not necessarily limited to the above combination. For example, the operation menu may be instantaneously displayed / erased for “tracing operation”, or fade-in display / fade-out display may be performed. Furthermore, the same type of display control may be performed with different finger gestures, or different types of display control may be performed with the same finger gestures during a single operation menu display / erase. For example, when you touch the touchpad, the operation menu slides in, and when you tap it, it slides out (the former example), or when you tap the touchpad once, the operation menu is displayed instantly, and when you tap it again, it fades out It may be a thing (the latter example).
In the case of fade-in display / fade-out display, as described later in another embodiment, the operation menu is displayed.
<Effect of Example 1>
According to the image display device set of the first embodiment, the operation menu can be displayed or hidden on the screen by an extremely intuitive and simple operation.

<Concept of Example 2>
The first embodiment mainly relates to a technique for displaying a channel list menu and a volume adjustment menu in a slide-in display or a slide-out display. The second embodiment relates to a technique for enabling selection of one of the options shown in the operation menu displayed as described above.

FIG. 8 is a diagram illustrating an example in which the scroll operation of the submenu is performed in the image display device set according to the second embodiment. The channel list menu 0802 has already been displayed on the screen of the image display device 0801. A list of selectable broadcast stations is displayed in the channel list menu, one of which is highlighted, indicating that the program of the broadcast station is currently on the screen. In this state, when the viewer traces the finger gesture operation area 0804 of the touch remote controller 0803 up and down, the highlight display 0805 moves up and down on the channel list menu accordingly, and the channel displayed on the TV screen is adjusted accordingly. To switch.
<Configuration of Example 2>
FIG. 9 is a block diagram illustrating an example of a functional configuration of the image display device set according to the second embodiment. The image display device set 0901 includes a touch remote controller 0902 and an image display device 0903. The touch remote control includes a touch detection unit 0904, a finger gesture information acquisition unit 0905, and a transmission unit 0906. The image display device includes a receiving unit 0907, an operation menu display control unit 0908, and an image display unit 0909. In the image display device set according to the second embodiment, the operation menu display control unit includes a slide operation menu display control unit 0910, and the slide operation menu display control unit includes a hierarchical information holder 0911 and a sub menu scroll unit 0912. Hereinafter, the hierarchical information holder and the sub menu scroller will be described. Other configurations are the same as those of the image display device set of the first embodiment.

  The “hierarchical information holder” holds hierarchical information for making the operation menu display hierarchical display. As already described, the operation menu may have a hierarchical structure, and may have a submenu as described later. The hierarchical information holder holds the hierarchical structure between these operation menus.

  The “sub menu scroller” scrolls the sub menu according to the direction indicated by the finger gesture information when the operation menu displayed in the slide-in has a plurality of sub menus.

  When a certain operation menu includes a plurality of selectable items, the plurality of items are referred to as “submenu” of the operation menu. In the examples so far, the channel list menu and volume control menu are the highest-level operation menus, and individual broadcast stations and specific volumes are their submenus.

  “Scrolling” generally means moving the display contents up, down, left and right as if winding a scroll, so the submenu included in the operation menu displayed here is also moved up, down, left and right. It means to repeat. In this case, the highlight portion may be fixed in one place, and the submenu selected by highlighting may be switched by moving the submenu, or the submenu may be fixed and highlighted as shown in FIG. The display may move vertically and horizontally.

  When the operation menu is scrolled, the trajectory of the finger may be displayed on the operation menu to be scrolled so that the viewer can realistically experience the operation by the finger gesture.

  In FIG. 8, when the finger gesture operation area of the touch remote controller is traced down, whether to scroll the submenu or slide in the volume menu becomes a problem. When the channel list menu is displayed as shown in the figure, the scroll operation of the submenu may be prioritized. In this case, in order to display the volume menu, it is only necessary to slide out the channel list menu and then perform a slide-in operation on the volume menu. As described above, it is preferable that one process is defined for one direction of the tracing operation as to whether slide-in display or slide-out display is performed for each state of the screen or whether scroll processing is performed.

FIG. 10 is a flowchart illustrating an example of a processing flow of the image display device set according to the second embodiment. Steps up to step 1004 are the same as those up to 0704 in FIG. When the receiving unit receives the finger gesture information (step 1004), it is determined whether or not the slide-in operation menu has a plurality of submenus (step 1005). The case where this determination is denied includes a case where the slid-in operation menu does not have a plurality of submenus and a case where there is no slid-in operation menu. If the determination is affirmative, the submenu scroll control means performs control so as to scroll the submenu according to the direction indicated by the finger gesture information (step 1006). Finally, the image display unit scrolls the sub menu according to the control of the operation menu display control unit (step 1007).
<Effect of Example 2>
According to the image display device set of the second embodiment, the operation menu is displayed or hidden on the screen by an extremely intuitive and simple operation, and the desired function is selected by scrolling the submenu on the operation menu. can do.

<Concept of Example 3>
In the image display device set according to the first embodiment, the viewer displays a channel list menu on the screen by pulling out the channel list menu from the right side of the screen by a tracing operation on the touch remote controller. However, when watching a program, it is not immediately obvious whether the channel list menu is hidden on the right side of the screen or on the left side until you get used to it. In particular, if a different operation menu is prepared for each side of the square screen, such as the channel list menu on the right side, the volume adjustment menu on the left side, and another operation menu on the upper side, the menu is drawn from which side. It is difficult to immediately determine what should be done. In view of this, it is conceivable to arrange icons or headline displays representing these menus at corresponding locations on the screen.

  FIGS. 11 and 12 are examples of screens displaying operation menu headings at corresponding locations in the image display device set of the third embodiment. In FIG. 11, a program is displayed in a reduced size than usual within the program display frame 1106 in the screen 1105 of the image display device 1101, and a heading display area 1107 is provided outside the program display frame for arranging operation menu headings. The operation menu headings 1108 are arranged on the top, bottom, left, and right of the program display frame. On the other hand, in FIG. 12, the program is displayed in full screen 1205 without providing a program display frame in particular, and operation menu headings 1208 are displayed inside the program at four locations on the top, bottom, left, and right.

Since these displays are disturbing while the program is being viewed, they need only be displayed when necessary to operate the operation menu. Therefore, in the image display device set of the third embodiment, when the viewer touches the touch remote control or presses the home button provided separately from the touch remote control touch panel, the headline display is displayed on the screen. The If the touch remote controller is not operated for a certain period of time, the headline display is deleted from the screen.
<Configuration of Example 3>
FIG. 13 is a block diagram illustrating an example of a functional configuration of the image display device set according to the third embodiment. The image display device set 1301 includes a touch remote controller 1302 and an image display device 1303. The touch remote controller includes a touch detection unit 1304, a finger gesture information acquisition unit 1305, and a transmission unit 1306. The image display apparatus includes a receiving unit 1307, an operation menu display control unit 1308, and an image display unit 1309. The operation menu display control unit includes a slide operation menu display control unit 1310, and the slide operation menu display control unit includes a hierarchical information holder 1311 and a sub menu scroll controller 1312. In the image display device set according to the third embodiment, the slide operation menu display control unit further includes a headline display controller 1313. Hereinafter, the headline display controller will be described. Other configurations are the same as those of the image display device set of the second embodiment.

  The “headline display controller” displays or hides the headline display associated with the operation menu at the highest hierarchy according to the finger gesture information at the place where the operation menu slides in. The “top-level operation menu” refers to the operation menu that can be slid in first from the initial state. In the examples so far, this includes the channel list menu, volume control menu, setting menu, etc. To do. The “headline display” is, for example, the headline display in FIGS. 11 and 12, and the headline display having the heading “program” inside is associated with the channel list menu. Furthermore, each headline display is displayed in the “location where the operation menu slides in” associated therewith.

  As a specific configuration for displaying the headline display “according to the finger gesture information”, for example, there is a method of displaying the headline display when a hit operation is performed in the state of the initial screen. In this case, in order to display the channel list menu on the initial screen, first display the heading display by tapping, then display by the left-hand stroking operation, and the direct left-hand movement in the initial screen state. By doing so, there are two ways of displaying the channel list menu.

  As another configuration, the movement of the finger at the moment when the finger touches the touch panel is captured and this is set as, for example, a “starting action”, and when the finger gesture information acquisition unit recognizes some detection signal, the “starting action” is classified as a classification. The finger gesture information is configured to be acquired. The headline display control means performs control to display a headline display when finger gesture information whose start operation is classified is acquired. In this configuration, at the moment the viewer places his finger on the touch panel of the touch remote control, the headline display is first displayed on the screen, and the viewer confirms that “Program” is placed on the right side and then moves the finger to the left side. By sliding, the channel list menu is further displayed. In this configuration, it is possible to perform two operations of displaying a headline display and displaying a channel list menu with one operation.

  As another configuration, there is a method in which a home button different from the touch panel is provided on the touch remote controller, and a headline display is displayed when the home button is pressed on the initial screen. The home button is provided on the touch remote control, but for the purpose of the present invention to perform most operations with the touch pad, halfway warping is unavoidable, but if it is about the home button, there is not much discomfort for the operation It seems not. As a specific configuration, the home button is configured to generate a press signal by pressing the button, and when the finger gesture information acquisition unit recognizes this, the finger gesture information that classifies the “start operation” is acquired. And Subsequent processing is the same as that of the said structure.

The above is the configuration for displaying the headline display. For the configuration for hiding the display, for example, the operation menu associated with the headline display is displayed in a slide-in state, and the operation is further performed. When the menu is slid out and disappears from the screen, the heading display can be erased. Of course, the heading display may remain on the screen at this time. Further, there is a configuration in which the headline display and the operation menu are all automatically hidden when the operation is not performed for a certain period of time.
<Effect of Example 3>
According to the third embodiment, the headline display associated with the top menu can be displayed on the screen to assist the function operation.

<Concept of Example 4>
In the image display device set of the third embodiment, in order to perform the channel switching operation, it is necessary to first display the channel list menu on the screen. However, since the channel list menu occupies a certain range of the screen, it becomes an obstacle to program viewing. Therefore, the viewer may feel that he / she wants to operate the channel without displaying it. In the image display device set of the fourth embodiment, for example, after displaying a headline display related to a top menu such as a program, volume, and setting by a hitting operation, a program menu is selected from these by a finger gesture to be in an active state, By performing the up and down tracing operation in this state, the channel can be switched without displaying the channel list menu.

In the image display device set according to the fourth embodiment, a configuration in which operation menus in the same hierarchy are displayed at the same time is possible. For example, if the channel list menu is displayed in a slide-in display with a left-hand stroking operation while the heading display is displayed, then the channel list menu can be displayed by moving the heading display of the volume menu to the active state and then performing a downward-tracing operation. The volume menu can be displayed in a state where is displayed. FIG. 14 is a diagram showing a state in which the channel list menu and the volume menu are displayed at the same time in the image display device set according to the fourth embodiment (background program images are omitted). In this case, the volume menu 1401 is in an active state and is highlighted.
<Configuration of Example 4>
FIG. 15 is a block diagram illustrating an example of a functional configuration of the image display device set according to the fourth embodiment. The image display device set 1501 includes a touch remote controller 1502 and an image display device 1503. The touch remote control includes a touch detection unit 1504, a finger gesture information acquisition unit 1505, and a transmission unit 1506. The image display device includes a receiving unit 1507, an operation menu display control unit 1508, and an image display unit 1509. The operation menu display control unit includes a slide operation menu display control unit 1510, and the slide operation menu display control unit includes a hierarchical information holder 1511, a sub menu scroll controller 1512, and a headline display controller 1513. In the image display device set according to the fourth embodiment, the operation menu display control unit further includes a switch 1514. Below, a switching device is demonstrated. Other points are the same as those of the third embodiment.

  The “switcher” switches an active operation menu or headline display according to the finger gesture information.

  “Active” refers to a state in which the operation menu can accept a certain operation, and the viewer can recognize it by highlighting such as a highlight display.

As a configuration for “switching the active operation menu according to the finger gesture information”, for example, in the screen state of FIG. 12, since the tracing operation is already assigned to the display of each operation menu, a circle is drawn on the touch panel. Another form of finger gesture, such as “turning motion”, may be assigned to this. In this configuration, when the viewer draws a circle by placing a finger on the touch panel in the screen state of FIG. 12, the highlight on the top menu of the screen moves while rotating according to the rotation direction. For example, when the left / right tracing operation is performed in a state where the volume is highlighted, the volume of the television is changed without displaying the volume adjustment menu of FIG. 4 on the screen. Alternatively, even when a certain menu is displayed in a slide-in manner, another menu in the same hierarchy can be displayed in a slide-in manner simultaneously by switching the active operation menu.
<Effect of Example 4>
According to the image display device set of the fourth embodiment, the viewer can perform a desired operation intuitively and easily without the screen being occupied by the operation menu.

<Concept of Example 5>
FIG. 16 is a diagram illustrating the concept of the image display device set according to the fifth embodiment. The upper diagram of FIG. 16 represents a state in which the channel list menu is displayed in a slide-in manner by tracing the finger gesture operation area of the touch remote controller to the left in the initial state, as in the first embodiment of FIG. Unlike the case of the first embodiment, not only the broadcasting station name is displayed but also a display format that can be said to be a program table including a program name that can be viewed at present. In this state, when the finger gesture operation area of the touch remote controller is traced to the left once more, the program guide including the broadcast schedule not only for the present but also for several hours ahead is displayed in a slide-in manner. As described above, when more detailed information is desired or when a finer operation is desired, the operability can be further improved by enabling the slide-in display of a series of associated functions step by step.
<Configuration of Example 5>
FIG. 17 is a block diagram illustrating an example of a functional configuration of the image display device set according to the fifth embodiment. The image display device set 1701 includes a touch remote controller 1702 and an image display device 1703. The touch remote control includes a touch detection unit 1704, a finger gesture information acquisition unit 1705, and a transmission unit 1706. The image display apparatus includes a receiving unit 1707, an operation menu display control unit 1708, and an image display unit 1709. The operation menu display control unit includes a slide operation menu display control means 1710. The slide operation menu display control means includes a hierarchical information holder 1710, a submenu scroll controller 1711, a headline display controller 1712, and a switch. 1713. In the image display device set of the fifth embodiment, the slide operation menu display control means further includes one or both of a stage slide-in controller 1714 and a stage slide-out controller 1715. Hereinafter, the stage slide-in controller and the stage slide-out controller will be described. Other configurations are the same as those of the fourth embodiment.

  The “step slide-in controller” performs slide-in display step by step. The “step slide-out controller” performs slide-out display step by step. Specifically, in the screen state after the slide-in display by the first tracing operation, the sliding operation in the same direction is associated with the slide-in display of another screen in the same direction as the first.

A single slide-in display and a step-by-step slide-in display cannot be made to correspond simultaneously to one direction of the tracing operation in the same screen state. For example, the screen mode menu 0405 of the setting menu shown in FIG. 4 has a lower-level menu 0406, but this screen mode cannot be displayed in a stepwise slide-in display. On the other hand, since the channel list menu of FIG. 16 does not have a lower-level menu, there is no problem in displaying slide-in or slide-out in stages.
<Effect of Example 5>
In the image display device set according to the fifth embodiment, the related data is displayed stepwise by repeating the same kind of finger gesture, so that many related functions can be operated intuitively and easily.

<Concept of Example 6>
FIG. 18 is a diagram illustrating the concept of the image display device set according to the sixth embodiment. The image display device set of Example 1 has a configuration in which one top menu is arranged at each side or four corners of the screen. In the image display device set of the sixth embodiment, the top menu 1808 is displayed in parallel on the screen, and when the viewer traces the finger gesture operation area 1804 of the touch remote control 1803 to the right, the program, volume, setting, and interactive Each menu is scrolled to the right. In the top menu, the rightmost submenu is active, and the “program” menu corresponds to that in the figure. A channel list menu which is a lower layer of the program is displayed below it. That is, the lower menu is displayed on the right side of the screen as the top menu is scrolled. For example, when the volume top menu is on the rightmost side, the volume adjustment menu similar to FIG. Is displayed.
<Configuration of Example 6>
In the above description, the four menus arranged on the screen are called the top menu, but only one top menu is arranged on the screen, and it can be understood that the menu including programs etc. is the menu corresponding to the second layer. For example, this embodiment can be realized by the same configuration as that of the first embodiment.
<Effect of Example 6>
In the image display device set of the sixth embodiment, the top menu displayed in parallel on the screen is scroll-displayed according to the direction of the finger gesture, and the active lower menu is displayed in accordance with the scroll so that the viewer can recognize it. Can do.

<Concept of Example 7>
[Embodiment 7] Embodiment 7 relates to a technique for controlling an operation menu to be displayed or deleted instantaneously according to a finger gesture. In particular, a finger gesture is a “tapping action”, and an operation menu is instantaneously displayed or erased at a position corresponding to the position on the touch remote control of the image display unit according to the position of the touch remote control. This is the most characteristic of the control in Example 7. However, the control in the seventh embodiment is not limited to this, and includes control that instantaneously displays or deletes the operation menu in accordance with, for example, “race operation” or “push operation”.

FIG. 20 is a diagram illustrating an example of operation menu display in the image display device set according to the seventh embodiment. In this example, when the left area 2005 is struck with a finger or the like in the area (finger gesture operation area) (area indicated by the broken line 2004 in the figure) where the touch sensors on the touch remote control 2003 are arranged as shown in FIG. , (B), an operation menu 2002 is instantaneously displayed in the left area of the screen 2001. Although illustration of the contents of the operation menu is omitted in this figure, actually, for example, a channel list menu as shown in FIG. 1 is displayed as the operation menu (the same applies to FIGS. 22 and 23 described later). Is). Further, when the same area is subsequently hit again, the operation menu display may disappear instantaneously. In this way, a tapping action is associated with instantaneous display / erasure, and an operation menu is displayed at a position on the screen corresponding to the tapping position on the touch remote control, giving the user an intuitive and easy-to-understand operational feeling. be able to.
<Configuration of Example 7>
FIG. 21 is a block diagram illustrating an example of a functional configuration of the image display device set according to the seventh embodiment. The image display device set 2101 includes a touch remote controller 2102 and an image display device 2103. The touch remote control includes a touch detection unit 2104, a finger gesture information acquisition unit 2105, and a transmission unit 2106. The image display device includes a receiving unit 2107, an operation menu display control unit 2108, and an image display unit 2109. In the image display device set according to the seventh embodiment, the operation menu display control unit includes the instantaneous menu display control unit 2110. Hereinafter, the instantaneous operation menu display control means will be described. Other configurations are the same as those of the image display device set of the first embodiment.

  When the receiving unit receives the finger gesture information, the “instantaneous operation menu display control means” performs an operation associated with the function of the image display device according to the position of the finger gesture indicated by the finger gesture information on the touch remote controller. Control is performed so that the menu is instantaneously displayed or instantaneously deleted at a position corresponding to the position on the touch remote controller of the image display unit.

  “Position on the touch remote control” refers to each area obtained by dividing the area on the touch remote control, for example, the left area shown in FIG. For example, the area on the touch remote controller can be divided into areas such as a left area, a right area, an upper area, a lower area, and a central area. When hitting each of these areas with a finger or the like, it is not necessary to touch the entire area, and it is sufficient to touch somewhere in the area. For example, in the example of FIG. 20, if any part of the left area 2004 of the touch remote controller is hit, it is determined that the left area has been hit, and the operation menu is displayed in the left area of the screen accordingly. Just keep it.

  In addition, if the inside and outside of the area are hit at the same time in such a manner that a part protrudes outside the area, it may be determined that the area has been hit. In other words, as long as the contacted area includes the area, it is determined that the area has been hit. For this reason, it is desirable that the regions such as the left region, the right region, the upper region, the lower region, and the central region are not adjacent to each other, and a region that does not belong to any of the regions is provided between the regions. Otherwise, two or more areas may be hit at the same time, and it is impossible to determine which area should be displayed with the operation menu. Still, there may be a case where two or more areas are simultaneously hit. In this case, it is only necessary not to perform display control of the operation menu on the screen, assuming that a finger gesture is not detected. The same applies when hitting only an area that does not belong to any of the areas.

  The control for displaying the operation menu at a position corresponding to the position on the touch remote controller of the image display unit according to the position on the touch remote controller is performed on the touch remote controller as shown in FIG. When the left area 2005 is hit among the areas where the touch sensors are arranged (finger gesture operation area) (area indicated by the broken line 2004 in the figure), the operation menu is displayed on the left area of the screen. This means that the contact position in the finger gesture operation area is associated with the operation menu display position on the screen. To determine which area on the touch remote controller has been hit, associate each of the multiple touch sensors of the touch detection unit with an individual area such as the left area, or an area that does not belong to any of the individual areas. Just keep it. Further, whether or not the finger gesture in the region is a “tapping action” can be determined by detecting the contact time. In this case, for example, if the contact time is less than 0.5 seconds, a determination rule such as “hitting operation” is determined, and the determination may be made according to this rule.

  “Instantaneous display” means to display instantaneously. Specifically, first, unlike slide-in / slide-out display and fade-in / fade-out display, the operation menu is displayed from the beginning to the final display position with the final image quality (sharpness, brightness, etc.). means. Secondly, it means that the display is performed with little time (for example, within one second from the above detection) after detecting that the finger or the like has come off after touching the touch remote controller. However, if the operation menu is displayed at the final display position from the beginning with the final image quality, the time from detection to display can be designed to some extent. “Instant erasure” means erasing instantaneously, and the specific meaning is parallel to the above.

  Further, the instantaneous operation menu display control means may be configured to perform control to change the display method according to the tapping strength (pressure). For example, if a predetermined case is determined to be “struck strongly” by a pressure sensor and a determination rule, and if it is “struck strongly”, the time until display is shortened or the display area is widened ( That is, the operation menu may be displayed slightly larger).

  The instantaneous operation menu display control means has means for holding hierarchical information for making the operation menu display hierarchical display, and when the instantaneously displayed operation menu has a plurality of submenus, the finger gesture information It may have means for controlling to scroll the submenu according to the direction indicated by.

  Further, in this case, the instantaneous operation menu display control means includes means for displaying or hiding the headline display associated with the operation menu of the highest hierarchy according to the finger gesture information at a place where the operation menu is displayed. Furthermore, you may have.

  Further, in this case, the instantaneous operation menu display control means may have means for switching an active operation menu or heading display according to the finger gesture information.

  The instantaneous operation menu display control means may include means for performing instantaneous display step by step and / or means for performing instantaneous deletion step by step.

  FIG. 22 is a diagram illustrating an example of the display when the instantaneous display of the operation menu in the image display device set according to the seventh embodiment is performed in stages. In this example, when the left area 2204 of the touch remote controller 2203 is tapped with a finger or the like as shown in (a), the left half 2202a of the operation menu is instantaneously displayed in the left area of the screen 2201 as shown in (b). Next, when the same area of the touch remote controller is hit again, as shown in (c), the entire operation menu 2202b is displayed in the left area of the screen 2201. The purpose of configuring in this way is the same as that of the step-by-step slide-in display described in the fifth embodiment. Therefore, as an example of the operation menu suitable as a display target according to the seventh embodiment, as in the fifth embodiment, a channel list menu in the form of a program table including the currently viewable program names can be cited.

  The difference from the slide-in display of the fifth embodiment is that the operation menu is displayed “instantly”. That is, in the fifth embodiment, half of the operation menu first appears in such a manner that it slides out, and then the other half of the operation menu appears in such a manner that it further slides out, whereas in the embodiment, first, the operation menu appears. Half of the menu is displayed instantaneously, and then the entire operation menu is displayed instantaneously in such a manner that it switches to this.

  In this case, control for changing the display method may be performed depending on the strength (pressure) of tapping. For example, in the case of “striking strongly”, a normal instantaneous display is performed, and in other cases (in the case of “striking weakly”), a stepwise instantaneous display is considered.

Furthermore, an operation other than the “striking operation” may be associated with a stepped instantaneous display. For example, when the “race operation” is performed in the arrow direction (right direction) shown in FIG. ) And (c), stepwise instantaneous display in the left side area of the screen may be performed.
<Effect of Example 7>
According to the image display device set of the seventh embodiment, when an operation such as hitting a specific position on the touch remote controller is performed, the operation menu can be displayed at a position corresponding to this on the screen, so that the user can intuitively It is possible to give an easy-to-understand operational feeling.

<Concept of Example 8>
Example 8 relates to a technique for controlling an operation menu to display fade-in or fade-out according to a finger gesture. In particular, the finger gesture is a “push operation” and the operation menu is displayed in a fade-in or fade-out manner on the image display unit in accordance with the pressure or contact area to the touch remote control by the finger gesture. The most characteristic of them. At this time, an operation menu may be displayed at a position on the screen corresponding to the position of the finger gesture on the touch remote controller. However, the control according to the eighth embodiment is not limited to the one according to such a “pushing operation”, and for example, the operation menu is displayed in a fade-in display or a fade-out display in accordance with the “tracing operation” or “striking operation”. Something to control is also included.

FIG. 23 is a diagram illustrating an example of an operation menu display in the image display device set according to the eighth embodiment. In this example, when the central area 2304 of the touch remote controller 2303 is pressed with a finger or the like as shown in (a), the operation menu 2302a is initially displayed lightly in the central area of the screen 2301 as shown in (b). Further, when the pressing force (pressure) is increased or the contact area of a finger or the like is increased, the operation menu 2302b is gradually displayed as shown in (c). When the finger or the like is released, for example, the operation menu is gradually displayed lightly at the same changing pace as when the operation menu becomes dark, and finally disappears. In this way, the pressing operation is associated with the fade-in display or the fade-out display, and more preferably, the operation menu is displayed at a position on the screen corresponding to the pressing position on the touch remote controller, so that the user can easily understand intuitively. A feeling of operation can be given.
<Configuration of Example 8>
FIG. 24 is a block diagram illustrating an example of a functional configuration of the image display device set according to the eighth embodiment. The image display device set 2401 includes a touch remote controller 2402 and an image display device 2403. The touch remote control includes a touch detection unit 2404, a finger gesture information acquisition unit 2405, and a transmission unit 2406. The image display apparatus includes a receiving unit 2407, an operation menu display control unit 2408, and an image display unit 2409. In the image display device set according to the eighth embodiment, the operation menu display control unit includes a fade menu display control unit 2410. Hereinafter, the fade operation menu display control means will be described. Other configurations are the same as those of the image display device set of the first embodiment.

  When the reception unit receives the finger gesture information, the “fade operation menu display control unit” associates the function with the function of the image display device according to the pressure or the contact area to the touch remote control by the finger gesture indicated by the finger gesture information. Control is performed so that the displayed operation menu is faded in or faded out on the image display unit.

  “Fade-in display” means that the operation menu is (1) initially lightly displayed and then gradually darkened, (2) initially darkly displayed, and then gradually lighter (3) A mode in which the image is initially displayed dimly and then gradually and clearly, or (4) a mode in which the image is initially displayed in a small size and then gradually displayed in a large size, or (5) any combination of the above modes (for example, A mode in which a thin and small image is displayed at first, and then a deeper and larger image is displayed thereafter. The “fade out display” refers to the reverse display mode.

  Next, a specific configuration for performing display control according to the pressure on the touch remote controller will be described. First, the touch detection unit of the touch remote controller determines whether or not the finger gesture is a “push operation”. This determination can be made by detecting the contact time in the same manner as in the seventh embodiment. For example, if the contact time is 0.5 seconds or longer, a determination rule such as “depressing operation” is set, and the determination may be made according to this rule.

In this case, when it is determined that the “pushing operation” is performed, the fade-in display or the fade-out display may be performed in a predetermined display mode that is uniquely determined, but the pressure of the “pushing operation” is further detected. The fade-in display or the fade-out display may be performed in a manner corresponding to the pressure. For this reason, it is desirable that the touch detection unit of the touch remote controller has a pressure sensor.
In this case, for example, if the detected pressure is equal to or higher than a predetermined pressure, it may be possible to display such as shortening the time required for fade-in / fade-out or slightly increasing the darkness displayed first. . Further, the pressure and the density of the display may be associated with each other finely, and the change pace of the density or the like may be changed according to the change of the pressure. According to such a configuration, for example, if the touch remote controller is pressed while gradually increasing pressure, fade-in is performed at a slow pace, and if pressure is applied at a stretch, the fade-in is performed at a rapid pace. It will be possible. In addition, if the “push operation” is canceled halfway, the subsequent fade-in may be performed while maintaining the changing pace at that time, or the display state at that time may be maintained elsewhere. May be.

Similarly, the contact area of the “push operation” may be detected, and fade-in display or fade-out display may be performed in a manner corresponding to the contact area. The contact area can be detected by, for example, multiplying the area of each touch sensor constituting the touch detection unit by the number of touch sensors that have detected contact with a finger or the like.
In this case, for example, if the detected contact area is greater than or equal to a predetermined area, it may be possible to display such as shortening the time required for fade-in / fade-out or increasing the darkness displayed first. It is done. Further, the contact area and the display density may be associated with each other finely, and the change pace of the density or the like may be changed according to the change of the contact area. According to such a configuration, for example, if the touch remote controller is gradually pushed so that the finger touches a wide range, the fade-in is performed at a slow pace, and if the finger touches the touch remote controller so that the range where the finger touches widens at once, the fade-in is performed. Can be performed at a rapid pace. In addition, if the “push operation” is canceled halfway, the subsequent fade-in may be performed while maintaining the changing pace at that time, or the display state at that time may be maintained elsewhere. This may be the same as in the case where the display is controlled according to the pressure.

Further, as described in the first embodiment, even when the contact time is very short (for example, less than 0.5 seconds), when there is a change in which the pressure increases more than a predetermined level, or when the contact area is When there is a change that expands beyond a predetermined degree, it may be determined that the operation is a “pushing operation”. Here, for a change of a predetermined degree or more, for example, a rule is set such that a “pushing operation” is determined when there is a change of 100 kPa or more for pressure and 0.2 cm ² or more for a contact area. The measurement result may be determined in light of this determination rule.

In the case where the size of the operation menu displayed at the time of fade-in / fade-out does not change (the above-described aspects (1) to (3)), the position on the screen according to the pressed position on the touch remote controller It is desirable to display an operation menu on the screen. In this case, the method of dividing the area on the screen, the method of determining which area of the touch remote controller is touched, and the like are the same as those described in the seventh embodiment.
In the case where the size of the operation menu displayed in the fade-in / fade-out display is changed (the above-described (4) or the mode including the change in size in (5)), the first display is a touch. It is desirable to perform at a position on the screen according to the position where the touch pad on the remote control is pressed. In this case, by pressing the center area of the touchpad, the operation menu is initially displayed in a small size in the center of the screen. A typical mode is considered. In addition, by pressing an area other than the center of the touchpad (for example, the left area), the operation menu is initially displayed in a small size in the corresponding area (for example, the left area) of the screen, and then the center of enlargement toward the center of the screen. The screen may be gradually enlarged without changing the aspect ratio of the operation menu while shifting points.

Furthermore, an operation other than the “pushing operation” may be associated with a fade-in display or a fade-out display. For example, even in the “striking operation”, when the pressure increases during contact, A fade-out display may be performed.
Further, in a mode in which the size of the operation menu displayed at the time of fade-in / fade-out display is changed, for example, as the fade-in display, after the initial operation menu is displayed small in the center of the screen, the screen gradually rotates in a spiral shape. You may display so that it may spread over the whole. As a finger gesture in this case, for example, a “tracing operation” that is an operation of drawing an arc may be considered. As a fade-out display in this case, for example, by tracing the touchpad so as to draw an arc in the direction opposite to the top, the operation menu displayed on the entire screen gradually becomes smaller while gathering in the center of the screen. A mode of disappearing can be considered.
In this way, the fade-in / fade-out display in which the size of the operation menu changes is not limited to the one in which only the size is changed without changing the direction of the operation menu as described at the beginning. A mode of changing both the direction and the size of the menu is also included. In other words, the operation menu of (4) described in the definition of the fade-in display or the fade-out display described above is limited to the direction of the operation menu during the change in “a mode in which the menu is initially displayed small and then gradually displayed larger”. That is not.

<Effect of Example 8>
According to the image display device set of the eighth embodiment, when an operation such as pressing the touch remote controller is performed, the operation menu can be displayed on the screen as fade-in display or fade-out display, so that the operation feeling that is easy to understand intuitively for the user. Can be given.

Note that the combination of finger gesture and display control is a slide-in display or slide-out display for “tracing action”, an instantaneous display or erase for “tapping action”, and a fade for “pushing action”. In-display or fade-out display is generally considered to fit the user's intuition most, but it is not necessarily limited to the above combination. For example, the operation menu may be instantaneously displayed / erased for “tracing operation”, or fade-in display / fade-out display may be performed. Furthermore, the same type of display control may be performed with different finger gestures, or different types of display control may be performed with the same finger gestures during a single operation menu display / erase. For example, when you touch the touchpad, the operation menu slides in, and when you next tap, it slides out (example of the former). It may be a thing (the latter example).

Claims (9)

An image display device set comprising an image display device and a touch remote control for operating the functions of the image display device,
The touch remote control is
A touch detection unit for detecting a finger contact or proximity and generating a detection signal;
A finger gesture information acquisition unit that analyzes the detection signal and acquires finger gesture information that is information indicating a finger gesture;
A transmission unit for transmitting finger gesture information to the image display device;
Have
The image display device includes:
An image display unit;
A receiving unit for receiving finger gesture information;
When the receiving unit receives the finger gesture information, an operation menu associated with the function of the image display device is displayed on the image display unit according to the finger gesture indicated by the finger gesture information. An operation menu display controller that performs control to perform at least one of instantaneous display or instantaneous erasure, or fade-in display or fade-out display;
An image display device set. When the reception unit receives the finger gesture information, the operation menu display control unit of the image display device displays an operation menu associated with the function of the image display device according to the direction of the finger gesture indicated by the finger gesture information. The image display device set according to claim 1, further comprising a slide operation menu display control unit that performs control so that slide-in display or slide-out display is performed in the image display unit. The slide operation menu display control means includes:
A hierarchy information holder for holding hierarchy information for making the operation menu display a hierarchy display;
The image according to claim 2, further comprising: a submenu scroll controller that controls to scroll the submenu according to the direction indicated by the finger gesture information when the slide-in displayed operation menu has a plurality of submenus. Display device set. The slide operation menu display control means includes:
4. The headline display controller according to claim 2, further comprising: a headline display controller configured to display or hide a headline display associated with the operation menu of the highest hierarchy according to the finger gesture information at a place where the operation menu slides in. 5. Image display device set. The slide operation menu display control means includes:
The image display device set according to claim 4, further comprising a switch that switches an active operation menu or a heading display according to the finger gesture information. The slide operation menu display control means includes:
Stage slide-in controller for performing slide-in step by step and / or
6. The image display device set according to claim 2, further comprising a stage slide-out controller that performs the slide-out step by step. The operation menu display control unit of the image display device includes:
When the reception unit receives the finger gesture information, an operation menu associated with the function of the image display device is displayed on the touch remote control of the image display unit according to the position of the finger gesture on the touch remote control indicated by the finger gesture information. The image display device set according to claim 1, further comprising an instantaneous operation menu display control unit that performs control so that instantaneous display or instantaneous erasure is performed at a position corresponding to the upper position. The operation menu display control unit of the image display device includes:
When the reception unit receives the finger gesture information, the operation menu associated with the function of the image display device is displayed on the image display unit according to the pressure or the contact area to the touch remote controller by the finger gesture indicated by the finger gesture information. The image display device set according to claim 1, further comprising a fade operation menu display control unit that performs control so as to perform fade-in display or fade-out display. The image display device according to claim 1.

Images