JP2012014459A - Display apparatus, image display method and image display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display apparatus, an image display method and an image display program capable of optimizing display mode of menu even when user operates a touch panel with a finger.SOLUTION: The display apparatus determines a holding position of the display apparatus, an object content displayed on the touch panel and inclination of the display apparatus (S1-S5). A menu indicating processing items available for the user is generated corresponding to either one of the display state or processing state of the object content (S7). A display mode of the menu including display position and the direction of the menu is determined corresponding to the content of the menu, the holding position of the display apparatus and the inclination of the display apparatus (S9). The menu is displayed on the touch panel based on the determined display mode of the menu (S11).

Description

  The present invention relates to a display device that can be carried by a user, and an image display method and an image display program used therefor.

  2. Description of the Related Art Conventionally, as a small and lightweight display device that can be carried by a user, an electronic device that changes the display position of an icon according to the user's dominant arm is known (for example, see Patent Document 1). In this electronic device, the pointing direction of the input element is determined by a plurality of magnetic sensors provided on the touch panel and a magnetic field generator provided in the input element. The display position of the icon is changed according to the determined indication direction (that is, whether the user is right-handed or left-handed). Thereby, when the user performs an input operation such as selection of an icon, the icon is prevented from being obscured by a hand having an input element.

JP 2006-172367 A

  However, in the above electronic device, the user needs to operate the touch panel with an input element including a magnetic field generation unit. That is, when the user operates the touch panel with a finger, the user's dominant arm cannot be determined. In such a display device, the display position of the menu indicating the processing items that can be selected by the user cannot be optimized, so that the operability is deteriorated.

  An object of the present invention is to solve the above-described problems, and a display device, an image display method, and an image display method that can optimize a menu display mode even when a user operates a touch panel with a finger. An image display program is provided.

  A display device according to a first aspect of the present invention includes a touch panel that is a display body capable of detecting contact of a first external object, content display means for displaying content on the touch panel, and a main body that surrounds at least the outer edge of the touch panel. According to at least one of detection means for detecting the proximity or contact of the second external object at a plurality of different positions in the main body, and the display state and processing state of the content displayed on the touch panel. A menu generation unit that generates a menu indicating processing items that can be selected, a detection result of the detection unit, and a display position and display of the menu on the touch panel according to the menu generated by the menu generation unit Display mode determining means for determining a display mode as a direction, and the display mode determination Based on the display mode determined by the level, the menu display means for displaying the menu on the touch panel, and based on the detection result of the touch panel, it is determined whether or not the processing item indicated by the menu is selected. A selection determining unit; and a process executing unit that executes the selected processing item when the selection determining unit determines that the processing item is selected.

  According to the first mode, the display mode of the menu displayed on the touch panel is determined based on the detection result of the second external object and the content of the menu. Therefore, even when the user operates the touch panel with a finger, the display position and display direction of the menu are optimized according to the position where the second external object approaches or touches and at least one of the display state and the processing state of the content can do. As a result, the operativity of the touch panel in a display apparatus can be improved.

  In the first aspect, when the display mode determining means is associated with a submenu indicating the processing item more detailed than the selected processing item, the display mode determining means follows the inner edge of the touch panel, and You may determine the said display mode so that it may leave | separate from the position where the proximity | contact or contact of the said 2nd external object was detected by the said detection means. Examples of the menu associated with the submenu include a menu that needs to select a lower processing item, such as a top menu used in the initial state of the display device. In this case, the menu is displayed at a position on the touch panel where the second external object is difficult to approach or touch. Therefore, it can suppress that a 2nd external object contacts a menu, and can suppress a malfunctioning of a display apparatus by extension. Furthermore, it is possible to suppress the menu from being hidden behind the user's hand during the operation of the touch panel, thereby improving the operability of the display device.

  In the first aspect, the display mode determination means superimposes on the image displayed on the touch panel when the menu is not associated with a submenu indicating the processing item more detailed than the selected processing item. In addition, the display mode may be determined so as to be close to the position where the detection unit detects the proximity or contact of the second external object. As a menu that is not associated with a submenu, it is exemplified that there is no need to select a lower processing item like a browsing menu used when browsing content. In this case, the menu is displayed at a position where the second external object is proximate to or in contact with the touch panel. Therefore, the user can perform an input operation from the menu using the hand holding the display device.

  In the first aspect, the display mode determining means does not superimpose the image displayed on the touch panel when the menu includes a processing item accompanied by editing the content, and the detection means determines the second external The display mode may be determined so as to be separated from the position where the proximity or contact of the object is detected. Examples of menus that include processing items that involve editing of content include an editing menu that is displayed when the content is edited. In this case, since the menu does not cover the image displayed on the touch panel and the second external object can be prevented from coming into contact with the menu, the user can easily edit the image on the touch panel.

  In the first aspect, the apparatus includes a state determination unit that determines whether or not at least one of a display state and a processing state of the content displayed on the touch panel has changed, and the display mode determination unit includes the state determination unit. When it is determined that at least one of the display state and the processing state of the content has changed, the display mode may be determined again. In this case, the display mode of the menu can be optimized according to a change in at least one of the content display state and the processing state.

  In the first aspect, there may be provided tilt detecting means for detecting the tilt of the display device, and the display mode determining means may further determine the display mode according to a detection result of the tilt detecting means. In this case, the display mode of the menu can be optimized according to the tilt of the display device.

  In the first aspect, when it is determined that the processing item is selected by the selection determining unit, a sub-display for determining whether or not to display a submenu indicating the processing item more detailed than the selected processing item is displayed. A determination unit; and a finger determination unit that determines a type of a finger that has selected the processing item based on a detection result of the touch panel when the sub-display determination unit determines to display the submenu; and the finger determination Sub-menu display means for displaying the sub-menu at a position adjacent to the menu on the touch panel according to the type of the finger determined by the means may be provided. In this case, the display mode of the submenu can be optimized so that at least the submenu is displayed at a position adjacent to the selected menu according to the type of the finger that has selected the menu processing item.

  In the first aspect, the detection means detects a plurality of optical sensors provided at a plurality of different positions in the main body section to detect the proximity of the second external object, or detects contact of the second external object. There may be a plurality of pressure sensitive sensors. In this case, the detection position of the second external object in the main body can be specified by a plurality of light sensors or a plurality of pressure sensors.

  The image display method according to the second aspect of the present invention includes a touch panel that is a display body capable of detecting contact of a first external object, content display means for displaying content on the touch panel, and a main body that surrounds at least the outer edge of the touch panel. And a display state and process of the content displayed on the touch panel, which is used in a display device including a detection unit that detects proximity or contact of a second external object at a plurality of different positions in the main body In accordance with at least one of the states, a menu generation step for generating a menu showing processing items selectable by the user, a detection result of the detection means, and the menu generated by the menu generation step, The display mode which is the display position and display direction of the menu on the touch panel is determined. A display mode determining step; a menu display step for displaying the menu on the touch panel based on the display mode determined by the display mode determining step; and the process indicated by the menu based on a detection result of the touch panel. A selection determining step for determining whether or not an item has been selected, and a process executing step for executing the selected processing item when the selection determining step determines that the processing item has been selected.

  According to the second mode, the display mode of the menu displayed on the touch panel is determined based on the detection result of the second external object and the content of the menu. Therefore, even when the user operates the touch panel with a finger, the display position and display direction of the menu are optimized according to the position where the second external object approaches or touches and at least one of the display state and the processing state of the content can do. As a result, the operativity of the touch panel in a display apparatus can be improved.

  An image display program according to a third aspect of the present invention includes a touch panel that is a display body capable of detecting contact with a first external object, content display means for displaying content on the touch panel, and a main body that surrounds at least the outer edge of the touch panel. The display state of the content displayed on the touch panel, and a display device that is a computer provided with a detection unit that detects proximity or contact of a second external object at a plurality of different positions on the main body According to at least one of the processing states, a menu generation step for generating a menu indicating processing items that can be selected by the user, a detection result of the detection means, and the menu generated by the menu generation step, A table showing the display position and display direction of the menu on the touch panel The display mode determining step for determining the mode, the menu display step for displaying the menu on the touch panel based on the display mode determined by the display mode determining step, and the menu based on the detection result of the touch panel. A selection determination step for determining whether or not the processing item has been selected, and a process execution step for executing the selected processing item when the processing item is determined to be selected by the selection determination step. It is characterized by.

  According to the third mode, the display mode of the menu displayed on the touch panel is determined based on the detection result of the second external object and the content of the menu. Therefore, even when the user operates the touch panel with a finger, the display position and display direction of the menu are optimized according to the position where the second external object approaches or touches and at least one of the display state and the processing state of the content can do. As a result, the operativity of the touch panel in a display apparatus can be improved.

It is a front view of the display apparatus 1 by which the left edge was hold | gripped. 3 is a block diagram showing an electrical configuration of the display device 1. FIG. 3 is a flowchart showing main processing of the display device 1. It is a front view of the display apparatus 1 by which the right edge was hold | gripped. It is a front view of the display apparatus 1 by which the front side edge was hold | gripped. It is a front view of the display apparatus 1 by which the rear side edge was hold | gripped. It is a front view of the display apparatus 1 on which the submenu 73 was displayed. It is a front view of the display apparatus 1 on which the submenu 74 was displayed. It is a front view of the display apparatus 1 with which the browsing menu 82 was displayed. FIG. 6 is a front view of the display device 1 on which an editing menu 83 is displayed. FIG. 6 is a front view of the display device 1 rotated 30 ° counterclockwise from the state shown in FIG. 5. FIG. 6 is a front view of the display device 1 rotated counterclockwise by 60 ° from the state shown in FIG. 5.

  Hereinafter, a display device 1 according to an embodiment of the present invention will be described with reference to the drawings. The drawings to be referred to are used for explaining technical features that can be adopted by the present invention. The configuration of the apparatus, the flowcharts of various processes, and the like described in the drawings are not intended to be limited to these, but are merely illustrative examples.

  The physical configuration of the display device 1 will be described with reference to FIG. In the following description, the upper side, the lower side, the left side, the right side, the front side of the page, and the rear side of the page are defined as the front side, the rear side, the left side, the right side, the front side, and the back side of the display device 1. FIG. 1 shows a state in which the user holds the display device 1 with one hand so that the front-rear direction of the display device 1 is parallel to the vertical direction and the left-right direction of the display device 1 is parallel to the horizontal direction. (The same applies to FIGS. 4 and 7 to 10 described later).

  The display device 1 includes a plate-shaped main body 2 formed in a rectangular shape when viewed from the front. On the front side of the main body 2, a touch panel 3 that is a display body capable of detecting contact with an external object is provided. The main body 2 surrounds the outer edge of the touch panel 3 in a front view. For example, the user can view an image displayed on the touch panel 3 while operating the touch panel 3 with the other hand while holding the side edge of the main body 2 with one hand.

  An optical sensor 5 is provided along the side edge of the main body 2. The optical sensor 5 detects an external object close to the side edge of the main body 2. The optical sensor 5 of the present embodiment includes optical sensors 51, 52, 53, and 54 provided on the front side, the rear side, the left side, and the right side of the touch panel 3 in front view. Specifically, the optical sensor 51 detects an external object close to the front side edge of the main body 2. The optical sensor 52 detects an external object close to the rear edge of the main body 2. The optical sensor 53 detects an external object close to the left side edge of the main body 2. The optical sensor 54 detects an external object close to the right edge of the main body 2. That is, the optical sensors 51, 52, 53, 54 can detect the user's handle using the display device 1.

  When the display device 1 is in the initial state, a desktop image 71 is displayed on the touch panel 3. The initial state refers to a state in which no other content is displayed on the touch panel 3, for example, immediately after the display device 1 is turned on. The desktop image 71 is the lowest layer image displayed on the touch panel 3. On the desktop image 71, content selected by the user, a menu described later, and the like can be displayed in an overlapping manner. The content is an electronic file including images such as text and diagrams.

  Although not shown, the main body 2 includes a control board 10 that controls the operation of the display device 1, a battery 4 that supplies power to the display device 1, an acceleration sensor 6 that detects the tilt of the display device 1, and the like. Provided (see FIG. 2). On the side surface of the main body 2, a card slot for inserting a memory card 9 (see FIG. 2), a USB port to which a USB cable connector is attached and detached, and the like are provided. In the present embodiment, various contents that can be displayed on the touch panel 3 are stored in the memory card 9 in advance. Of course, the content displayed on the touch panel 3 may be information stored in a storage device other than the memory card 9 (for example, image data stored in the EEPROM 14 or the ROM 12).

  The electrical configuration of the display device 1 will be described with reference to FIG. The control board 10 of the display device 1 includes a CPU 11, ROM 12, RAM 13, EEPROM 14, touch panel controller 15, optical sensor controller 16, acceleration sensor controller 17, power controller 18, USB I / F 19, and memory card interface (I / F) 20. These components are connected via a bus. The ROM 12 stores a control program for causing the CPU 11 to execute a main process (see FIG. 3), which will be described later, an application program for browsing and editing contents, and the like.

  In the touch panel 3, a substantially transparent pressure sensitive sheet 32 that detects contact of an external object is laminated on a display panel 31 that displays an image. The display controller 15 outputs an image control signal to the display panel 31. The touch panel controller 21 receives a detection signal from the pressure sensitive sheet 32. The touch panel controller 21 specifies the contact position of the external object on the touch panel 3 based on the pressure sensitive value indicated by the input detection signal. The CPU 11 determines the user's input operation based on the identified contact position of the external object.

  The optical sensor controller 16 receives the detection signals of the optical sensors 51, 52, 53, and 54, respectively. Among the optical sensors 51, 52, 53, and 54, the light detection value indicated by the detection signal is determined as the target detection sensor. As specified. The acceleration sensor controller 17 receives the detection signal of the acceleration sensor 6 and specifies the tilt of the display device 1 based on the acceleration indicated by the detection signal. The power controller 18 controls charging / discharging of the battery 4, detects the remaining battery level and voltage drop of the battery 4, and controls the voltage supplied to the display device 1. The USB I / F 19 has the above-described USB port, and transmits and receives data to and from an external device via a USB cable. The memory card I / F 20 reads / writes data from / to the memory card 9 inserted in the card slot.

  With reference to FIGS. 1 and 3 to 10, main processing executed in the display device 1 will be described. 3 is executed by the CPU 11 based on a control program stored in the ROM 12 when the display device 1 is powered on. In the present embodiment, a desktop image 71 is displayed on the touch panel 3 at the start of the main process (FIG. 3). 5 and 6, the user holds the display device 1 with one hand so that the front-rear direction of the display device 1 is parallel to the horizontal direction and the left-right direction of the display device 1 is parallel to the vertical direction. Shows the state.

  In the main process of the display device 1, first, the grip position of the display device 1 is specified (S1). In step S <b> 1, the gripping position of the display device 1 is specified according to the target detection sensor specified by the optical sensor controller 16. Specifically, as shown in FIG. 1, when the user holds the left edge of the display device 1 with the left hand, a part of the optical sensor 53 is covered with the left hand. In this case, since the optical sensor 53 in which the amount of received light decreases is specified as the target detection sensor, the left edge of the display device 1 is specified as the gripping position. Similarly, when the target detection sensors are the optical sensors 51, 52, and 54, the front edge, the rear edge, and the right edge of the display device 1 are specified as the gripping positions, respectively.

  After execution of step S1, the target content is specified (S3). The target content is content displayed on the touch panel 3. In the example shown in FIG. 1, since the content specified by the user is not displayed on the touch panel 3, the desktop image 71 is specified as the target content. After execution of step S3, the inclination of the display device 1 is specified based on the output from the acceleration sensor controller 17 (S5). In the example illustrated in FIG. 1, it is specified that the front-rear direction of the display device 1 is parallel to the vertical direction so that the front side of the display device 1 is the upper side and the rear side of the display device 1 is the lower side.

  After execution of step S5, a menu indicating processing items that can be selected by the user is generated according to at least one of the display state and processing state of the target content specified in step S3 (S7). The display state of the target content includes the image size, scale, display position, and the like of the target content on the touch panel 3. The processing state of the target content includes processing details (for example, browsing display and image editing of the target content) executed by the application program.

  In step S7, a menu indicating processing items that can be selected by the user is generated. The menu generated in step S7 displays a list of processing items indicating functions that can be executed according to the display state and processing state of the target content among the functions provided by the control program and the application program. In other words, the menu generated in step S7 includes a combination of processing items optimized according to the display state and processing state of the target content. Hereinafter, a combination of processing items displayed in a list by the menu is referred to as a menu content. In the example shown in FIG. 1, since the desktop image 71 is the target content, a top menu 72 including processing items such as “display content”, “edit content”, and “delete content” is generated.

  A menu display mode is determined based on at least one of the gripping position of the display device 1 specified in step S1, the inclination of the display device 1 specified in step S5, and the contents of the menu generated in step S7. (S9). The menu display mode includes the display position and display direction of the menu generated in step S7.

  In the present embodiment, when the menu generated in step S7 is associated with the submenu, it is superimposed on the image displayed on the touch panel 3, and the proximity or contact of the external object is detected by the target detection sensor. The display mode of the menu is determined so as to be separated from the position. The submenu is a lower-level menu that indicates processing items (that is, lower-level processing items) that are more detailed than processing items selected from the menu displayed on the touch panel 3. Examples of the menu associated with the submenu include a menu that needs to select a lower processing item, such as the top menu 72 used in the initial state of the display device 1. Hereinafter, an example in which the menu display mode is determined in step S9 when the top menu 72 is generated in step S7 will be described.

  The display position of the menu may be determined according to the holding position of the display device 1 and the contents of the menu. For example, when the top menu 72 is generated in step S7, the display position of the top menu 72 is determined along the inner edge of the touch panel 3 and away from the position where the proximity of the external object is detected by the target detection sensor. The In the example shown in FIG. 1, since the optical sensor 53 is a target detection sensor, a position along the side opposite to the left edge of the main body 2 (that is, the right edge of the touch panel 3) is determined as the display position of the top menu 72. Is done.

  The menu display direction may be determined according to the display position of the menu and the tilt of the display device 1. In the present embodiment, when the menu display position is the left edge or the right edge of the touch panel 3, the menu display direction is determined so that a plurality of process items are arranged in the front-rear direction. In this case, a plurality of process items are arranged from the upstream side (high side) to the downstream side (low side) in the front-rear direction of the display device 1, and the upstream side is the upper side of the characters displayed in the process items. As described above, the display direction of the menu is determined. In the example shown in FIG. 1, the display direction of the menu is such that a plurality of processing items are arranged from the front side to the rear side of the display device 1 and the front side is above the characters displayed in the processing items. It is determined (the same applies to FIG. 4).

  On the other hand, when the menu display position is the front side edge or the rear side edge of the touch panel 3, the menu display direction is determined so that a plurality of processing items are arranged in the left-right direction. In this case, a plurality of processing items are arranged from the upstream side (high side) to the downstream side (low side) in the left-right direction of the display device 1, and the upstream side is the upper side of the characters displayed in the processing items. As described above, the display direction of the menu is determined. In the examples shown in FIGS. 5 and 6 to be described later, the menu is arranged so that a plurality of processing items are arranged from the right side to the left side of the display device 1 and the right side is above the characters displayed in the processing items. The display direction of is determined.

  Based on the menu display mode determined in step S9, the menu generated in step S7 is displayed on the touch panel 3 (S11). In the example illustrated in FIG. 1, the top menu 72 is displayed on the right edge that is the farthest from the left hand that holds the display device 1 in the display area of the touch panel 3. Therefore, the possibility that the left hand holding the display device 1 erroneously presses the processing item indicated by the top menu 72 can be suppressed, and consequently the malfunction of the display device 1 can be suppressed. Furthermore, when the touch panel 3 is operated, it is possible to suppress the top menu 72 from being hidden behind the user's hand, and thus the operability of the display device 1 can be improved.

  After execution of step S11, it is determined whether or not the gripping position has been changed (S13). In step S13, the latest gripping position is specified as in step S1. If the latest gripping position matches the gripping position specified in step S1, it is determined that there is no change in the gripping position (S13: NO). In this case, it is determined whether or not there is an input operation on the touch panel 3 based on the contact position detected by the touch panel controller 21 and the display range of the processing item indicated by the menu displayed on the touch panel 3 (S15). If it is determined that there is no input operation on the touch panel 3 (S15: NO), the process returns to step S13. Thereby, an input operation of the touch panel 3 is awaited.

  On the other hand, if the latest gripping position does not match the gripping position specified in step S1, it is determined that the gripping position has been changed (S13: YES), and the process returns to step S1. When there is an input operation on the touch panel 3 (S15: YES), it is determined whether or not the input operation on the touch panel 3 is a content end instruction (S17). When the input operation on the touch panel 3 is a content end instruction (S17: YES), the content and menu displayed on the touch panel 3 are closed. That is, the desktop image 71 is displayed on the touch panel 3, and the process returns to step S1.

  Thus, in the main process (FIG. 3), steps S1 to S17 are repeatedly executed until an instruction to end the content is received. As a result, the display position and display direction of the menu on the touch panel 3 are appropriately switched according to any of the menu contents, the gripping position of the display device 1, and the tilt of the display device 1.

  For example, assume that the user changes the display device 1 shown in FIG. 1 from the right hand to the left hand. In this case, as shown in FIG. 4, since the target detection sensor changes from the optical sensor 53 to the optical sensor 54, the right edge of the display device 1 is specified as the gripping position (S13: YES, S1). A position along the side opposite to the right edge of the main body 2 is determined as the display position of the top menu 72 (S9). Therefore, in step S11, the display position of the top menu 72 is switched from the right edge of the touch panel 3 to the left edge.

  Further, it is assumed that the user rotates the display device 1 shown in FIG. 1 by 90 ° counterclockwise in front view and holds it with the left hand. In this case, as shown in FIG. 5, since the target detection sensor changes from the optical sensor 53 to the optical sensor 51, the front edge of the display device 1 is specified as the gripping position (S13: YES, S1). It is specified that the left-right direction of the display device 1 is parallel to the vertical direction so that the right side of the display device 1 is the upper side and the left side of the display device 1 is the lower side (S5).

  In this case, in step S <b> 9, the position along the side opposite to the front edge of the main body 2 is determined as the display position of the top menu 72. Furthermore, the display direction of the menu is determined so that a plurality of process items are arranged from the right side to the left side of the display device 1 and the right side is above the characters displayed in the process items. Therefore, in step S11, the display position of the top menu 72 is switched from the left side edge of the touch panel 3 to the rear side edge.

  Furthermore, it is assumed that the user further changes the display device 1 shown in FIG. 5 from the right hand to the left hand. In this case, as shown in FIG. 6, since the target detection sensor changes from the optical sensor 51 to the optical sensor 52, the rear edge of the display device 1 is specified as the gripping position (S13: YES, S1). A position along the side opposite to the rear edge of the main body 2 is determined as the display position of the top menu 72 (S9). Therefore, in step S11, the display position of the top menu 72 is switched from the rear side edge of the touch panel 3 to the front side edge.

  When the input operation on the touch panel 3 is not a content end instruction (S17: NO), the user selects a processing item other than the end instruction from the menu displayed on the touch panel 3. In this case, it is determined whether or not to execute the submenu display according to the input operation of the touch panel 3 (S19). In step S19, when the process item selected from the menu includes a lower process item, it is determined to execute the submenu display (S19: YES).

  In this case, the type (for example, thumb, middle finger, little finger, etc.) of the operating finger that performed the input operation on the touch panel 3 is specified (S21). In step S21, an operation finger may be specified by a known method. For example, a finger identification method using tapping fluctuation in touch panel operation can be used. After execution of step S21, a submenu indicating a lower processing item included in the selected processing item is generated (S23).

  After execution of step S23, the submenu display mode is determined (S25). The submenu display mode includes the display position and display direction of the submenu generated in step S23. In step S25, the position adjacent to the menu selected on the touch panel 3 is determined as the display position of the submenu according to the type of the operating finger specified in step S21. More specifically, when the operation finger specified in step S21 is “thumb”, a position selectable by “finger other than thumb” in the same hand as the operation finger is determined as the display position of the submenu. The When the operation finger specified in step S21 is “a finger other than the thumb”, a position selectable by “thumb” in the same hand as the operation finger is determined as the display position of the submenu. The display direction of the submenu is determined in the same direction as the menu including the selected processing item.

  Based on the submenu display mode determined in step S25, the submenu generated in step S23 is displayed on the touch panel 3 (S27). Thereafter, the process returns to step S13.

  In the example shown in FIG. 4, it is assumed that the user selects the processing item “display content” of the top menu 72 displayed on the touch panel 3 with the index finger of the left hand. The processing item “content display” includes processing items “content A”, “content B”,... Indicating the names of content that can be displayed on the touch panel 3 as lower processing items. Therefore, when the processing item “display content” is selected (S19: YES), “left index finger” is specified as the operation finger (S21), and the processing items “content A”, “content B”,. A sub-menu including it is generated (S23).

  In step S25, the position that can be selected with the “thumb of the left hand” (the right rear side of the processing item “content display” in the example of FIG. 4) is determined as the display position of the submenu. Further, the display direction of the sub menu is determined so that a plurality of process items are arranged from the front side to the rear side of the display device 1 and the front side is above the characters displayed in the process items. As a result, as shown in FIG. 7, the submenu 73 is displayed at a position and a direction in which the user can easily select the processing items “content A”, “content B”... With the “left thumb” (S27). ).

  Further, in the example shown in FIG. 4, it is assumed that the user selects the processing item “edit contents” of the top menu 72 displayed on the touch panel 3 with the thumb of the left hand. The processing item “content editing” includes processing items “content A”, “content B”,... Indicating the names of content that can be edited on the touch panel 3 as lower processing items. Therefore, when the processing item “edit content” is selected (S19: YES), “left thumb” is specified as the operation finger (S21), and the processing items “content A”, “content B”. A sub-menu including it is generated (S23).

  In step S25, a position that can be selected with “a finger other than the thumb of the left hand” (in the example of FIG. 4, the left front side of the processing item “set tail”) is determined as the display position of the submenu. Further, the display direction of the sub menu is determined so that a plurality of process items are arranged from the front side to the rear side of the display device 1 and the front side is above the characters displayed in the process items. As a result, as shown in FIG. 8, the submenu 74 is displayed at a position and direction in which the user can easily select the processing items “content A”, “content B”... With “a finger other than the thumb of the left hand”. (S27).

  If the processing item selected from the menu does not include a lower processing item, it is determined not to execute the submenu display (S19: NO). In this case, a process for each selected item, which is a process executed according to the selected process item, is executed (S29). After execution of step S29, it is determined whether or not there is a state change in the target content (S31). In step S31, it is determined that there is a change in the state of the target content when either the display state or the processing state of the target content is changed by the selection item-specific processing in step S29 (S31: YES). In this case, the process returns to step S1, and the content and display mode of the menu are redetermined according to the state change of the target content (S1-S11). On the other hand, when there is no change in the state of the target content (S31: NO), the process returns to step S13.

  In the example shown in FIG. 7, it is assumed that the user selects the processing item “content A” from the submenu 73. In this case, as shown in FIG. 9, an application program for browsing and displaying the content is activated, and a content image 81 indicating “content A” is displayed on the touch panel 3 (S29). At this time, the content image 81 is displayed in a size over the entire area of the touch panel 3 so that the user can easily browse and display it.

  In this case, it is determined that the state change of the target content has occurred (S31: YES), and the process returns to step S1. In step S3, the target content is specified as “content A”. In step S7, the processing items “end of browsing”, “next image”, and “previous image” corresponding to the processing contents executed by the application program (in the example of FIG. 7, browsing display of “content A”) are displayed. A browsing menu 82 is generated. In step S9, as in the case where the target content is the desktop image 71, the menu display mode of the browsing menu 82 is determined.

  However, in the present embodiment, when the menu generated in step S7 is not associated with the submenu, the menu is superimposed on the image displayed on the touch panel 3, and the proximity or contact of the external object is detected by the target detection sensor. The display mode of the menu is determined so as to be close to the set position. Examples of menus that are not associated with submenus include menus that do not require selection of lower processing items, such as a browsing menu 82 that is used when browsing content.

  Therefore, when the browsing menu 82 is generated in step S7, the browsing menu 82 is superimposed on the content image 81 displayed on the touch panel 3 and is close to the position where the proximity of the external object is detected by the target detection sensor. The display position of the menu 82 is determined (S9). In the example shown in FIG. 7, since the optical sensor 53 is a target detection sensor, the position on the content image 81 along the left edge of the main body 2 is determined as the display position of the browsing menu 82. At this time, the display position of the browsing menu 82 is determined within a range that can be operated with the thumb of the user's handle existing at the detection position of the target detection sensor.

  Therefore, in step S11, unlike the display mode of the top menu 72 (see FIG. 1), the browsing menu 82 is displayed near the left hand holding the display device 1. The user can select a processing item shown in the browsing menu 82 with the thumb of the left hand holding the display device 1. Specifically, the user presses the processing items “next image” and “previous image” with the thumb of the left hand to sequentially switch the content image 81 displayed on the touch panel 3 and browse “content A”. it can.

  In the example illustrated in FIG. 8, it is assumed that the user selects the processing item “content A” from the submenu 74. In this case, as shown in FIG. 10, an application program for editing content is activated, and a content image 81 indicating “content A” is displayed on the touch panel 3 (S29). At this time, the content image 81 is displayed in a size that fits the entire image in a predetermined area of the touch panel 3 so that the user can easily edit the image.

  In this case, it is determined that the state change of the target content has occurred (S31: YES), and the process returns to step S1. In step S3, the target content is specified as “content A”. In step S7, processing items “end editing”, “enlargement”, “reduction”,... According to the processing contents executed by the application program (image editing of “content A” in the example of FIG. 8) are shown. An editing menu 83 is generated. In step S9, as in the case where the target content is the desktop image 71, the menu display mode of the editing menu 83 is determined.

  However, in the present embodiment, when the menu generated in step S7 includes a processing item that involves editing the content, the menu is not superimposed on the image displayed on the touch panel 3, and the object detection sensor approaches or touches the external object. The display mode of the menu is determined so as to be separated from the position where the is detected. An example of the menu including processing items that involve editing of content is an editing menu 83 displayed when editing the content.

  Therefore, when the editing menu 83 is generated in step S7, it is not superimposed on the content image 81 displayed on the touch panel 3 and is separated from the position where the proximity of the external object is detected by the target detection sensor. The display position of the editing menu 83 is determined (S9). In the example shown in FIG. 8, since the optical sensor 53 is a target detection sensor, the position behind the content image 81 along the lower edge of the main body 2 is determined as the display position of the editing menu 83. .

  Therefore, in step S11, unlike the display mode of the browsing menu 82 (see FIG. 9), the editing menu 83 is displayed at a position away from the left hand holding the display device 1 and not overlapping the content image 81. Is done. Thus, the editing menu 83 is prevented from covering the content image 81, and the hand holding the display device 1 is prevented from accidentally touching the editing menu 83. Therefore, the user can easily edit the content image 81 using the processing items of the editing menu 83.

  In the example shown in FIG. 10, only the edit menu 83 is displayed as the menu displayed on the touch panel 3, but menus other than the edit menu 83 may be displayed together. In this case, the menu displayed together with the edit menu 83 is preferably displayed at a position separated from the user's gripping position regardless of whether or not the menu is associated with the submenu. Specifically, when another menu is displayed together with the edit menu 83 on the touch panel 3 shown in FIG. 10, the other menus are arranged vertically in a display area sandwiched between the right side of the touch panel 3 and the right side of the content image 81. Is displayed.

  As described above, according to the display device 1 according to the present embodiment, the display mode of the menu displayed on the touch panel 3 is determined based on the detection result of the external object by the optical sensor 5 and the content of the menu. The Here, the detection result of the external object by the optical sensor 5 indicates a position where the main body 2 is gripped by the user. The contents of the menu reflect the display state and processing state of the target content. Therefore, even when the user operates the touch panel 3 with a finger, the display position and display direction of the menu can be optimized according to the position where the main body unit 2 is gripped and the display state and processing state of the target content. it can. As a result, the operability of the touch panel 3 in the display device 1 can be improved.

  By the way, in the said embodiment, the optical sensor 5 is corresponded to the "detection means" of this invention. The touch panel controller 21 corresponds to the “content display unit” of the present invention. The CPU 11 that executes step S7 corresponds to the “menu generating means” of the present invention. The CPU 11 executing step S9 corresponds to the “display mode determining means” of the present invention. The CPU 11 executing step S11 corresponds to the “menu display means” of the present invention. The CPU 11 that executes steps S15 to S19 corresponds to the “selection determination unit” of the present invention. The CPU 11 that executes step S29 corresponds to the “process execution means” of the present invention.

  The CPU 11 executing step S31 corresponds to the “state determination unit” of the present invention. The CPU 11 executing step S5 corresponds to the “tilt detection means” of the present invention. The CPU 11 executing step S19 corresponds to the “sub display determination unit” of the present invention. The CPU 11 that executes step S21 corresponds to the “finger determination unit” of the present invention. The CPU 11 executing steps S23 and S25 corresponds to the “submenu display means” of the present invention. Step S7 corresponds to the “menu generation step” of the present invention. Step S9 corresponds to the “display mode determining step” of the present invention. Step S11 corresponds to the “menu display step” of the present invention. Steps S15 to S19 correspond to the “selection determination step” of the present invention. Step S29 corresponds to the “processing execution step” of the present invention.

  In addition, this invention is not limited to the said embodiment, The change in the range which does not change the summary of invention is possible. For example, in step S9 of the above embodiment, the menu display position is determined according to the gripping position of the display device 1 and the contents of the menu, and the menu display direction is determined according to the menu display position and the tilt of the display device 1. Has been. Furthermore, both the display position and the display direction of the menu may be changed according to the inclination of the display device 1.

  Specifically, it is assumed that the user gradually rotates the display device 1 shown in FIG. 5 counterclockwise when viewed from the front. In this case, in step S9, after the menu display mode is determined as in the above embodiment, the angle θ1 (see FIG. 11) and the angle θ2 (see FIG. 12) are compared. The angle θ1 is an angle formed by the direction X from the upstream side to the downstream side in the left-right direction of the display device 1 with respect to the gravity direction Z. The angle θ2 is an angle formed by the direction Y from the upstream side to the downstream side in the front-rear direction of the display device 1 with respect to the gravity direction Z. The angles θ1 and θ2 may be specified based on the inclination of the display device 1 specified in step S5.

  As shown in FIG. 11, when the angle θ <b> 1 is less than the angle θ <b> 2, the display device 1 is closer to the gravitational direction Z in the left-right direction than in the front-back direction. In this case, of the front side edge and the rear side edge of the touch panel 3, the one that is separated from the grip position of the display device 1 (in the example of FIG. 11, the rear side edge of the touch panel 3) is the display position of the top menu 72. It is determined. In this case, the display direction of the top menu 72 is such that a plurality of processing items are arranged from the upstream side (high side) to the downstream side (low side) in the left-right direction of the display device 1 in the same manner as in the above embodiment. The upstream side may be determined to be above the character displayed in the processing item.

  As shown in FIG. 12, when the angle θ1 is equal to or larger than the angle θ2, the display device 1 approximates the gravity direction Z in the front-rear direction rather than the left-right direction. In this case, of the left edge and the right edge of the touch panel 3, the one that is separated from the grip position of the display device 1 (the right edge of the touch panel 3 in the example of FIG. 12) is determined as the display position of the top menu 72. The In this case, the display direction of the top menu 72 is such that a plurality of processing items are arranged from the upstream side (high side) to the downstream side (low side) in the front-rear direction of the display device 1 in the same manner as in the above-described embodiment. The upstream side may be determined to be above the character displayed in the processing item.

  Moreover, in the said embodiment, although the holding position of the display apparatus 1 is specified using the optical sensor 5, you may specify the holding position of the display apparatus 1 using the sensor of another detection system. For example, a plurality of pressure sensors that detect contact with an external object may be provided at a plurality of different positions in the main body 2. In this case, in step S1, the grip position of the display device 1 can be specified based on the detection result of each pressure sensor.

  Further, in the above-described embodiment, the display device 1 is provided with the touch panel 3 that detects the user's input operation and the optical sensor 5 for specifying the grip position of the display device 1. However, if the grip position of the display device 1 can be specified by the touch panel 3, it is not necessary to provide the optical sensor 5 in the display device 1. For example, when the touch panel 3 has a size that occupies almost the entire area of the main body 2 in a front view, the user's finger holding the main body 2 contacts the touch panel 3. In this case, in step S <b> 1, the grip position of the display device 1 can be specified based on the detection result at the peripheral edge of the touch panel 3.

DESCRIPTION OF SYMBOLS 1 Display apparatus 2 Main-body part 3 Touch panel 5 Optical sensor 6 Acceleration sensor 11 CPU
16 optical sensor controller 17 acceleration sensor controller 21 touch panel controller 51 optical sensor 52 optical sensor 53 optical sensor 54 optical sensor 71 desktop image 72 top menu 73 submenu 74 submenu 81 content image 82 browsing menu 83 editing menu

Claims (10)

A touch panel which is a display body capable of detecting contact of the first external object;
Content display means for displaying content on the touch panel;
A main body that surrounds at least the outer edge of the touch panel;
Detecting means for detecting the proximity or contact of the second external object at a plurality of different positions in the main body;
Menu generating means for generating a menu indicating processing items that can be selected by the user according to at least one of a display state and a processing state of the content displayed on the touch panel;
A display mode determination unit that determines a display mode that is a display position and a display direction of the menu on the touch panel according to a detection result of the detection unit and the menu generated by the menu generation unit;
Menu display means for displaying the menu on the touch panel based on the display mode determined by the display mode determination unit;
Selection determination means for determining whether or not the processing item indicated by the menu is selected based on a detection result of the touch panel;
And a process execution unit configured to execute the selected process item when the selection determination unit determines that the process item is selected.   When the display mode determining unit is associated with a submenu indicating the processing item more detailed than the selected processing item, the display mode determining unit is configured along the inner edge of the touch panel and by the detecting unit. The display device according to claim 1, wherein the display mode is determined so as to be separated from a position where proximity or contact of the second external object is detected.   The display mode determining means superimposes on the image displayed on the touch panel when the menu is not associated with a submenu indicating the processing item more detailed than the selected processing item, and The display device according to claim 1, wherein the display mode is determined so as to be close to a position where proximity or contact of the second external object is detected by a detection unit.   In the case where the menu includes a processing item that involves editing the content, the display mode determination unit does not overlap the image displayed on the touch panel, and approaches or touches the second external object by the detection unit. The display device according to claim 1, wherein the display mode is determined so as to be separated from a position where the detection is detected. A state determination unit that determines whether or not at least one of a display state and a processing state of the content displayed on the touch panel has changed,
5. The display mode determination unit according to claim 1, wherein the display mode determination unit re-determines the display mode when it is determined by the state determination unit that at least one of a display state and a processing state of the content has been changed. The display apparatus in any one. Inclination detecting means for detecting the inclination of the display device,
The display device according to claim 1, wherein the display mode determination unit further determines the display mode according to a detection result of the tilt detection unit. Sub-display determining means for determining whether or not to display a submenu indicating the processing item in more detail than the selected processing item when the selection determining means determines that the processing item is selected;
A finger discriminating unit that discriminates the type of the finger that selected the processing item based on the detection result of the touch panel when the sub-display determining unit determines to display the submenu;
The submenu display means for displaying the submenu at a position adjacent to the menu on the touch panel according to the type of the finger determined by the finger determination means. Display device.   The detection means includes a plurality of optical sensors that detect proximity of the second external object, or a plurality of pressure sensors that detect contact of the second external object, provided at a plurality of different positions in the main body. The display device according to claim 1, wherein the display device is a display device. A touch panel which is a display body capable of detecting contact of the first external object;
Content display means for displaying content on the touch panel;
A main body that surrounds at least the outer edge of the touch panel;
Used in a display device comprising detection means for detecting proximity or contact of a second external object at a plurality of different positions in the main body,
A menu generation step of generating a menu indicating processing items that can be selected by the user according to at least one of a display state and a processing state of the content displayed on the touch panel;
A display mode determination step for determining a display mode that is a display position and a display direction of the menu on the touch panel according to a detection result of the detection unit and the menu generated by the menu generation step;
A menu display step for displaying the menu on the touch panel based on the display mode determined by the display mode determination step;
A selection determination step of determining whether or not the processing item indicated by the menu is selected based on a detection result of the touch panel;
An image display method comprising: a process execution step of executing the selected process item when it is determined in the selection determination step that the process item has been selected. A touch panel which is a display body capable of detecting contact of the first external object;
Content display means for displaying content on the touch panel;
A main body that surrounds at least the outer edge of the touch panel;
In a display device that is a computer including detection means for detecting proximity or contact of a second external object at a plurality of different positions in the main body,
A menu generation step of generating a menu indicating processing items that can be selected by the user according to at least one of a display state and a processing state of the content displayed on the touch panel;
A display mode determination step for determining a display mode that is a display position and a display direction of the menu on the touch panel according to a detection result of the detection unit and the menu generated by the menu generation step;
A menu display step for displaying the menu on the touch panel based on the display mode determined by the display mode determination step;
A selection determination step for determining whether or not the processing item indicated by the menu is selected based on a detection result of the touch panel, and a selection when the processing item is determined to be selected by the selection determination step. An image display program for executing a process execution step for executing the process item.

Images