JP4786292B2 - Information processing apparatus, hierarchical information output method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus having a display control function for changing a display direction.

  A conventional information processing apparatus has an information processing apparatus that has a display screen stored in a table and performs display control in accordance with an input from an operator (operator). For example, proposed in Patent Document 1 and Patent Document 2 Yes. Patent Document 1 proposes an information processing apparatus having a display control function for rotating and displaying a specific window which is the entire displayed screen or a part of the displayed screen based on a mouse input by an operator.

  In Patent Document 2, an operator directly operates the display screen by hand, and a display control function for moving, rotating, and turning the displayed document based on the movement and tilt of the hand on the screen is displayed. An information processing apparatus having

JP-A-5-181437 Japanese Patent Laid-Open No. 7-175589

  However, the conventional information processing apparatus does not consider the operability of the operation buttons by the operator. Accordingly, the present invention provides an information processing apparatus that displays lower layer information such as operation buttons and messages to be displayed next in consideration of operator operability when an operation button having a hierarchy is selected. With the goal.

In order to achieve the above object, the present invention has a display screen, and on this display screen, an image output means for outputting an image including an operation button and lower layer information corresponding to the operation button ,
Position recognition means for recognizing an operation position on the image;
Direction recognition means for recognizing an operation direction (A to D) of the operator with respect to the display screen ;
And a determination means for determining the lower layer information corresponding to the operation buttons of the recognized position by said position recognizing means,
The image output means includes
The image including the operation button is output without changing the direction on the display screen regardless of the operation direction (A to D) recognized by the direction recognition unit ,
The lower layer information determined by said determining means, and outputs in the manner according to the recognized operation direction in the direction recognition unit (to D).

  According to the information processing apparatus of the present invention, when an operation button is selected, lower level information such as operation buttons and messages that are displayed subsequently is displayed according to the recognized operation direction. Information can be easily viewed.

  The best mode for carrying out the present invention will be described below with reference to the drawings. The information processing apparatus of the present invention can be used by surrounding the display screen with a plurality of people, and FIG. 10 shows an example of its appearance. FIG. 10 is a diagram in which an information processing apparatus having a display screen stored in a table is used by four users surrounding the display screen.

(Embodiment 1)
The information processing apparatus according to the present embodiment acquires an input by an operator's finger as an image, and recognizes an operation direction (A to D) with respect to the display screen based on the obtained image. When an operation button is selected, lower hierarchy information such as a lower hierarchy operation button (referred to as a lower hierarchy button) or a message corresponding to the operation button is displayed in a manner according to the operation direction (A to D) . images that already contains operation buttons which was being displayed, and displays not allow changing the direction of the display screen. That is, for example, an operation button (hereinafter referred to as an operation button, an operation button “menu”) that is already displayed when the operation button operated by the above-described operator is displayed, for example, “menu” shown in FIGS. ”And“ menu ”button) and other screen contents, such as“ Meeting Summary OO △ △ △ ”as an example, without changing the output direction of the recognized operation direction described above. Regardless of (A to D), the image including the operation buttons is displayed without changing the direction on the display screen . The lower hierarchy information is information that is subsequently presented in accordance with an operation button such as a selected menu or icon. For example, in a menu having a configuration in which another menu opens when a certain menu item is selected, such as a pull-down menu, another menu opened according to the selected item is lower-layer information for the selected item. In addition, for example, in an application having a configuration in which a message screen or an operation window opens when a certain operation icon is selected, the message screen or operation window opened according to the selected icon is lower-layer information for the selected icon.

  Hereinafter, a first embodiment for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the main configuration of the information processing apparatus according to the present embodiment, FIG. 2 is a flowchart showing processing of the information processing apparatus, and FIG. 3 is an example of an acquired image obtained by acquiring an input by an operator's finger as an image. FIG. 4 is a diagram for explaining an example of the operation direction recognition, FIG. 4 is a diagram for explaining an example of the operation direction of the information processing apparatus, and FIGS. 5, 6, and 7 correspond to the operation direction when the operation button is selected. It is a figure for demonstrating the example of a display of lower hierarchy information, such as a lower hierarchy button and a message.

  In FIG. 1, 1 is a display unit such as an LCD (hereinafter referred to as LCD) for displaying images and characters, 2 is a light sensor that is stacked on the LCD 1 and detects light, and 3 is a distribution of light detected by the light sensor 2. Is input to image information, and the image information of an object placed on the optical sensor 2 is acquired by the optical sensor 2 and the image input unit 3. Further, the image input unit 3 determines whether the acquired image information includes a predetermined shape, for example, a predetermined shape such as a finger shape or a barcode. Reference numeral 4 denotes a position sensor that is stacked on the LCD 1 and detects a position on a display screen designated by an operator using a pen. Here, an electromagnetic induction type digitizer is used. The position sensor 4 is not limited to an electromagnetic induction type digitizer as long as it can be used by an operator to indicate a position on a display screen. It may be a digitizer of another method such as a method, or may be a pointing device such as a mouse or a track pad.

  Reference numeral 5 denotes a coordinate input unit that converts the position detected by the position sensor 4 or the pointing device into coordinates and inputs the coordinates. 6 is a position recognition unit that holds position information of the image displayed on the LCD 1 and recognizes the position on the display image instructed by the operator from the coordinates input from the coordinate input unit 5; A direction recognizing unit for recognizing; 8 a tag recognizing unit for recognizing tag information such as a barcode or an IC tag attached to an object placed on the screen; and 9 a character included in the image information input by the image input unit 3 That is, a character recognition unit 10 for recognizing characters written on an object placed on the screen or characters input by handwriting using the position sensor 4 is mainly used to hold information necessary for the operation of the information processing apparatus. A storage unit 11 is an auxiliary storage unit that partially holds information for improving the processing speed of the information processing apparatus, and 12 is a communication unit for communicating with external devices. Reference numeral 13 denotes a menu determination unit that determines lower layer information such as lower layer buttons and messages to be displayed when an instruction position on the display image by the operator recognized by the position recognition unit 6 corresponds to an operation button. A display control unit 15 that controls display on the LCD 1 is a central processing unit (CPU) that controls the entire information processing apparatus.

  Image input unit 3, coordinate input unit 5, position recognition unit 6, direction recognition unit 7, tag recognition unit 8, character recognition unit 9, main storage unit 10, auxiliary storage unit 11, communication unit 12, menu determination unit 13, display The control unit 14 and the CPU 15 are connected to each other via a bus 15a.

  In the present embodiment, the LCD 1 and the display control unit 14 constitute an image output unit, the position recognition unit 6 constitutes a position recognition unit, the direction recognition unit 7 constitutes a direction recognition unit, and the menu decision unit 13 decides. The optical sensor 2 and the image input unit 3 constitute an image input means. As described above, in the present embodiment, each means is composed of one or two blocks. However, the present invention is not limited to this, and more units can be used as long as they perform the same operation. It may be composed of blocks. Conversely, a plurality of means may be included in one block. For example, instead of the LCD 1 and the optical sensor 2, which constitute part of the image output means and the image input means in this embodiment, an image reading function as proposed in Japanese Patent Application Laid-Open No. 2004-45875 is provided. A display device can be used.

  In the present embodiment, the image output means includes the LCD 1 and the display control unit 14 and shows an information processing apparatus having the display screen LCD 1. However, the present invention is limited to the information processing apparatus having the display screen. Yes. For example, the present invention can be applied to an information processing apparatus having an image output unit that outputs an image by projecting an image onto a display target surface, such as a projector. In this way, in the case of the projector type, for example, a screen that is a display target surface may be arranged instead of the LCD 1 in FIG. 1, and an image may be projected from the translucent position sensor 4 side.

  The information processing apparatus according to the present embodiment includes the LCD 1 as a display screen. However, the display screen is not limited to a liquid crystal display, but includes an FED (Field Emission Display), an organic EL display (Organic Electro). Other image display type display devices such as Luminescence Display) may be used.

  In the present embodiment, the image input means includes the optical sensor 2 and the image input unit 3. However, the present invention is not limited to this, as long as the shape of the operator's finger can be acquired. The present invention is applicable. For example, the shape of the operator's finger may be acquired by using a pressure sensor.

  Next, the operation of the information processing apparatus according to the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing processing of the information processing apparatus in the present embodiment. A program for executing the flow of FIG. 2 is stored in the main storage unit 10, and the CPU 15 controls the information processing apparatus according to the program. By executing the program on a computer, the hierarchical information output method described below can be realized not only in the information processing apparatus described in this embodiment but also in various devices such as a personal computer and a workstation. I can do it.

  The flow of FIG. 2 starts when the information processing apparatus is turned on, and repeats the loop from step S1 to step S9. In step S1, the optical sensor 2 and the image input unit 3 acquire image information of an object placed on the optical sensor 2, that is, the display screen of the LCD 1, and the main storage unit 10 holds the acquired image. Proceed to S2. In step S2, in the first loop, the process proceeds to step S3. In the second and subsequent loops, the image information acquired in the previous loop and stored in the main storage unit 10 is compared with the image information on the display screen acquired in step S1 of the loop, and the image information changes. If there is, the process proceeds to step S3, and if there is no change, the process proceeds to step S9. Here, the image information acquired in the previous loop may be acquired in the previous loop, or may be used as a comparative reference retroactively to the image information acquired in the previous loop.

In step S3, the image input unit 3 determines whether or not the acquired image information includes a predetermined shape. If it is included, the process proceeds to step S4, and if not, the process proceeds to step S9. In the present embodiment, the predetermined shape is a finger shape shown in FIG. Step S
4, the direction recognizing unit 7 recognizes the direction of the operator from the shape of the finger included in the image information detected by the image input unit 3, for example, as shown in FIG. 3, and proceeds to step S <b> 5. In step S5, the position recognition unit 6 recognizes the coordinate position of the finger image acquired by the image input unit 3, and proceeds to step S6. In step S6, the position recognition unit 6 further determines an instruction position on the display screen by the operator from the position information of the display image held by the position recognition unit 6 and the coordinate position of the finger image obtained in step S5. If the operation button whose position is “menu” shown in FIGS. 4 to 7 is selected, the process proceeds to step S7, and if not, the process proceeds to step S9. When determining whether or not the operation button is selected, taking into account the displacement of the instruction position based on the operation of the operator, whether or not the instruction position is in the vicinity of the operation button, for example, the instruction position is the operation button Whether or not the circumference is within 5 mm can be used as a criterion.

  In step S7, the menu determining unit 13 determines lower layer information such as a lower layer operation button (lower layer button) and a message to be displayed following the operation button instructed by the operator, and the process proceeds to step S8. Here, the menu determination unit 13 has an internal storage unit, stores lower layer information such as lower layer buttons and messages corresponding to each operation button, and is displayed following the operation button instructed by the operator. Determine hierarchy information. Of course, the storage unit for storing the correspondence between the operation buttons and the lower hierarchy information is not limited to the storage unit inside the menu determination unit 13, and may be the main storage unit 10 or the auxiliary storage unit 11. .

  In step S8, the display control unit 14 determines lower layer information such as lower layer buttons and messages determined by the menu determination unit 13 according to the direction of the operator recognized by the direction recognition unit 7, for example, FIG. As shown in FIGS. 6 and 7, it is displayed on the LCD 1 and the process returns to step S1. At this time, the lower layer button displayed according to the direction of the operator is also an operation button. If it is determined that the lower layer button is selected in the next loop, further lower layer operation buttons, messages, etc. Is displayed in accordance with the operation direction. In step S9, the display control unit 14 continues the current display without changing the display, and returns to step S1.

  Next, the finger shape that is the predetermined shape determined by the image input unit 3 in step S3 and the direction of the operator recognized by the direction recognition unit 7 in step S4 will be described with reference to FIG.

  FIG. 3A is a diagram illustrating a state in which an operator operates the LCD 1 by pointing from the right on the display screen. FIG. 3B1 is an enlarged view of an image example acquired by the optical sensor 2 and the image input unit 3 when the operation of FIG. 3A is performed. The image input unit 3 recognizes that the object on the display screen is a “finger” because the acquired image is a raindrop type, and the direction recognition unit 7 is operated from the “right direction” by the operator based on the shape. I can recognize that. Next, FIG. 3 (b2) is an enlarged view of another example of an image acquired by the optical sensor 2 and the image input unit 3 when the operation of FIG. 3 (a) is performed. The image input unit 3 recognizes that the object on the display screen is “finger” from the fingerprint shape of the acquired image, and the direction recognition unit 7 is operated from the “right direction” by the operator from the unique arc shape of the fingerprint. I can recognize that.

  Next, a display example in which the lower layer information such as operation buttons and messages of the lower layer determined by the menu determining unit 13 according to the direction recognized by the direction recognition unit 7 by the display control unit 14 in step S8 is displayed on the LCD 1. This will be described with reference to FIGS. 4, 5, 6, and 7.

  FIG. 4 shows directions when the display screen of the information processing apparatus is used from four directions. The front direction is the direction A with respect to the operation button “menu” and the icon “?” Indicating help, and the direction B, the direction C, and the direction D are set every 90 degrees counterclockwise. In the following, an example in which an operator (operator) operates from four directions is shown, but the present invention is not limited to this, and may be four directions or more or less.

FIGS. 5C1 to 5C4 are display examples of lower layer buttons when the operator selects the “ Menu ” button from directions A to D, respectively. Here, the "menu" button is selected, "open" the lower hierarchy button in the lower layer information to be displayed after the menu determiner 13 "Save" to determine the "end", recognized by the direction determination unit 7 The lower layer buttons are displayed according to the direction A to direction D of the operator. Figure 5 (c1) ~ (c4), without changing the output direction of the "Menu" button on the display screen as shown in these figures, the display of a lower layer buttons corresponding to "Menu" button, the This is an example of changing the displayed character direction according to the direction of the operator without changing the arrangement of the lower hierarchy buttons. As shown in FIGS. 5C2 and 5C4, the characters on the buttons can be vertically written and displayed to the operator.

FIGS. 6D1 and 6D2 are other display examples when the operator selects the “ Menu ” button from the direction C and the direction B, respectively. Here, the "menu" button is selected, the lower hierarchy button "open" as the lower hierarchy information "Save", "end" that is determined is as described with reference to FIG. FIG. 6D1 shows the order of “Save”, “Open”, and “End” from the left as seen from the direction C without changing the output direction of the “Menu” button on the display screen as shown in these drawings. Is an example of displaying a lower hierarchy button. Further, FIG. 6 (d2) shows that the lower layer button shown in FIG. 5 (c1) is rotated 90 degrees counterclockwise without changing the output direction of the “menu” button on the display screen as shown in these drawings . It is an example of rotating and displaying. In this way, when displaying the lower layer buttons for the operation direction, the arrangement of the lower layer buttons to be displayed, such as changing the arrangement of the buttons from vertical to horizontal, changing the display order, rotating the buttons, etc. Can be changed and displayed with respect to the operation direction. 6 (d1) and 6 (d2) are merely examples for changing the arrangement of the lower hierarchy buttons and displaying the lower hierarchy buttons according to the present invention is not limited to this. In addition to changing the position of the lower hierarchy button, as described above, the character direction on the button can be further changed to display the lower hierarchy button with respect to the operation direction.

FIG. 7 is a display example when the operator selects the icon “?” Indicating help as an operation button from the direction C. When the icon “?” Is selected, the menu determination unit 13 determines the lower layer buttons “search” and “close” together with the help message that is the lower layer information to be displayed subsequently, and the direction recognition unit 7 determines the direction of the operator. Recognizing that the direction is C, without changing the output direction of the operation button of the icon “?” , A help message and lower layer buttons “search” and “close” are displayed according to the operation direction.

  5, 6, and 7 show examples in which there are a plurality of lower layer buttons corresponding to the operation button selected by the operator, but the present invention is not limited to this, and the lower layer buttons are not limited thereto. There may be one button.

  In addition, as described above, in FIGS. 5, 6, and 7, when the lower hierarchy information such as the lower hierarchy buttons and messages corresponding to the operation buttons are displayed in a manner corresponding to the operator direction, the display that has already been displayed The screen is displayed without changing the direction. However, the present invention is not limited to this, and the direction of the display screen that was being displayed when the operator selected the operation button may be changed. In the present invention, it is only necessary that the lower hierarchy information corresponding to the operation button selected by the operator is displayed in a manner corresponding to the operation direction.

As described above, according to the information processing apparatus of this embodiment, when an operation button is selected , the lower layer button corresponding to the operation button is not changed on the display screen without changing the output direction of the operation button. And lower hierarchy information such as messages and the like are recognized by the direction recognition unit 7 and displayed in a manner corresponding to the operation direction. Accordingly, the operator can easily visually recognize the displayed operation buttons and messages without performing any special operation, and the operability is improved. Further, according to the information processing apparatus of this embodiment, the display screen which was being displayed in the operation button selection operation during already can be displayed without changing the output direction. Further, when the operation button operated by the above-mentioned operator is operated, the operation button that is already displayed, for example, “Menu” and other screen contents, for example, “Summary Overview ○○○ △△△” Does not change the output direction. As a result, users other than the operator can quickly confirm the screen content being displayed. Further, according to the information processing apparatus of the present embodiment, when an operation button is selected, lower layer information such as a lower layer button and a message corresponding to the operation button is determined by the menu determination unit 13, and the direction recognition unit 7. Is displayed in accordance with the operation direction recognized by. The menu determination unit 13 has an internal storage unit and stores the correspondence between the operation buttons and the lower layer information. The menu determination unit 13 stores the character direction and arrangement of the lower layer information to be displayed for each operation direction. I'm not. The display control unit 14 displays the lower hierarchy information determined by the menu determination unit 13 according to the operation direction recognized by the direction recognition unit 7. Therefore, the menu determining unit 13 does not need to have lower hierarchy information for each operation direction, and the storage unit inside the menu determining unit 13 can be used efficiently. Of course, as described in the explanation of FIG. 2, the storage unit that stores the correspondence between the operation button and the lower hierarchy information is not limited to the storage unit inside the menu determination unit 13, but the main storage unit 10 or the auxiliary storage unit. The storage unit 11 or the like may be used. Even in that case, similarly, the main storage unit 10 or the auxiliary storage unit 11 does not need to have lower layer information for each operation direction.

  In the present embodiment, as described with reference to FIGS. 5 and 6, when an operation button is selected, the menu determining unit 13 determines a lower layer button as lower layer information corresponding to the operation button. The LCD 1 displays the lower hierarchy buttons in a manner corresponding to the operation direction. Thus, for example, operation buttons having a hierarchical structure such as a pull-down menu are displayed in the operation direction without any special operation by the operator, so that the operator can easily visually recognize them.

  Furthermore, in the present embodiment, as described with reference to FIGS. 5 and 7, when an operation button is selected, the display control unit 14 displays a lower layer button or a message screen corresponding to the operation button. The character direction of the lower layer information is recognized by the direction recognition unit 7 and changed according to the operation direction. As a result, the operator can easily confirm the characters of the lower layer information without performing any special operation.

  Furthermore, in the present embodiment, as described with reference to FIG. 6, when an operation button is selected, the display control unit 14 changes the arrangement of the lower layer buttons corresponding to the operation button to the direction recognition unit 7. Is changed according to the operation direction. For example, the display control unit 14 changes the arrangement of the lower hierarchy buttons to be displayed, such as changing the arrangement of buttons from vertical to horizontal, changing the display order, rotating the buttons, etc. In consideration, it is possible to display the operation direction. Thereby, the operator can easily confirm the operation button without performing any special operation. Moreover, the use frequency of the lower hierarchy button is memorize | stored in the memory | storage part 10, and it can also arrange and display a button in order with a high use frequency. As a result, the operator can easily check buttons that are used more frequently.

  Further, in the present embodiment, as described with reference to FIGS. 1, 2, and 3, the optical sensor 2 for acquiring an image of an object on the LCD 1 is laminated on the LCD 1. An image of the object on the LCD 1 is acquired, and it is determined whether or not the acquired image has a finger shape. If it is a finger shape, the direction recognition unit 7 recognizes the operation direction, and the position recognition unit 6 Recognize the operation position. If it is determined that the operation button is selected from the operation position, lower layer information such as a lower layer button or a message corresponding to the operation button is displayed in a manner corresponding to the operation direction. Thus, the operator can intuitively use the information processing apparatus using a finger.

  Further, as described above with reference to FIG. 2, according to the hierarchical information output method of the information processing apparatus of the present embodiment and the program that causes a computer to execute the operation button, when the operation button is selected, the operation button Lower layer information such as lower layer buttons and messages corresponding to is displayed in a manner corresponding to the operation direction. Accordingly, the operator can easily visually recognize the displayed operation buttons and messages without performing any special operation, and the operability is improved.

  In the first embodiment, the operation direction is recognized based on the finger-shaped image input to the information processing apparatus when the operation button is selected. However, the operation direction is not limited to this. Not a thing. Other examples of this will be described below in the second, third, and fourth embodiments.

(Embodiment 2)
The information processing apparatus according to the present embodiment includes a mouse for each operation direction, and recognizes the operation direction by identifying the mouse used for input.

  The main configuration of the information processing apparatus according to the present embodiment is the same as that shown in FIG. 1 used in the description of the first embodiment. The coordinate input unit 5 performs coordinate input and identifies the mouse used for input. Further, the direction recognition unit 7 recognizes the operation direction based on the mouse identification information that is an input from the coordinate input unit 5.

  FIG. 8 is an external view of an information processing apparatus having a mouse associated with an operation direction. The operator performs an operation using mouse α, mouse β, mouse γ, and mouse δ that are associated with the four directions A, B, C, and D, respectively, around the display screen of the information processing apparatus. The coordinate input unit 5 inputs coordinates and identifies the mouse used, and the direction recognition unit 7 recognizes the operation direction corresponding to the mouse. Then, in the same manner as in the first embodiment, the lower level operation buttons corresponding to the operation buttons are displayed.

  Therefore, according to the present embodiment, a plurality of mice that are input devices used for recognizing the operation direction are provided, and the operation direction can be easily recognized depending on which mouse is operated. . Further, in this embodiment, instead of recognizing the directionality based on the shape of the operator's finger in the above-described first embodiment, the directionality is recognized based on the operation of a plurality of mice. The effects based on other than this can be obtained as in the first embodiment.

(Embodiment 3)
The information processing apparatus according to the present embodiment includes a pen for each operation direction, and recognizes the operation direction by identifying the pen used for input.

  The main configuration of the information processing apparatus according to the present embodiment is the same as that shown in FIG. 1 used in the description of the first embodiment. By using an electromagnetic induction type digitizer as the position sensor 4, the coordinate input unit 5 performs coordinate input and identifies the pen used for input by utilizing the fact that pens of different frequencies can be identified. Further, the direction recognition unit 7 recognizes the operation direction based on the pen identification information that is input from the coordinate input unit 5.

  FIG. 9 is an external view of an information processing apparatus having a pen associated with an operation direction. Using pen α ′, pen β ′, pen γ ′, and pen δ ′ having different frequencies respectively associated with four directions A, B, C, and D around the display screen of the information processing apparatus. The operator performs the operation. The coordinate input unit 5 inputs coordinates and identifies the used pen, and the direction recognition unit 7 recognizes the operation direction corresponding to the pen. Then, in the same manner as in the first embodiment, the lower level operation buttons corresponding to the operation buttons are displayed.

  Therefore, according to the present embodiment, a plurality of pens which are input devices used for recognizing the operation direction are provided, and the operation direction can be easily recognized depending on which pen is operated. . Further, in the present embodiment, instead of recognizing the directionality based on the shape of the operator's finger in the above-described first embodiment, the directionality is recognized based on the operation of a plurality of pens. The effects based on other than this can be obtained as in the first embodiment.

(Embodiment 4)
The information processing apparatus according to the present embodiment includes a resistance film type digitizer that is operated by a finger with an operator, and an input generated when a finger is input, that is, when a finger is placed on a screen. Recognize the direction of operation based on small changes in coordinates. Recognition of the operation direction using a resistance film type digitizer is described in Japanese Patent Laid-Open No. 60-243730.

The main configuration of the information processing apparatus according to the present embodiment is the same as that of the first embodiment (see FIG. 1) except that the position sensor 4 is a resistive film type digitizer. The direction recognizing unit 7 can recognize the operation direction from a minute transition of input coordinates generated by an input by a finger, that is, a minute transition of input coordinates obtained from a resistive film digitizer. Then, in the same manner as in the first embodiment, the lower level operation buttons corresponding to the operation buttons are displayed. Of course, the position sensor 4 is not limited to the resistive film type digitizer, and may be any sensor that can recognize a minute change in input coordinates by a finger.
Therefore, according to the present embodiment, the same effect as in the first embodiment can be obtained.

  The information processing apparatus of the present invention can be applied to an information processing apparatus that surrounds and uses a display screen.

FIG. 3 is a block diagram of an information processing device showing Embodiment 1; 3 is a flowchart of the information processing apparatus according to the first embodiment. The figure for demonstrating the example of an acquired image which acquired the input with an operator's finger as an image, and the example of operation direction recognition. The figure for demonstrating the example of the operation direction of information processing apparatus. The figure for demonstrating the example of a display of the lower hierarchy button according to an operation direction. The figure for demonstrating the example of a display of the lower hierarchy button according to an operation direction. The figure for demonstrating the example of a display of the lower hierarchy message according to an operation direction. FIG. 6 is an external view of an information processing apparatus showing Embodiment 2. FIG. 6 is an external view of an information processing apparatus showing Embodiment 3. The conceptual diagram which shows an example of the external appearance of the information processing apparatus of this invention.

Explanation of symbols

1 LCD (image output means)
2 Optical sensor (image input means)
3 Image input unit (image input means)
6 Position recognition unit (position recognition means)
7 direction recognition part (direction recognition means)
13 Menu decision part (decision means)
14 Display control unit (image output means)

Claims (9)

An image output means for outputting an image including an operation button and lower layer information corresponding to the operation button on the display screen ;
Position recognition means for recognizing an operation position on the image;
Direction recognition means for recognizing an operation direction (A to D) of the operator with respect to the display screen ;
And a determination means for determining the lower layer information corresponding to the operation buttons of the recognized position by said position recognizing means,
The image output means includes
The image including the operation button is output without changing the direction on the display screen regardless of the operation direction (A to D) recognized by the direction recognition unit ,
The information processing apparatus and outputs in a manner that the lower layer information determined by said determining means, in accordance with the recognized operation direction (to D) in the direction identification means.   The information processing apparatus according to claim 1, wherein the lower hierarchy information determined by the determination unit is a lower hierarchy button.   The information processing apparatus according to claim 1, wherein the image output unit changes a character direction of lower layer information to be output according to an operation direction recognized by the direction recognition unit.   The information processing apparatus according to claim 2, wherein the image output unit changes the arrangement of the lower layer buttons according to the operation direction recognized by the direction recognition unit and outputs the changed information.   The information processing apparatus according to claim 4, wherein the change of the arrangement of the lower layer buttons includes rotation of the lower layer buttons. It further comprises image input means,
The position recognition means recognizes an operation position from the coordinate position of the image input from the image input means,
The information processing apparatus according to claim 1, wherein the direction recognition unit recognizes an operation direction from a shape of an image input from the image input unit. The image output means includes
Not only changing the output direction of the operation button that was already displayed when the operation button was operated, but also changing the output direction of other screen contents,
The information processing apparatus according to claim 1, wherein the lower hierarchy information is output in a mode corresponding to an operation direction recognized by the direction recognition unit. On the display screen, the image including the operation button and the lower layer information corresponding to the operation button are output,
Recognizing the operation position on the image,
Recognizing the operation direction (A to D) of the display screen of the operator;
Determine the lower layer information corresponding to the operation button of the recognized position,
The image including the operation button is output without changing the direction on the display screen regardless of the operation direction (A to D) recognized by the direction recognition unit ,
The hierarchy information output method characterized by outputting the said lower hierarchy information determined by the said determination means in the aspect according to the operation direction (AD) recognized by the said direction recognition means.   A program for causing a computer to execute the hierarchical information output method according to claim 8.

Images