JP4803868B2 - Information processing apparatus and function list display method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention relates to an information processing apparatus.as well asFunction list display methodTo the lawIn particular, an information processing apparatus provided with an image display unit surrounded by a stepped frame and a coordinate designating unit for designating a coordinate position on the screen of the image display unitas well asFunction list display method applied to the information processing apparatusTo the lawRelated.
[0002]
[Prior art]
Conventionally, in a personal computer (hereinafter referred to as “personal computer”), when a predetermined button, icon, or the like in a screen displayed on an image display device is clicked, a menu display in a pull-down (pull-up) menu style is generally performed. Is called. In this menu, items of various functions that can be realized by a personal computer and related to the predetermined buttons, icons, and the like are displayed.
[0003]
In addition, in a display screen of an image display device such as a desktop personal computer capable of displaying a relatively large amount of information, a multi-window method in which a plurality of screens are displayed side by side or stacked is generally used. Yes.
[0004]
Since it is difficult to adopt such a menu display method and a multi-window method in a personal digital assistant (PDA) having a small image display area, a plurality of menus are not displayed on the image display unit at the same time. When the display of the menu is finished, it is deleted and another menu is displayed.
[0005]
[Problems to be solved by the invention]
However, in the conventional portable information terminal having a small image display area, there is a demand to display a plurality of menus side by side or overlap each other.
[0006]
If it is going to respond to such a request | requirement, since the conventional portable information terminal has an originally small image display area, the displayed menu will become small. Even if the resolution of the image display unit is high, there is a problem that the menu is difficult to see.
[0007]
In addition, when there are many function items in each menu, it is difficult to select function items by displaying multiple menus at the same time. In some cases, there is a risk of selecting function items by mistake. .
[0008]
  The present invention has been made in view of such problems, and is an information processing apparatus in which menus are easy to see even when a plurality of menus are simultaneously displayed on a small image display unit, and operability is improved.as well asFunction list display methodThe lawThe purpose is to provide.
[0009]
[Means for Solving the Problems]
  In order to achieve the above object, an information processing apparatus according to the present invention includes an image display unit surrounded by a quadrangular frame that forms a step, and coordinate designation means for designating a coordinate position on the screen in the image display unit. A main image display means for displaying a main image, a plurality of predetermined areas on the image display unit provided near each of the four sides of the frame, and a plurality of the predetermined areas, respectively. Correspondingly set, a plurality of function lists each including a plurality of function items related to the processing for the main image, and a first predetermined area of the plurality of predetermined areas is coordinate-designated by the coordinate designating means Subsequently, the coordinate designation is continued by the coordinate designating means, and the first function list corresponding to the first predetermined area when the designated coordinates are changed in a substantially central direction of the image display unit. Table A first function list display means that draws out in the predetermined direction an amount that is a change amount of the designated coordinate in a predetermined direction and displays it on the image display unit, and the first function list display means by the first function list display means. When one function list is displayed on the image display unit, the coordinate designation means designates a second predetermined area different from the first predetermined area among the plurality of predetermined areas, and continues. When the coordinate designation is continued by the coordinate designating means, and the designated coordinate changes in a substantially central direction of the image display unit, a second function list corresponding to the second predetermined area is displayed. A second function list display means for pulling out the predetermined amount in the predetermined direction and displaying on the image display unit in preference to the display of the first function list. The main image displayed on the image display unit immediately before the display of the first and second function lists is changed according to the withdrawal amount of each of the first and second function lists. The second function list display means is reduced in size and displayed on the image display unit, and the second function list display means is located at a position where the drawing direction of the first function list and the drawing direction of the second function list face each other. In some cases, the first function list is displayed as the amount of withdrawal of the second function list increases while maintaining a predetermined distance between the first function list and the second function list. The size is scaled and displayed in a drawing direction of the second function list.
  In order to achieve the above object, a function list display method applied to an information processing apparatus according to the present invention includes an image display unit surrounded by a quadrangular frame that forms a step, and an on-screen in the image display unit. Coordinate designating means for designating coordinate positions, a plurality of predetermined areas on the image display unit provided near each of the four sides of the frame, and each set corresponding to the plurality of predetermined areas, In a function list display method applied to an information processing apparatus including a plurality of function lists including a plurality of function items related to processing on a main image, a main image display step for displaying a main image, and the coordinate designation The first predetermined area of the plurality of predetermined areas is designated by the means, and the coordinate designation is continued by the coordinate designation means, and the designated coordinates are substantially in the central direction of the image display unit. The first function list corresponding to the first predetermined area is drawn out in the predetermined direction by the amount of change that is a change amount of the designated coordinate in the predetermined direction and displayed on the image display unit. When the first function list is displayed on the image display unit by one function list display step and the first function list display step, the coordinate designating means Of these, a second predetermined area different from the first predetermined area is designated, and the coordinate designation is continued by the coordinate designation means, and the designated coordinates are substantially in the center direction of the image display unit. When changed, the second function list corresponding to the second predetermined area is pulled out in the predetermined direction by the amount of pull-out, and the image is prioritized over the display of the first function list. A second function list display step for displaying on the display unit, and in the main image display step, the first and second function list are displayed on the image display unit immediately before being displayed. The main image is scaled and reduced according to the drawing amount of each of the first and second function lists, and displayed on the image display unit. In the second function list display step, When the drawing direction of the function list is opposite to the drawing direction of the second function list, the distance between the first function list and the second function list is kept at a predetermined distance. The display size of the first function list is scaled and displayed in the drawing direction of the second function list as the amount of the second function list is increased.The
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0013]
(First embodiment)
FIG. 1 is a front view showing the configuration of the first embodiment of the portable information processing apparatus according to the present invention, and FIG. 2 is a top view of the portable information processing apparatus shown in FIG. FIG. 4 is a rear view of the portable information processing apparatus shown in FIG. 1, and FIG. 4 is a cross-sectional view taken along line AA ′ in the portable information processing apparatus shown in FIG.
[0014]
The portable information processing device 01 is equipped with an image display display 09 having the capability of displaying full color image information with high definition, and is a notebook-sized portable information terminal (PDA) that receives coordinate instructions mainly by a pen-type input device 05. It is.
[0015]
A camera unit 07 and a microphone 06 for recording sound data are arranged on the front side shown in FIG.
[0016]
A shutter switch 08 is arranged on the upper surface side shown in FIG. The shutter switch 08 is composed of a two-stage switch. When the first stage switch is turned on, a shooting standby state is set, and finder image information is displayed on the image display display 09. Then, shooting is performed by switching on the second stage, and an image is recorded.
[0017]
The back side shown in FIG. 3 is a side on which operations are mainly performed when the user uses the portable information processing device 01. The touch panel sensor 11 on the image display display 09 is touched by the pen-type input device 05, whereby the coordinates are designated and various functions are selected. Reference numeral 10 denotes a speaker.
[0018]
As shown in the cross-sectional view of FIG. 4, the touch panel sensor 11 is configured to be surrounded by the exterior cover member 04, and hits the exterior cover member 04 when the input device 05 is moved along the upper surface of the touch panel sensor 11. As described above, the exterior cover member 04 is stepped with respect to the touch panel sensor 11.
[0019]
FIG. 5 is a diagram showing a configuration of the touch panel sensor 11.
[0020]
The touch panel sensor 11 is provided with an image display area 11E and menu display trigger areas 11A to 11D. The drawer menu display trigger areas 11 </ b> A to 11 </ b> D are respectively located near the touch panel sensor 11 in contact with the exterior cover member 04. Thereby, when the input device 05 is moved along the upper surface of the touch panel sensor 11 and hits the exterior cover member 04, the input device 05 is positioned in any one of the pull-out menu display trigger areas 11A to 11D. The coordinate definitions of the drawer menu display trigger areas 11A to 11D are determined based on the shape of the pen tip of the input device 05, and the coordinates detected by the touch panel sensor 11 when the input device 05 is abutted against the exterior cover member 04. Define the range with a margin. Each predefined coordinate information of the drawer menu display trigger areas 11A to 11D is registered in the ROM, and when the coordinate information by the input device 05 is detected, the coordinate information registered in the ROM is collated, and the input device When it is determined that the coordinate information 05 is present in the drawer menu display trigger areas 11A to 11D, the drawer menu display activation state described later is entered, and the input device 05 is scrolled toward the center of the touch panel sensor 11. If it is detected, a drawer menu is displayed.
[0021]
FIG. 6 is a diagram for explaining a pull-out menu displayed on the image display display 09.
[0022]
In order to display the names of a large number of processing functions of the portable information processing device 01 on the image display display 09, the large number of processing functions are classified into four categories in advance and assigned to the A to D classification menus. . When any of the drawer menu display trigger areas 11A to 11D is selected by the input device 05, the corresponding one of the A to D classification menus is displayed as the “drawer menu” on the image display display 09. To do.
[0023]
The contents laid out in the drawer menu are assumed to be a list of buttons based on icons and text display, or an example of icons and characters written in accordance with the specifications of the portable information processing device 01 and the product concept. The
[0024]
As specific examples of functions stored in the A to D classification menu, the A classification menu summarizes a search function for searching for a desired image from images captured and stored in the past, and the B classification menu includes The character input functions for adding characters to the image are summarized, and the processing and editing functions for adding special effects to the image are summarized in the C classification menu. Since the B category menu is displayed on the image display display 09 as a drawer menu, various function processes are performed, so that the B category menu is positioned above the image display display 09 as described later with reference to FIG. This prevents the input device 05 and the hand from hiding the image when writing to the image or selecting a function.
[0025]
The D classification menu includes a function for designating a storage destination of image data subjected to image processing, such as a storage / organization function.
[0026]
FIG. 7 is a diagram showing a screen of the image display display 09 on which the B classification menu is displayed as a drawer menu.
[0027]
If the input device 05 is slid toward the center of the screen while the coordinates of the drawer menu display trigger area 11B are designated by the input device 05, the B classification menu is displayed as the drawer menu 11b. In the drawer menu 11b, function buttons with icons and characters corresponding to each function are laid out.
[0028]
As described above, the user designates one of the pull-out menu display trigger areas 11A to 11D using the input device 05 according to the necessary function, and displays the menu including the necessary function by scrolling. Can do. While the user repeatedly uses the drawer menu display trigger areas 11A to 11D, the user can learn the large category of each area.
[0029]
The number of icons and buttons shown in FIG. 7 is set according to the size of the screen, and is not limited to the number shown in FIG. The drawer menu display trigger areas 11A to 11D are set to be always displayed on the image display display 09, and are not normally displayed, but are displayed only when a predetermined area of the image display display 09 is designated by the input device 05. You may make it use properly a setting. Furthermore, the drawer menu display trigger areas 11A to 11D may be distinguished from each other by changing the pattern or color.
[0030]
In the following description, as shown in FIG. 5, the horizontal direction of the screen of the image display display 09 is the X axis, the vertical direction is the Y axis, and the pullout amounts of the pullout menu are x and y, respectively.
[0031]
FIG. 8 is a block diagram illustrating a system configuration of the portable information processing apparatus 01.
[0032]
As described above, by touching the soft button on the screen of the image display display 09 with the input device 05, the coordinates on the touch panel sensor 11 are detected, and the CPU 21 stores the operation stored in the ROM 25 according to the detected coordinate information. Perform various functions based on the system.
[0033]
Further, the image input from the CCD 22 of the camera unit 07 and the sound information input from the microphone 06 are stored in the flash memory 24 by the shutter switch 08 and stored in the RAM 23 according to various processing procedures of the program stored in the ROM 25. The stored information is reproduced later on the image display display 09 or the speaker 10, and a desired image or sound can be arbitrarily selected through a plurality of search means by GUI operation instructed from the coordinate position on the touch panel sensor 11 by touching the input device 05. It is possible to play back.
[0034]
The image information is edited and processed by various methods such as arbitrarily adding an image to the reproduced image information using the RAM 23 or adding a character by a word processor function.
[0035]
FIG. 9 is a flowchart showing an outline of the entire operation procedure in the portable information processing apparatus 01.
[0036]
When the main power supply is activated (YES in S11), the pictures taken in the past are reproduced, and a display state in which the list can be displayed like an album is made (S12).
[0037]
In this state, there is a button (hard key) operation (S13), and if it is an operation of the power switch, the power is turned off. If it is the operation (half-press) of the first switch SW1 of the shutter switch 08 (S14), the image is displayed on the viewfinder (S15), and the second switch SW2 of the shutter switch 08 is operated (all If pressed (S16), the captured image is stored in the flash memory 24 (S17).
[0038]
When the GUI function button is selected and operated by the input device 05 after the process of step S15 or step S17 or the process of step S12 (S18), search is performed according to the selected function (S19), character input (S20), processing / editing (S21), storage / arrangement (S22), and the like are executed.
[0039]
The present invention relates to a display of a menu containing various GUI function buttons.
[0040]
10 and 11 are flowcharts showing the processing procedure when displaying the drawer menu, and FIG. 12 is a display screen in the process of displaying the drawer menu (particularly, when the B classification menu is selected and displayed). FIG. Hereinafter, description will be made along the steps shown in FIGS. 10 and 11 with reference to FIG. 12 as appropriate.
[0041]
First, the outline of the processing procedure when displaying the drawer menu will be described. The defined coordinates of the drawer menu display trigger areas 11A to 11D on the touch panel sensor 11 are registered in the ROM 25 in advance. When it is detected that these areas are touched by the input device 05, the detected coordinate data is collated with the defined coordinates registered in the ROM 25, and a drawer menu corresponding to the drawer menu display trigger area that is the operation target is displayed. Selected and enters display standby mode. When the detected coordinates are continuously updated by dragging the input device 05 toward the center of the image display display 09, the drawer menu is pulled out in the dragged direction accordingly. When the detection information is OFF (the touch of the input device 05 with respect to the touch panel sensor 11 is lost and the coordinates are not detected), the drawer menu continues to be displayed at the dragged position. Here, “OFF” indicates that the touch of the input device 05 with respect to the touch panel sensor 11 is lost, and coordinates are not detected. In the following description, “OFF” is used in the same meaning.
[0042]
First, in step S101, a photographic image or the like is displayed using the full screen of the image display display 09. A screen D1 in FIG. 12 shows the screen of the image display display 09 at this time. Next, in step S102, the position coordinates on the touch panel sensor 11 touched by the input device 05 are detected.
[0043]
In step S103, it is determined whether or not the coordinate value detected in step S102 is included in any of the pull-out menu display trigger areas 11A to 11D. If not, wait until it is included. As shown in screens D3 and D4 in FIG. 12, the detected coordinate values exist in areas other than the pull-out menu display trigger areas 11A to 11D, and are continuously updated without being turned OFF, and then the pull-out menu display trigger area. When moving to any of 11A to 11D, the coordinate information before reaching any of the pull-out menu display trigger areas 11A to 11D becomes invalid. If the detected coordinate value is included in one of the pull-out menu display trigger areas 11A to 11D as shown in the screen D2 of FIG. 12, the process returns to step S101 if it is turned off.
[0044]
In step S104, it is determined whether the detected coordinate value is included in any of the drawer menu display trigger areas 11A to 11D. If the detected coordinate value is included in the drawer menu display trigger areas 11A and 11D, the process proceeds to step S105. , 11C, the process proceeds to step S112.
[0045]
In steps S105 and S112, the selected drawer menu display trigger area is highlighted, and at the same time, an electronic sound such as a beep is generated as a key reception sound to notify the user that the selection has been made. If it is turned off during this period, the process returns to step S101.
[0046]
In this way, the user can display the target menu only by roughly operating the wide drawer menu display trigger areas 11A to 11D with the input device 05.
[0047]
Next, for example, when the input device 05 is slid toward the center of the image display display 09 without touching the touch panel sensor 11 while the input device 05 is in contact with the drawer menu display trigger area 11B, As shown in the screens 12 to D8 of FIG. 12, the B classification menu is pulled out with the movement of the input device 05. This will be described below along steps S113 to S118 of FIGS.
[0048]
First, in step S113, only the Y coordinate value of the coordinate value detected when the input device 05 contacts the menu display trigger areas 11B and 11C is monitored. Here, since the drawer menu display trigger areas 11B and 11C are selected, the X-axis information is ignored and only the Y-axis information is reflected in the process. Even if the user is not conscious of dragging the input device 05 in the vertical direction accurately, the intention can be reflected by roughly dragging the input device 05 downward. In general, the dragging direction slightly deviates from the vertical direction depending on whether the dominant hand is left or right. For example, in the case of a right-handed user, the user drags with a vector slightly leftward from the vertical direction, that is, from the upper right to the lower left. On the other hand, left-handed is dragged with a vector from the upper left to the lower right. However, by adopting a method of reflecting only the change value of the Y-axis information, it is possible to reflect the user's intention without being affected by the above-described wrinkles.
[0049]
In step S114, the display amount of the drawer menu is updated according to the Y coordinate value by the input device 05. Note that the maximum drawer amount that can be pulled out of the drawer menu can be changed depending on the specification, but in this embodiment, it is defined as the center position of the display area.
[0050]
If the menu withdrawal amount y is less than the predetermined defined amount and is turned off as shown in the screen D5 in FIG. 12, the menu withdrawal process is canceled halfway and the process returns to step S101 (S115). . If the menu drawer amount y exceeds the predetermined defined amount and then turns OFF as shown in the screen D6 of FIG. 12, the drawer menu drawer is stopped at that position and can be used as it is (S116). . Further, when the menu pull-out amount y exceeds the maximum pull-out amount, the pull-out of the pull-out menu is stopped, the maximum pull-out amount is maintained (S117), and the detected coordinate value is ignored (S118).
[0051]
Note that, unlike the above-described embodiment, the change speed of the detected coordinate value in the process progress as shown in the screens D2, D5, and D6 in FIG. 12 is detected, and when the change speed is high, the screen D6 in FIG. Even if the process is turned OFF, the process may be shifted to the process of the screen D9 of FIG. 12 without moving to the process of the screen D8 of FIG.
[0052]
When the input device 05 has selected the menu display trigger areas 11A and 11D, similarly, in step S106, the X coordinate value of the coordinate value detected when the input device 05 contacts the menu display trigger areas 11A and 11d. Just monitor. Here, the Y-axis information is ignored, and only the X-axis information is reflected in the processing.
[0053]
In step S107, the display amount of the drawer menu is updated according to the X coordinate value by the input device 05.
[0054]
If the menu withdrawal amount x is turned off while the predetermined amount is not reached, the menu withdrawal process is canceled halfway and the process returns to step S101 (S108). If the menu withdrawal amount x exceeds the predetermined defined amount and then turns OFF, the withdrawal menu withdrawal is stopped at that position and can be used as it is (S109). Further, when the menu pullout amount x exceeds the maximum pullout amount, the pullout of the pullout menu is stopped, the maximum pullout amount is maintained (S110), and the detected coordinate value is ignored (S111).
[0055]
FIGS. 13 and 14 are flowcharts showing a processing procedure for closing the displayed drawer menu, and FIG. 15 is a display screen in the process of closing the drawer menu (particularly, when the B classification menu is selected). FIG. Hereinafter, description will be made along the steps shown in FIGS. 13 and 14 with reference to FIG. 15 as appropriate.
[0056]
First, as shown in the screen D11 of FIG. 15, it is assumed that the drawer menu is displayed with the maximum drawer amount (S201). Next, in step S202, the position coordinates on the touch panel sensor 11 touched by the input device 05 are detected.
[0057]
In step S203, it is determined whether or not the coordinate value detected in step S102 is included in any of the pull-out menu display trigger areas 11A to 11D. If not included, as shown in the screen D13 of FIG. 15, it is determined whether or not a specific function button (GUI function button) in the pull-out menu is selected by the input device 05 (S210). The function is processed (S211). If not selected, the process returns to step s203, and the acceptance standby state is maintained. As shown in the screens D12 and D14 in FIG. 15, when only the detected coordinate value changes and enters the pull-out menu display trigger area, the detected coordinate value so far is ignored and the standby state is entered from there. This is a method for reliably accepting the user's intention even with a rough operation.
[0058]
If it is determined in step S203 that the detected coordinate value is included in any of the pull-out menu display trigger areas 11A to 11D (screen D14 in FIG. 15), the detected coordinate value is extracted in the pull-out menu display trigger area in step S204. 11A to 11D is determined. If it is included in the drawer menu display trigger areas 11A and 11D, the process proceeds to step S205. If it is included in the drawer menu display trigger areas 11B and 11C, the process proceeds to step S212.
[0059]
In steps S205 and S212, the selected drawer menu display trigger area is highlighted, and at the same time, an electronic sound such as a beep is generated as a key reception sound to notify the user that the selection has been made. If it is turned off during this period, the process returns to step S203.
[0060]
Next, when the input device 05 has selected the menu display trigger areas 11B and 11C, the Y coordinate value of the coordinate value detected when the input device 05 contacts the menu display trigger areas 11B and 11C in step S213. Just monitor. X-axis information is ignored and only Y-axis information is reflected in the process. As shown in the screen D15 of FIG. 15, the case where the input device 05 is dragged downward and the menu pull-out amount y is increased is ignored.
[0061]
In step S214, the display amount of the drawer menu is updated according to the Y coordinate value by the input device 05.
[0062]
When the menu withdrawal amount y exceeds the predetermined definition amount, when it is turned off as shown in the screen D16 in FIG. 15, the display state is maintained as shown in the screen D17 in FIG. (S215). Further, when the menu withdrawal amount y becomes smaller than the predetermined definition amount and then turns OFF as shown in the screen D18 in FIG. 15, it is assumed that the user intends to erase the display of the withdrawal menu, and FIG. As shown in the screen D19 of FIG. 15, the drawer menu display is stopped (S216).
[0063]
On the other hand, if it is determined in step S204 that the input device 05 has selected the menu display trigger areas 11A and 11D, the input device 05 is detected by contacting the pull-out menu display trigger areas 11A and 11D in step S206. Only the X coordinate value of the coordinate value to be monitored is monitored. Y-axis information is ignored and only X-axis information is reflected in the process.
[0064]
In step S207, the display amount of the drawer menu is updated according to the X coordinate value by the input device 05.
[0065]
If the menu withdrawal amount x exceeds the predetermined definition amount and is turned OFF, the display state is maintained (S208). If the menu withdrawal amount x becomes smaller than the predetermined defined amount and then turns OFF, it is assumed that the user intends to erase the drawer menu display, and the drawer menu display is stopped (S209).
[0066]
In the above embodiment, the user drags the drawer menu to stop the display of the drawer menu, but instead of this, a close function that can stop the display of the drawer menu just by clicking on it. You may provide the button which had.
[0067]
Further, as in the case of starting the display of the drawer menu, the change speed of the detected coordinate value in the process progress such as the screens D12, D14, and D16 in FIG. 15 is detected, and when the change speed is high, FIG. Even if the screen D16 is turned OFF, the process may be shifted to the process of the screen D19 of FIG. 15 without moving to the process of the screen D17 of FIG.
[0068]
FIG. 16 is a flowchart showing a processing procedure for determining the size of the drawer menu according to the amount of drawer. FIG. 17 is a diagram showing a screen of the A category menu displayed according to the amount of withdrawal, and FIG. 18 is a diagram showing a screen of the B category menu displayed according to the amount of withdrawal. In FIG. 17 and FIG. 18, for the sake of easy understanding, the pull-out menu display trigger areas 11A to 11D are shown on the four sides, but the four areas are not necessarily displayed. Hereinafter, the steps shown in FIG. 16 will be described with reference to FIGS. 17 and 18 as appropriate.
[0069]
In FIG. 16, steps S301, S302, S303, and S307 have the same contents as steps S103, S104, S106, and S112 shown in FIG.
[0070]
If the A classification menu is selected, in step S304, the size of the pull-out menu is scaled and displayed in the horizontal direction at the ratio of the position of the X coordinate (the pull-out amount x) to the maximum pull-out amount. The screen D34 in FIG. 17 shows the A classification menu at the maximum withdrawal amount position. For example, when the withdrawal amount x on the screen D33 in FIG. 17 is 3/4 of the maximum withdrawal amount on the screen D34 in FIG. The A classification menu on the screen D33 in FIG. 17 is the same as the screen D34 in FIG. 17 in the Y direction, but is displayed as an image reduced to 3/4 in the X direction compared to the screen D34 in FIG. Accordingly, the display area of the button is also reduced in the horizontal direction, and the display style of the contents of the A classification menu changes depending on the amount of extraction x, such as only an icon or a combination of an icon and a character.
[0071]
If the pullout amount x is updated, the display ratio is updated (S305), and when the input device 05 is moved away from the touch panel sensor 11 at a position halfway to the maximum pullout amount position, the pullout menu display is held at that position. When the pullout amount x exceeds the maximum pullout amount, the pullout menu display is held at the maximum pullout amount position (S306).
[0072]
Next, when the B classification menu is selected, in step S308, the size of the pull-out menu is displayed by scaling in the vertical direction at the ratio of the position of the Y coordinate (the pull-out amount y) with respect to the maximum pull-out amount. . A screen D38 in FIG. 18 shows a B classification menu at the maximum withdrawal amount position. For example, when the withdrawal amount y in the screen D37 in FIG. 18 is 3/4 of the maximum withdrawal amount in the screen D38 in FIG. The B classification menu on the screen D38 in FIG. 18 is the same as the screen D38 in FIG. 18 in the X direction, but is displayed as an image reduced to 3/4 in the Y direction compared to the screen D38 in FIG. The button display area is also reduced in the vertical direction accordingly.
[0073]
If the pull-out amount y is updated, the display ratio is updated (S309), and when the input device 05 is moved away from the touch panel sensor 11 at a position on the way to the maximum pull-out amount position, the pull-out menu display is held at that position. When the pullout amount y exceeds the maximum pullout amount, the pullout menu display is held at the maximum pullout amount position (S310).
[0074]
In the above description, the A and B classification menus have been described as examples, but the same procedure is applied to the C and D classification menus. Further, when the drawer menu display is closed, the procedure proceeds in the reverse direction of the processing shown in FIG.
[0075]
FIG. 19 is a diagram showing a screen of the image display display 09 for explaining the relationship between the drawer menu display trigger areas 11A to 11D and the A to D classification menus to be pulled out.
[0076]
Depending on which one of the pull-out menu display trigger areas 11A to 11D is selected by the input device 05 on the screen of the image display display 09, the pull-out direction of the pull-out menu, the received coordinate information, and the image to be scaled / reduced in the menu layout The direction of processing is different.
[0077]
A screen D41 shows a pull-out menu display trigger area 11A selected when pulling out the A-class menu and a pull-out direction thereof, and a screen D42 shows a state in which the A-class menu is pulled out to the maximum pull-out amount position.
[0078]
A screen D41 shows a pull-out menu display trigger area 11A selected when pulling out the A-class menu and a pull-out direction thereof, and a screen D42 shows a state in which the A-class menu is pulled out to the maximum pull-out amount position.
[0079]
Screen D43 shows the pull-out menu display trigger area 11B to be selected when pulling out the B classification menu and the pulling direction thereof, and screen D44 shows a state in which the B classification menu has been pulled out to the maximum pull-out amount position.
[0080]
A screen D45 shows a pull-out menu display trigger area 11C to be selected when pulling out the C classification menu and a pulling direction thereof, and a screen D46 shows a state in which the C classification menu is pulled out to the maximum pull-out amount position.
[0081]
A screen D47 shows a pull-out menu display trigger area 11D to be selected when pulling out the D classification menu and its pulling direction, and a screen D48 shows a state in which the D classification menu has been pulled out to the maximum pull-out amount position.
[0082]
The drawer menu shown in FIG. 19 is an example for explanation, and the number and size of icons in the drawer menu differ depending on the number of functions and the size of the image display display 09.
[0083]
(Second Embodiment)
Next, a second embodiment will be described.
[0084]
Since the configuration of the second embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the second embodiment.
[0085]
In the second embodiment, the content of the control process performed by the portable information processing apparatus 01 is different from that of the first embodiment.
[0086]
FIG. 20 is a flowchart illustrating a procedure of a drawer menu display process according to the second embodiment. In this display process, stage display is performed according to the priority of the function. FIG. 21 is a diagram showing ranges a, b, and c on the screen of the image display display 09, FIG. 22 is a diagram showing a screen of an A classification menu displayed according to the amount of withdrawal, and FIG. FIG. 24 is a diagram showing a screen of the B classification menu displayed according to the amount of withdrawal, and FIG. 24 is a diagram showing a screen of the C classification menu displayed according to the amount of withdrawal. Hereinafter, it demonstrates along the step of the flowchart shown in FIG. 20, referring FIGS. 21-24 suitably.
[0087]
First of all, if an overview is given, if there are too many items in the drawer menu that can be listed at a time, the selection may be lost and the usability may deteriorate. Assuming such a case, in the second embodiment, the number of items that can be listed is limited, and function items are displayed in two or three stages in order from the highest priority. That is, in each drawer menu, function items are laid out and displayed in order of frequency of use from the side closer to the drawer menu display trigger area. As a result, it is possible to select function items that are frequently used just by pulling out the first row.
[0088]
For example, in FIG. 22, items A-1, A-2, and A-3 shown on the screens D52 and D53 are function items that are most frequently used, and items A-4, A-5, and A shown on the screen D53. -6 is a function item that is less frequently used than items A-1, A-2, and A-3. In this way, the drawer menu can be arranged and used like a desk drawer.
[0089]
The maximum number of items displayed in the drawer menu varies depending on the size of the screen and the function of the icon. For example, a maximum of 6 items are displayed in the A and C classification menus, and 30 items of 3 × 10 in the B classification menu are displayed. In the B category menu, it can be assumed that a color palette function is laid out. In the B classification menu, three steps of display steps are added according to the vertical number.
[0090]
In the flowchart of FIG. 20, the display of the A classification menu is taken as an example. Steps S401, S402, and S403 have the same contents as steps S103, S104, and S106 shown in FIG.
[0091]
When the input device 05 is moving and the detected X coordinate value is changing, only the position of the pull-out menu display trigger area is updated, and when the detected X coordinate value is turned OFF, it corresponds to the detected X coordinate value immediately before OFF. To determine and display the layout in the drawer menu.
[0092]
First, in step S404, when the detected X-coordinate value is turned off in the range a shown in FIG. 21, the screen D51 in FIG. 22 is displayed.
[0093]
If the detected X coordinate value is turned off in the range b shown in FIG. 21 in step S405, the screen D52 of FIG. 22 is displayed.
[0094]
If the detected X coordinate value is turned off in the range c shown in FIG. 21 in step S406, the screen D53 shown in FIG. 22 is displayed.
[0095]
When the input device 05 moves and crosses the boundaries of the ranges a, b, and c, a buzzer sound is transmitted to notify the user.
[0096]
The number of ranges a, b, and c increases as the number of function item columns laid out in the drawer menu increases, but the basic mechanism is the same. Similarly, when the display of the drawer menu is closed, it can be closed stepwise. Other B, C, and D classification menus are displayed in the same procedure.
[0097]
(Third embodiment)
Next, a third embodiment will be described.
[0098]
Since the configuration of the third embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the third embodiment.
[0099]
In the third embodiment, the content of the control process performed by the portable information processing apparatus 01 is different from that of the first embodiment.
[0100]
FIG. 25 is a flowchart illustrating a procedure of drawer menu display processing according to the third embodiment. In this display process, the maximum withdrawal amount is expanded. FIG. 26 is a diagram showing a screen of the A classification menu displayed on the screen of the image display display 09 according to the amount of drawer. First, the feature of the third embodiment will be described with reference to FIG.
[0101]
In the third embodiment, the drawer menu is displayed to the full extent up to the entire display area of the image display display 09, and more function items are displayed.
[0102]
In the first embodiment described above, the maximum display amount of the pull-out menu is set to the center position of the image display display 09 (half display area). The reason for this is that the image that should be originally displayed on the image display display 09 is displayed. There was consideration to avoid hiding as much as possible. However, depending on the nature of the function item, the display image does not necessarily have to be displayed, but rather it may be desired to improve the list of the function items in the drawer menu.
[0103]
For example, the search function originally does not require a display image. In this case, as shown in the screens D65 and D69 in FIG. 26, the entire display area of the image display display 09 is used to display the menu. On the other hand, the image editing function originally requires a display image. In this case, the original display image and the drawer menu are displayed simultaneously. In this case, the maximum display amount of the drawer menu is ½ of the screen of the image display display 09.
[0104]
In this embodiment, since the upper and lower B and C classification menus contain function items that are frequently selected while viewing the displayed image, the B and C classification menus are displayed on the screen of the image display display 09. The left and right A and D classification menus can be drawn to the entire display area of the image display display 09.
[0105]
Even when the drawer menu can be pulled out to the entire display area of the image display display 09, as shown in the screens D62 to D65 in FIG. 25, all the function items are displayed in the drawer menu regardless of the drawer amount. As shown in screens D66 to D69 of FIG. 25, there may be a method of changing the number of function items displayed in the drawer menu in a stepwise manner in accordance with the amount of drawer. Either method may be selected and implemented depending on the nature of the function item, or the user may freely select one of both methods.
[0106]
In the flowchart of FIG. 25, the display of the A classification menu is taken as an example. Steps S501, S502, and S503 have the same contents as steps S103, S104, and S106 shown in FIG. 10, and a description thereof will be omitted.
[0107]
In step S504, the display position of the pull-out menu display trigger area 11A is updated in accordance with the detected X-coordinate value due to the touch of the input device 05, and the function items associated therewith are displayed. At this time, when the input device 05 is turned off, the display state is maintained.
[0108]
Step S505 shows a pull-out menu display process when the input device 05 is moved in the direction opposite to the moving direction in step S504. Even in this case, the pull-out menu display is performed according to the detected X coordinate value. The display position of the trigger area 11A is updated and the function items associated therewith are displayed. At this time, when the input device 05 is turned off, the display state is maintained.
[0109]
Then, when the input device 05 further moves in the moving direction in step S505 and the detected X coordinate value x becomes smaller than a predetermined defined amount, the display of the pull-out menu is stopped (S506).
[0110]
That is, in the third embodiment, the definition of the maximum pullout amount is not provided, and the entire display area of the image display display 09 can be used for displaying the pullout menu.
[0111]
(Fourth embodiment)
Next, a fourth embodiment will be described.
[0112]
Since the configuration of the fourth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the fourth embodiment.
[0113]
In the fourth embodiment, the content of the control process performed by the portable information processing apparatus 01 is different from that of the first embodiment.
[0114]
FIG. 27 is a flowchart illustrating a procedure of drawer menu display processing according to the fourth embodiment. In this display process, the number of drawer menus is increased from 4 to 8. FIG. 28 is a diagram showing an increase drawer menu displayed on the screen of the image display display 09. First, the features of the fourth embodiment will be described with reference to FIG.
[0115]
In the first embodiment, the pull-out menu display trigger areas 11A to 11D are provided on the four sides of the image display display 09. However, in the fourth embodiment, the number of function item categories is further increased. The four corners of the image display display 09 as shown on the screen D70 in FIG. 28 are used as the trigger areas a, b, c, and d.
[0116]
That is, the four corner positions of the image display display 09 avoiding the pull-out menu display trigger areas 11A to 11D are set as the trigger areas a, b, c, and d. , Advanced settings, user settings, etc.).
[0117]
The pull-out menu display trigger areas 11A to 11D for pulling out function items that are normally used have a large display area so that they can be easily touched by the input device 05, whereas the trigger areas a, b, c, d On the contrary, the display area is reduced so that it is not easily displayed due to an erroneous operation or the like. Since the input device 05 hits a step around the image display display 09, it can be easily selected when the selection operation is performed with the trigger areas a, b, c, and d taken into consideration.
[0118]
With reference to the flowchart of FIG. 27, the process in which the a classification detail menu is displayed by selecting the trigger area a will be particularly described. Steps S601, S602, S603, S604, and S605 have the same contents as steps S101, S102, 103, S104, and S105 shown in FIG. However, in steps S603 to S605, the drawer menu display trigger areas 11A to 11D are read as trigger areas a, b, c, and d, respectively.
[0119]
In step S606, the display position of the diagonal bar 30 is determined and displayed according to the detected coordinate value by the contact of the input device 05. That is, as shown in the screen D72 of FIG. 28, when the detected coordinate values of the X axis and the Y axis are x and y with the position of the trigger area a as the base point, the absolute value of the detected coordinate values x and y Is detected, and the display position of the diagonal bar 30 is determined according to the detected value. Specifically, an oblique bar 30 extending in a direction perpendicular to the diagonal line is displayed along a diagonal line extending in the direction of 45 degrees from the base point at a position away from the base point by a distance corresponding to the detected value. . When the input device 05 is turned off, if the detected value is within the predetermined value, the process returns to the screen D70 in FIG. 28. If the detected value exceeds the predetermined value, the screen D73 in FIG. As shown, the display state is maintained as it is.
[0120]
In steps S607 and S608, if the detected value exceeds the maximum pullout amount, the display state is maintained at the maximum pullout amount position as shown by a screen D74 in FIG. Even when the input device 05 is turned off, the display state is maintained at the maximum drawing amount position as shown in the screen D75 of FIG.
[0121]
The display process during drawing is the same as the display process in the first embodiment.
[0122]
(Fifth embodiment)
Next, a fifth embodiment will be described.
[0123]
Since the configuration of the fifth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the fifth embodiment.
[0124]
In the fifth embodiment, the content of the control process performed by the portable information processing device 01 is similar to that of the fourth embodiment.
[0125]
FIG. 29 is a flowchart illustrating a procedure of drawer menu display processing according to the fifth embodiment. Also in this display process, the number of drawer menus is increased from 4 to 8 as in the fourth embodiment. FIG. 30 is a diagram showing an increase drawer menu displayed on the screen of the image display display 09. The features of the fifth embodiment will be described below along the steps of the flowchart shown in FIG. 29 with reference to FIG.
[0126]
In the flowchart of FIG. 29, steps S701, S702, S703, and S704 have the same contents as steps S601, S602, 603, and S604 shown in FIG. However, in steps S703 to S704, the drawer menu display trigger areas 11A to 11D are read as trigger areas a, b, c, and d, respectively. In the flowchart of FIG. 29, a process for displaying the a classification detail menu by selecting the trigger area a will be particularly described.
[0127]
In step S705, when the trigger area a is detected by touching the input device 05, a start button for starting the setting menu is popped up as shown in a screen D82 of FIG. 30, and this portion is highlighted. At the same time, a buzzer sound is generated. If the input device 05 is turned off here, the process returns to step S701.
[0128]
In the pop-up display state, as shown in the screen D83 of FIG. 30, the input device 05 is slid slightly upward to the right to reach the start button area (S706). The display process is executed, and a detailed setting menu as shown on the screen D84 in FIG. 30 is displayed (S707).
[0129]
In order to close the detailed setting menu, the input device 05 is coordinated with the input device 05 in the vicinity of the “setting” character shown on the screen D84 in FIG. Note that a close button may be laid out somewhere on the screen D84 in FIG.
[0130]
Even in the fifth embodiment, it is possible to divide the basic menu of up to four categories and the other four detailed setting menus into four categories. Since it is premised on that it is difficult to occur, it is desirable in terms of ease of use to keep the number of detail menus to about two.
[0131]
FIG. 31 is a diagram showing another display example of the increase drawer menu displayed on the screen of the image display display 09.
[0132]
Furthermore, considering the ease of use, it is desirable that the position of the two detailed menus can be changed according to the user's dominant hand even when only two detailed menus are used. . That is, the display position can be changed according to the principle that the stroke direction natural for right-handed is lower left → upper right (screen D87 in FIG. 31), and the stroke direction natural for left-handed is upper left → lower right (screen D88 in FIG. 31). For right-handed use, a display position like screen D85 in FIG. 31 is assigned, and for left-handed use, a display position like screen D86 in FIG. 31 is assigned.
[0133]
Compared to the operation method in which a soft button on the screen is simply selected with an input device as in the conventional device, a menu that takes this dominant hand into consideration is used by sliding the screen and processing the command after selection. Display is realized.
[0134]
(Sixth embodiment)
Next, a sixth embodiment will be described.
[0135]
Since the configuration of the sixth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the sixth embodiment.
[0136]
In the sixth embodiment, a plurality of drawer menus can be displayed on the image display display 09 simultaneously. That is, this method can be applied when the screen size of the image display display 09 is large, and two, three, or four drawer menus can be displayed simultaneously.
[0137]
First, when two drawer menus are displayed at the same time, according to the positional relationship between the two menus to be pulled out, a relationship between a right angle direction (adjacent position) and a parallel direction (face-to-face position) is distinguished. In the parallel direction, there are two kinds of positional relationship display patterns. Further, the display method differs depending on the order of drawing, and the display method of the menu displayed earlier is influenced by the menu drawn later.
[0138]
For convenience of explanation, the maximum withdrawal amount will be described as half of the screen. However, the present invention is not limited to this, and as shown in each of the embodiments, the drawer menu can be placed at any position during the withdrawal. The display may be retained, or the maximum drawer amount may be extended to the full screen depending on the specification.
[0139]
FIG. 32 is a flowchart illustrating a procedure of simultaneous display processing of two or more drawer menus in the sixth embodiment.
[0140]
In step S801, one of the A to D classification menus is displayed.
[0141]
Next, when any one of the A to D classification menus excluding the drawer menu displayed in step S801 is selected by the input device 05, as shown in step S802, the positional relationship between the two drawer menus. Depending on, the subsequent processing is divided. That is, if the positional relationship between both drawer menus is a parallel direction (face-to-face position) relationship, the process proceeds to step S803, and if the relationship is a right angle direction (adjacent position), the process proceeds to step S805.
[0142]
When the drawer menu displayed later is continuously pulled out, in step S803, the first displayed drawer menu is scaled and displayed in the same axis direction while keeping the distance between the two drawer menus constant. To do. In step S804, the size of the drawer menu displayed later is fixed when the size of the menu becomes 1/4 of the screen.
[0143]
In step S805, if the drawer menu displayed later is continuously pulled out, the drawer menu displayed first is displayed in a scaled-down manner in the pull-out direction of the drawer menu displayed later. In step S806, the size of the drawer menu displayed later is fixed when the size of the drawer menu becomes 1/2 of the screen.
[0144]
33 and 34 are flowcharts showing a specific procedure of the processing procedure shown in FIG. 35 to 38 are diagrams showing two drawer menus displayed simultaneously on the screen of the image display display 09 in accordance with the amount of withdrawal, and FIGS. 39 to 42 show image display in accordance with the amount of withdrawal. It is a figure which shows three drawer menus simultaneously displayed on the screen of the display 09, and FIGS. 43-46 is a figure which shows four drawer menus displayed on the screen of the image display display 09 according to the amount of drawers. It is. It should be noted that the numbers described on each drawer menu in FIGS. 35 to 46 are numbers indicating the order of the drawers, and are not displayed as images. Hereinafter, the steps shown in FIGS. 33 and 34 will be described with reference to FIGS. 35 to 46 as appropriate.
[0145]
First, in step S901, it is assumed that the A classification menu is first drawn and displayed.
[0146]
Next, when any one of the BD classification menus is selected by the input device 05 (S902), as shown in step S903, the subsequent processing is divided depending on the positional relationship between the two drawer menus.
[0147]
If the D classification menu (tool) is selected, the relationship is in the parallel direction (face-to-face position). Therefore, the process proceeds to step S904, and when the D classification menu (tool) is continuously drawn, the D classification menu (tool) is selected. ), The A classification menu (tool) is scaled and displayed in the direction of the X axis. This is shown in screens D109 to D111 in FIG.
[0148]
In step S905, if one of the B and C classification menus is selected by the input device 05 as the three drawer menus, if the B classification menu (tool) is selected, the process proceeds to step S907. Then, the B classification menu (tool) is displayed according to the drawing amount in the Y-axis direction. At the same time, the already displayed A classification menu (tool) and D classification menu (tool) are displayed in the Y-axis direction. Depending on the drawing amount of the (tool) in the Y-axis direction, zooming and reduction display is performed. This is shown in screens D125 to D127 in FIG.
[0149]
If the C classification menu is selected by the input device 05 in step S905, the process advances to step S908 to display the C classification menu (tool) according to the drawing amount in the Y-axis direction and at the same time. The A classification menu (tool) and the D classification menu (tool) are displayed in the Y-axis direction and scaled according to the amount of withdrawal in the Y-axis direction of the C classification menu (tool).
[0150]
Next, in step S909, when the fourth classification menu is selected by the input device 05, if it is the C classification menu (tool), the process proceeds to step S910, and according to the amount of drawing in the Y-axis direction. The C classification menu (tool) is displayed. This is shown in screens D138 to D140 in FIG.
[0151]
In step S909, if the fourth classification menu is selected by the input device 05 and it is the B classification menu (tool), the process proceeds to step S911, and the Y-axis direction pull-out amount is selected. The B classification menu (tool) is displayed.
[0152]
Returning to step S902, if any one of the B to D classification menus is selected by the input device 05 as the second drawer menu, if the B and C classification menu (tool) is selected, Since there is a relationship in the direction perpendicular to the A classification menu (tool) (adjacent position), the process proceeds to steps S912 and S913.
[0153]
If the B category menu (tool) is selected, in step S912, the B category menu (tool) is displayed according to the amount of withdrawal in the Y-axis direction, and at the same time, the already displayed A category menu (tool) is displayed as Y. In the axial direction, zooming / reduction display is performed according to the amount of withdrawal in the Y-axis direction of the B classification menu (tool). This is shown in screens D101 to D103 in FIG.
[0154]
If the C classification menu (tool) is selected, in step S913, the C classification menu (tool) is displayed at the same time as the C classification menu (tool) is displayed according to the drawing amount in the Y-axis direction. Are scaled and reduced in the Y-axis direction according to the amount of withdrawal in the Y-axis direction of the C classification menu (tool).
[0155]
Next, when three drawer menus are selected by the input device 05 in step S914, the subsequent processing is divided depending on the positional relationship with the second drawer menu as shown in step S915.
[0156]
When the second drawer menu is a B category menu (tool) and the third drawer menu is a C category menu (tool), or the second drawer menu is a C category menu (tool). When the third drawer menu is the B category menu (tool), the relationship is parallel (face-to-face position), so the process proceeds to step S916, and the C or B category menu (tool) is continuously pulled out. In this case, the C or B classification menu (tool) is displayed according to the drawing amount in the Y axis direction, and at the same time, the already displayed B or C classification menu (tool) is displayed in the Y axis direction with the C or B classification menu (tool). The tool is scaled according to the amount of drawing in the Y-axis direction. The A classification menu (tool) only moves its position and does not perform scaling. This is shown in screens D117 to D119 in FIG.
[0157]
On the other hand, if the third drawer menu is the D category menu (tool), the relationship is in the direction perpendicular to the second drawer menu (adjacent position), so the process proceeds to step S917, and the D category menu (tool) is selected. ) Is continuously drawn, the D category menu (tool) is displayed according to the amount of withdrawal in the X axis direction, and at the same time the B or C category menu (tool) already displayed is changed to the Y axis direction. Double reduction display. Then, the A category menu (tool) is displayed in a scaled manner while maintaining a constant distance from the D category menu (tool) according to the amount of withdrawal of the D category menu (tool). Only the position is moved according to the drawing amount in the X-axis direction, and scaling is not performed. This is shown in screens D121 to D123 in FIG.
[0158]
Next, in step S918, if the fourth classification menu is selected by the input device 05 and it is the D classification menu (tool), the process proceeds to step S919, and according to the amount of extraction in the X-axis direction. The D classification menu (tool) is displayed.
[0159]
If the fourth classification menu is selected by the input device 05 in step S918 and it is the B classification menu (tool), the process proceeds to step S920, and the Y-axis direction pull-out amount is selected. The B classification menu (tool) is displayed.
[0160]
FIG. 35 and FIG. 36 show a case where the relationship between the two drawer menus is in the perpendicular direction (adjacent position). The two drawer menus shown in the screens D100 to D103 in FIG. 35 and the two drawer menus shown in the screens D104 to D107 in FIG. 36 have the same positional relationship between the two drawer menus. The way it is displayed is different. The display of the menu drawn later has priority, and the menu drawn later displays the menu as usual, and accordingly, the display of the menu drawn first is affected. That is, as shown in the screen D101 in FIG. 35, when the B category menu having a right-angled positional relationship is drawn as shown in the screen D102 in a state where the A category menu has already been drawn, Y of the A category menu is displayed. The axial direction is scaled according to the amount by which the B category menu is drawn, and as shown in the screen D103, the B category menu is fixed at the position of the maximum draw amount (half of the screen).
[0161]
The display content in the A classification menu is simply reduced in shape, but the display content itself may be changed. For example, on the screen D101, icons and characters are displayed together in the A category menu, and on the screen D103, only the icons are displayed in the A category menu, and the type of information is changed according to the display area. You may do it.
[0162]
Further, in FIG. 36, when the A category menu having a right-angled positional relationship is pulled out in the state where the B category menu has already been drawn as shown in the screen D104, the B category menu is displayed as shown in the screen D106. The A category menu is displayed in a reduced size in accordance with the amount of drawer in the X-axis direction, and as shown on the screen D107, the drawer of the A category menu is fixed at the position of the maximum drawer amount (half the screen).
[0163]
FIG. 37 and FIG. 38 show a case where the relationship between the two drawer menus is in the parallel direction (facing position).
[0164]
As shown in the screen D108 of FIG. 37, if the D class menu in the parallel position relationship is to be pulled out while the A classification menu is displayed, the D classification menu is pulled out as shown in the screens D110 and D111. Depending on the amount, the A category menu is scaled while keeping the distance between the two drawer menus constant. As a result, a fixed amount of display area of the image to be originally displayed is always secured, and the drawer menu and the originally displayed image are always displayed at the same time.
[0165]
FIG. 38 shows a case where two drawer menus are in the vertical position, and processing is performed in the same manner as in FIG.
[0166]
FIGS. 39 and 40 show a case where three drawer menus are displayed simultaneously when the second drawer menu is in a right angle (adjacent position) relationship to the first drawer menu. FIG. 39 shows a case where the third drawer menu is in a parallel direction (face-to-face position) with respect to the second drawer menu, and FIG. 40 shows that the third drawer menu is the second drawer menu. A case in which the menu is in a perpendicular direction (adjacent position) is shown.
[0167]
In FIG. 39, as shown on screens D117 to D119, the A classification menu is reduced and displayed in the Y-axis direction, so that the C classification menu is pulled out while the state is maintained, and at the same time the B classification menu is displayed. Zoom out. The distance between the B category menu and the C category menu always maintains a constant value.
[0168]
In FIG. 40, as shown on screens D121 to D123, the D classification menu is pulled out, and at the same time, the A classification menu and the B classification menu are reduced and displayed in the X-axis direction. The distance in the X-axis direction between the D category menu and the A category menu always maintains a constant value.
[0169]
41 and 42 show a case where three drawer menus are displayed simultaneously when the second drawer menu is in a parallel direction (face-to-face position) with respect to the first drawer menu. FIG. 41 shows a case where the third drawer menu is a B category menu, and FIG. 40 shows a case where the third drawer menu is an A category menu.
[0170]
In FIG. 41, as shown in screens D125 to D127, as the B category menu is drawn, both the already displayed A category menu and D category menu are simultaneously reduced and displayed in the Y-axis direction.
[0171]
In FIG. 42, as shown in the screens D129 to D131, with the withdrawal of the A category menu, both the B category menu and the C category menu that are already displayed are simultaneously reduced and displayed in the X-axis direction.
[0172]
43 to 46 show a case where four drawer menus are displayed simultaneously.
[0173]
FIG. 43 shows a case where the remaining D classification menus are pulled out as a continuation of the state shown on the screen D119 in FIG.
[0174]
FIG. 44 shows a case where the remaining C classification menu is pulled out as a continuation of the state shown on the screen D123 in FIG.
[0175]
FIG. 45 shows a case where the remaining C classification menu is pulled out as a continuation of the state shown on the screen D127 in FIG.
[0176]
FIG. 46 shows a case where the remaining D classification menu is pulled out as a continuation of the state shown on the screen D131 in FIG.
[0177]
Note that when any drawer menu is to be closed in any drawer menu display, the coordinates in the corresponding drawer menu are selected by the input device 05 regardless of the drawer order, and the menus before the drawer of each menu are directly selected. Drag to the position direction.
[0178]
(Seventh embodiment)
Next, a seventh embodiment will be described.
[0179]
Since the configuration of the seventh embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the seventh embodiment.
[0180]
In the seventh embodiment, the shape of the main image to be originally displayed is distorted in accordance with the pull-out amount of the pull-out menu.
[0181]
FIG. 47 is a flowchart showing a processing procedure related to display of the drawer menu and deformation of the shape of the main image accompanying the display of the drawer menu in the seventh embodiment. FIG. 48 is a diagram showing a screen displayed on the image display display 09 in the process of displaying the drawer menu. In FIG. 48, the case where the B classification menu is mainly displayed is taken as an example. Hereinafter, description will be made along the steps shown in FIG. 47 with reference to FIG. 48 as appropriate.
[0182]
The main image A shown in FIG. 48 is, for example, a photographic image, a sentence, or a mixture of a photograph and a sentence. A playback image that has already been stored in the built-in memory or a viewfinder image that is captured by the CCD of the camera unit in a shooting standby state can be assumed.
[0183]
In the flowchart of FIG. 47, steps S1001, S1002, S1003, S1004, S1005, S1006, S1009, and S1010 have the same contents as steps S101, S102, S103, S104, S105, S106, S112, and S113 shown in FIG. Therefore, the description thereof is omitted.
[0184]
When the pull-out menu display trigger area 11B is selected and the detected value (drawing amount) y of the Y-axis coordinates is subsequently changed, in step S1011, the B classification menu is displayed according to the pulling amount y, and Y The main image A is scaled and displayed in the Y-axis direction at a ratio of the value (Yy) to the total screen size Y in the axial direction (screens D154 and D155 in FIG. 48). When the input device 05 is turned off during this time, if the withdrawal amount y is smaller than the predetermined definition amount, the screen returns to the state of the screen D150 from the state of the screen D154 in FIG. If larger, the state of the screen D155 in FIG. 48 is maintained (screen D157 in FIG. 48).
[0185]
If the extraction amount y further increases, in step S1012, the B classification menu is fixed at the maximum extraction amount (half the screen size in the Y-axis direction), and the main image A is also halved in the Y-axis direction. The image is held at the scaled size (screen D156 in FIG. 48). In this case, when the input device 05 is turned off, the state of the screen D156 in FIG. 48 is maintained (screen D158 in FIG. 48).
[0186]
The above description is based on the case where the B classification menu is displayed, but the same applies to the case where the C classification menu is displayed.
[0187]
Next, when the pull-out menu display trigger areas 11A and D are selected and the detected value (drawing amount) x of the X-axis coordinate is continuously changed thereafter, the A and D classifications are performed according to the pulling amount x in step S1007. While displaying the menu, the main image A is scaled and displayed in the X-axis direction at the ratio of the value (X−x) to the full screen size X in the X-axis direction. If the input device 05 is turned off during this time, if the extraction amount x is smaller than the predetermined definition amount, the screen returns to the screen displaying only the main image A, and the extraction amount y is smaller than the predetermined definition amount. If it is larger, the screen state at that time is maintained.
[0188]
If the extraction amount x further increases, in step S1008, the A, D classification menu is fixed at the maximum extraction amount (half the screen size in the X-axis direction), and the main image A is also 1 / X in the X-axis direction. It is held at a size reduced to 2 in size. In this case, when the input device 05 is turned off, the screen state at that time is maintained.
[0189]
FIG. 49 is a flowchart showing a processing procedure for closing the displayed drawer menu, and FIG. 50 is a display screen in the process of closing the drawer menu (particularly, a screen when the B classification menu is selected). FIG. Hereinafter, description will be made along the steps shown in FIG. 49 with reference to FIG. 50 as appropriate.
[0190]
First, in step S1101, it is assumed that a pull-out menu is displayed and the main image A is deformed according to the pull-out amount of the displayed pull-out menu as shown in a screen D160 in FIG. When the input device 05 touches the touch panel sensor 11 of the image display display 09 in this state, the coordinate value is detected (S1102). It is determined whether or not the detected coordinate value is a value in the pull-out menu display trigger area (S1103). If the value is in the pull-out menu display trigger area, the process proceeds to step S1104. The process proceeds to step S1109. Note that when the determination in step S1103 is affirmative (YES), the input input device 05 is imaged from the state of the screen D163 directly from the state of the screen D160 of FIG. 50 and the state of the screen D161 of FIG. There is a case where the screen D163 is brought into a state of being slid as it is without being separated from the touch panel sensor 11 of the display display 09.
[0191]
In step S1109, as shown in screen D162 of FIG. 50, when any of the function buttons in the drawer menu is selected by the input device 05 (S1109), the function corresponding to the button is executed (S1110). The processing result is reflected in the main image A. In this state, if the input device 0504 is slid in the direction of the arrow as shown on the screen D164 in FIG. 50, it is ignored.
If the input device 05 is turned off in this state, the process returns to step S1103.
[0192]
In step S1104, it is determined in which of the pull-out menu display trigger areas 11A to 11D the detected coordinate value is included. If it is included in the drawer menu display trigger areas 11A and 11D, the process proceeds to step S1105. If it is included in the drawer menu display trigger areas 11B and 11C, the process proceeds to step S1111.
[0193]
In step S1111, the selected drawer menu display trigger area is highlighted, and at the same time, a buzzer is sounded to indicate that it has been selected. If the input device 05 is turned off in this state, the process returns to step S1103. In step S1112, only the Y coordinate value is monitored among the detected coordinate values, and the X coordinate value is ignored. Again, when the input device 05 is turned off, the process returns to step S1103.
[0194]
In step S1113, a pull-out menu is displayed according to the pull-out amount y, and the main image A is scaled in the Y-axis direction at a ratio of the value (Y−y) to the full screen size Y in the Y-axis direction. Are displayed (screens D165 and D167 in FIG. 50). If the input device 05 is turned off during this period, the state of the screen D165 in FIG. 50 is maintained (the screen D166 in FIG. 50) if the pullout amount y is larger than the predetermined definition amount, and the pullout amount y is predetermined. If it is smaller than the definition amount, the state of the screen D167 in FIG. 50 is shifted to the state of the screen D168 that displays the main image A in full screen.
[0195]
Further, when the drawing amount y decreases and the state of the screen D169 in FIG. 50 is reached, the state shifts to the state of the screen D170 that displays the main image A in full screen (S1114). Of course, even if the input device 05 is turned off, the screen D170 is entered.
[0196]
On the other hand, if it is determined in step S1104 that the detected coordinate value is included in the pull-out menu display trigger areas 11A and 11D, the selected pull-out menu display trigger area is highlighted in step S1105 and a buzzer is sounded at the same time. To indicate that it has been selected. If the input device 05 is turned off in this state, the process returns to step S1103. In step S1106, only the X coordinate value of the detected coordinate values is monitored, and the Y coordinate value is ignored. Again, when the input device 05 is turned off, the process returns to step S1103.
[0197]
In step S1107, a pull-out menu is displayed according to the pull-out amount x, and the main image A is scaled in the X-axis direction at a ratio of the value (X−x) to the full screen size X in the X-axis direction. To display. If the input device 05 is turned off during this period, the display state is maintained if the extraction amount x is larger than the predetermined definition amount, and the main image is displayed if the extraction amount x is smaller than the predetermined definition amount. Move to the state of the screen that displays A in full screen.
[0198]
Further, when the drawing amount x decreases to 0, the screen shifts to a screen state where the main image A is displayed on the full screen (S1108). Of course, even if the input device 05 is turned off, the main image A is shifted to a full screen display state.
[0199]
Note that the deformation / reduction display method of the image A differs depending on which of the four pull-out menus is to be pulled out. This will be described with reference to FIG.
[0200]
FIG. 51 is a diagram showing a screen of the image display display 09 for explaining the relationship between the storage position of the drawer menu and the main image A.
[0201]
For example, in the screen D184 of FIG. 51 in which the pull-out menu display trigger area 11B is selected by the input device 05 and the B classification menu is extracted, a list of character colors to be written in the main image A by the input device 05 is displayed in the B classification menu. It is laid out like a palette. In the state of the screen D184, the color can be selected and the character can be written to the main image A while the drawer menu is pulled out, and the writing can be continued while changing the color in the middle. In this case, when the drawer menu is closed, the characters may be displayed on the main image A in the ratio at which they were written. In addition, when the main image A returns to the original ratio, the characters are displayed. May be scaled in the vertical direction at the same ratio.
[0202]
Further, when it is desired to display the main image A in the original aspect ratio on the screens D182, D184, D186, and D188, the original image A may be restored by dragging the corners of the scaled main image A. . As a result, for example, when this operation is performed in the state of the screen D184, a screen D193 shown in FIG.
[0203]
Note that the seventh embodiment may be applied to the sixth embodiment.
[0204]
(Eighth embodiment)
Next, an eighth embodiment will be described.
[0205]
Since the configuration of the eighth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the eighth embodiment.
[0206]
In the eighth embodiment, even when the pull-out menu is pulled out, the aspect ratio of the main image to be originally displayed is kept constant.
[0207]
FIG. 52 is a flowchart showing a procedure of main image display processing accompanying display of a pull-out menu in the eighth embodiment. FIG. 53 is a diagram showing a screen displayed on the image display display 09 in the process of displaying the drawer menu. FIG. 53 shows an example in which the B classification menu is displayed. Hereinafter, the steps shown in FIG. 52 will be described with reference to FIG. 53 as appropriate.
[0208]
The main image A shown in FIG. 48 is, for example, a photographic image, a sentence, or a mixture of a photograph and a sentence. A playback image that has already been stored in the built-in memory or a viewfinder image that is captured by the CCD of the camera unit in a shooting standby state can be assumed.
[0209]
In the flowchart of FIG. 52, steps S1201, S1202, S1203, S1204, S1205, S1206, S1209, and S1210 have the same contents as steps S101, S102, S103, S104, S105, S106, S112, and S113 shown in FIG. Therefore, the description thereof is omitted.
[0210]
When the pull-out menu display trigger area 11B is selected and the detected value (drawing amount) y of the Y-axis coordinates is subsequently changed, in step S1211, the B classification menu is displayed according to the pulling amount y, and the main menu is displayed. The image A is scaled and displayed while maintaining the aspect ratio (screens D191 and D192 in FIG. 53). If the input device 05 is turned off during this period, the screen state at that time is maintained.
[0211]
If the drawing amount y further increases, in step S1212, the B category menu is fixed at the maximum drawing amount (half the screen size in the Y axis direction), and the main image A is also in both the X axis direction and the Y axis direction. It is held in a size that has been scaled down to 1/2 (screen D193 in FIG. 53). In this case, when the input device 05 is turned off, the state of the screen D193 in FIG. 53 is maintained.
[0212]
The above description is based on the case where the B classification menu is displayed, but the same applies to the case where the C classification menu is displayed.
[0213]
Next, when the pull-out menu display trigger areas 11A and D are selected and the detected value (drawing amount) x of the X-axis coordinates is subsequently changed, in step S1207, A and D classifications are performed according to the pulling amount x. While displaying the menu, the image is scaled and displayed while maintaining the aspect ratio of the main image A. If the input device 05 is turned off during this period, the screen state at that time is maintained.
[0214]
If the extraction amount x further increases, in step S1208, the A, D classification menu is fixed at the maximum extraction amount (half the screen size in the X-axis direction), and the main image A is also in the X-axis direction and the Y-axis. Both directions are held at a size reduced to 1/2. In this case, when the input device 05 is turned off, the main image A is also held in a size that has been reduced to 1/2 in both the X-axis direction and the Y-axis direction.
[0215]
Note that the eighth embodiment may be combined with the other embodiments so that the user can arbitrarily select one of the methods by operating means for performing operation setting or pressing any button.
[0216]
Further, the main image A as shown in FIG. 54 may be displayed.
[0217]
FIG. 54 is a diagram showing a screen displayed on the image display display 09 for explaining a display method different from the display method of the main image A shown in FIG.
[0218]
That is, on the screens D195 to D197 of the image display display 09, the shape and the vertical / horizontal display ratio of the main image A are not changed at all, and are displayed in a form that covers the drawer menu. This display method of the main image A has a drawback that a part of the main image A is lost. However, this display method is effective when a CPU capable of performing arithmetic processing at a very high speed is not mounted. .
[0219]
In this display method, while the input device 05 is in contact with the touch panel sensor 11, the pull-out menu overlaps the main image A. On the other hand, when the input device 05 is turned off, the main image A is pulled out and the menu is pulled out. Zoom out in the direction. For example, when the screen D195 is turned off, the screen switches to the screen D198 after a predetermined processing time has elapsed. When the screen D196 is turned off, the screen switches to the screen D199 after a predetermined processing time. Furthermore, when the screen D197 is turned off, the screen switches to the screen D200 after a predetermined processing time has elapsed.
[0220]
(Ninth embodiment)
Next, a ninth embodiment will be described.
[0221]
Since the configuration of the ninth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment is used in the description of the ninth embodiment.
[0222]
In the ninth embodiment, a display method called “partial cutout help in the drawer menu” is adopted as the display method of the drawer menu.
[0223]
FIG. 55 and FIG. 56 are flowcharts showing the procedure of the drawer menu display process in the ninth embodiment. FIG. 57 is a diagram showing a drawer menu in the ninth embodiment displayed on the image display 09, and particularly shows an A classification menu. FIG. 58 is a diagram illustrating a BD classification menu displayed on the image display display 09 according to the ninth embodiment. Hereinafter, the steps shown in FIGS. 55 and 56 will be described with reference to FIGS. 57 and 58 as appropriate.
[0224]
In each of the above embodiments, the function items described in each drawer cannot be grasped until the drawer menu is displayed, so what function items are described by the user. , You need to remember in advance. In order to avoid such annoyance, in the ninth embodiment, an auxiliary function for using the drawer menu without hesitation is added to the drawer menu display process of the first embodiment.
[0225]
That is, in a personal computer or the like, generally, simply by placing a pointing device such as a mouse on an icon corresponding to a function, a balloon that briefly explains the function corresponding to the icon is displayed. However, in this embodiment, instead of a balloon explaining such a function, a part of the drawer menu is cut out in the same expression as when the drawer menu is displayed, and displayed as “partial cutout help in the drawer menu”. Make it easy to check the contents of the drawer menu.
[0226]
The process shown in FIG. 55 is a process added to the drawer menu display process of the first embodiment as described above. In FIG. 55, step S1301 performs the same process as step S103 of FIG.
[0227]
Next, in step S1302, it is determined whether or not the execution of the function of “help partially cut out in the drawer menu” is set in advance. If not set, the process proceeds to step S104 and subsequent steps in FIG.
[0228]
On the other hand, if the execution of the function “help partially cut out in the drawer menu” is set in advance, the process advances to step S1303 to determine whether the detected coordinate value is included in any of the drawer menu display trigger areas 11A to 11D. If it is included in the drawer menu display trigger areas 11A and 11D, the process proceeds to step S1305, and if it is included in the drawer menu display trigger areas 11B and 11C, the process proceeds to step S1311.
[0229]
In step S1305, the Y coordinate value of the position where the input device 05 is in contact in the pull-out menu display trigger areas 11A and 11D is detected, and the function item having the Y coordinate value closest to the Y coordinate value is displayed. This is shown in a screen D202 in FIG. 57, taking as an example the case where the drawer menu display trigger area 11A is touched by the input device 05. From this state, when the input device 05 is slid vertically along the exterior frame on the pull-out menu display trigger area 11A, screens D203 to D205 in FIG. 57 are obtained. In this way, the contents can be confirmed without displaying all the drawer menus, and when a desired function item is not found, the other drawer menus can be searched in the same manner. Hereinafter, an image forming a part of the drawer menu displayed on the screens D202 to D205 in FIG. 57 is referred to as “cutout help”.
[0230]
When a desired function item is found in this way and the input device 05 is turned off, it is determined in step S1306 whether or not a predetermined time (2 to 3 seconds) has elapsed after turning off. If the predetermined time has not elapsed, the process advances to step S1307, and the input device 05 selects the function item (icon) in the cut-out help before the predetermined time elapses. Thereby, in step S1308, the display of the clipping help is stopped and the function corresponding to the selected function item (icon) is executed.
[0231]
If it is determined in step S1306 that the predetermined time has elapsed, the process proceeds to step S1309, and the display of the clipping help is stopped.
[0232]
On the other hand, in step S1311, the X coordinate value of the position where the input device 05 is in contact in the pull-out menu display trigger areas 11B and 11C is detected, and the function item having the X coordinate value closest to the X coordinate value is displayed. .
[0233]
When a desired function item is found in this way and the input device 05 is turned off, in step S1312, it is determined whether or not a predetermined time (2 to 3 seconds) has elapsed after turning off. If the predetermined time has not elapsed, the process proceeds to step S1313, and the input device 05 selects the function item (icon) in the cut-out help before the predetermined time elapses. Thereby, in step S1314, the display of the clipping help is stopped, and the function corresponding to the selected function item (icon) is executed.
[0234]
If it is determined in step S1312 that the predetermined time has elapsed, the process proceeds to step S1315, and the display of the clipping help is stopped.
[0235]
FIG. 58 displays a cut-out help when the drawer menu display trigger areas 11B, 11C, and 11D are touched by the input device 05. In addition, illustrations of contents and the like of the cutout help are omitted. An arrow indicates the sliding direction of the input device 05.
[0236]
Furthermore, another embodiment based on the ninth embodiment will be described with reference to FIG. That is, a display example of another drawer help when the drawer help shown in the ninth embodiment cannot be displayed as described above due to some restrictions.
[0237]
FIG. 59 is a diagram showing each drawer menu according to another embodiment based on the ninth embodiment. All the screens D211 to D215 on the image display display 09 shown here are display examples when the drawer menu display trigger area 11A is coordinated.
[0238]
In the screen D211, a slightly larger drawer help display area is secured. This makes it easier to see the contents of the drawer help.
[0239]
On the screen D212, similarly to the third embodiment described with reference to FIG. 26, the ninth embodiment also shows the extraction help that is assumed when the maximum withdrawal amount is extended.
[0240]
On the screen D213, all the function items in the drawer menu are displayed in the drawer help without sliding the input device 05 in the drawer menu display trigger area.
[0241]
On the screen D214, only the character notation of the name of the function item is performed in the drawer help. As a result, the reduction of the display area of the main image A is minimized.
[0242]
On the screen D215, assuming that the input device 05 cannot be slid in the drawer menu display trigger area, the scroll buttons are laid out in software in the drawer help.
[0243]
(Other embodiments)
You may make it combine each embodiment demonstrated above suitably.
[0244]
In each of the above embodiments, the portable information processing device 01 has been described as a portable information terminal having a notebook size. However, the application of the present invention is not limited thereto, and the operation method is not limited thereto. However, the present invention is also applicable to a large-screen image display display having another pointing device as an operation means, an eyepiece-type viewfinder, and the like.
[0245]
The present invention is also applicable to devices with an image display screen, such as a still camera, a video camera, a notebook computer, a head mounted display, and a car navigation system.
[0246]
The present invention can also be applied to stationary personal computers and workstations. For example, in the case of a personal computer, the mouse is slid in any direction up, down, left, and right, and when the cursor arrives at the edge of the screen, a bar for pulling out a pull-out menu is displayed at the display position. And this invention is applicable by taking in the operation method of dragging a mouse to the center direction from the state. In this case, there is an advantage that the list of function items can be quickly displayed and the user can arbitrarily adjust the amount of the display area.
[0247]
In addition, in a device equipped with a so-called cross key in which the mechanical switch is laid out in the shape of a cross on the top, bottom, left, and right, one of the drawer menus is selected by pressing one of the top, bottom, left, or right. When the release button is released, the operation method of performing a fixed display in a state where the drawer menu is pulled out is also used. You may make it use properly according to it.
[0248]
In each of the above-described embodiments, the drawer menu can be stopped steplessly at any drawer position in the middle of the drawer menu. Instead, the drawer positions that can be stopped in advance are limited to a plurality of positions. You may do it. Thereby, the display processing speed of the drawer menu can be further increased.
[0249]
Furthermore, a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus is stored in the storage medium. It goes without saying that the present invention can also be achieved by reading and executing the program code.
[0250]
In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
[0251]
As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like can be used.
[0252]
Further, by executing the program code read out by the computer, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instruction of the program code is actually Needless to say, the present invention also includes a case in which the functions of the above-described embodiments are realized by performing part or all of the processing and the processing.
[0253]
Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. Needless to say, the present invention includes a case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0254]
【The invention's effect】
As described above in detail, according to the present invention, the first predetermined area is designated by the coordinate designating means, and the coordinate designation is continued by the coordinate designating means, and the designated coordinates are displayed in the image display. When the part changes in a substantially central direction, the first function list corresponding to the first predetermined area is displayed on the image display part according to the change amount of the designated coordinates. Next, when the first function list is displayed on the image display unit, a second predetermined area different from the first predetermined area is specified by the coordinate specifying means, and subsequently, When the coordinate designation is continued by the coordinate designating means and the designated coordinate is changed in a substantially central direction of the image display unit, a second function list corresponding to the second predetermined area is displayed as the designation. Displayed on the image display unit according to the amount of change in coordinates and prioritizing the display of the first function list. In particular, the first function list is reduced and displayed according to the change amount of the designated coordinate in the second function list.
[0255]
As a result, even if multiple function lists are displayed simultaneously on a small image display unit, the last function list displayed is the same size as when a single function list is displayed. Therefore, it is easy to see and the function items are displayed in the same size as the function items when a single function list is displayed, so that selection mistakes can be prevented and operability is improved.
[0256]
In addition, all function lists do not overlap, all are displayed in a list, and multiple function lists can be referenced at the same time, making it easy to execute function items classified according to different classification criteria. Become.
[0257]
In addition, among the multiple function lists displayed at the same time, the last function list can be displayed so that it can be used with priority, while the order in which these function lists are stopped is displayed. Can stop the display of any function list regardless of the display order.
[Brief description of the drawings]
FIG. 1 is a front view showing a configuration of a first embodiment of a portable information processing apparatus according to the present invention.
FIG. 2 is a top view of the portable information processing apparatus shown in FIG.
3 is a rear view of the portable information processing apparatus shown in FIG. 1. FIG.
4 is a cross-sectional view taken along line AA ′ in the portable information processing apparatus shown in FIG. 3. FIG.
FIG. 5 is a diagram illustrating a configuration of a touch panel sensor.
FIG. 6 is a diagram showing a drawer menu displayed on the image display.
FIG. 7 is a diagram showing a screen of an image display on which a B classification menu is displayed as a drawer menu.
FIG. 8 is a block diagram showing a system configuration of a portable information processing apparatus.
FIG. 9 is a flowchart showing an outline of an overall operation procedure in the portable information processing apparatus.
FIG. 10 is a flowchart (1/2) showing a processing procedure for displaying a drawer menu.
FIG. 11 is a flowchart (2/2) showing a processing procedure for displaying a drawer menu.
FIG. 12 is a diagram showing a display screen in the process of displaying a drawer menu (particularly, a screen when a B classification menu is selected and displayed).
FIG. 13 is a flowchart (1/2) showing a processing procedure for closing a displayed drawer menu.
FIG. 14 is a flowchart (2/2) showing a processing procedure for closing a displayed drawer menu.
FIG. 15 is a diagram showing a display screen (particularly, a screen when a B classification menu is selected) in the process of closing a drawer menu.
FIG. 16 is a flowchart showing a procedure of processing for determining the size of the drawer menu according to the amount of drawer;
FIG. 17 is a diagram showing a screen of an A classification menu displayed according to the withdrawal amount.
FIG. 18 is a diagram showing a screen of a B classification menu displayed according to the amount of withdrawal.
FIG. 19 is a diagram showing a screen of an image display for explaining the relationship between the drawer menu display trigger area and the A to D classification menus to be pulled out.
FIG. 20 is a flowchart illustrating a procedure of drawer menu display processing according to the second embodiment.
FIG. 21 is a diagram showing ranges a, b, and c on the screen of the image display.
FIG. 22 is a diagram showing a screen of an A classification menu displayed according to the amount of withdrawal.
FIG. 23 is a diagram showing a screen of a B classification menu displayed according to the amount of withdrawal.
FIG. 24 is a diagram showing a screen of a C classification menu displayed according to the amount of withdrawal.
FIG. 25 is a flowchart illustrating a procedure of drawer menu display processing according to the third embodiment.
FIG. 26 is a diagram showing an A classification menu screen displayed on the screen of the image display according to the amount of withdrawal;
FIG. 27 is a flowchart illustrating a procedure of drawer menu display processing according to the fourth embodiment.
FIG. 28 is a diagram showing an increase drawer menu displayed on the screen of the image display.
FIG. 29 is a flowchart illustrating a procedure of drawer menu display processing according to the fifth embodiment.
FIG. 30 is a diagram showing an increase drawer menu displayed on the screen of the image display.
FIG. 31 is a diagram showing another display example of the increase drawer menu displayed on the screen of the image display.
FIG. 32 is a flowchart showing a procedure for simultaneously displaying two or more drawer menus in the sixth embodiment.
FIG. 33 is a flowchart (1/2) showing a specific procedure of the processing procedure shown in FIG. 32;
34 is a flowchart (2/2) showing a specific procedure of the processing procedure shown in FIG. 32. FIG.
FIG. 35 is a first diagram illustrating two drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 36 is a second diagram showing two drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 37 is a third diagram showing two drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 38 is a fourth diagram illustrating two pull-out menus displayed simultaneously on the screen of the image display according to the pull-out amount.
FIG. 39 is a first diagram illustrating three drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 40 is a second diagram showing three drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer.
FIG. 41 is a third diagram illustrating three drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 42 is a fourth diagram illustrating three drawer menus displayed simultaneously on the screen of the image display according to the amount of drawer;
FIG. 43 is a first diagram illustrating four drawer menus displayed on the screen of the image display according to the amount of drawer;
FIG. 44 is a second diagram showing four drawer menus displayed on the screen of the image display according to the amount of drawer;
FIG. 45 is a third diagram illustrating four drawer menus displayed on the screen of the image display according to the amount of drawer;
FIG. 46 is a fourth diagram showing four drawer menus displayed on the screen of the image display according to the drawer amount.
FIG. 47 is a flowchart showing a processing procedure related to display of a drawer menu and deformation of the shape of the main image accompanying the display of the drawer menu in the seventh embodiment.
FIG. 48 is a diagram showing a screen displayed on the image display in the process of displaying the drawer menu.
FIG. 49 is a flowchart showing a processing procedure for closing a displayed drawer menu.
FIG. 50 is a diagram showing a display screen (particularly, a screen when a B classification menu is selected) in the process of closing the drawer menu.
FIG. 51 is a diagram showing a screen of an image display for explaining a relationship between a storage position of a drawer menu and a main image A.
FIG. 52 is a flowchart showing a procedure of main image display processing accompanying display of a pull-out menu in the eighth embodiment.
FIG. 53 is a diagram showing a screen displayed on the image display in the process of displaying the drawer menu.
54 is a diagram showing a screen displayed on an image display for explaining a display method different from the display method of main image A shown in FIG. 53. FIG.
FIG. 55 is a flowchart (1/2) illustrating a procedure of drawer menu display processing according to the ninth embodiment;
FIG. 56 is a flowchart (2/2) showing a procedure of drawer menu display processing in the ninth embodiment.
FIG. 57 is a diagram showing a pull-out menu in the ninth embodiment displayed on the image display.
FIG. 58 is a diagram showing a BD classification menu displayed on the image display in the ninth embodiment.
FIG. 59 is a diagram showing each drawer menu according to another embodiment based on the ninth embodiment.
[Explanation of symbols]
01 Portable information processing device (information processing device)
04 Exterior cover member (frame)
05 Input device (coordinate designation means)
06 Microphone
07 Camera part
08 Shutter switch
09 Image display (image display)
10 Speaker
11 Touch panel sensor (coordinate designation means)
11A to 11D Menu display trigger area (predetermined area)
11E Image display area
11b Drawer menu (function list)
21 CPU (first display means, second display means)
22 CCD
23 RAM
24 Flash memory
25 ROM

Claims (14)

An information processing apparatus comprising: an image display unit surrounded by a quadrangular frame that forms a step; and coordinate designation means for designating a coordinate position on the screen in the image display unit.
Main image display means for displaying a main image;
A plurality of predetermined regions on the image display unit provided near each of the four sides of the frame,
A plurality of function lists each including a plurality of function items set in correspondence with the plurality of predetermined areas, each of which includes a plurality of function items related to processing for the main image;
A first predetermined region of the plurality of predetermined regions is designated by the coordinate designating unit, and then the coordinate designation is continued by the coordinate designating unit, and the designated coordinate is substantially at the center of the image display unit. When the direction is changed, the first function list corresponding to the first predetermined area is drawn in the predetermined direction by the amount of drawing that is the amount of change in the predetermined direction of the designated coordinates and displayed on the image display unit. First function list display means for
When the first function list is displayed on the image display unit by the first function list display means, the first predetermined area of the plurality of predetermined areas is defined by the coordinate specifying means. When a different second predetermined region is designated as coordinates, and subsequently the coordinate designation is continued by the coordinate designating means, and when the designated coordinates are changed in a substantially central direction of the image display unit, the second predetermined region is designated. The second function list display corresponding to the area is pulled out in the predetermined direction by the amount of withdrawal, and is displayed on the image display unit in preference to the display of the first function list. Means,
The main image display means extracts the main image displayed on the image display unit immediately before the first and second function lists are displayed, from the first and second function lists. Scaled according to the amount and displayed on the image display unit,
The second function list display means has the first function list and the second function list when the pulling direction of the first function list and the pulling direction of the second function list are opposed to each other. While the distance between the second function lists is kept at a predetermined distance, the display size of the first function list is changed as the second function list is pulled out. An information processing apparatus characterized by displaying the image at a reduced scale.   The second function list display means increases the pull-out amount of the second function list when the pull-out direction of the first function list and the pull-out direction of the second function list are orthogonal to each other. The information processing apparatus according to claim 1, wherein the display size of the first function list is scaled and reduced in a drawing direction of the second function list. When the first and second function lists are displayed on the image display unit, a third different from the first and second predetermined areas among the plurality of predetermined areas by the coordinate designating unit. A predetermined area is designated as coordinates, and the coordinate designation is continued by the coordinate designating means. When the designated coordinates change in a substantially central direction of the image display unit, the predetermined area corresponds to the third predetermined area. A third function list display means for displaying a third function list in the predetermined direction by pulling out the third function list in the predetermined direction;
The third function list display means includes a third function list pull-out direction when a pull-out direction of the first function list is orthogonal to a pull-out direction of the second function list. 2. The method according to claim 1, wherein either the first function list or the second function list is to be scaled according to whether the drawing direction of the second function list is opposite or orthogonal. Or the information processing apparatus of 2.   4. The information processing apparatus according to claim 1, wherein a number of different function lists from 2 to 4 can be displayed simultaneously on the image display unit. 5. The coordinate designating unit includes a contactor that contacts the screen of the image display unit,
The plurality of predetermined regions include a region where the contact is positioned on the screen of the image display unit when the contact moves on the screen of the image display unit and contacts the frame. The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus.   The information processing apparatus according to claim 1, wherein the plurality of predetermined regions are further positioned in the vicinity of four corners of the frame.   The information processing apparatus according to claim 1, wherein the information processing apparatus is a portable information processing terminal.   A plurality of function items representing a plurality of information processing functions provided in the information processing apparatus are classified in advance according to a predetermined classification criterion to form a plurality of groups, and each group is included in each of the plurality of function lists. The information processing apparatus according to claim 1, wherein the information processing apparatus corresponds to the information processing apparatus.   The information processing apparatus according to claim 8, wherein the classification criterion is a function usage frequency.   Each of the first and second function list display means is configured such that the first or second amount of the first or second function list display means is only the amount of the withdrawal if the amount of withdrawal when the coordinate designation by the coordinate designation unit is released is greater than a predetermined value. The information processing apparatus according to any one of claims 1 to 9, wherein the display of the second function list is pulled out.   Each of the first and second function list display means is configured to display the first or second function list if the amount of withdrawal when the coordinate designation by the coordinate designation means is canceled is equal to or less than the predetermined value. The information processing apparatus according to claim 1, wherein display of a table is stopped.   Each of the first and second function list display means displays all the function items constituting the function list in the function list corresponding to the first or second predetermined area designated by coordinates. The information processing apparatus according to any one of claims 1 to 11, wherein the information display unit displays the image on the image display unit by scaling the image according to the drawing amount. In each of the plurality of function lists, a display priority is set in advance for a plurality of function items constituting the function list,
Each of the first and second function list display means gives priority to the high priority function item in the first or second function list on the image display unit according to the withdrawal amount. The information processing apparatus according to claim 1, wherein the information processing apparatus displays the information processing apparatus. An image display unit surrounded by a quadrangular frame forming a step, a coordinate designating unit for designating a coordinate position on the screen in the image display unit, and the image display provided near each of the four sides of the frame An information processing apparatus comprising: a plurality of predetermined areas on a section; and a plurality of function lists each including a plurality of function items set in correspondence with the plurality of predetermined areas, each of which is related to processing on a main image In the function list display method applied to
A main image display step for displaying the main image;
A first predetermined region of the plurality of predetermined regions is designated by the coordinate designating unit, and then the coordinate designation is continued by the coordinate designating unit, and the designated coordinate is substantially at the center of the image display unit. When the direction is changed, the first function list corresponding to the first predetermined area is drawn in the predetermined direction by the amount of drawing that is the amount of change in the predetermined direction of the designated coordinates and displayed on the image display unit. First function list display step to perform,
When the first function list is displayed on the image display unit by the first function list display step, the first predetermined area of the plurality of predetermined areas is determined by the coordinate designating unit. When a different second predetermined region is designated as coordinates, and subsequently the coordinate designation is continued by the coordinate designating means, and when the designated coordinates are changed in a substantially central direction of the image display unit, the second predetermined region is designated. The second function list display corresponding to the area is pulled out in the predetermined direction by the amount of withdrawal, and is displayed on the image display unit in preference to the display of the first function list. And having steps,
In the main image display step, the main image displayed on the image display unit immediately before the first and second function lists are displayed is extracted from the first and second function list. Scaled according to the amount and displayed on the image display unit,
In the second function list display step, when the pulling direction of the first function list and the pulling direction of the second function list are opposed to each other, the first function list and the second function list are displayed. While the distance between the second function lists is kept at a predetermined distance, the display size of the first function list is changed as the second function list is pulled out. A function list display method characterized by displaying the image at a reduced scale.

Images