JP2002055753A - Information processor, function list display method and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor capable of securing the display area of a main image on an image display screen as much as possible, improving operability and realizing miniaturization. SOLUTION: This information processor is provided with an image display part surrounded by a frame different in level, an input device 05 for designating coordinate positions on a screen in the image display part, plural prescribed areas on the image display part arranged near the frame, and plural menus including plural function items set corresponding to the plural prescribed areas. In this case, the coordinate designation of a prescribed area 11B is operated by the input device 05, and successively the coordinate designation is continued by the input device 05, and when the designated coordinates are changed to almost the central direction of the image display part, the menu corresponding to the prescribed area 11B is displayed on the image display part according to the changing amounts of the designated coordinates (D5, D6 and D7).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, a function list display method, and a storage medium, and more particularly, to an image display section surrounded by a frame forming a step, and a display on the screen in the image display section. The present invention relates to an information processing apparatus provided with a coordinate designating means for designating a coordinate position, a function list display method applied to the information processing apparatus, and a storage medium storing a program for executing the function list display method.

[0002]

2. Description of the Related Art Conventionally, as an input / output device connected to an information processing device, an image display device and a menu (a large number of various function items and function command keys) displayed on a screen of the image display device have been selected. And an input device that is used by an operator to select the function described above.

As an input device, for example, in a notebook-sized portable information terminal, a hard key (menu button) laid out around an image display device (liquid crystal display) or a periphery of the image display device (liquid crystal display) is provided. There are touch-sensitive keys to be arranged. In a device equipped with a large screen display, there are a mouse cursor and a pointing device for selecting a button or a soft key using an illustration, which is called an icon that is always displayed on the screen and symbolically represents a corresponding function. For devices with a large-screen display, a list of function items is pulled down from the top or down, or pulled up from the bottom to display many function items and a pull-down (pull-down) that allows selection of any function. There is a menu display method called up) menu.

[0004]

However, in the above-mentioned conventional portable information terminal, it is necessary to lay out menu buttons and touch sensor keys around an image display device (liquid crystal display), which is an obstacle to miniaturization of the device. There was a problem of becoming. In addition, since buttons and keys are laid out close to each other, there is a problem in that when selecting them with a pen or the like, it is easy for the adjacent buttons to be erroneously operated.

[0005] In addition, even when a menu is not required, a constant area on the screen must always be ensured for menu display, and the display area size of the main image to be originally displayed is reduced accordingly. There was a problem.
There is also a method of not displaying the menu at all times, and displaying only the button for prompting the menu display on the screen when the menu is not displayed, but even in that case, it is necessary to display the button, Constant area of
It is necessary to secure a small amount.

[0006] In addition, if the menu display is performed even though the user only wants to see only the image information and does not need to display the menu, the image is visually disturbing as extra information.

Further, when a pull-down (pull-up) menu display method is adopted in a portable information terminal, if the number of functions included in the menu is large, the menu display image hides the main image and the main image is hidden. There is a problem that the result cannot be seen when performing some kind of editing processing.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and has been made in view of the above problem. It is an object to provide an apparatus, a function list display method, and a storage medium.

[0009]

According to the first aspect of the present invention, there is provided an image display section surrounded by a frame forming a step, and coordinates on the screen of the image display section. In an information processing apparatus including a coordinate designating unit for designating a position, a plurality of predetermined areas on the image display unit provided near the frame are set corresponding to the plurality of predetermined areas, respectively. A plurality of function lists each including a plurality of function items, and any one of the plurality of predetermined areas is coordinate-designated by the coordinate designating means, and the coordinate designation is continued by the coordinate designating means. A display for displaying, on the image display unit, a function list corresponding to the coordinate-designated predetermined area in accordance with the change amount of the designated coordinates when the designated coordinates change substantially toward the center of the image display unit; And having a stage.

Further, according to the present invention, an image display section surrounded by a frame forming a step, coordinate specifying means for specifying a coordinate position on a screen in the image display section, and the frame body Including a plurality of predetermined areas on the image display unit provided in the vicinity of and a plurality of function lists each including a plurality of function items set corresponding to each of the plurality of predetermined areas. In the function list display method applied to the processing device, any one of the plurality of predetermined areas is designated by the coordinate designation means, and the coordinate designation is continued by the coordinate designation means, and A detecting step of detecting that the coordinates change substantially in the direction of the center of the image display unit, and when the change of the designated coordinates is detected by the detecting step, the coordinates are set to a predetermined area designated by the coordinates. A function list to respond, and having a display step of displaying on the image display unit according to the amount of change in the specified coordinate.

Further, according to the invention of claim 27,
An image display unit surrounded by a frame forming a step, a coordinate designation unit for designating a coordinate position on the screen in the image display unit,
A plurality of predetermined regions on the image display unit provided near the frame, and a plurality of function lists each including a plurality of function items set corresponding to the plurality of predetermined regions, respectively. In a computer-readable storage medium storing a function list display method applied to an information processing apparatus provided as a program, the function list display method may be any one of the plurality of predetermined areas by the coordinate designating means. Are designated by coordinates, subsequently, the coordinates designation is continued by the coordinates designation means, and a detection step of detecting that the designated coordinates change substantially toward the center of the image display unit; and When a change in the designated coordinates is detected, a function list corresponding to the predetermined area designated by the coordinates is displayed according to the amount of change in the designated coordinates. And having a display step of displaying the image display unit.

[0012]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 is a front view showing a configuration of a first embodiment of a portable information processing apparatus according to the present invention, and FIG. 2 is a portable information processing apparatus shown in FIG. FIG. 3 is a rear view of the portable information processing apparatus shown in FIG. 1, and FIG. 4 is a cross-sectional view taken along the line AA ′ in the portable information processing apparatus shown in FIG. is there.

The portable information processing apparatus 01 is equipped with an image display display 09 capable of displaying full-color image information at high definition, and is a notebook-sized portable information terminal mainly receiving coordinate instructions by a pen-type input device 05. (P
DA).

On the front side shown in FIG. 1, a camera unit 07 and a microphone 06 for recording sound data are arranged.

A shutter switch 08 is arranged on the upper surface side shown in FIG. The shutter switch 08 is constituted by a two-stage switch. When the first-stage switch is turned on, a shooting standby state is established, and finder image information is displayed on the image display display 09. Then, shooting is performed when the second stage switch is turned on, and an image is recorded.

The back side shown in FIG. 3 is a side on which operations are mainly performed when a user uses the portable information processing apparatus 01. The touch panel sensor 11 on the image display 09 is touched by the pen-type input device 05, whereby coordinates are designated and various functions are selected. 10 is a speaker.

As shown in the cross-sectional view of FIG. 4, the touch panel sensor 11 is surrounded by an outer cover member 04. When the input device 05 is moved along the upper surface of the touch panel sensor 11, the outer cover member 0
4, the outer cover member 04 is a step with respect to the touch panel sensor 11.

FIG. 5 is a diagram showing a configuration of the touch panel sensor 11.

The touch panel sensor 11 has an image display area 11E and a menu display trigger area 1
1A to 11D are provided. The drawer menu display trigger areas 11 </ b> A to 11 </ b> D are respectively located near the touch panel sensor 11 in contact with the exterior cover member 04. Thereby, the input device 05 is moved along the upper surface of the touch panel sensor 11, and the outer cover member 0 is moved.
4, the input device 05 is located in one of the drawer menu display trigger areas 11 </ b> A to 11 </ b> D. Note that the coordinate definitions of the drawer menu display trigger areas 11A to 11D are determined based on the shape of the pen tip of the input device 05 and the like.
The coordinate range detected by the touch panel sensor 11 when 5 is hit against the exterior cover member 04 is defined with a margin. Predefined coordinate information of the drawer menu display trigger areas 11A to 11D is stored in a ROM.
When the coordinate information from the input device 05 is detected, it is compared with the coordinate information registered in the ROM, and it is determined that the coordinate information from the input device 05 exists in the pull-out menu display trigger areas 11A to 11D. When the input device 05 is scrolled toward the center of the touch panel sensor 11, the drawer menu is displayed.

FIG. 6 is a view for explaining a drawer menu displayed on the image display display 09.

In order to display a menu of the names of a large number of processing functions of the portable information processing apparatus 01 on the image display display 09, a large number of these processing functions must be displayed in advance.
Classified into two categories and assigned to the A to D classification menu. Then, when any of the drawer menu display trigger areas 11A to 11D is selected by the input device 05, the corresponding one of the A to D classification menus is displayed on the image display display 09 as a "drawer menu". I do.

The contents laid out in the drawer menu are, for example, a list of buttons based on icons and text display, an example of writing icons and characters together according to the specifications and product concept of the portable information processing apparatus 01. Is assumed.

As specific examples of functions stored in the A to D classification menus, the A classification menu includes a search function for searching for a desired image from previously shot and stored images. The menu summarizes the character input function for adding characters to the image.
It summarizes the processing and editing functions for adding special effects to images. Note that since various functional processes are performed while the B classification menu is displayed on the image display display 09 as a drawer menu, the B classification menu is located at the top of the image display display 09 as described later with reference to FIG. This prevents the input device 05 or hand from hiding the image when writing the image or selecting a function.

The D classification menu includes functions for designating a storage destination of image data subjected to image processing, such as a storage / organization function.

FIG. 7 is a diagram showing a screen of the image display display 09 in which the B classification menu is displayed as a drawer menu.

Drawer menu display trigger area 11
When the input device 05 is slid toward the center of the screen while the coordinates of B are designated by the input device 05, the B classification menu is displayed as the pull-out menu 11b. In the drawer menu 11b, function buttons with icons and characters corresponding to each function are laid out.

As described above, the user designates any of the pull-out menu display trigger areas 11A to 11D by using the input device 05 according to the necessary function, and scrolls the menu including the necessary function. Can be displayed. While repeatedly using the drawer menu display trigger areas 11A to 11D, the user can remember the large classification category of each area.

The number of icons and buttons shown in FIG. 7 is set according to the size of the screen.
However, the number is not limited to the number shown in FIG. Further, the drawer menu display trigger areas 11A to 11D are set to be always displayed on the image display display 09, and are normally displayed only when a predetermined area of the image display display 09 is designated by the input device 05 without being displayed. The setting may be properly used. Further, the drawer menu display trigger areas 11A to 11D may be distinguished from each other by changing the pattern or the color of each other.

In the following description, as shown in FIG.
The horizontal direction of the screen of the image display display 09 is the X axis, the vertical direction is the Y axis, and the withdrawal amounts of the withdrawal menu are x and y, respectively.

FIG. 8 is a block diagram showing a system configuration of the portable information processing apparatus 01.

As described above, the image display display 09
By touching a soft button on the screen of the input device 05 with the input device 05, coordinates on the touch panel sensor 11 are detected, and according to the detected coordinate information, the CPU 21
Various functions are executed based on the operation system stored in the ROM 25.

An image input from the CCD 22 of the camera unit 07 and audio information input from the microphone 06 are stored in the flash memory 24 by the shutter switch 08, and are stored in the RAM 23 in accordance with various processing procedures of the program stored in the ROM 25. To store. The stored information is later reproduced on the image display display 09 or the speaker 10, and through a plurality of search means by a GUI operation instructing from a coordinate position on the touch panel sensor 11 by touching the input device 05, the required image or sound can be arbitrarily selected. It is possible to play back.

For the reproduced image information, the image information is edited and processed by various methods such as adding an image arbitrarily using the RAM 23 or adding a character by a word processing function.

FIG. 9 is a flowchart showing an outline of the overall operation procedure in the portable information processing apparatus 01.

When the main power supply is started (YE in S11)
S), the photograph taken in the past is reproduced, and the display state becomes such that the photograph can be viewed like an album (S12).

In this state, the button (hard key)
There is an operation (S13), and if it is a power switch operation, the power is turned off. If it is the operation (half-press) of the first-stage switch SW1 of the shutter switch 08 (S
14), an image is displayed on the viewfinder (S15),
If the second-stage switch SW2 of the shutter switch 08 is operated (fully pressed) (S16), the captured image is stored in the flash memory 24 (S17).

After the processing of step S15 or S17 or the processing of step S12, when the GUI function button is selected and operated by the input device 05 (S18), a search is performed according to the selected function (S1).
9), character input (S20), processing / editing (S21), storage / organization (S22), and the like.

The present invention relates to the display of a menu containing various GUI function buttons.

FIGS. 10 and 11 are flowcharts showing a processing procedure when displaying a drawer menu. FIG. 12 is a display screen (particularly, selecting and displaying a B classification menu) in a process of displaying a drawer menu. FIG. Hereinafter, a description will be given along the steps shown in FIGS. 10 and 11 while appropriately referring to FIG.

First, the processing procedure for displaying the drawer menu will be briefly described. The drawer menu display trigger area 11 on the touch panel sensor 11 is previously described.
The definition coordinates of A to 11D are registered in the ROM 25. When it is detected that these areas are touched by the input device 05, the detected coordinate data is compared with the defined coordinates registered in the ROM 25, and a drawer menu corresponding to the drawer menu display trigger area that has been operated is displayed. It is selected and enters the display standby state. When the detection coordinates are continuously updated by dragging the input device 05 toward the center of the image display display 09, the pull-out menu is drawn in the dragged direction accordingly. If the detection information is OFF (touch panel sensor 11
Is lost, and the coordinates are no longer detected), the drawer menu continues to be displayed at the dragged position. Here, “OFF” means that the input device 0 for the touch panel sensor 11
5 indicates that the contact is lost and the coordinates are no longer detected. In the following description, “OFF” is used in the same meaning.

First, in step S101, a photographic image or the like is displayed using the entire screen of the image display display 09. The screen D1 in FIG. 12 shows the screen of the image display display 09 at this time. Next, in step S102, the position coordinates on the touch panel sensor 11 touched by the input device 05 are detected.

In step S103, it is determined whether or not the coordinate value detected in step S102 is included in any of the pull-out menu display trigger areas 11A to 11D. If not, wait until it is. In addition,
As in screens D3 and D4 in FIG. 12, the detected coordinate values are present in an area other than the drawer menu display trigger areas 11A to 11D, are continuously updated without being turned off, and are thereafter updated. 1
When the user moves to any one of 1D, the coordinate information before reaching any of the drawer menu display trigger areas 11A to 11D is treated as invalid. Also, screen D2 in FIG.
As described above, even if the detected coordinate value is included in one of the drawer menu display trigger areas 11A to 11D, if it is turned off, the process returns to step S101.

In step S104, it is determined whether the detected coordinate value is included in any of the pull-out menu display trigger areas 11A to 11D.
To 105, a drawer menu display trigger area 11
If it is included in B and 11C, the process proceeds to step S112.

In steps S105 and S112, the selected drawer menu display trigger area is highlighted, and at the same time, an electronic sound such as a beep is generated as a key reception sound to notify the user of the selection.
If the switch is turned off during this time, the process returns to step S101.

In this way, the user can display the target menu simply by roughly operating the input device 05 in the wide drawer menu display trigger areas 11A to 11D.

Next, for example, while the input device 05 is in contact with the drawer menu display trigger area 11B,
When the input device 05 is slid toward the center of the image display display 09 without releasing the touch panel sensor 11 while keeping it in contact with the touch panel sensor 11, as shown in screens D5 to D8 in FIG. The menu is pulled out. This will be described below along steps S113 to S118 in FIGS.

First, in step S113, the input device 05 sets the menu display trigger areas 11B, 11B.
Only the Y coordinate value of the coordinate value detected by touching C is monitored. Here, since the drawer menu display trigger areas 11B and 11C are selected, the X-axis information is ignored, and only the Y-axis information is reflected in the processing. Even if the user is not conscious of dragging the input device 05 in the vertical direction, the intention can be reflected by roughly dragging the input device 05 downward. Typically,
Although the direction in which the dominant hand drags is slightly deviated from the vertical direction, for example, in the case of a right-handed user, the drag is performed slightly to the left from the vertical direction, that is, in a vector from the upper right to the lower left. For left-handed people, drag in the opposite direction using a vector from upper left to lower right. However, by adopting a method of reflecting only the change value of the Y-axis information, it is possible to reflect the user's intention without being affected by the above-mentioned habit.

In step S114, the input device 05
, The display amount of the drawer menu is updated according to the Y coordinate value. The maximum withdrawal amount of the withdrawable menu that can be withdrawn most can be changed according to the specification, but in the present embodiment, it is defined as up to the center position of the display area.

Note that while the menu withdrawal amount y is less than the predetermined definition amount, the OF as shown in the screen D5 of FIG.
In the case of F, the menu drawing process is canceled halfway, and the process returns to step S101 (S115).
Further, if the menu withdrawal amount y is turned off as shown in the screen D6 of FIG. 12 after exceeding the predetermined defined amount, the withdrawal of the withdrawal menu is stopped at that position and can be used as it is (S116). . Further, when the menu withdrawal amount y exceeds the maximum withdrawal amount, the withdrawal of the withdrawal menu is stopped, the maximum withdrawal amount is maintained (S117), and the detected coordinate value is ignored (S118).

Unlike the above-described embodiment, the change speed of the detected coordinate value during the process progress is detected as shown in screens D2, D5, and D6 in FIG. 12, and if the change speed is high, the change in FIG. Even if it is turned off in the process of screen D6,
The process may move to the process of screen D9 in FIG.

When the input device 05 has selected the menu display trigger areas 11A and 11D, similarly, in step S106, the coordinate values detected when the input device 05 touches the menu display trigger areas 11A and 11d. Only the X coordinate value is monitored. Here, the Y-axis information is ignored, and only the X-axis information is reflected in the processing.

In step S107, the input device 05
The display amount of the drawer menu is updated in accordance with the X coordinate value of.

If the menu-drawing amount x is turned off while the menu-drawing amount x is less than the predetermined defined amount, the menu-drawing process is canceled halfway, and step S101 is performed.
Return to (S108). If the menu is turned off after the menu withdrawal amount x exceeds a predetermined defined amount, the withdrawal of the withdrawal menu is stopped at that position and can be used as it is (S109). Further, when the menu withdrawal amount x exceeds the maximum withdrawal amount, the withdrawal of the withdrawal menu is stopped and the maximum withdrawal amount is maintained (S11).
0), the detected coordinate value is ignored (S111).

FIGS. 13 and 14 are flowcharts showing a processing procedure for closing the displayed drawer menu. FIG. 15 shows a display screen in the process of closing the drawer menu (particularly, the B category menu is selected). FIG. Hereinafter, description will be made along the steps shown in FIGS. 13 and 14 with reference to FIG.

First, it is assumed that the withdrawal menu is displayed with the maximum withdrawal amount as in the screen D11 in FIG. 15 (S201). Next, in step S202, the position coordinates on the touch panel sensor 11 touched by the input device 05 are detected.

In step S203, it is determined whether or not the coordinate value detected in step S102 is included in any of the drawer menu display trigger areas 11A to 11D. If not included, it is determined whether or not a specific function button (GUI function button) in the drawer menu is selected by the input device 05 as shown in a screen D13 in FIG. 15 (S210). The function is processed (S211). If not, the process returns to step s203, and the reception standby state is maintained. As shown in screens D12 and D14 in FIG.
When only the detected coordinate values change and the user enters the drawer menu display trigger area, the detected coordinate values up to that point are ignored, and the apparatus enters a standby state. This is a method for reliably accepting the user's intention even in a rough operation.

If it is determined in step S203 that the detected coordinate value is included in any of the pull-out menu display trigger areas 11A to 11D (screen D1 in FIG. 15).
4) In step S204, it is determined whether the detected coordinate value is included in any of the pull-out menu display trigger areas 11A to 11D. If the detected coordinate value is included in the pull-out menu display trigger areas 11A and 11D, step S205 is performed.
To, drawer menu display trigger area 11B, 11
If it is included in C, the process proceeds to step S212.

In steps S205 and S212, the selected drawer menu display trigger area is highlighted, and at the same time, an electronic sound such as a beep is generated as a key accepting sound to notify the user of the selection.
If it is turned off during this time, the process returns to step S203.

Next, when the input device 05 has selected the menu display trigger areas 11B and 11C, in step S213, the coordinate values detected by the input device 05 touching the menu display trigger areas 11B and 11C are determined. Monitor only the Y coordinate value. The X-axis information is ignored, and only the Y-axis information is reflected in the processing. In addition,
As shown in the screen D15 of FIG. 15, when the input device 05 is dragged downward and the menu withdrawal amount y is increased, it is ignored.

In step S214, the input device 05
, The display amount of the drawer menu is updated according to the Y coordinate value.

When the menu display amount y is turned off as shown in the screen D16 of FIG. 15 while the menu withdrawal amount y exceeds the predetermined defined amount, the display state is displayed as shown in the screen D17 of FIG. Is maintained (S215). Further, if the menu withdrawal amount y is turned off as shown in a screen D18 in FIG. 15 after the menu withdrawal amount y becomes smaller than the predetermined defined amount, it is assumed that the user intends to erase the display of the withdrawal menu, and FIG. As shown in the 15th screen D19, the display of the drawer menu is stopped (S216).

On the other hand, if it is determined in step S204 that the input device 05 has selected the menu display trigger areas 11A and 11D, then in step S206 the input device 05 contacts the pull-out menu display trigger areas 11A and 11D. Only the X-coordinate value of the coordinate value detected by this is monitored. The Y-axis information is ignored, and only the X-axis information is reflected in the processing.

In step S207, the input device 05
The display amount of the drawer menu is updated in accordance with the X coordinate value of.

When the button is turned off while the menu withdrawal amount x exceeds the predetermined defined amount, the display state is maintained (S208). Further, after the menu withdrawal amount x becomes smaller than the predetermined defined amount, OFF
If it becomes, it is considered that the user intends to erase the display of the drawer menu, and the display of the drawer menu is stopped (S209).

In the above embodiment, the user drags the drawer menu to stop the display of the drawer menu. However, instead of this, the display of the drawer menu can be stopped only by clicking the drawer menu. A button having a close function may be provided.

Further, similarly to the case where the display of the drawer menu is activated, the screens D12, D14, D16 in FIG.
The change speed of the detected coordinate value during the process as described above is detected, and when the change speed is high, the screen D16 of FIG.
Even if it is turned off in the processing of the above, the processing may move to the processing of the screen D19 of FIG. 15 without going to the processing of the screen D17 of FIG.

FIG. 16 is a flowchart showing a procedure of processing for determining the size of the withdrawal menu according to the withdrawal amount. FIG. 17 is a diagram showing a screen of the A classification menu displayed according to the withdrawal amount.
FIG. 8 is a diagram showing a screen of a B classification menu displayed according to the amount of withdrawal. 17 and 18, the drawer menu display trigger areas 11A to 11D are shown on four sides for easy understanding, but the four areas are not necessarily displayed. FIG. 17 and FIG.
8 will be described along the steps shown in FIG.

In FIG. 16, steps S301, S30
2, S303 and S307 are steps S1 shown in FIG.
03, S104, S106, and S112, respectively, and the description thereof is omitted.

When the A category menu is selected, in step S304, the size of the drawer menu is scaled and reduced in the horizontal direction at the ratio of the X coordinate position (drawer amount x) to the maximum drawer amount and displayed. . The screen D34 in FIG. 17 shows the A classification menu at the maximum withdrawal amount position. For example, assume that the withdrawal amount x on the screen D33 in FIG. 17 is ／ of the maximum withdrawal amount on the screen D34 in FIG. Screen D33 in FIG.
In the A category menu, the Y direction is the screen D3 of FIG.
4, but is displayed as an image reduced to 3/4 in the X direction compared to the screen D34 in FIG. Accordingly, the display area of the button is also reduced in the horizontal direction, and the display style of the contents of the A classification menu changes depending on the amount of withdrawal x, such as only an icon or a combination of an icon and a character.

When the withdrawal amount x is updated, the display ratio is updated (S305), and the input device 05 is moved to the touch panel sensor 1 at a position halfway to the maximum withdrawal amount position.
When it is separated from 1, the drawer menu display is held at that position. When the withdrawal amount x exceeds the maximum withdrawal amount, the withdrawal menu display is held at the maximum withdrawal amount position (S306).

Next, when the B classification menu is selected, in step S308, the size of the drawer menu is scaled down and down in the vertical direction at the ratio of the Y coordinate position (drawer amount y) to the maximum drawer amount. To display. Figure 1
The screen D38 of FIG. 8 shows the B classification menu at the maximum withdrawal amount position. For example, if the withdrawal amount y on the screen D37 of FIG. 18 is 3/4 of the maximum withdrawal amount on the screen D38 of FIG. Screen D in FIG.
The B classification menu at 38 is the same as the screen D38 in FIG. 18 in the X direction, but is displayed as an image reduced to 3/4 in the Y direction as compared with the screen D38 in FIG. The display area of the button is accordingly reduced in the vertical direction.

When the withdrawal amount y is updated, the display ratio is updated (S309), and the input device 05 is moved to the touch panel sensor 1 at a position halfway to the maximum withdrawal position.
When it is separated from 1, the drawer menu display is held at that position. If the withdrawal amount y exceeds the maximum withdrawal amount, the withdrawal menu display is held at the maximum withdrawal amount position (S310).

In the above description, the A and B classification menus have been described as an example, but the same procedure is applied to the C and D classification menus. When closing the drawer menu display, the procedure proceeds in the reverse direction of the processing shown in FIG.

FIG. 19 is a diagram showing a screen of the image display display 09 for explaining the relationship between the pull-out menu display trigger areas 11A to 11D and the pulled-out A to D classification menus.

On the screen of the image display display 09, the drawer menu display trigger areas 11A to 11
Depending on which of D is selected by the input device 05, the pull-out direction of the pull-out menu, the coordinate information to be accepted, and the direction of image processing for scaling the layout in the menu are different.

The screen D41 shows a drawer menu display trigger area 11 to be selected when pulling out the A category menu.
A and the drawing direction are shown, and the screen D42 shows a state in which the A classification menu has been drawn to the maximum drawing amount position.

The screen D41 shows a drawer menu display trigger area 11 to be selected when pulling out the A category menu.
A and the drawing direction are shown, and the screen D42 shows a state in which the A classification menu has been drawn to the maximum drawing amount position.

The screen D43 is a drawer menu display trigger area 11 to be selected when the B class menu is drawn.
B and the direction in which it is drawn out, and the screen D44 shows a state in which the B-classified menu has been drawn out to the maximum draw-out amount position.

Screen D45 is a drawer menu display trigger area 11 selected when pulling out the C category menu.
C and the direction in which it is pulled out are displayed, and the screen D46 shows a state in which the C classification menu has been pulled out to the maximum withdrawal amount position.

The screen D47 displays a drawer menu display trigger area 11 to be selected when pulling out the D classification menu.
D and the direction in which it is drawn out, and a screen D48 shows a state where the D-classification menu has been drawn out to the maximum draw-out amount position.

The drawer menu shown in FIG. 19 is merely an example for explanation, and the number and size of the icons in the drawer menu differ according to the number of functions and the size of the image display display 09.

(Second Embodiment) Next, a second embodiment will be described.

Since the configuration of the second embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the second embodiment.

In the second embodiment, the contents of the control processing performed by the portable information processing apparatus 01 are different from those in the first embodiment.

FIG. 20 is a flowchart showing the procedure of the display process of the drawer menu in the second embodiment. In this display processing, step display is performed according to the priority of the function. FIG. 21 is a diagram showing ranges a, b, and c on the screen of the image display display 09.
FIG. 23 is a diagram showing a screen of the A classification menu displayed according to the withdrawal amount, and FIG. 23 is a diagram showing a screen of the B classification menu displayed according to the withdrawal amount.
13 is a diagram showing a screen of a C classification menu displayed according to the withdrawal amount. FIG. Hereinafter, description will be made along the steps of the flowchart shown in FIG. 20 with reference to FIGS. 21 to 24 as appropriate.

First, an overview will be given. If there are too many items in the drawer menu that can be listed at one time, the selection may be lost and the usability may be deteriorated. Assuming such a case, in the second embodiment, the number of items that can be viewed is limited, and the function items are displayed in two or three stages in descending order of priority. That is, in each drawer menu, the function items are laid out and displayed in descending order of the frequency of use from the one closer to the drawer menu display trigger area. This makes it possible to select a frequently used function item only by pulling out the first column.

For example, in FIG.
Items A-1, A-2, and A-3 shown in FIG. 53 are the most frequently used function items, and the items A-1 to A-3 shown in the screen D53.
4, A-5 and A-6 are function items that are used less frequently than the items A-1, A-2 and A-3. in this way,
The drawer menu can be arranged and used like a drawer on a desk.

The maximum number of items displayed in the drawer menu differs depending on the size of the screen and the function of the icon.
For example, in the A and C classification menu, up to 6 items are displayed,
In the B classification menu, 30 items of 3 × 10 are displayed. In the B class menu, it can be assumed that a color palette function is laid out. In the B classification menu, three display steps are provided according to the number of columns.

In the flowchart of FIG. 20, the display of the A classification menu is taken as an example. Step S4
01, S402, and S403 correspond to the steps S shown in FIG.
103, S104, and S106 have the same contents, respectively, and a description thereof will be omitted.

When the detected X coordinate value has changed due to the movement of the input device 05, only the position of the pull-out menu display trigger area is updated. Determine and display the layout in the drawer menu according to the value.

First, in step S404, when the detected X coordinate value is turned off in the range a shown in FIG.
The screen D51 of FIG. 22 is displayed.

When the detected X coordinate value is turned off in the range b shown in FIG. 21 in step S405,
The screen D52 of FIG. 22 is displayed.

When the detected X coordinate value is turned off in the range c shown in FIG. 21 in step S406,
The screen D53 of FIG. 22 is displayed.

When the input device 05 moves and crosses the boundaries of the ranges a, b, and c, a buzzer sound is emitted and the user is notified.

Note that, as the number of columns of function items laid out in the drawer menu increases, the number of ranges a, b, and c also increases and is subdivided. Similarly, when the display of the drawer menu is closed, the display can be gradually closed. Other B, C, D classification menus are displayed in the same procedure.

(Third Embodiment) Next, a third embodiment will be described.

Since the configuration of the third embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the third embodiment.

In the third embodiment, the contents of the control processing performed by the portable information processing apparatus 01 are different from those in the first embodiment.

FIG. 25 is a flowchart showing the procedure of the display processing of the drawer menu in the third embodiment. In this display processing, the maximum withdrawal amount is extended. FIG. 26 is a diagram showing a screen of the A classification menu displayed on the screen of the image display display 09 according to the amount of withdrawal. First, the features of the third embodiment will be described with reference to FIG.

In the third embodiment, the drawer menu is displayed so as to maximize the entire display area of the image display display 09, and more function items are displayed.

In the first embodiment described above, the maximum display amount of the drawer menu is set up to the center position of the image display display 09 (semi-display area). Care was taken to minimize the hiding of the desired image. However, depending on the nature of the function item, the display image does not necessarily have to be displayed, but rather, it may be required to enhance the list of function items in the drawer menu.

For example, the search function does not originally require a display image. In this case, as shown in screens D65 and D69 in FIG. 26, the entire display area of the image display display 09 is used for displaying a pull-out menu. On the other hand, the image editing function originally requires a display image, and in this case, the display image and the drawer menu are displayed simultaneously. In this case, the maximum display amount of the drawer menu is １ ／ of the screen of the image display display 09.

In the present embodiment, since the function items for which the function is frequently selected while viewing the displayed image are stored in the upper and lower B and C classification menus, the B and C classification menu is displayed on the image display display 09. , And the left and right A and D classification menus can be extended to the entire display area of the image display display 09.

Even if the drawer menu can be drawn to the entire display area of the image display display 09,
As shown in screens D62 to D65 of FIG. 25, regardless of the amount of withdrawal, depending on the method of displaying all function items in the drawer menu, and as shown in screens D66 to D69 of FIG. There may be a method in which the number of function items displayed in the drawer menu is changed stepwise. Either method may be selected and implemented depending on the nature of the function item, or the user may be able to freely select either method.

In the flowchart of FIG. 25, the display of the A classification menu is shown as an example. Step S5
01, S502, and S503 correspond to the steps S shown in FIG.
103, S104, and S106 have the same contents, respectively, and a description thereof will be omitted.

In step S504, the input device 05
The display position of the drawer menu display trigger area 11A is updated in accordance with the detected X-coordinate value due to the contact of the user, and the corresponding function item is displayed. At this time, when the input device 05 is turned off, the display state is maintained.

Step S505 shows the display processing of the drawer menu when the input device 05 is moved in the direction opposite to the moving direction in step S504.
Also in this case, the display position of the drawer menu display trigger area 11A is updated according to the detected X coordinate value, and the corresponding function item is displayed. At this time,
When the input device 05 is turned off, the display state is maintained.

Then, the input device 05 operates in step S
When the detected X-coordinate value x is smaller than a predetermined defined amount by further moving in the moving direction at 505, the display of the drawer menu is stopped (S506).

That is, in the third embodiment, the definition of the maximum withdrawal amount is not provided, and the entire display area of the image display display 09 can be used for displaying the withdrawal menu.

(Fourth Embodiment) Next, a fourth embodiment will be described.

Since the configuration of the fourth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the fourth embodiment.

In the fourth embodiment, the contents of the control processing performed by the portable information processing apparatus 01 are different from those in the first embodiment.

FIG. 27 is a flowchart showing the procedure of the display process of the drawer menu in the fourth embodiment. In this display processing, the number of drawer menus is increased from four to eight. FIG. 28 shows an image display display 09.
It is a figure which shows the additional drawer menu displayed on the screen of FIG. First, the features of the fourth embodiment will be described with reference to FIG.

In the first embodiment, the drawer menu display trigger areas 11A to 11D are provided on the four sides of the image display display 09. In the fourth embodiment, however, the number of functional item categories is further increased. To increase
Four corners of the image display display 09 as shown in a screen D70 of FIG. 28 are used as trigger areas a, b, c, and d.

That is, the image display display 0 avoiding the drawer menu display trigger areas 11A to 11D.
The four corner positions 9 are set as trigger areas a, b, c, and d, and functions that are used less frequently, such as special settings (for example, detailed settings, user settings, etc.) are assigned to the areas.

The drawer menu display trigger areas 11A to 11D for pulling out the normally used function items are:
While the display area is enlarged so that the input device 05 can easily make contact, the trigger areas a and
On the other hand, b, c, and d have a small display area so that they are not easily displayed due to erroneous operation or the like. Since the input device 05 abuts on a step around the image display display 09, selection can be easily performed when the selection operation is performed with the trigger areas a, b, c, and d conscious.

With reference to the flow chart of FIG. 27, a process for displaying the a category detailed menu by selecting and operating the trigger area a will be particularly described. Steps S601, S602, S603, S604, S605
Correspond to steps S101, S102, 10 shown in FIG.
3, S104, and S105 have the same contents, and a description thereof will be omitted. However, in steps S603 to S605, the drawer menu display trigger areas 11A to 11D are set to the trigger areas a, b, c,
It should be read as d.

In step S606, the input device 05
The display position of the oblique bar 30 is determined and displayed in accordance with the coordinate value detected by the contact of. That is, as shown in a screen D72 in FIG.
When the detected coordinate values of the axis and the Y axis are x and y, the larger absolute value of the detected coordinate values x and y is detected, and the display position of the oblique bar 30 is changed according to the detected value. Decide. Specifically, along an oblique line extending in a direction of 45 degrees from the base point, at a position away from the base point by a distance corresponding to the detected value,
An oblique bar 30 extending in a direction perpendicular to the oblique line is displayed. When the input device 05 is turned off, if the detected value is within a predetermined value, the screen D in FIG.
Returning to FIG. 70, if the detected value exceeds a predetermined value, FIG.
8, the display state is maintained as it is.

In steps S607 and S608,
If the detected value exceeds the maximum withdrawal amount, the display state is maintained at the maximum withdrawal amount position as shown on a screen D74 in FIG. Then, even when the input device 05 is turned off, the display state is maintained at the maximum withdrawal amount position as shown in the screen D75 in FIG.

The display process during the withdrawal is the same as the display process in the first embodiment.

(Fifth Embodiment) Next, a fifth embodiment will be described.

Since the configuration of the fifth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the fifth embodiment.

In the fifth embodiment, the contents of the control processing performed by the portable information processing apparatus 01 are similar to those in the fourth embodiment.

FIG. 29 is a flowchart showing the procedure for displaying a drawer menu in the fifth embodiment. Also in this display processing, the number of withdrawal menus is increased from four to eight as in the fourth embodiment. FIG.
FIG. 10 is a diagram showing an additional pull-out menu displayed on the screen of the image display display 09. Hereinafter, the features of the fifth embodiment will be described along the steps of the flowchart shown in FIG. 29 with reference to FIG.

In the flowchart of FIG. 29, steps S701, S702, S703, and S704 correspond to those of FIG.
Steps S601, S602, 603, and S604 shown in FIG.
Since the contents are the same as those described above, their description is omitted. However, in steps S703 to S704, the drawer menu display trigger areas 11A to 11A
It is assumed that D is read as trigger areas a, b, c, and d, respectively. In the flowchart of FIG. 29, a process in which the a category detailed menu is displayed by selecting and operating the trigger area a will be particularly described.

In the step S705, the input device 05
When the coordinates of the trigger area a are detected by the contact of
As shown in a screen D82 in FIG. 30, a start button for starting the setting menu is displayed in a pop-up, and this portion is highlighted and a buzzer sound is generated. Here, if the input device 05 is turned off, the process returns to step S701.

In the state of the pop-up display, as shown in a screen D83 in FIG. 30, the input device 05 is slid slightly upward diagonally right to reach the start button area (S30).
706), when it is turned off, a menu display process related to the start button is executed, and a detailed setting menu as shown in a screen D84 in FIG. 30 is displayed (S707).

[0129] To close the detailed setting menu, the input device 05 near the "setting" character shown on the screen D84 in FIG.
Then, the input device 05 is moved to the trigger area a. A close button may be laid out somewhere on the screen D84 in FIG.

In the fifth embodiment, it is possible to divide the basic menu into a maximum of four categories and the other detailed setting menus into four categories.
Since the display of the detailed menu is premised on that the frequency of use is small and erroneous operations are unlikely to occur, it is desirable to keep the number of detailed menus at about two in terms of ease of use.

FIG. 31 is a diagram showing another display example of the increase pull-out menu displayed on the screen of the image display display 09.

In consideration of ease of use, even when the number of the detailed menus is limited to two, the position of the two detailed menus can be changed according to the dominant hand of the user in terms of where to display the two detailed menus. It is desirable. That is, the natural stroke direction for a right-handed person is lower left → upper right (screen D87 in FIG. 31), and the natural stroke direction for a left-handed person is upper left → lower right (screen D8 in FIG. 31).
It is necessary that the display position be changed in accordance with the principle of 8). For right-handed use, a display position such as screen D85 in FIG. 31 is assigned, and for left-handed use, display position D8 in FIG.
A display position such as 6 is assigned.

[0133] Compared to the operation method of simply selecting a soft button on the screen with an input device as in the conventional device, the operation in which the command is processed by sliding on the screen after selection is often used, and this dominant hand is considered. Menu display is realized.

(Sixth Embodiment) Next, a sixth embodiment will be described.

Since the configuration of the sixth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the sixth embodiment.

In the sixth embodiment, a plurality of drawer menus can be simultaneously displayed on the image display display 09. In other words, this is a method applicable when the screen size of the image display display 09 is large, and allows two, three, or four drawer menus to be displayed at the same time.

First, when two drawer menus are displayed at the same time, a relationship in a right angle direction (adjacent position) and a relationship in a parallel direction (face-to-face position) are distinguished according to the positional relationship between the two menus to be pulled out. There are four types of display patterns with two types of positional relation in the parallel direction. Further, the display method differs depending on the order in which the menu is drawn, and the display method of the previously displayed menu is affected by the menu drawn later.

In the following, for convenience of explanation, the maximum withdrawal amount will be described as half of the screen, but is not limited to this. Further, as shown in each of the above-described embodiments, the maximum withdrawal amount is set at an arbitrary position during the withdrawal. The display of the drawer menu may be held, or the maximum drawer amount may be extended to the entire screen depending on the specification.

FIG. 32 is a flowchart showing a procedure of a process for simultaneously displaying two to four drawer menus according to the sixth embodiment.

In step S801, one of the A to D classification menus is displayed.

Next, when one of the A to D classification menus except for the drawer menu displayed in step S801 is selected by the input device 05, as shown in step S802, the menu is displayed between the two drawer menus. Subsequent processing is divided according to the positional relationship.
That is, if the positional relationship between the two drawer menus is a relationship in the parallel direction (face-to-face position), step S803.
If the relationship is in the right angle direction (adjacent position), the process proceeds to step S805.

If the subsequently displayed drawer menu is continuously drawn, in step S803, the drawer menu displayed first is changed in the same axis direction while keeping the distance between both drawer menus constant. Display in double size. In step S804, the size of the subsequently displayed drawer menu is fixed when the size of the drawer menu becomes 1/4 of the screen.

In step S805, when the subsequently displayed drawer menu is continuously pulled out, the first displayed drawer menu is scaled down in the drawing direction of the later displayed drawer menu. Then, in step S806, the size of the subsequently displayed drawer menu is fixed when it becomes half the screen.

FIG. 33 and FIG. 34 are flowcharts showing specific procedures of the processing procedure shown in FIG. Also,
FIGS. 35 to 38 are diagrams showing two withdrawal menus displayed simultaneously on the screen of the image display display 09 according to the withdrawal amount. FIGS. 39 to 42 show the image display displays 09 with the withdrawal amount. FIG. 43 to FIG. 46 are diagrams illustrating four drawer menus displayed on the screen of the image display display 09 in accordance with the amount of withdrawal. . It should be noted that the numbers described on the respective drawer menus in FIGS. 35 to 46 are numbers indicating the order in which the drawers are drawn, and are not displayed as images. Hereinafter, FIG.
The description will be made along the steps shown in FIGS. 33 and 34 with reference to FIGS.

First, in step S901, it is assumed that the A category menu is first drawn and displayed.

Next, when any one of the B to D classification menus is selected by the input device 05 (S902), as shown in step S903, the subsequent processing is performed according to the positional relationship between the two drawer menus. Split.

If the D-classification menu (tool) is selected, it is in a parallel direction (face-to-face position), so the flow advances to step S904. If the D-classification menu (tool) is continuously pulled out, the D-classification menu (tool) is displayed. Classification menu (tool) while keeping the distance between the menu (tool) constant
Is scaled down in the X-axis direction. This is shown in screens D109 to D111 in FIG.

Next, at step S905, when one of the B and C classification menus is selected by the input device 05 as three drawer menus,
If the classification menu (tool) has been selected, the process proceeds to step S907, where the B classification menu (tool) is displayed according to the amount of withdrawal in the Y-axis direction, and at the same time, the A classification menu (tool) already displayed is displayed. D classification menu (tool) in the Y-axis direction, B classification menu (tool)
Is scaled down according to the amount of extraction in the Y-axis direction. This is shown in screens D125 to D127 in FIG.

If the C classification menu is selected by the input device 05 in step S905, the flow advances to step S908 to display the C classification menu (tool) according to the amount of withdrawal in the Y-axis direction. The already displayed A category menu (tool) and D category menu (tool) are scaled down and displayed in the Y-axis direction in accordance with the amount of pull-out of the C category menu (tool) in the Y-axis direction.

Next, in step S909, when the fourth classification menu is selected by the input device 05,
If it is a C classification menu (tool), step S
Proceeding to 910, a C classification menu (tool) is displayed according to the amount of withdrawal in the Y-axis direction. This is shown in screens D138 to D140 in FIG.

In step S909, if the fourth classification menu is selected by the input device 05 and it is a B classification menu (tool), the flow advances to step S911 to extract the Y-axis direction. B according to
Display the classification menu (tool).

Returning to step S902, if one of the B to D classification menus is selected by the input device 05 as the second withdrawal menu, the B, C classification menu (tool) is selected. If so, there is a right angle (adjacent position) relationship to the A classification menu (tool), so steps S912 and S913
Proceed to.

If the category B menu (tool) is selected, in step S912, the category B menu (tool) is displayed according to the amount of withdrawal in the Y-axis direction, and at the same time, the category A menu (tool) already displayed is displayed. ) To Y
In the axial direction, the image is scaled down according to the amount of pull-out in the Y-axis direction of the B classification menu (tool). This is shown in screens D101 to D103 in FIG.

If the C category menu (tool) has been selected, in step S913, the C category menu (tool) is displayed in accordance with the amount of withdrawal in the Y-axis direction, and at the same time, the already displayed A category menu is displayed. (Tool) is scaled down and displayed in the Y-axis direction according to the amount of pull-out in the Y-axis direction of the C classification menu (Tool).

Next, when three drawer menus are selected by the input device 05 in step S914, as shown in step S915, the subsequent processing is divided depending on the positional relationship with the second drawer menu. .

The second withdrawal menu is a B-classified menu (tool), and the third withdrawal menu is C
If it is a classification menu (tool) or the second drawer menu is a C classification menu (tool),
The third drawer menu is the B category menu (tool)
In the case of, the relationship is in the parallel direction (facing position),
Proceeding to step S916, if the C or B classification menu (tool) is continuously pulled out, the C or B classification menu (tool) is displayed according to the amount of withdrawal in the Y-axis direction, and at the same time, the already displayed B is displayed. Alternatively, the C class menu (tool) is displayed in the Y-axis direction, and scaled down according to the amount of pull-out of the C or B class menu (tool) in the Y-axis direction. The A-classification menu (tool) only moves the position and does not perform scaling. This is shown in screens D117 to D119 of FIG.

On the other hand, when the third withdrawal menu is a D-classified menu (tool), the third withdrawal menu is in a right angle direction (adjacent position) with respect to the second withdrawal menu.
Proceeding to step S917, if the D classification menu (tool) is continuously pulled out, the D classification menu (tool) is displayed according to the amount of withdrawal in the X-axis direction, and at the same time, the already displayed B or C classification menu is displayed. (Tool) is scaled down in the Y-axis direction. Then, the A category menu (tool) is scaled down and displayed according to the pull-out amount of the D category menu (tool) while maintaining a constant distance from the D category menu (tool). Only the position is moved in accordance with the amount of extraction in the X-axis direction, and no scaling is performed. This is shown in screens D121 to D123 in FIG.

Next, in step S918, when the fourth classification menu is selected by the input device 05,
If it is a D classification menu (tool), step S
Proceeding to 919, a D classification menu (tool) is displayed according to the amount of withdrawal in the X-axis direction.

In step S918, if the fourth classification menu is selected by the input device 05 and it is a B classification menu (tool), the flow advances to step S920 to extract the Y-axis direction. B according to
Display the classification menu (tool).

FIGS. 35 and 36 show a case where the relationship between the two drawer menus is a relationship in a right angle direction (adjacent position). The two drawer menus shown on the screens D100 to D103 in FIG. 35 and the two drawer menus shown on the screens D104 to D107 in FIG. , The way they are displayed is different. There is a priority on the display of a menu drawn later, and a menu drawn later displays the menu as usual, and accordingly, the display of the menu drawn first is affected. That is, as shown in a screen D101 in FIG. 35, in a state where the A classification menu has already been drawn,
As shown in screen D102, when a B-class menu having a right angle positional relationship is drawn, the Y-axis direction of the A-class menu is scaled down and displayed according to the amount by which the B-class menu is drawn, and shown in screen D103. As described above, the B classification menu is fixed at the position of the maximum withdrawal amount (half of the screen).

[0161] In the display contents in the A classification menu, only the shape is simply reduced, but the display contents themselves may be changed. For example, the type of information is changed according to the display area, such as displaying icons and characters in the A category menu on the screen D101 and displaying only icons in the A category menu on the screen D103. You may do so.

In FIG. 36, when the B-class menu is already drawn and the A-class menu having a right angle positional relationship is drawn out as shown in screen D104, the B-class menu is drawn as shown in screen D106. Menu
The A-class menu is displayed in a reduced size in accordance with the withdrawal amount in the X-axis direction, and as shown in a screen D107, the drawer of the A-class menu is fixed at the position of the maximum withdrawal amount (half of the screen).

FIGS. 37 and 38 show the case where the relationship between the two drawer menus is in the parallel direction (face-to-face position).

As shown in the screen D108 of FIG. 37, if the D-type menu having a parallel positional relationship is to be pulled out while the A-class menu is displayed, the screen D11 is displayed.
As shown at 0 and D111, the A-class menu is scaled down in accordance with the amount of pull-out of the D-class menu, while keeping the distance between the two menus constant. As a result, the display area of the image to be displayed is always secured by a certain amount, and the drawer menu and the originally displayed image are always displayed simultaneously.

FIG. 38 shows a case where two drawer menus are located at the upper and lower positions, and the processing is performed in the same manner as in FIG. 37.

FIGS. 39 and 40 show a case where three drawer menus are displayed at the same time when the second drawer menu is in a perpendicular direction (adjacent position) to the first drawer menu. . FIG.
The case where the second drawer menu is in a parallel direction (face-to-face position) relationship with the second drawer menu,
FIG. 40 shows a case where the third withdrawal menu is in a right angle direction (adjacent position) with the second withdrawal menu.

In FIG. 39, as shown in screens D117 to D119, the A classification menu is displayed in a reduced size in the Y-axis direction. Display the classification menu in a reduced size. The distance between the B class menu and the C class menu always keeps a constant value.

In FIG. 40, as shown in screens D121 to D123, the D-classification menu is pulled out, and at the same time, the A-classification menu and the B-classification menu are reduced in the X-axis direction.
The distance in the X-axis direction between the D classification menu and the A classification menu always keeps a constant value.

FIGS. 41 and 42 show a case where three drawer menus are displayed at the same time when the second drawer menu is in a parallel direction (face-to-face position) relationship with the first drawer menu. . FIG.
FIG. 40 shows a case where the third withdrawal menu is the B classification menu, and FIG. 40 shows a case where the third withdrawal menu is the A classification menu.

In FIG. 41, as shown in screens D125 to D127, along with the extraction of the B classification menu, both the A classification menu and the D classification menu already displayed are simultaneously reduced in the Y-axis direction.

In FIG. 42, as shown in screens D129 to D131, as the A-class menu is pulled out, both the B-class menu and the C-class menu which are already displayed are simultaneously reduced in the X-axis direction.

FIGS. 43 to 46 show a case where four drawer menus are displayed simultaneously.

FIG. 43 shows a case where the remaining D-classification menu is drawn as a continuation of the state shown in screen D119 of FIG.

FIG. 44 shows a case where the remaining C category menu is pulled out as a continuation of the state shown on the screen D123 in FIG.

FIG. 45 shows a case where the remaining C category menu is drawn as a continuation of the state shown on the screen D127 of FIG.

FIG. 46 shows a case where the remaining D classification menu is drawn as a continuation of the state shown on the screen D131 in FIG.

[0177] When closing any of the drawer menus in any of the drawer menu displays,
Regardless of the order in which the menus are pulled out, the coordinates in the corresponding drawer menu are selected by the input device 05 and are dragged as they are to the position direction before the pull-out of each menu.

(Seventh Embodiment) Next, a seventh embodiment will be described.

Since the configuration of the seventh embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the seventh embodiment.

In the seventh embodiment, the shape of the main image to be originally displayed is distorted according to the amount of withdrawal of the withdrawal menu.

FIG. 47 is a flow chart showing the processing procedure related to the display of the drawer menu and the deformation of the shape of the main image accompanying the display of the drawer menu in the seventh embodiment. FIG. 48 is a diagram showing a screen displayed on the image display display 09 in the process of displaying the drawer menu. FIG. 48 mainly shows an example in which the B classification menu is displayed. Hereinafter, description will be made along the steps shown in FIG. 47 with reference to FIG. 48 as appropriate.

The main image A shown in FIG. 48 is, for example, a photograph image, a sentence, or a mixture of a photograph and a sentence. Playback images already stored in the built-in memory, or in the camera
A case of a viewfinder image captured by the camera is also assumed.

In the flowchart of FIG. 47, step S
1001, S1002, S1003, S1004, S1
005, S1006, S1009, and S1010 correspond to FIG.
0, steps S101, S102, S103, S1
04, S105, S106, S112, and S113 have the same contents, respectively, and thus description thereof will be omitted.

Drawer menu display trigger area 11
When B is selected and the detection value (drawing amount) y of the Y-axis coordinate is continuously changed thereafter, in step S1011 a B classification menu is displayed according to the drawing amount y, and the entire screen in the Y-axis direction is displayed. Value for size Y (Y-
The main image A is scaled down in the Y-axis direction and displayed at the ratio y) (screens D154 and D155 in FIG. 48). If the input device 05 is turned off during this time, the withdrawal amount y
Is smaller than the predetermined definition amount, the screen D1 in FIG.
Returning from the state of FIG. 54 to the state of the screen D150, if the withdrawal amount y is larger than the predetermined defined amount, the screen D of FIG.
155 is maintained (screen D157 in FIG. 48).

If the withdrawal amount y further increases, in step S1012, the B-classification menu is fixed at the maximum withdrawal amount (half the screen size in the Y-axis direction), and the main image A is also set to 1 in the Y-axis direction. The size is held at the size reduced / magnified to / 2 (screen D156 in FIG. 48). In this case, when the input device 05 is turned off, the state of the screen D156 of FIG. 48 is maintained (the screen D156 of FIG. 48).
158).

In the above description, the case of displaying the B classification menu is taken as an example, but the same applies to the case of displaying the C classification menu.

Next, the drawer menu display trigger areas 11A and 11D are selected, and thereafter, when the detection value (drawer amount) x of the X-axis coordinate is continuously changed, step S10 is performed.
At 07, the A and D classification menus are displayed according to the withdrawal amount x, and the main image A is scaled down and scaled in the X-axis direction by the ratio of the value (Xx) to the entire screen size X in the X-axis direction. To display. When the input device 05 is turned off during this time, if the withdrawal amount x is smaller than the predetermined definition amount, the screen returns to the state of the screen displaying only the main image A, and the withdrawal amount y is smaller than the predetermined definition amount. If big
The state of the screen at that time is maintained.

If the withdrawal amount x further increases, in step S1008, the A, D classification menu is fixed at the maximum withdrawal amount (half the screen size in the X-axis direction), and the main image A is also in the X-axis direction. Is held at a size reduced to 1/2. In this case, when the input device 05 is turned off, the state of the screen at that time is maintained.

FIG. 49 is a flowchart showing a processing procedure for closing the displayed drawer menu, and FIG. 50 is a display screen in the process of closing the drawer menu (particularly, the case where the B classification menu is selected). FIG. Hereinafter, description will be made along the steps shown in FIG. 49 with reference to FIG. 50 as appropriate.

First, in step S1101, a drawer menu is displayed as shown in a screen D160 in FIG.
It is assumed that the main image A is deformed in accordance with the withdrawal amount of the displayed withdrawal menu. When the input device 05 contacts the touch panel sensor 11 of the image display display 09 in this state, the coordinate value is detected (S11).
02). It is determined whether or not the detected coordinate value is a value in the drawer menu display trigger area (S11).
03), if the value is within the drawer menu display trigger area, the process proceeds to step S1104; otherwise, the process proceeds to step S1109. Step S1
When the determination of 103 is affirmative (YES), the input input device 05 is displayed on the image display display 09 from the state of the screen D163 directly from the state of the screen D160 of FIG. 50 and from the state of the screen D161 of FIG. There is a case where the screen D163 is brought into the state of the screen D163 by sliding the touch panel sensor 11 without releasing it from the touch panel sensor 11.

In the step S1109, the screen D shown in FIG.
As shown at 162, when any of the function buttons in the drawer menu is selected by the input device 05 (S1109), the function corresponding to that button is executed (S1110), and the processing result is reflected on the main image A. Is done. In this state, if the input device 0504 is slid in the direction of the arrow as shown in a screen D164 of FIG. 50, it is ignored. If the input device 05 is turned off in this state, the process returns to step S1103.

In step S1104, it is determined which of the pull-out menu display trigger areas 11A to 11D includes the detected coordinate value. If it is included in the drawer menu display trigger areas 11A and D, step S
1105, drawer menu display trigger area 11
If it is included in B and C, the process proceeds to step S1111.

In step S1111, the selected drawer menu display trigger area is highlighted, and a buzzer sounds at the same time to indicate that it has been selected. In this state, when the input device 05 is turned off,
It returns to step S1103. Then, step S111
In step 2, only the Y coordinate value of the detected coordinate values is monitored, and the X coordinate value is ignored. Again, input device 05 is off
Then, the process returns to step S1103.

Next, in step S1113, the withdrawal amount y
, The main image A is scaled down and displayed in the Y-axis direction at the ratio of the value (Y-y) to the entire screen size Y in the Y-axis direction (screen D165 in FIG. 50). , D167). If the input device 05 is turned off during this time, if the withdrawal amount y is larger than the predetermined defined amount, the state of the screen D165 in FIG. 50 is maintained (screen D166 in FIG. 50), and the withdrawal amount y becomes the predetermined amount. If it is smaller than the defined amount, the state shifts from the state of the screen D167 in FIG. 50 to the state of the screen D168 in which the main image A is displayed on the full screen.

Further, the withdrawal amount y is reduced, as shown in FIG.
When the state of the screen D169 is reached, the screen shifts to the state of the screen D170 in which the main image A is displayed on the full screen (S1114). Of course,
Even if the input device 05 is turned off, the state shifts to the state of the screen D170.

On the other hand, if it is determined in step S1104 that the detected coordinate value is included in the drawer menu display trigger areas 11A and D, in step S1105, the selected drawer menu display trigger area is highlighted and simultaneously displayed. A buzzer sounds to indicate the selection. In this state, the input device 05 is turned off.
Then, the process returns to step S1103. In step S1106, only the X coordinate value of the detected coordinate values is monitored, and the Y coordinate value is ignored. Again, input device 0
When 5 is turned off, the process returns to step S1103.

Next, in step S1107, the withdrawal amount x
, The main image A is scaled down and displayed in the X-axis direction at the ratio of the value (X−x) to the entire screen size X in the X-axis direction. If the input device 05 is turned off during this time, the withdrawal amount x
Is larger than the predetermined definition amount, the display state is maintained, and if the withdrawal amount x is smaller than the predetermined definition amount, the screen shifts to a screen state where the main image A is displayed on the full screen.

Further, when the withdrawal amount x decreases to 0, the screen shifts to a screen state where the main image A is displayed on the full screen (S1).
108). Of course, even if the input device 05 is turned off,
The screen shifts to the state of the screen where the main image A is displayed on the full screen.

Note that the method of deformed and reduced display of the image A differs depending on which of the four drawer menus is to be drawn. This will be described with reference to FIG.

FIG. 51 is a diagram showing a screen of the image display display 09 for explaining the relationship between the storage position of the drawer menu and the main image A.

For example, on the screen D184 of FIG. 51 in which the drawer menu display trigger area 11B is selected by the input device 05 and the B classification menu is drawn, the list of the colors of the characters to be written into the main image A by the input device 05 is displayed in the B classification. The menu is laid out like a color palette.
In the state of the screen D184, a character can be written in the main image A by selecting a color while the drawer menu is pulled out, and writing can be continued as it is while changing the color on the way. In this case, when you close the drawer menu,
The characters may be displayed on the main image A at the ratio at which they were written, or the characters may be scaled vertically at the same ratio as the main image A returns to the original ratio. You may make it.

Furthermore, screens D182, D184, D18
In 6, D188, when the main image A is desired to be displayed at the original aspect ratio, the original image A may be restored to the original state by dragging a corner of the scaled main image A. As a result, for example, when this operation is performed in the state of the screen D184,
A screen D193 shown in FIG. 53 to be described later is obtained.

[0203] The seventh embodiment may be applied to the sixth embodiment.

(Eighth Embodiment) An eighth embodiment will now be described.

Since the configuration of the eighth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the eighth embodiment.

In the eighth embodiment, even when the drawer menu is pulled out, the aspect ratio of the main image to be displayed is kept constant.

FIG. 52 is a flow chart showing the procedure of the main image display process accompanying the display of the withdrawal menu in the eighth embodiment. FIG. 53 shows an image display 0 in the process of displaying a drawer menu.
FIG. 9 is a diagram showing a screen displayed on the screen 9. FIG. 53 exemplifies a case where the B classification menu is displayed. Hereinafter, FIG.
3 will be described along with the steps shown in FIG. 52 as appropriate.

The main image A shown in FIG. 48 is, for example, a photograph image, a sentence, or a mixture of a photograph and a sentence. Playback images already stored in the built-in memory, or in the camera
A case of a viewfinder image captured by the camera is also assumed.

In the flowchart shown in FIG.
1201, S1202, S1203, S1204, S1
205, S1206, S1209, and S1210 correspond to FIG.
0, steps S101, S102, S103, S1
04, S105, S106, S112, and S113 have the same contents, respectively, and thus description thereof will be omitted.

Drawer menu display trigger area 11
When B is selected and the detection value (drawing amount) y of the Y-axis coordinate is continuously changed thereafter, in step S1211, a B classification menu is displayed according to the drawing amount y, and the aspect ratio of the main image A is displayed. Are displayed in a scaled manner while maintaining the image size (screens D191 and D192 in FIG. 53). If the input device 05 is turned off during this time, the state of the screen at that time is maintained.

If the withdrawal amount y further increases, in step S1212, the B-classification menu is fixed at the maximum withdrawal amount (half the screen size in the Y-axis direction), and the main image A is also in the X-axis direction, Y 1/2 axially
(The screen D in FIG. 53).
193). In this case, the input device 05 is turned off.
Then, the state of the screen D193 in FIG. 53 is maintained.

The above description has been made on the example of displaying the B classification menu, but the same applies to the case of displaying the C classification menu.

Next, the drawer menu display trigger areas 11A and 11D are selected, and thereafter, when the detection value (drawer amount) x of the X-axis coordinate is continuously changed, step S12 is performed.
At 07, the A and D classification menus are displayed according to the withdrawal amount x, and the main image A is displayed while being reduced in magnification while maintaining the aspect ratio. If the input device 05 is turned off during this time, the state of the screen at that time is maintained.

If the withdrawal amount x further increases, in step S1208, the A and D classification menus are fixed at the maximum withdrawal amount (half the screen size in the X-axis direction), and the main image A is also in the X-axis direction. , 1 in both Y-axis direction
/ 2. In this case, when the input device 05 is turned off, the main image A is also held at a size reduced to 1/2 in both the X-axis direction and the Y-axis direction.

Note that the eighth embodiment may be combined with the other embodiments so that the user can arbitrarily select one of the methods by operating the operation setting and operating means while pressing one of the buttons. .

Further, the main image A as shown in FIG. 54 may be displayed.

FIG. 54 is a diagram showing a screen displayed on the image display display 09 for explaining a display method different from the display method of the main image A shown in FIG.

That is, on the screens D195 to D197 of the image display display 09, the shape of the main image A and the vertical / horizontal display ratio are not changed at all, and the drawer menu is displayed over the main image A. This display method of the main image A has a disadvantage that a part of the main image A is missing, but this display method is effective when a CPU capable of performing arithmetic processing at a very high speed is not mounted. .

Note that, in this display method, the input device 0
While the touch panel 5 is in contact with the touch panel sensor 11, the drawer menu overlaps the main image A. On the other hand, when the input device 05 is turned off, the main image A is reduced and displayed in the drawer direction of the drawer menu. For example, screen D195
When the button is turned OFF in the state described above, the screen is switched to the screen D198 after a required processing time has elapsed. Further, when the power is turned off in the state of the screen D196, after a required processing time has passed, the screen D19 is turned off.
Switch to 9. Furthermore, it is OFF in the state of the screen D197.
In this case, the screen is switched to the screen D200 after a required processing time has elapsed.

(Ninth Embodiment) Next, a ninth embodiment will be described.

Since the configuration of the ninth embodiment is basically the same as the configuration of the first embodiment, the configuration of the first embodiment will be used in the description of the ninth embodiment.

In the ninth embodiment, as a display method of the drawer menu, a display method of “partial help in the drawer menu” is adopted.

FIGS. 55 and 56 are flowcharts showing the procedure of the display processing of the drawer menu in the ninth embodiment. FIG. 57 is a diagram illustrating a drawer menu according to the ninth embodiment displayed on the image display display 09, and particularly illustrates an A classification menu. FIG.
It is a figure showing the B-D classification menu displayed on image display display 09 in a 9th embodiment. 55 and 56 will be described below with reference to FIGS.
Explanation will be given along the steps shown in FIG.

In each of the above embodiments, the function items described in each drawer cannot be grasped until the drawer menu is displayed. Have to be remembered in advance. In order to avoid such inconvenience, in the ninth embodiment, an auxiliary function for managing the drawer menu without hesitation is added to the drawer menu display processing of the first embodiment.

That is, in a personal computer or the like, generally, simply placing a pointing device such as a mouse on an icon corresponding to a function displays a speech balloon that briefly describes in text what kind of function the icon corresponds to. . However, in the present embodiment, instead of a balloon explaining such a function, in the same expression as when the drawer menu is displayed, a part of the drawer menu is cut out and displayed as “partial cut-out menu helper”, Make it easy to see the contents of the drawer menu.

The process shown in FIG. 55 is a process added to the drawer menu display process of the first embodiment as described above, and step S1301 in FIG.
The same processing as in step S103 is performed.

Next, in step S1302, it is determined whether or not the execution of the function of "partial help in drawer menu" has been set in advance. If it is not set, the process proceeds to step S104 and subsequent steps in FIG.

On the other hand, if the execution of the function of “partial help in drawer menu” is set in advance,
Proceeding to step S1303, it is determined whether the detected coordinate value is included in any of the pull-out menu display trigger areas 11A to 11D. If it is included in the pull-out menu display trigger areas 11A and 11D, step S130 is performed.
To 5, drawer menu display trigger area 11B, 1
If it is included in 1C, the process proceeds to step S1311.

In step S1305, the Y coordinate value of the position where the input device 05 is in contact with the drawer menu display trigger areas 11A and 11D is detected, and the function item having the Y coordinate value closest to the Y coordinate value is displayed. You. Drawer menu display trigger area 1
A screen D202 in FIG. 57 is shown by taking a case where 1A is touched by the input device 05 as an example. From this state,
When the input device 05 is slid up and down along the exterior frame on the drawer menu display trigger area 11A, screens D203 to D205 in FIG. 57 are obtained. In this way, the contents can be confirmed without displaying all the drawer menus, and if the desired function item is not found, the user can search other drawer menus in the same manner. The screen D202 in FIG.
An image forming a part of the drawer menu displayed in D205 is referred to as “cutout help”.

When the desired function item is found and the input device 05 is turned off, it is determined in step S1306 whether or not a predetermined time (2 to 3 seconds) has elapsed since the input device 05 was turned off. If the predetermined time has not elapsed, the process proceeds to step S1307, and the input device 05 selects a function item (icon) in the cut-out help before the predetermined time has elapsed. Thus, in step S1308, the display of the extracted help is stopped, and the function corresponding to the selected function item (icon) is executed.

If it is determined in step S1306 that the predetermined time has elapsed, step S13
In step 09, the display of the cut-out help is stopped.

On the other hand, in step S1311, the X coordinate value of the position where the input device 05 is in contact with the drawer menu display trigger areas 11B and 11C is detected, and the function item having the X coordinate value closest to the X coordinate value is determined. Is displayed.

When the desired function item is found and the input device 05 is turned off, it is determined in step S1312 whether a predetermined time (2 to 3 seconds) has elapsed after the input device 05 has been turned off. If the predetermined time has not elapsed, the process advances to step S1313, and the input device 05 selects a function item (icon) in the extracted help before the predetermined time has elapsed. Thus, in step S1314, the display of the cut-out help is stopped, and the function corresponding to the selected function item (icon) is executed.

If it is determined in step S1312 that the predetermined time has elapsed, the process proceeds to step S1312.
Proceeding to 15, the display of the cut-out help is stopped.

FIG. 58 shows a cut-out help when the drawer menu display trigger areas 11B, 11C and 11D are touched by the input device 05. It should be noted that illustrations of icons and the like in the cut-out help are omitted. The arrow indicates the sliding direction of the input device 05.

Further, another embodiment based on the ninth embodiment will be described with reference to FIG. That is,
The following shows another display example of the withdrawal help in the case where the withdrawal help shown in the ninth embodiment cannot be displayed as described above due to some restrictions.

FIG. 59 is a diagram showing each drawer menu in another embodiment based on the ninth embodiment. All of the screens D211 to D215 on the image display display 09 shown here are display examples when coordinates are designated in the drawer menu display trigger area 11A.

On the screen D211, the display area of the drawer help is secured a little larger. This makes it easy to see the contents of the drawer help.

On the screen D212, similar to the third embodiment described with reference to FIG. 26, the ninth embodiment also shows clipping help assumed when the maximum withdrawal amount is extended.

On the screen D213, all the function items in the drawer menu are displayed in the drawer help without sliding the input device 05 in the drawer menu display trigger area.

On the screen D214, in the drawer help,
Only the character description of the name of the function item is performed. by this,
A reduction in the display area of the main image A is minimized.

On screen D215, scroll buttons are laid out in the drawer help in a software manner, assuming that it is not possible to slide input device 05 in the drawer menu display trigger area.

(Other Embodiments) The embodiments described above may be appropriately combined.

Further, in each of the above embodiments, the portable information processing apparatus 01 has been described as a portable information terminal having a notebook-size, but the present invention is not limited to this. Although there are differences in the operation method, the present invention is applicable to a large-screen image display having another pointing device as an operation means, an eyepiece type viewfinder, and the like.

Also, the present invention relates to a still camera, a video camera, a notebook computer, a head-mounted display,
The present invention is also applicable to a device having an image display screen such as a car navigation system.

The present invention is also applicable to stationary personal computers and workstations. For example, in the case of a personal computer, the mouse is slid in any direction, up, down, left and right, and when the cursor reaches an edge on the screen, a bar for pulling out a drawer menu is displayed at the display position. The present invention can be applied by adopting an operation method of dragging the mouse from the state to the center. In this case, there is an advantage that the list of the function items can be quickly displayed, and the user can arbitrarily adjust the amount of the display area.

In a device equipped with a so-called cross key in which mechanical switches are laid out in the shape of a cross in the up, down, left, and right directions, pressing one of the up, down, left, and right selects one of the drawer menus, and When the user releases the finger, the operation method of performing fixed display in a state where the drawer menu is pulled out is also used, and the case where the user operates using the input device 05 and the case where the user operates using the cross key are You may make it use properly according to a use situation.

In each of the above-described embodiments, the drawer menu can be stopped at an arbitrary drawer position in the middle of the drawer, but instead, a drawer position that can be stopped in advance is provided at a plurality of positions. It may be limited to. Thereby, the display processing speed of the drawer menu can be further increased.

Further, a storage medium storing a program code of software for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and the computer (or CPU or MPU) of the system or the apparatus is supplied.
It is needless to say that the present invention can also be achieved by reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. .

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also an OS running on the computer based on the instructions of the program code. Performs some or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
Needless to say, this is included in the present invention.

Further, after the program code read from the storage medium is written into the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It is needless to say that the present invention includes a case where the CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments. No.

[0254]

As described above in detail, according to the present invention, there is provided an image display section surrounded by a frame forming a step, and coordinate designation means for designating a coordinate position on the screen in the image display section. In the information processing apparatus, a plurality of predetermined regions on the image display unit provided near the frame, and a plurality of each including a plurality of function items set respectively corresponding to the plurality of predetermined regions A function list is prepared in advance, and any one of the plurality of predetermined areas is designated by the coordinate designation means, and the coordinate designation is continued by the coordinate designation means. When the position changes substantially in the center direction of the image display unit, a function list corresponding to the predetermined area whose coordinates are specified is displayed on the image display unit according to the change amount of the specified coordinates.

As a result, the function list is not normally displayed on the image display unit, but the function list can be drawn out only by a necessary amount and drawn out only when necessary.
By simply specifying the coordinates of a plurality of predetermined areas on the image display unit provided near the frame by the coordinate specifying means, a corresponding function list can be displayed. Therefore, a large screen of the image display unit can be secured as a display area of the main image, operability is improved, and the device can be downsized.

Further, when it is not necessary to display a menu, it is possible to display a reproduced image in almost the entire display area of the image display display 09, so that it is possible to concentrate on viewing without displaying any unnecessary information. However, when it is desired to display one menu and perform some processing, the menu can be quickly displayed even with a rough operation, and an arbitrary display amount can be adjusted.

[Brief description of the drawings]

FIG. 1 is a front view showing a configuration of a first embodiment of a portable information processing apparatus according to the present invention.

FIG. 2 is a top view of the portable information processing device shown in FIG.

FIG. 3 is a rear view of the portable information processing device shown in FIG. 1;

FIG. 4 is a diagram illustrating a portable information processing apparatus A-
It is A 'cross-sectional view.

FIG. 5 is a diagram showing a configuration of a touch panel sensor.

FIG. 6 is a diagram showing a drawer menu displayed on the image display.

FIG. 7 is a diagram showing a screen of an image display display on which a B classification menu is displayed as a drawer menu.

FIG. 8 is a block diagram illustrating a system configuration of the portable information processing apparatus.

FIG. 9 is a flowchart illustrating an outline of an overall operation procedure in the portable information processing apparatus.

FIG. 10 is a flowchart (1/2) showing a processing procedure when displaying a drawer menu.

FIG. 11 is a flowchart (2/2) showing a processing procedure when a drawer menu is displayed.

FIG. 12 is a diagram illustrating a display screen in a process of displaying a drawer menu (particularly, a screen when a B-class menu is selected and displayed).

FIG. 13 is a flowchart (1/2) showing a processing procedure for closing a displayed drawer menu.

FIG. 14 is a flowchart (2/2) showing a processing procedure for closing a displayed drawer menu.

FIG. 15 is a diagram showing a display screen (especially, a screen in a case where the B classification menu has been selected) in the process of closing the drawer menu.

FIG. 16 is a flowchart illustrating a procedure of a process of determining the size of the withdrawal menu according to the withdrawal amount.

FIG. 17 is a diagram showing a screen of an A classification menu displayed according to the withdrawal amount.

FIG. 18 is a diagram illustrating a screen of a B classification menu displayed according to a withdrawal amount.

FIG. 19 is a diagram showing a screen of an image display for explaining a relationship between a drawer menu display trigger area and a drawn A to D classification menu.

FIG. 20 is a flowchart illustrating a procedure of display processing of a drawer menu according to the second embodiment.

FIG. 21 is a diagram showing ranges a, b, and c on a screen of an image display.

FIG. 22 is a diagram showing a screen of an A classification menu displayed according to the amount of withdrawal.

FIG. 23 is a diagram illustrating a screen of a B classification menu displayed according to a withdrawal amount.

FIG. 24 is a diagram showing a screen of a C classification menu displayed according to the amount of withdrawal.

FIG. 25 is a flowchart illustrating a procedure of a drawer menu display process according to the third embodiment.

FIG. 26 is a diagram illustrating a screen of an A-classification menu displayed on the screen of the image display according to the withdrawal amount.

FIG. 27 is a flowchart illustrating a procedure of display processing of a drawer menu according to the fourth embodiment.

FIG. 28 is a diagram showing an increased withdrawal menu displayed on the screen of the image display.

FIG. 29 is a flowchart illustrating a procedure of display processing of a drawer menu according to the fifth embodiment.

FIG. 30 is a diagram showing an increased withdrawal menu displayed on the screen of the image display.

FIG. 31 is a diagram showing another display example of the increase pull-out menu displayed on the screen of the image display.

FIG. 32 is a flowchart illustrating a procedure of processing for simultaneously displaying two to four drawer menus according to the sixth embodiment.

FIG. 33 is a flowchart (1/2) showing a specific procedure of the processing procedure shown in FIG. 32;

FIG. 34 is a flowchart (2/2) showing a specific procedure of the processing procedure shown in FIG. 32;

FIG. 35 is a first diagram showing two withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount.

FIG. 36 is a second diagram showing two withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount.

FIG. 37 is a third diagram showing two withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount;

FIG. 38 is a fourth diagram illustrating two withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount;

FIG. 39 is a first diagram showing three withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount.

FIG. 40 is a second diagram showing three withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount.

FIG. 41 is a third diagram showing three withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount;

FIG. 42 is a fourth diagram illustrating three withdrawal menus displayed simultaneously on the screen of the image display according to the withdrawal amount;

FIG. 43 is a first diagram illustrating four drawer menus displayed on the screen of the image display according to the amount of drawer;
FIG.

FIG. 44 is a second drawing showing four drawer menus displayed on the screen of the image display according to the drawer amount.
FIG.

FIG. 45 is a third diagram illustrating four drawer menus displayed on the screen of the image display according to the amount of withdrawal;
FIG.

FIG. 46 is a fourth drawing showing four withdrawal menus displayed on the screen of the image display according to the withdrawal amount;
FIG.

FIG. 47 is a flowchart showing processing procedures relating to display of a drawer menu and deformation of the shape of a main image accompanying display of the drawer menu in the seventh embodiment.

FIG. 48 is a diagram showing a screen displayed on the image display in a process of displaying a drawer menu.

FIG. 49 is a flowchart showing a processing procedure for closing a displayed drawer menu.

FIG. 50 is a diagram showing a display screen in the process of closing the drawer menu (especially, a screen when the B-class menu is selected).

FIG. 51 is a diagram illustrating a screen of an image display for explaining a relationship between a storage position of a drawer menu and a main image A.

FIG. 52 is a flowchart showing a procedure of a main image display process accompanying the display of a drawer menu in the eighth embodiment.

FIG. 53 is a diagram showing a screen displayed on the image display in the process of displaying the drawer menu.

FIG. 54 is a diagram showing a screen displayed on the image display for explaining a display method different from the display method of the main image A shown in FIG. 53;

FIG. 55 is a flowchart (1/2) showing a procedure of a display process of a drawer menu in the ninth embodiment.

FIG. 56 is a flowchart (2/2) showing a procedure of a display process of a drawer menu in the ninth embodiment.

FIG. 57 is a diagram illustrating a withdrawal menu displayed on the image display according to the ninth embodiment.

FIG. 58 is a diagram showing BD classification menus displayed on the image display according to the ninth embodiment;

FIG. 59 is a diagram showing each withdrawal menu in another embodiment based on the ninth embodiment.

[Explanation of symbols]

01 Portable information processing device (information processing device) 04 Exterior cover member (frame) 05 Input device (coordinate specifying means) 06 Microphone 07 Camera unit 08 Shutter switch 09 Image display (image display) 10 Speaker 11 Touch panel sensor ( 11A to 11D Menu display trigger area (predetermined area) 11E Image display area 11b Pull-out menu (function list) 21 CPU (display means) 22 CCD 23 RAM 24 Flash memory 25 ROM

Continuing on the front page (72) Inventor Hideki Narushima 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Shinichi Matsumoto 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Mamoru Ozawa 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Yoshiyuki Endo 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. (72) Inventor Kiyoshi Iwabuchi 3-30-2 Shimomaruko, Ota-ku, Tokyo F-term within Canon Inc. (reference) 5E501 AA02 BA05 CA02 CB05 CB11 EA07 EA17 EB05 FA05 FA23 FB03 FB04 FB22 FB43

Claims (37)

[Claims] 1. An information processing apparatus comprising: an image display section surrounded by a frame forming a step; and coordinate specifying means for specifying a coordinate position on a screen of the image display section. A plurality of predetermined areas on the image display unit provided; a plurality of function lists each including a plurality of function items, which are set corresponding to the plurality of predetermined areas, respectively; Any one of the plurality of predetermined areas is designated by coordinates, and subsequently the coordinates designation is continued by the coordinate designation means, and when the designated coordinates change substantially toward the center of the image display unit, the coordinates are designated. And a display unit for displaying a function list corresponding to the predetermined area on the image display unit according to a change amount of the designated coordinates. 2. The image processing apparatus according to claim 2, wherein the coordinate designating unit includes a contact that contacts a screen of the image display unit, and the plurality of predetermined regions are formed by moving the contact on the screen of the image display unit. 2. The information processing apparatus according to claim 1, wherein the contact includes a region where the contact is located on a screen of the image display unit when the contact comes into contact with the information display. 3. The information processing apparatus according to claim 2, wherein the frame has a quadrangular shape, and the plurality of predetermined regions are located near four sides of the frame. 4. The information processing apparatus according to claim 2, wherein the frame has a quadrangular shape, and the plurality of predetermined regions are located near four corners of the frame. 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a portable information processing terminal. 6. A plurality of function items representing a plurality of information processing functions of the information processing apparatus are classified in advance according to a predetermined classification criterion to form a plurality of groups, and each group includes the plurality of function lists. The information processing apparatus according to claim 1, wherein the information processing apparatus corresponds to each of the tables. 7. The information processing apparatus according to claim 6, wherein the classification criterion is a frequency of use of a function. 8. The display means extracts a change amount component in a predetermined direction from the change amount of the designated coordinate, and corresponds to the coordinate-designated predetermined area by an extraction amount corresponding to the extracted change amount component. The information processing apparatus according to any one of claims 1 to 7, wherein an image of a function list to be performed is drawn in the predetermined direction and displayed on the image display unit. 9. When the coordinate designation by the coordinate designation means is released, if the extracted change amount component is larger than a predetermined value, the display means draws out the function list by the drawout amount only. The information processing apparatus according to claim 8, wherein the display is maintained. 10. The display means, when the coordinate designation by the coordinate designation means is released, if the extracted change amount component is equal to or less than the predetermined value, stop displaying the function list. The information processing apparatus according to claim 8 or 9, wherein: 11. The display unit according to claim 1, wherein all of the function items constituting the function list in the function list corresponding to the predetermined area designated by the coordinates are reduced and scaled in the vertical and horizontal directions in accordance with the change amount of the designated coordinates. The information processing apparatus according to claim 1, wherein the information is displayed on the image display unit. 12. The image display apparatus according to claim 1, wherein the display unit displays all the function items constituting the function list in the function list corresponding to the predetermined area designated by the coordinates in the image display at any change amount of the designated coordinates. The information processing apparatus according to any one of claims 1 to 10, wherein the information is reduced and displayed on a unit. 13. In each of the plurality of function lists, a display priority is set in advance for a plurality of function items constituting the function list, and the display means includes: 2. The function list having a higher priority in the function list is displayed on the image display section with priority.
The information processing apparatus according to claim 10. 14. The display means according to claim 1, wherein the function list corresponding to the coordinate-designated predetermined area is a group of function items that do not require display of the main image. The information processing apparatus according to claim 1, wherein the information is displayed over the entire screen of the image display unit. 15. A function list corresponding to the predetermined area designated by the coordinates, wherein the display means selects the predetermined one designated by the coordinates designation means from among a plurality of function items constituting the function list. The information processing apparatus according to any one of claims 1 to 10, wherein a function item corresponding to the coordinates in the area is selected and displayed on the image display unit. 16. An image display section surrounded by a frame forming a step, coordinate specifying means for specifying a coordinate position on the screen in the image display section, and the image display section provided near the frame. A function list display applied to an information processing apparatus including a plurality of predetermined areas above and a plurality of function lists each including a plurality of function items set respectively corresponding to the plurality of predetermined areas. In the method, any one of the plurality of predetermined areas is designated by the coordinate designating unit, and subsequently, the coordinate designation is continued by the coordinate designating unit, and the designated coordinate is set to substantially the center of the image display unit. Detecting a change in the designated coordinates, and when the change in the designated coordinates is detected by the detecting step, the function list corresponding to the predetermined area designated by the coordinates is stored in the designated seat. Function list display method; and a display step of displaying on the image display unit according to the amount of change. 17. A plurality of function items representing a plurality of information processing functions of the information processing apparatus are classified in advance according to a predetermined classification criterion to form a plurality of groups, and each group is a list of the plurality of functions. 17. The method of displaying a function list according to claim 16, wherein the method corresponds to each of the tables. 18. The method according to claim 17, wherein the classification criterion is a frequency of use of the function. 19. The display step includes extracting a change amount component in a predetermined direction from the change amount of the designated coordinate, and corresponding to the predetermined area designated by the coordinate by an extraction amount corresponding to the extracted change amount component. 19. The function list display method according to claim 16, wherein an image of the function list to be performed is drawn in the predetermined direction and displayed on the image display unit. 20. The display step, when the coordinate designation by the coordinate designation means is released, if the extracted change amount component is larger than a predetermined value, extracting the function list by the extracted amount only. The method according to claim 19, wherein the display is maintained. 21. In the display step, when the coordinate designation by the coordinate designation means is canceled, if the extracted change amount component is equal to or less than the predetermined value, the display of the function list is stopped. The function list display method according to claim 19 or claim 20, characterized in that: 22. The display step, in the function list corresponding to the coordinate-designated predetermined area, scales all the function items constituting the function list according to the change amount of the designated coordinates. 22. The function list display method according to claim 16, wherein the function list is displayed on the image display unit. 23. The display step includes displaying all the function items constituting the function list in the function list corresponding to the predetermined area designated by the coordinates, by displaying the image at any change amount of the designated coordinates. 22. The method of displaying a function list according to claim 16, wherein the function list is displayed in a reduced size. 24. In each of the plurality of function lists, a display priority is set in advance for a plurality of function items constituting the function list, and the displaying step includes:
22. The function list display method according to claim 16, wherein the function item with the higher priority in the function list is displayed with priority on the image display unit. 25. The display step, wherein, if the function list corresponding to the predetermined area designated by the coordinates is a group of function items that do not require display of the main image, 22. The function list display method according to claim 16, wherein the display is performed over the entire screen of the image display unit. 26. The display step, wherein in the function list corresponding to the coordinate-designated predetermined area, the predetermined item designated by the coordinate designating means is selected from a plurality of function items constituting the function list. 22. The function list display method according to claim 16, wherein a function item corresponding to the coordinates in the area is selected and displayed on the image display unit. 27. An image display section surrounded by a frame forming a step, coordinate specifying means for specifying a coordinate position on the screen in the image display section, and the image display section provided near the frame. A function list display applied to an information processing apparatus including a plurality of predetermined areas above and a plurality of function lists each including a plurality of function items set respectively corresponding to the plurality of predetermined areas. In a computer-readable storage medium storing a method as a program, the function list display method is such that one of the plurality of predetermined areas is designated by coordinates by the coordinate designation means, and then the coordinates are designated by the coordinate designation means. A detecting step of detecting that the designated coordinates are changed in a substantially central direction of the image display unit while the designation is continued; and Displaying a list of functions corresponding to the predetermined area designated by the coordinates when the change in the designated coordinates is detected on the image display unit according to the amount of change in the designated coordinates. Storage medium. 28. A plurality of function items representing a plurality of information processing functions provided in the information processing apparatus are classified in advance according to a predetermined classification criterion to form a plurality of groups, and each group includes the plurality of function lists. 28. The storage medium according to claim 27, corresponding to each of the tables. 29. The storage medium according to claim 28, wherein the classification criterion is a frequency of use of a function. 30. The display step, wherein a change amount component in a predetermined direction is extracted from the change amount of the designated coordinate, and a drawing amount corresponding to the extracted change amount component corresponds to the coordinate designated predetermined area. 30. The storage medium according to claim 27, wherein an image of a function list to be performed is drawn in the predetermined direction and displayed on the image display unit. 31. The display step according to claim 31, wherein, when the coordinate designation by the coordinate designation means is released, if the extracted change amount component is larger than a predetermined value, the function list is extracted only by the extraction amount. 31. The storage medium according to claim 30, wherein the display is maintained. 32. In the display step, when the coordinate designation by the coordinate designation means is released, if the extracted change amount component is equal to or smaller than the predetermined value, the display of the function list is stopped. 32. The storage medium according to claim 30, wherein: 33. The display step according to claim 26, wherein in the function list corresponding to the predetermined area designated by the coordinates, all the function items constituting the function list are scaled vertically and horizontally according to the change amount of the designated coordinates. 33. The storage medium according to claim 27, wherein the storage medium is displayed on the image display unit. 34. The display step includes displaying all the function items constituting the function list in the function list corresponding to the predetermined area designated by the coordinates, by displaying the image at any change amount of the designated coordinates. 33. The storage medium according to claim 27, wherein the storage medium is displayed in a reduced size. 35. In each of the plurality of function lists, a display priority is set in advance for a plurality of function items constituting the function list, and the displaying step includes:
33. The storage medium according to claim 27, wherein the function item with the higher priority in the function list is preferentially displayed on the image display unit. 36. The display step, wherein, when the function list corresponds to a group of function items that do not require display of the main image, the function list corresponding to the predetermined area designated by the coordinates is displayed. 33. The storage medium according to claim 27, wherein the storage medium is displayed over the entire screen of the image display unit. 37. The display step, wherein in the function list corresponding to the coordinate-designated predetermined area, the predetermined item designated by the coordinate designating means is selected from a plurality of function items constituting the function list. 33. The storage medium according to claim 27, wherein a function item corresponding to the coordinates in the area is selected and displayed on the image display unit.