JP2003195998A - Information processor, control method of information processor, control program of information processor and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor, a control method of the information processor, a control program of the information processor, and a storage medium capable of improving visibility and operability of a display image screen. <P>SOLUTION: A CPU801 is arranged for controlling so as to execute function menus by cutting off and partially displaying a part of the content classified into a plurality of function menus, scrolling the function menus displayed on the display image screen by sliding an input device in the parallel direction to the selected side in a partially displaying state, and directly operating a selecting means displayed on the display image screen without displaying a function tool of the function menus on the display image screen. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus capable of displaying various information such as accumulated images and characters, a control method for controlling the information processing apparatus, and a control method for controlling the information processing apparatus. The present invention relates to a control program and a storage medium storing the control program.

[0002]

2. Description of the Related Art In a conventional information processing apparatus of this type, a balloon is used as a means for confirming what function the icon button is for processing before executing the function. It is general to provide a function called balloon help for explaining the function in such a frame, but the description information is generally expressed only in characters.

Further, a menu display in the style of a pull-down menu is generally used in a PC (personal computer) or the like, but since these are premised on the operation of an input device such as a mouse or a pointing device, an input is made. It has been common to display by instructing the device to be pulled down from the top of the display screen or pulled up from the bottom.

[0004]

However, in the above-mentioned conventional example, a plurality of menu buttons are laid out in advance around the display screen of the display, and the function menu is displayed even when it is not necessary to display it. Therefore, it is necessary to always secure a certain display area, and it is necessary to reduce the size of the display area for the contents to be displayed in the main, or to lay out the sheet key separately around the liquid crystal display and not print it. It was necessary to secure a certain area on the display screen so that the key at the entrance of the menu could not always be displayed. In particular, in a small-sized portable information processing terminal having a small display area of the display, there is a problem that the operability deteriorates because the display area of the display is narrowed.

Further, even if only the reproduced image information is desired to be viewed, if any function button is displayed somewhere on the display screen, it gives a visually disturbing impression as extra information.

In addition, when a plurality of display screens are arranged side by side or overlaid on a small portable information processing terminal at the same time, since the display screen size of the display is originally small, even if the provisional display is high definition, it is displayed. However, it is difficult for the user to arbitrarily adjust the display area to give priority to what he / she wants to see, and there is a problem that it is difficult to see because the list is poor.

[0007] Further, for a user who is not familiar with PC operation, the method of displaying information overlapping each other causes confusion.

Also, in the case of a display having a small and limited display area, when there are many choices of function keys, when a plurality of buttons are displayed in a list and laid out, the display screen is completely changed, and the main image to be used for executing the function is displayed. Is hidden, and the fact that the process is difficult to grasp when processing a function also becomes a factor that interrupts the flow of operation,
There was a problem that operability deteriorates.

Further, in the above-mentioned prior art, it is general that a plurality of buttons are laid out in close proximity to each other, and like a small portable information processing terminal, a touch pen is used while being held by a hand. When making a selection, it is easy to push the adjacent button due to an erroneous operation, resulting in poor operability.

The present invention has been made in order to solve the above-mentioned problems of the prior art, and an object thereof is an information processing apparatus and information capable of improving the visibility and operability of a display screen. A control method for a processing device, a control program for an information processing device, and a storage medium.

[0011]

In order to achieve the above object, the information processing apparatus of the present invention includes a plurality of display means of a display means having a rectangular display screen provided in the main body of the information processing apparatus. An information processing apparatus configured to display a function menu accommodating various functions on the display screen by selecting a side with an input device, and cut out a part of the contents classified into a plurality of the function menus. Are partially displayed, and the input device is slid in a direction parallel to the selected side in the partially displayed state, thereby scrolling the function menu displayed on the display screen, and the function tool of the function menu is displayed. Control for executing the function menu by directly operating the selection means displayed on the display screen without displaying the function menu on the display screen. Characterized in that a means.

Further, in order to achieve the above object, the information processing apparatus of the present invention cuts off a part of a function menu displayed on the display screen of a display means having a rectangular display screen to display the display screen. Control means for controlling the display of the function menu and the function by cutting the part of the function menu and displaying it on the display screen by sliding the input device along a plurality of sides surrounding the display screen as it is. Scroll means for scrolling the contents of the menu, and instructing means for executing the function menu by directly instructing the selecting means displayed on the display screen without displaying the function tool of the function menu on the display screen. It is characterized by having.

In order to achieve the above-mentioned object, the control method of the information processing apparatus of the present invention has a plurality of sides surrounding the display screen of a display means having a rectangular display screen provided in the main body of the information processing apparatus. Is a control method for controlling an information processing apparatus that displays a function menu accommodating various functions on the display screen by selecting a function menu by using an input device. By cutting out a part and displaying it partially, by sliding the input device in a direction parallel to the selected side in the partially displayed state, the function menu displayed on the display screen is scrolled, and By directly operating the selection means displayed on the display screen without displaying the function tool of the function menu on the display screen, the function menu is realized. Characterized in that the provided control step for controlling to.

In order to achieve the above-mentioned object, the control method of the information processing apparatus according to the present invention has a plurality of sides surrounding the display screen of a display means having a rectangular display screen provided in the main body of the information processing apparatus. Is a control method for controlling the information processing apparatus, which displays a function menu accommodating various functions on the display screen by selecting the A control step of cutting out a part of the function menu and displaying it on the display screen; and when cutting out a part of the function menu and displaying it on the display screen, input devices are attached to a plurality of sides surrounding the display screen as they are. A scroll step for scrolling the contents of the function menu by sliding it along with a function tool of the function menu. By instructing the selection means it is displayed on the display screen without display on the serial display screen directly and having an instruction step to execute the function menu.

In order to achieve the above-mentioned object, the control program of the information processing apparatus of the present invention has a plurality of sides surrounding the display screen of a display means having a rectangular display screen provided in the main body of the information processing apparatus. Is a computer-readable control program for controlling an information processing apparatus that displays a function menu containing various functions on the display screen by selecting the By cutting out a part of the displayed contents and partially displaying the contents, by sliding the input device in a direction parallel to the selected side in the partially displayed state, the function menu displayed on the display screen is displayed. Scroll to directly operate the selection means displayed on the display screen without displaying the function tool of the function menu on the display screen. It allows characterized in that it consists of program code for executing the control step of controlling to perform said function menu computer.

In order to achieve the above object, the control program of the information processing apparatus of the present invention is such that a plurality of sides surrounding the display screen of a display means having a rectangular display screen provided in the main body of the information processing apparatus. Is a computer-readable control program for controlling the information processing apparatus, which displays a function menu accommodating various functions on the display screen by selecting the A control step of controlling a part of the function menu to be cut and displayed on the display screen, and a plurality of sides surrounding the display screen as they are when the part of the function menu is cut and displayed on the display screen. Scroll step to scroll the contents of the function menu by sliding the input device along the And a command step for causing the computer to execute the function menu by directly instructing the selection means displayed on the display screen without displaying the function tool of the function menu on the display screen. It is characterized by consisting of a code.

Further, in order to achieve the above object, the storage medium of the present invention is characterized by storing a control program for an information processing apparatus according to any one of claims 27 to 39.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings.

(First Embodiment) First, a first embodiment of the present invention will be described with reference to FIGS.

FIG. 1 is a front view showing the overall configuration of an information processing apparatus according to this embodiment, FIG. 2 is a plan view of the same, and FIG.
Is a rear view and FIG. 4 is a sectional view taken along the line IV-IV in FIG.

The information processing apparatus according to this embodiment is equipped with a display (display means) having a capability of displaying full-color image information in high definition, and a touch pen type input device.
It is a notebook-sized portable information processing terminal mainly for coordinate designation by a (pen-type pointing device).

However, the size of the portable information processing terminal described in the present embodiment is not limited to the size of a notebook, and although there are differences in the operating method, it has a large pointing device as an operating means. It is also applicable to an information processing device having a screen display, an eyepiece viewfinder, and the like.

In FIGS. 1 to 4, reference numeral 100 denotes an information processing apparatus.
As shown in FIG. 3, a camera unit 102 and a microphone (microphone) 103 that receives audio data are provided.

A shutter button 104 is provided on one side of the upper surface of the exterior cover 101, as shown in FIGS. The shutter button 104 has a switch that can be pressed in two steps. When the shutter button 104 is pressed in the first step, a shooting standby state is set, and a display described later is displayed.
The finder image information is displayed on the (display unit) 105, and the image is captured and recorded by the second-stage pressing operation to enter the image capturing state.

On the back side of the outer cover 101, a rectangular display (display means) 10 is provided as shown in FIG.
5 are provided. On the upper surface of the display 105, as shown in FIGS. 3 and 4, the touch panel sensor 10
6 is provided. Then, when the user uses it, as shown in FIG. 4, the touch panel sensor 106 on the display 105 mainly indicates the coordinates by the touch pen type input device (pen type pointing device) 107,
Instruct execution of various functions.

On the back side of the exterior cover 101, speakers 108 are provided on both sides of the display 105 as shown in FIG.

As shown in FIGS. 3 and 4, a step portion 109 is provided on the frame at the boundary between the outer cover 101 and the display 105. The step portion 109 has an auxiliary function when designating a “drawer menu display trigger area” and the like which will be described later. That is, as shown in FIG. 4, when the tip portion of the input device 107 is abutted against the stepped portion 109 of the frame of the outer cover 101 that is in contact with the side surrounding the display 105, the coordinates in the area within the “drawer menu display trigger area” are specified. The user's intention is reflected even in the rough input by the input device 107.

A, B, C in FIGS.
D When the coordinates of each area are designated, or as shown in FIG.
When starting a "detailed menu that is infrequently used", which will be described later with reference to FIG. 27, or when performing a scroll operation in the partial cutout help in the drawer menu, which will be described later with reference to FIGS. 46 to 48. In addition, the stepped portion 109 of the frame of the outer cover 101 has an auxiliary function.

FIGS. 5 to 7 are views showing examples of the coordinate definition of the “drawer menu display trigger area” on the display 105, which is an enlarged view of only the part of the display 105 shown in FIG.

As shown in FIGS. 5 to 7, four sides of A, B, C and D are preliminarily arranged on each side of the rectangular display 105.
Functions assigned to one category are assigned in a layout like a virtual drawer. Hereinafter, this function will be referred to as a "draw-out menu".

Depending on the specifications and product concept of the information processing apparatus, a list of function buttons based on icons or text display, or an example in which icons and characters are written together is laid out in the “drawer menu”. is assumed.

For example, in FIG. 5 to FIG. 7, the left side of the display screen of the display 105 is an A classification that summarizes the functions for the procedure before displaying an image on the display screen. Assign functions. Also,
The upper / lower side of the display screen is classified into the B and C categories in which the additional functions for the displayed image are summarized, and the B classification menu on the upper side of the display screen includes, for example, the character input function and the C classification menu on the lower side of the display screen. For example, a processing / editing function is assigned to each. In particular, as for the B classification menu, as shown in FIG.
Even when selecting a menu, the image is input to the input device 107.
The layout shown in the figure is suitable as a position that is not hidden by hand. Furthermore, the right side of the display screen is a D classification that summarizes the functions for designating the destination of the processed image data. For example, a save / organize function is assigned to this D classification menu, and various functions related to each are processed. Display a list of icons and so on.

The user can display the menu of each category by the operation of pulling out from each side of the display 105 according to the required function. During repeated use, the display triggers of the major categories can be learned at the positions of the four sides with respect to the display 105.

FIG. 7 shows a state in which the B classification menu is displayed (a storage image of the drawer menu). That is, with the operation means of sliding the input device 107 toward the center of the display screen in the direction of the arrow E while the coordinates are designated in the B classification area shown in FIG. 5 by the dedicated input device (pen-type pointing device) 107, It shows a state in which a "drawer menu" of B classification is displayed.

The definition of each display trigger area is determined by the pen tip shape of the input device 107, etc., and is the range detected when the tip of the input device 107 is abutted against the stepped portion 109 of the frame of the exterior cover 101. It is defined by the width of plus alpha. Further, the coordinate information of each boot area is registered in advance in a ROM (Read Only Memory) described later, and the input device 10
When the coordinate information by 7 is detected, the coordinates are collated, and when the areas shown in the figure are collated, the respective standby states for activation are obtained, and further, the input device 107
By sliding and scrolling toward the center of the display screen, it is possible to display the menu contents so that the menu contents can be retrieved.

In the drawer on each side of the display screen, FIG.
As shown in, a plurality of function buttons 701 are laid out by icons and characters having functions according to each classification.

For convenience of explanation, the number of function buttons 701 shown in FIG. 7 is laid out. However, the number of layouts of the function buttons 701 differs depending on the size of the display screen. It is not limited to what is shown.

Further, there are a setting method of displaying the display trigger area in advance and a setting method of not displaying the display trigger area in advance and highlighting the selected state only when the defined coordinates are detected by the input device 107. It is possible to use them properly by setting them as needed.

The identification means of the four classifications A to D are:
Identify by changing the pattern of the bars on each side of the display screen or changing the color.

In the present embodiment, the description will be made by exemplifying inputting of characters and writing of illustrations and the like to the image information.
Similar display processing can be performed for mixed display of text and images.

In the following description, as shown in FIG. 5, the horizontal direction of the display screen of the display 105 is the X axis, the vertical direction is the Y axis, and the withdrawal amounts are x and y, respectively.

FIG. 8 is a block diagram showing the system configuration of the information processing apparatus according to this embodiment. In the figure, 801 is a CPU (Central Processing Unit), and 802 is a CC
D (image sensor, corresponding to the camera unit 101 in FIG. 1), 8
03 is an image display display (display 10 of FIG.
Equivalent to 5. ), 804 is a RAM (random access memory), 805 is a flash memory, and 806 is a microphone.
(Corresponding to the microphone in FIG. 1), 807 is a shutter switch (corresponding to the shutter button 104 in FIGS. 1 to 3), and 808 is a touch panel sensor (corresponding to the touch panel sensor 106 in FIGS. 3 and 4). , 809 is RO
M (Read Only Memory), 810 is a battery, 811
Is a speaker (corresponding to the speaker 108 in FIG. 3).

The soft touch buttons displayed on the display screen of the image display display 803 are input devices 10.
Touch panel sensor 80
Various functions based on the operation system stored in the ROM 809 are executed based on the coordinate information detected by 8. In addition, the shutter switch 80 outputs image information and audio information input from the CCD 802 and the microphone 806.
It is stored in the flash memory 805 by turning on 7
The ROM 809 is stored according to various laws programmed therein. The information stored in the flash memory 805 is
After that, the image is displayed on the image display 803 and the speaker 811, and the touch panel sensor 8 by the input device 107 is reproduced.
GUI (Graphical)
A desired image or sound can be reproduced through a plurality of searching means by a User Interface) operation.

The reproduced image information is edited / processed by various methods such as adding an image arbitrarily using the ROM 804 or adding characters by a word processor (word processor) function.

Next, the overall functional operation of the information processing apparatus according to this embodiment will be described with reference to FIG.

FIG. 9 is a flow chart showing the flow of overall functional operation of the information processing apparatus according to this embodiment.

In FIG. 9, first, in step S901, it is determined whether or not the main power source is turned on (ON) until it is turned on. Then, when the main power supply is turned on, in the next step S902, the photograph taken in the past is reproduced like an album and is displayed on the image display display 803. Next, in step S903, it is determined whether or not it is a mechanical button (or key) operation. If it is determined that the button operation is a mechanical button operation, the process proceeds to step S904 and step S9 is performed.
It is determined what the content of the button operated in 03 is.

Then, in step S904,
When it is determined that the operated button is power off (OFF), the process proceeds to step S905, the power is turned off, and then this processing operation is ended.

In step S904, the operated button is the shutter switch (shutter SW).
If it is determined to be 1), the process proceeds to step S906, the shutter switch (shutter SW1) is turned on, and the shooting standby state is set. Next, in step S907, the subject image is displayed on the viewfinder, and in the next step S908, the shutter switch (shutter SW2)
Is turned on and the camera is ready for shooting. Next, step S909.
Then, after the image information taken in step S908 is stored in the flash memory 805, the process returns to step S902.

If it is determined in step S904 that the operated button is the cross cursor key, the flow advances to step S910 to perform processing corresponding to the cross cursor key, and then the present processing operation is ended. .

If it is determined in step S904 that the operated button is the record key,
After proceeding to step S911 and performing the recording process, this processing operation is ended.

On the other hand, if it is determined in step S903 that the button operation is not a mechanical button operation, the flow advances to step S912 to perform a GUI operation. With this GUI operation, the search processing in step S913 and step S9 are performed.
After the character input processing in 14, the processing / editing processing in step S915, and the saving / arranging processing in step S916, the process returns to step S902.

That is, when the main power supply is turned on, the images taken in the past are reproduced like an album and displayed on the image display display 803. From there, particularly frequently-used functions are processed by turning off the power, shooting with the shutter switch 807, and the like by hard key operation (or mechanical button operation), and the captured image information is stored in the flash memory 805. It

Other than that, various applied functions performed on an image are displayed on the GUI by the input device 107 such as a touch pen.
It is performed by selecting buttons and operating with gestures.

The gist of the present invention is, in particular, step S902.
"Retrieval process" (step S913) or "Character input process" (step S914) performed by GUI operation during the playback of the image or the viewfinder display of step S907.
In response to various instruction means and instructions relating to processes such as selection of functions from the display of a menu accommodating "processing / editing processing" (step S915) and "storing / arranging processing" (step S916) and closing of the menu. The present invention relates to recognition means, processing means, storage means and display means.

Next, the starting operation for displaying the pull-out menu in the information processing apparatus according to the present embodiment will be described with reference to FIGS.

FIG. 10 is a diagram showing a screen display example of a startup operation for displaying a drawer menu in the information processing apparatus according to this embodiment, and FIGS. 11 and 12 are information processing apparatus according to this embodiment. 5 is a flowchart showing a flow of an operation of a boot operation for displaying a drawer menu in FIG.

In FIG. 10, in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, the bar areas are shown on the four sides, but not all are visible to the user. .

As described with reference to FIGS. 5 to 7, the definition coordinates of the display trigger area of each functional tool on the touch panel sensor 106 are registered in the ROM 809 in advance. Then, when those areas are detected, the respective coordinate data are collated, the trigger area of the drawer corresponding to the operation situation is selected, and the standby state is set, and the central portion of the display screen of the image display display 803 is displayed. When the coordinates are continuously updated toward the display area, the display area of the drawer is drawn out in the designated direction. Then, when the detection information is turned off, the display state is also held.

Below, as an example of the B classification menu, FIG.
~ It demonstrates using FIG.

First, in FIG. 11, step S110.
At 1, the entire display screen of the image display display 803 is used to display a photographic image or the like (full-screen image reproduction state). Next, in step S1102, arbitrary coordinates are detected. Next, in step S1103, it is determined whether the coordinates in the "drawer menu display trigger area" of the B classification tool shown in FIG. 6 are detected. If it is determined that the coordinates in the "drawer menu display trigger area" are not detected, the process advances to step S1104 to determine whether or not to hold the coordinate input standby until entering the definition area. If it is determined that the coordinate input waiting state is not held until entering the definition area, the above step S1 is performed.
When it is determined to return to 101 and hold the coordinate input standby until entering the definition area, the above step S110.
Return to 3.

On the other hand, in step S1103,
When it is determined that the coordinates in the “drawer menu display trigger area” are detected, the process proceeds to step S1105, and the area detected in step S1103 is A
Or it judges whether it is B or C or D. If it is determined to be A or D, step S1
If it is determined to be B or C, the process proceeds to step S1113 in FIG. 12, which will be described later.

In step S1106, the trigger area is highlighted and it is determined whether the buzzer is turned on. If the determination result is negative (NO), the process returns to the step S1101, and if the determination result is affirmative (YES), the next step S1107 waits for X coordinate information reception, and the Y coordinate is ignored. Next step S11
At 08, the display position of the bar is constantly updated according to the X coordinate information.

Next, in step S1109, the withdrawal amount x
Is smaller than the defined amount. If the result of the determination is negative (NO), the step S110 is performed.
If the determination result is affirmative (YES), it is determined in the next step S1110 whether the withdrawal amount x is larger than the defined amount. If the determination result is negative (NO), the process proceeds to step S1113 to maintain the display state, then the present processing operation is terminated, and if the determination result is affirmative (YES), the next step S11
It proceeds to 11 and determines whether or not it is stopped at the X-axis maximum withdrawal amount position. If the determination result is negative (NO), the process proceeds to step S1113 and the display state is maintained, then the present processing operation is terminated, and if the determination result is affirmative (YES), After proceeding to step S1112, even if the detected coordinates are further updated in the X-axis direction, they are ignored, the input device (pen) 107 is separated from the touch panel 106 to maintain the display state, and then this processing operation is ended.

Next, in FIG. 12, first, in step S
At 1114, the trigger area is highlighted and it is determined whether or not the buzzer is turned on. If the determination result is negative (NO), step S1101 in FIG.
If the determination result is affirmative (YES), the next step S1115 waits for Y coordinate information reception,
The X coordinate is ignored, and in the next step S1116, the display position of the bar is constantly updated according to the Y coordinate information.

Then, in step S1117, the withdrawal amount y
Is smaller than the defined amount. If the result of the determination is negative (NO), the step S110 is performed.
If the determination result is affirmative (YES), it is determined in the next step S1118 whether the withdrawal amount y is larger than the defined amount. If the determination result is negative (NO), step S1113 in FIG.
If the determination result is affirmative (YES), the process proceeds to the next step S1119 to determine whether or not the vehicle is stopped at the Y-axis maximum withdrawal amount position. If the result of the judgment is negative (NO),
In step S1113, the display state is maintained, and if the determination result is affirmative (YES), the process proceeds to next step S1119, and even if the detected coordinates are further updated in the extension direction, they are ignored and the input device ( After the pen) 107 is separated from the touch panel 106 to maintain the display state, this processing operation is ended.

That is, first, the image display display 803
When a photographic image or the like is displayed using the entire display screen (full screen image reproduction state: 1000 in the screen display example of FIG. 10) and any coordinates are detected, the B classification tool shown in FIG. The coordinates in the "drawer menu display trigger area" are detected. This detection includes the case where the coordinates in the trigger area are directly detected, and the case where other areas are detected and the coordinates information is continuously updated without being turned off, and then the "drawer menu display trigger area" is detected. There are two ways: when the coordinates are detected. When the latter coordinate in the "drawer menu display trigger area" is detected, it is invalid if continuous coordinate information is detected before that (Fig. 1
1001-1002 in the screen display example of 0).

By this method, the user can display a desired menu with a rough operation feeling without carefully aiming inside the definition area. As a method for notifying the user of this selected state, it is possible to highlight the trigger area in the selected color and at the same time, use a buzzer to generate an electronic sound such as "Pipitz" as a key reception sound. Can be assumed.

Next, in this state, the input device 10
When 7 is kept in contact with the touch panel sensor 106 and is not released, when it is slid toward the center of the display screen of the image display display 803, the tool box is pushed out like a drawer with the movement of the input device 107 ( 1003 to 100 in the screen display example of FIG.
6). In this case, since the trigger area of the B classification menu is detected, the X axis information is ignored and only the Y axis information is reflected in the processing.

The user can roughly move the input device 10 downward without paying attention to pulling it down vertically.
By sliding 7 the intention can be reflected.

Generally, depending on whether the dominant hand is on the left or right side, a slight inclination tends to occur from the right angle direction. For example, a right-handed user scrolls slightly to the left of the right angle direction, that is, a vector from the upper right to the lower left. In the case of a right-handed user, on the contrary, the vector is scrolled from the upper left to the lower right.

However, by adopting the method of reflecting only the change value of the Y-axis information, it becomes possible to reflect the user's intention without being influenced by the dominant hand as described above.

In the screen display example of FIG. 10, the input device 1
The display amount of the menu is updated according to the Y coordinate information of 07. Although the definition of the maximum withdrawal amount can be changed according to the specification, in the present embodiment, the maximum withdrawal amount is defined as the center position of the display area, as indicated by 1006 in the screen display example of FIG.

When a menu withdrawal amount y of a predetermined amount or more is secured in advance, and thereafter, if coordinate detection is turned off at an arbitrary place, the withdrawal menu is fixed at an intermediate position and can be used as it is. . At this time, if the coordinate information is turned off at a pull-out amount less than the defined amount, the menu pull-out function is canceled midway and the first screen state (1 in the screen display example of FIG. 10 is displayed).
Return to (000).

Alternatively, if the detected coordinates are continuously changing even after being pulled out (in the case where the instruction is updated in the further pulling direction while keeping the state where the input device 107 is not released from the touch panel 106), then the same again. Continue ignoring until the trigger area is detected. After detection again
When returning to the pulled-out direction, it is updated again according to the coordinate information (1003 in the screen display example of FIG. 10).
~ 1009).

Alternatively, in addition to the above-mentioned means, in the screen display example of FIG. 10, the amount of change in coordinates updated within a specified time from 1002 to 1004 is calculated, and the user gives a high speed instruction and a low speed instruction. To distinguish it from
When the instruction is made at high speed (1000 to 1004 in the screen display example of FIG. 10 within the specified time), even if the coordinate instruction is turned off at 1004 in the screen display example of FIG.
The display amount is not displayed like 1005 in the screen display example of FIG.
7 state).

Next, an operation process for closing the drawer menu in the information processing apparatus according to this embodiment will be described with reference to FIGS. 13 to 15.

FIG. 13 is a diagram showing a screen display example when closing the drawer menu in the information processing apparatus according to the present embodiment, and FIGS. 14 and 15 show the drawer menu in the information processing apparatus according to the present embodiment. It is a flowchart which shows the flow of the operation process at the time of closing.

In FIG. 13, a bar area is shown on the four sides in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, but not all of them can be seen by the user. .

As a precondition, the processing shown in FIGS. 14 and 15 starts from a state in which the "drawer menu" is displayed with the maximum display amount as in 1301 in the screen display example of FIG.

First, in FIG. 14, step S140.
With 1, the drawer menu is displayed, and the next step S
At 1402, arbitrary coordinates are detected. Next, step S1
In 403, it is determined whether the coordinate information detected in step S1402 is a trigger area definition area. If it is determined that the area is not the trigger area definition area, the process advances to step S1404 to determine whether the GUI function button is turned on. If it is determined that the GUI function button is not turned on, the process returns to step S1403. If it is determined that the GUI function button is turned on, the process proceeds to step S1405 to execute the function process and then the present process. The operation ends.

On the other hand, in step S1403,
If it is determined that the coordinate information detected in step S1402 is the trigger area definition area, the process advances to step S1406 to determine whether the detected area is A, B, C or D. If it is determined to be A or D, the process proceeds to step S1407, and if it is determined to be B or C, the process proceeds to step S1414 of FIG.

In step S1407, the trigger area is highlighted, the buzzer is turned on, and the next step S
At 1408, the X coordinate information is waited for, and the Y coordinate is ignored.
Next, in step S1409, it is determined whether or not the display position of the bar is constantly updated according to the X coordinate information. Then, if the determination result is negative (NO), step S141
After proceeding to step 2 and maintaining the display state, the present processing operation is terminated, and when the result of the determination is affirmative (YES), the procedure proceeds to the next step S1410 and whether or not the withdrawal amount x is greater than the defined amount. To judge. If the determination result is negative (NO), the process proceeds to step S1412 to maintain the display state, and the determination result is positive (YE).
In the case of S), the process proceeds to the next step S1411, and it is determined whether the withdrawal amount x is smaller than the defined amount. And
If the determination result is negative (NO), step S14
After proceeding to step 13 and turning off the drawer menu display, this processing operation is terminated, and if the determination result is affirmative (YES), this processing operation is terminated.

Next, referring to FIG. 15, step S141.
At 4, the trigger area is highlighted and it is determined whether the buzzer is turned on. And the judgment result is negative
In the case of (NO), the process returns to step S1403 in FIG. 14, and when the result of the determination is affirmative (YES), the process proceeds to the next step S1415 to wait for Y coordinate information reception,
It is determined whether or not to ignore the X coordinate. If the determination result is negative (NO), step S in FIG.
Return to 1403, and the determination result is affirmative (YES).
In the case of, it progresses to the following step S1416.

In step S1416, it is determined whether or not the display position of the bar is constantly updated according to the Y coordinate information.
Then, if the determination result is negative (NO), the process proceeds to step S1412 of FIG. 14 to maintain the display state,
If the determination result is affirmative (YES), the flow advances to the next step S1417 to determine whether or not the withdrawal amount y is larger than the defined amount. If the determination result is negative (NO), the process proceeds to step S1412 in FIG. 14 to maintain the display state, and if the determination result is affirmative (YES), the process proceeds to next step S1418. It is determined whether the withdrawal amount y is smaller than the defined amount. If the result of the determination is negative (NO), then
In step S1413, the drawer menu display is turned off, and if the determination result is affirmative (YES), this processing operation ends.

That is, when the "drawer menu" is displayed with the maximum display amount, and the detected coordinate information is within the "display trigger area" of the extracted menu.
The bar in the selection area is highlighted (1303 in the screen display example of FIG. 13), the buzzer sound is also sent to the user, and the user is informed that the bar has been selected and activated. Or, even if the first detected coordinate information is not in the pull-out menu display trigger area, the reception standby state continues, only the coordinate information changes, and if it enters the pull-out menu display trigger area, the information up to that point is It is ignored and the standby state is entered from there (130 in the screen display example of FIG. 13).
1-11303). This is a method for surely accepting the user's intention even with a rough operation.

Alternatively, 13 in the screen display example of FIG.
Needless to say, when a specific function button in the menu is detected, as shown in 02, that function is processed.

Further, when the detected coordinate is changed, the X coordinate information is ignored even if changed, and only the instruction of the B coordinate tool storage position direction of the Y coordinate information is accepted. If a direction instruction such as 1304 in the screen display example of FIG. 13 is detected, it is ignored. Further, the display amount is also updated every time the coordinates are updated as in 1305 to 1309 in the screen display example of FIG. If it is turned off when the withdrawal amount y is equal to or larger than the defined amount, it is held in that state (1306 in the screen display example of FIG. 13). Within a certain defined amount
When entering (1307 in the screen display example of FIG. 13), it is considered that the user has the intention of turning off the display, and the drawer menu display is turned off even if the user turns off midway.

As another method of closing the drawer menu, apart from the case of closing by the method of scrolling by the user as described in the present embodiment, it is possible to erase it by only clicking the button. It is conceivable to also have a button that has the function that can be done.

Further, as in the case of activation, the amount of change in coordinates updated within a specified time in 1301 to 1305 in the screen display example of FIG. When the high speed instruction and the low speed instruction are distinguished, the high speed instruction is given (when 1301 to 1305 in the screen display example of FIG. 13 within the specified time is high speed), the screen table of FIG. Even if the coordinate instruction is turned off in 1305 in the illustrated example, instead of displaying it as in 1306 in the screen display example of FIG. 13, all may be stored.

Next, a method of listing the tools in the drawer menu according to the drawer amount in the information processing apparatus according to the present embodiment will be described with reference to FIGS. 16 and 17.

FIG. 16 is a diagram showing a layout process in the drawer menu according to the withdrawal amount in the information processing apparatus according to the present embodiment, and FIG. 17 is shown with reference to the withdrawal amount in the information processing apparatus according to the present embodiment. It is a flow chart which shows the flow of the layout processing operation in the drawer menu.

In FIG. 16, in order to make the relationship between the four sides around the display 803 and the other sides easy to understand, bar areas are shown on the four sides, but not all of them can be seen by the user. . Further, in FIG. 16, the A classification tool and the B classification tool will be described as an example.

In FIG. 17, step S14 of FIG.
01 and step S1402, it is determined in step S1701 whether or not the coordinate information detected in the previous processing step is the trigger area definition area. If it is determined that the area is not the trigger area definition area, step S1404 in FIG.
Perform the same processing as.

On the other hand, in step S1701 described above,
If it is determined that the coordinate information detected in the previous step is the trigger area definition area, the flow advances to step S1702 to determine whether the detected area is A, B, C or D. And A or D
If it is determined to be step S1703, or if it is determined to be B or C, step S1.
Proceed to 707 respectively.

In step S1703, the X coordinate information is waited for and the Y coordinate is ignored. Next, step S1704.
16 in the screen display example of FIG. 16 according to the X coordinate information.
The image is displayed as a laterally magnified image with the ratio of the amount of X to the maximum withdrawal amount of 04. Next, step S
In 1705, the image ratio in the menu is updated along with the update of the X coordinate information. Next, in step S1706, after stopping at the X-axis maximum withdrawal position (X / 2), this processing operation ends.

On the other hand, in step S1707, the Y coordinate information reception is awaited and the X coordinate is ignored. Next, in step S1708, the image is vertically scaled at the ratio of the amount of X to the maximum withdrawal amount shown in 1608 in the screen display example of FIG. 16 according to the Y coordinate information. Next, in step S1709, the image ratio in the menu is updated along with the update of the Y coordinate information. Next, in step S1710, Y
After stopping at the axis maximum withdrawal amount position (Y / 2), this processing operation is ended.

That is, in the case of the A classification menu, the display method in the drawer with respect to the withdrawal amount is scaling / reducing display in proportion to the position of the X coordinate with respect to the layout of the menu at the maximum display amount. For example, when the position of the X coordinate indicated by 1603 in the image display example of FIG. 16 is 3/4 position with respect to 1604 in the image display example of FIG. 16, the display in the tool of 1603 in the image display example of FIG. All have the same Y coordinate but are displayed as image information distorted to 3/4 in the X direction, and the area as the function of the function button is also reduced in the horizontal direction accordingly, and the position information of the X coordinate changes. The display ratio is also updated accordingly.

Also, depending on the display amount x of the A classification menu, the display style changes such that the contents of the pull-out tool are only icons or both icons and characters are written together. When the input device 107 is separated from the touch panel sensor 108 at a position on the way, the display state is fixed at that position. Alternatively, the image ratio in the menu is updated up to the maximum withdrawal amount, and the coordinates to be applied are defined.

The flow for closing the "drawout menu" is the reverse of the flow described above.

FIG. 18 is an image diagram of the storage position of the "drawer menu". In FIG. 18, the display 803
The area of the bar is shown on the four sides in order to make it easy to understand the relationship between the four sides around and the other sides, but not all are visible to the user.

The direction of drawing out from each of the four sides around the display 803 is as shown in FIG. Depending on which position the menu trigger area is detected, the direction of the instruction necessary for pulling out, the coordinate information to be received, and the direction of image processing for scaling the layout in the menu are different.

In the screen display example of FIG. 18, reference numeral 1801 indicates the side to be selected when pulling out the A classification tool and the pulling direction, and 1802 indicates the state in which the side is fully pulled out. Further, reference numeral 1803 denotes a side to be selected when pulling out the B classification tool and the pulling direction thereof, and 1804 denotes a state in which the side is fully pulled out. Also, 1805 is C
Reference numeral 1806 shows a state in which the side selected when pulling out the classification tool and the direction in which the side is pulled out are drawn out. Reference numeral 1807 indicates the side to be selected when pulling out the D classification tool and the direction in which it is pulled out, and 1808 indicates the state in which it has been pulled out.

The screen display example shown in FIG. 18 is an example for explanation, and the number and size of the icons in the drawer differ depending on the number of respective functions and the size of the display 803.

The method of closing each tool and the process thereof are the same as the method already described by taking the B classification tool as an example, and the rule of which of the detected coordinates is reflected depending on the position of the side is also the same. Is.

The same rules as those described with reference to FIGS. 5 to 10 are applied to the details of the display process of each tool and the closing method.

As described above, according to the information processing apparatus according to the present embodiment, there is no key around the display 803 for executing a specific function, and the menu display method using the four sides of the display 803 as display triggers is used. , Without shrinking the whole main image, you can grasp the type of each function tool contained in the menu of large items classified into each category, and directly click the target button. By selecting, it is possible to execute the command more quickly.

(Second Embodiment) Next, a second embodiment of the present invention will be described with reference to FIGS.

The basic structure of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 19 is a diagram showing an example of image display in the case of performing stepwise display according to the priority of the function in the information processing apparatus according to this embodiment, and FIG. 20 is the information processing apparatus according to this embodiment. 21 is a diagram showing a display range in the case of performing stepwise display according to the priority of the function in FIG. 21, and FIG. 21 is a flow of operations in the case of performing stepwise display according to the priority of the function in the information processing apparatus according to the present embodiment. It is a flowchart showing.

In FIG. 19, in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, bar areas are shown on the four sides, but not all are visible to the user. .

Depending on the specifications and the target user, if the number of items in the menu that can be viewed at one time is too large, it may be difficult to select and the usability may be reduced. Assuming such a situation, the present embodiment limits the amount of functions that can be listed, and ranks two or three levels in descending order of priority.
The display is divided into stages.

In each drawer menu, layouts are displayed in the descending order of frequency of use, starting from the side closest to the drawer bar. For the user who wants to use the item most easily or the item that is used most frequently, it is possible to select an arbitrary function just by pulling out the first column.

The numbers in the drawer menu in the screen display example of FIG. 19 indicate the order of layout according to the frequency of use. That is, 1 in the image display example of FIG.
A tool 902 is most often used before the drawer, a tool 1903 in the screen display example of FIG. 19 is the back of the drawer, and a tool 1902 in the screen display example of FIG. 19 is displayed. It is possible to organize and use it like a drawer that you normally use, as if it were a tool that is used less frequently than tools.

The amount of withdrawal defines a fixed position in advance according to the maximum number of displayed contents of the tool. As an example, it is assumed that a maximum of 6 items are displayed, but it depends on the size of the screen and the function of the icon. The C classification tool assumes function buttons of vertical 3 × horizontal 10, but such a layout can be assumed for functions such as a color palette. Further, in such a case, three steps are added according to the vertical number.

In the flowchart of FIG. 21, the A classification tool is shown as an example. In advance, the input device 107
The coordinate range in which the instruction is detected and the fixed position information of the toolbar corresponding thereto are defined and stored in the ROM 809. While the instruction from the input device 107 is being detected, only the position of the bar is updated in accordance with the change in the Y coordinate information, and when the detection information is turned off, together with the change in the coordinates immediately before the detection information is turned off. , At the stage corresponding to the position, the drawer is laid out again and the display is fixed.

In FIG. 21, step S14 of FIG.
01 and step S1402, it is determined in step S2101 whether the coordinate information detected in the previous step is the trigger area definition area. If it is determined that the area is not the trigger area definition area, step S1404 of FIG.
Perform the same processing as.

On the other hand, in the step S2101,
If it is determined that the coordinate information detected in the previous step is the trigger area definition area, the flow advances to step S2102 to determine whether the detected area is A, B, C or D. And A or D
If it is determined to be S, the process proceeds to step S2103, and if it is determined to be B or C, the process in FIG.
The same processing as steps S1707 to S1710 is executed.

In step S2103, the X coordinate information is waited for and the Y coordinate is ignored. Then, step S2104
It is determined whether or not the X coordinate is within the range of a in FIG.
If it is determined that the X coordinate is not within the range of a in FIG. 20, the process proceeds to step S2107 to return to a state in which nothing is displayed (image state of 1901 in the screen display example of FIG. 19), and then this processing operation To finish.

Also, in the step S2104,
If it is determined that the X coordinate is within the range of a in FIG. 20,
In step S2105, it is determined whether the X coordinate is within the range of b in FIG. If it is determined that the X coordinate is not within the range of b in FIG. 20, the process proceeds to step S2108 and the state in which only the first-stage list is displayed (the image state of 1902 in the screen display example of FIG. 19) is held. After that, this processing operation is ended.

If it is determined that the X coordinate is within the range of b in FIG. 20, the flow advances to step S2106 to determine whether the X coordinate is within the range of c in FIG. If it is determined that the X coordinate is not within the range c in FIG. 20, the flow advances to step S2109 to hold the state in which the second-stage list is displayed (image state 1903 in the screen display example in FIG. 19), and This processing operation ends. If it is determined that the X coordinate is within the range of b in FIG. 20, this processing operation is ended.

Note that a buzzer sound may be generated when the coordinates of the position of b and the position of the position of b are detected so that the user can easily understand where the range of b and c has entered. It can be envisioned that they will be done together. In addition, in FIG. 20, a case where the menu is vertically laid out in two columns is illustrated, but in the case of three or more, the range of b is simply subdivided as the number increases, The basic mechanism is the same. Also, when the drawer menu is closed, it can be closed stepwise as well. Further, similar rules apply to other tools.

(Third Embodiment) Next, a third embodiment of the present invention will be described with reference to FIGS.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 22 is a diagram showing an image display example regarding expansion of the maximum withdrawal amount in the information processing apparatus according to this embodiment, and FIG. 23 is related with expansion of the maximum withdrawal amount in the information processing apparatus according to this embodiment. It is a flowchart which shows the flow of operation.

In FIG. 22, in order to make the relationship between the four sides around the display 803 and the other sides easy to understand, the bar areas are shown on the four sides, but not all of them can be seen by the user. .

In FIG. 5 in the above-described first embodiment, the maximum withdrawal amount is extracted on the assumption that the target image to be processed by the menu and the menu are simultaneously displayed on the display 803 when the menu is withdrawn. Although the description has been given by taking the case of limiting to half the position of the direction as an example, depending on the nature of the function, the maximum display amount can be secured by maximizing the display area of the display to display more functional elements. It becomes possible.

In the above-described first embodiment, the maximum display amount is defined as the center position, but the reason is that it is necessary not to hide all the images before extraction. However, depending on the nature of the function,
It is not always necessary that the image before the menu is displayed is displayed, but rather, the listability in the menu may be required to be improved.

For example, when it is not necessary to associate the menu with the image before displaying the menu like the search function, the entire display area of the display is used, or the B classification tool or the C classification tool is used. Like a simple image editing function,
If the menu and the image before displaying it need to be related, the maximum withdrawal amount is up to 1/2.

In the present embodiment, since it is assumed that the upper and lower tools frequently select a function while looking at the image, it is assumed that the menu is pulled out to half, and it is also possible to pull out the left and right all. .

As shown in FIG. 22, the display style in which the withdrawal amount is stepless and all items can be listed, and FIG.
As shown in, it is possible to envision a composite display style (2205-2208 in the screen display example of FIG. 22) that is combined with a display style in which the display amount is changed stepwise, and which one is selected and implemented depending on the nature of the function. Alternatively, it is assumed that the user can freely change both display styles.

In FIG. 23, the point different from FIG. 11 and FIG. 12 in the above-described first embodiment, which is a method of limiting the maximum withdrawal amount to half, is step S1111 in FIG. 11 and step S1119 in FIG. The definition of the maximum withdrawal amount for each of X and Y
This is to extend the display display area to a possible range, and to extend the drawing area that is updated according to changes in the coordinate information.

That is, in FIG. 23, it is determined whether or not the pull-out menu display trigger area is detected in step S2301 through the same processing as steps S1101 and S1102 in FIG. If the determination result is negative (NO), the same process as step S1104 in FIG. 11 is performed, and if the determination result is affirmative (YES), the process proceeds to the next step S2302 and the step is performed. It is determined whether the area detected in S2301 is A, B, C, or D.

If the determination result is A or D, the same processing as step S1106 in FIG.
In step S2303, if B or C, the same process as step S1114 in FIG. 12 is performed.

In step S2303, the X coordinate information reception is awaited and the Y coordinate is ignored. Next, step S2304.
It is determined whether or not the display position of the bar is always updated according to the X coordinate. If not updated, step S23
After proceeding to 07 and maintaining the display state, this processing operation is terminated, and when updating is performed, it proceeds to step S2305 and further it is determined whether or not to update when the detected coordinate is further instructed in the opposite direction. If it is not updated, the process proceeds to step S2307, and if it is updated, the process proceeds to step S2307.
After proceeding to 2306 and turning off the pull-out menu display in the state where the pull-out amount x is smaller than the defined amount, this processing operation is ended.

(Fourth Embodiment) Next, a fourth embodiment of the present invention will be described with reference to FIGS. 24 and 25.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

In each of the above-mentioned embodiments, the method of displaying the menus classified into four types by using the four sides as a trigger has been mainly described, but the menu equipped with a general rectangular display is The maximum number of method categories is limited to four. Therefore, the present embodiment considers the position of the trigger and the display method when the number of items is further increased.

FIG. 24 is a diagram showing an example of a screen display of a detail menu of low frequency of use in the information processing apparatus according to this embodiment, and FIG. 25 is a detail of low frequency of use in the information processing apparatus according to this embodiment. It is a flowchart which shows the flow of a display operation of a menu.

In FIG. 24, bar regions are shown on the four sides in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, but not all of them can be seen by the user. .

FIGS. 24 and 25 show examples assuming that the a-classification detailed menu is displayed.

"Drawer menu display trigger area area" described with reference to FIG. 5 of the above-described first embodiment, a position which avoids the coordinate definition area is set as a trigger area area, and a function which is used infrequently such as special setting is used. Allocate to start (for example, detailed setting, user setting, etc.). In 2400 in the screen display example of FIG. 24, a, b, c and d are the trigger area areas. Considering that the normally used menu can be roughly and easily displayed with the four sides around the display 803 as a trigger, on the contrary, the function in the present embodiment is not easily displayed even by an erroneous operation. Although the area of the activation trigger area is small, the tip portion of the input device 107 is brought into contact with the stepped portion 109 around the display 803 so that the image can be displayed smoothly when the user intentionally activates it. The shape that makes it easy to indicate the coordinates in the definition area is considered.

Although the drawer tool described in each of the above-described embodiments has strictly defined the pull-out direction as the horizontal direction or the vertical direction, the function of this embodiment is that the direction of the pull-out direction is set to the diagonal direction. The feature is the coordinate calculation method for displaying the menu without feeling uncomfortable.

That is, when the base point is set to 0, the information of the numerical value of the X-axis or the Y-axis having the largest absolute value (the point farthest from the designated corner) of the detected coordinates is preferentially accepted. In 2402 in the screen display example of FIG. 24, a bar 2406 of 45 degrees passing through the point is displayed, and is displayed by a slidable operation in an oblique direction.

Details of the process in the process of withdrawing are the same as the menu display method in each of the above-described embodiments.

In FIG. 25, in step S2501, the entire display screen of the image display display 803 is used to display a photographic image or the like (full-screen image reproduction state). Next, in step S2502, arbitrary coordinates are detected. Next, in step S2503, it is determined whether the menu trigger area of the a-classification detailed menu is the definition area. If it is determined that the menu trigger area is not the definition area, the process advances to step S2509 to determine whether the GUI function button is turned on.
If it is determined that the GUI function button is not turned on, the process returns to step S2503, and the GUI
If it is determined that the function button is turned on, the flow advances to step S2510 to execute the function process, and then the present process operation is ended.

On the other hand, in step S2503,
If it is determined that the menu trigger area is the definition area, the process advances to step S2504 to determine whether the area detected in step S2503 is a, b, c, or d. If it is determined to be a or d, to step S2505, b
If it is determined to be c, the process proceeds to the corresponding processing step.

In step S2505, the trigger area is highlighted and it is determined whether the buzzer is turned on. If the determination result is negative (NO), the process returns to the step S2503, and if the determination result is affirmative (YES), the process proceeds to the next step S2506, and first of the X and Y coordinates, The farther from the received coordinate is given priority, and the amount of pulling out from the corner is updated according to the bar passing through that point.

Next, the process advances to step S2507 to stop at the maximum withdrawal amount position, and if the cursor moves from the maximum withdrawal amount position to a direction not near the starting point in the next step S2508, it is ignored and the coordinate information is turned off ( OF
After becoming valid until F), this processing operation is ended.

(Fifth Embodiment) Next, a fifth embodiment of the present invention will be described with reference to FIGS.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 26 is a diagram showing an example of a screen display of a menu of low frequency of use in the information processing apparatus according to this embodiment, and FIG. 27 shows a menu of low frequency of use in the information processing apparatus according to this embodiment. It is a flowchart which shows the flow of a display operation.

In FIG. 26, in order to make the relationship between the four sides around the display 803 and the other sides easy to understand, the bar areas are shown on the four sides, but not all of them can be seen by the user. .

In FIG. 27, in step S2701, the entire display screen of the image display display 803 is used to display a photographic image or the like (full-screen image reproduction state). Next, in step S2702, arbitrary coordinates are detected. Next, in step S2703, it is determined whether or not the menu trigger area of the a-classification detailed menu is the definition area. If it is determined that the menu trigger area is not the definition area, the process advances to step S2708 to determine whether the GUI function button is turned on.
If it is determined that the GUI function button is not turned on, the process returns to step S2703, and the GUI
If it is determined that the function button is turned on, the flow advances to step S2709 to execute the function processing, and then the present processing operation is ended.

On the other hand, in step S2703,
If it is determined that the menu trigger area is the definition area, the process proceeds to step S2704 and step S2704 is performed.
It is determined whether the area detected in 2703 is a, b, c, or d. If it is determined to be a or d, the process proceeds to step S2705, and if it is determined to be b or c, the process proceeds to the corresponding processing step.

In step S2705, a start button for starting the setting menu is popped up, the trigger area is highlighted, and it is determined whether or not the buzzer is turned on. If the determination result is negative (NO), the process returns to step S2703, and if the determination result is affirmative (YES), the start button is selected in the next step S2706 (shift diagonally rightward). Yes). Next, in step S2707, after the detailed menu is displayed on the display 803, this processing operation ends.

That is, when coordinates are detected in the a classification detailed menu definition area, 260 in the screen display example of FIG.
As shown in 2, a start-up button for starting the setting menu is displayed in a pop-up. When the input device 107 is slid slightly upward and rightward from that state, the start button area is detected, and when the detected coordinate information becomes 0 (OFF), it is selected in 2603 in the screen display example of FIG. The start button is executed, and the detailed setting menu is displayed on the display 803 as indicated by 2604 in the screen display example of FIG.

To close this detailed setting menu, similarly, "setting" shown in 2604 in the screen display example of FIG.
A means for detecting the inside of the trigger area a after the character range is coordinate-displayed, and 26 in the screen display example of FIG.
Means such as laying out a close button somewhere in the window indicated by 04 can be envisioned.

By providing this means, it is possible to divide the basic menu into a maximum of four categories and the other detailed setting menu into four categories. Since it is assumed that it is low and erroneous operation is unlikely to occur, it is desirable to keep only two options when considering mounting on products.

In consideration of practical conditions, it is desirable to be able to change the position in accordance with the dominant hand of the user in terms of which of the four corners of the display 803 is used for activation. A stroke direction that is natural for a right-handed person is from lower left to upper right (2 in the screen display example of FIG. 26).
607), the stroke direction that is natural for a left-handed person needs to be changed so as to be applied to the principle of upper left → lower right (2608 in the screen display example of FIG. 26). 2605 in the display example
For the left-handed person, the layout as shown by 2606 in the screen display example of FIG. 26 is most suitable.

From the operation method based on the selection of a soft touch button on the screen of the display by the input device as in the conventional device, the gesture of sliding the input device on the screen and processing the command after selection By diversifying the scrolling and moving methods, the means for setting the optimization for the dominant hand is effective.

(Sixth Embodiment) Next, a sixth embodiment of the present invention will be described with reference to FIGS. 28 and 35.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 28 is a diagram showing an example of a screen display when the drawer relations of two drawer menus in the information processing apparatus according to this embodiment are orthogonal, and FIG. 29 is the information processing according to this embodiment. The figure which shows the example of a screen display when the drawer relation of two drawer menus in a device is a parallel relationship, FIGS. 30-32 show the case where two or more drawer menus are drawn in the information processing apparatus which concerns on this Embodiment. FIG. 33 is a diagram showing a screen display example, and FIG. 33 is a flowchart showing the flow of basic principle operation according to the positional relationship of menus when pulling out two or more to four pull-out menus in the information processing apparatus according to the present embodiment, Figure 3
4 and FIG. 35 are flowcharts showing the flow of the operation of pulling up and displaying a maximum of four pull-out menus in the information processing apparatus according to the present embodiment.

In FIGS. 28 to 32, the display 803 is displayed.
The area of the bar is shown on the four sides in order to make it easy to understand the relationship between the four sides around and the other sides, but not all are visible to the user.

This embodiment is designed to display the pull-out menu from a plurality of directions at the same time, and can be applied when the display area of the display 803 is large.

When two pull-out menus are displayed at the same time, they are classified into a perpendicular relation and a parallel relation according to the positional relations of the two pull-out menus. There are four positions in the perpendicular direction and two positions in the parallel direction. There is a display pattern of relationships. Further, the display method also differs depending on the order of pulling out, the menu displayed first is influenced by the tool to be displayed later, and the screen transition is as shown in FIGS. 28 and 29.

In FIG. 28 and FIG. 29, the numbers described above the drawn menus indicate the order of drawing.

FIG. 28 shows an example of a screen display when two drawers are in an orthogonal relationship. In FIG.
The examples shown in 800 to 2803 and the examples shown in 2804 to 2807 are comparisons showing that the displayed methods are different depending on the drawing order even if the two drawers have the same relationship. In addition, there is a relation that the menu that is pulled out later has priority and the menu is displayed as usual, and as a result, the menu that is pulled out first is affected accordingly.

In the screen display example 2800 of FIG. 28, when the A classification menu is already extracted and the B classification menu in a right-angled positional relationship is to be extracted,
As indicated by 2802 in the screen display example of FIG. 28, the Y-axis direction of the A classification menu is scaled and reduced according to the amount by which the B classification tool is pulled out, and the maximum of the B classification menu of 2803 in the screen display example of FIG. 28 is displayed. It shows the process until it is fixed at the pull-out amount position.

The display contents in the A classification tool may be a display process in which it is simply reduced as image information, or the display information may be changed in the case of reduction depending on the specifications. For example, 2801 in the screen display example of FIG.
In the option in the A classification menu, the icon and the character are displayed together, but in the screen display example of FIG.
There is a possibility that the type of information may be changed according to the display area of the display 803, such as 03 in which only icons are displayed.

Next, 280 in the screen display example of FIG.
In FIG. 4, when pulling out the A classification menu in a right-angled position while the B classification menu is already extracted, as shown in 2806 in the screen display example of FIG. 28, the X axis direction of the B classification menu is the A classification. 28 shows the process in which the menu and its contents are reduced and displayed according to the extracted amount, and are fixed at the position of the maximum withdrawal amount of the A classification menu 2807 in the screen display example of FIG. 28.

FIG. 29 shows an example of a screen display in the case where two or more drawers in a parallel relationship are drawn out, and when the A classification menu is displayed in 2901 in the screen display example of the same figure. , When the D classification menu in the parallel position is about to be pulled out, the A classification menu is scaled in the opposite direction while keeping the pullout distance constant according to the pullout direction and the pullout amount of the D classification menu. (2902 to 2903 in the screen display example of FIG. 29).
This is because, as a feature of adopting this drawer method, a certain amount of the display area other than the menu is always displayed, so that the viewability of both images other than the drawer can be secured. .

FIG. 30 shows an example of a screen display when pulling out two or more menus. The state when pulling out the third "drawout menu" shows tools from two sides arranged in a right angle direction. And 2 arranged in parallel direction
The display method differs depending on whether the tool from the side is displayed.

In FIG. 30, the former will be described. Figure 2
As a continuation of 2803 in the screen display example of 8, the third tool is in a position in which the relationship of the third tool is parallel to the second drawer (3001 to 3003 in the screen display example of FIG. 30), When it becomes a right angle to the second one (3004 to 30 in the screen display example of FIG. 30)
06) and the change of the screen.

3001 to 3003 in the screen display example of FIG.
In 003, since the drawer of the A classification menu in the orthogonal relationship is already displayed in a reduced size in the vertical direction with respect to the maximum display, the law of the relationship between the tools facing each other while ensuring the minimum amount. The display state changes accordingly. B
Since the positional relationship between the classification menu and the C classification menu is parallel, 3002 to 3 in the screen display example of FIG.
In step 003, step S3303 to step S3304 of FIG. 33 described later are applied, which is shown by step S3416 of FIG. 34 described later.

Also, 300 in the screen display example of FIG.
In Nos. 4 to 3006, the A classification tool is a tool having a positional relationship facing each other, and the B classification tool is a tool having an orthogonal relationship, and changes according to the respective laws according to the circumstances such as the screen display example shown in FIG. Further, since the positional relationship between the B classification menu and the D classification menu is a right angle relationship, FIG.
In the screen display examples of 0 to 3005 to 3006, steps S3304 to S3305 of FIG.
Is applied, which is shown in step S3417 of FIG. 34 described later.

FIG. 31 shows an example of a screen display in the case where two or more drawers are drawn out. The latter example described above with reference to 3100 to 3103 in the screen display example of FIG.
The display progress when pulling out the third tool from the two sides arranged in the parallel direction is shown as a continuation of 2903 in the screen display example of FIG.

Since the relationship with the two drawers that have already been drawn out is orthogonal, step S3 in FIG.
The principle of 304 to step S3305 is applied, and A is already displayed as the third drawer is pulled out.
Both the classification tool and the D classification tool are simultaneously contracted and deformed in the Y-axis direction. Step S in FIG. 34 described later
Shown at 3407.

3104 to 3104 in the screen display example of FIG.
In 107, a screen display example of the progress according to the same rule is shown as a continuation of 2907 in the screen display example of FIG.

FIG. 32 shows a screen display example in the case of drawing out two or more drawers, and shows a screen display example in the middle of drawing out the maximum amount of four sides according to the above-mentioned law.

In the screen display example of FIG. 32, 3201 to 3203
Reference numeral 203 denotes a process of pulling out the remaining D classification tools as a continuation of 3003 in the screen display example of FIG.
Reference numerals 3204 to 3206 in the screen display example of FIG. 32 indicate a process of pulling out the remaining C classification tools as a continuation of 3006 in the screen display example of FIG. Reference numerals 3207 to 3209 in the screen display example of FIG. 32 indicate a process of pulling out the remaining C classification tools as a continuation of 3003 in the screen display example of FIG. 3210 to 3212 in the screen display example of FIG. 32 show a process of pulling out the remaining D classification tools as a continuation of 3007 in the screen display example of FIG.

In any process, if you want to close one of the drawers, you can specify the coordinates in the definition area of the menu bar, regardless of the order in which the drawers were drawn, and move the tool to the direction in which it was initially drawn. It can be closed by sliding it.

Further, for convenience of explanation in the case of pulling out a plurality of drawer menus, the maximum withdrawal amount is set to a position half the display area of the display 803, but the present invention is not limited to this. It is not limited, but holding at any position in the middle of withdrawal, and depending on the specifications, processing such as expanding the maximum withdrawal amount,
The means in each of the above-described embodiments is applied.

First, the basic principle operation according to the positional relationship of the menus in the case of pulling out two or more to four menus in the information processing apparatus according to the present embodiment will be described with reference to FIG.
It will be described based on the flowchart of FIG.

At step S3301, the display 803 is displayed.
It is determined whether any one of the four sides of the menu is pulled out, and in the next step S3302, the positional relationship with the first withdrawal menu is a facing position or a right angle position. If it is determined to be the facing position, the flow advances to step S3303 to perform a scaling reduction display process on the pull-out direction of the first pull-out menu while keeping the distance between the pull-out menus constant. Next, proceeding to step S3304, after fixing at the position of the same withdrawal amount that is 1/2 the withdrawal amount when displayed alone, this processing operation is ended.

On the other hand, in step S3302,
If it is determined that the position is the right angle position, step S330.
In step 5, the first drawer menu is subjected to a scaling reduction display process in the same direction as the drawer direction of the second drawer menu. Next, proceeding to step S3306, after fixing at the position of the maximum withdrawal amount of the second withdrawal menu, this processing operation is ended.

The above is the basic principle for displaying a plurality of menus, and it can be applied even if the number of menus to be pulled out increases.

Next, the overall operation of the information processing apparatus according to this embodiment up to the display of up to four menus will be described with reference to the flowcharts of FIGS. 34 and 35.

First, in FIG. 34, step S340.
In step 1, the a-class drawing menu is brought out, and in step S3402, the second tool is brought out. Next, in step S3403, the above step S340
The positional relationship between the second tool extracted in 2 and the tool extracted first is the facing position (2901 to 2903 in the screen display example of FIG. 29) or the perpendicular position (in the screen display example of FIG. 28). 2801 to 2803). If it is determined that the position is the right angle position, the process of FIG. 35 described later is performed. If it is determined that the position is the facing position, the process proceeds to step S3404.

In step S3404, the D classification tool is displayed, and the A classification tool shrinks in the direction opposite to the D classification tool withdrawing direction while maintaining the distance from the A classification tool according to the amount of extraction. Display processing is performed.
Next, in step S3405, the third tool is pulled out, and in next step S3406, the above-mentioned step S3405 is extracted.
The positional relationship between the third tool and the display tool extracted in step 3 is the facing position (3 in the screen display example of FIG. 31).
101-3103) or a right angle position. Then, if it is determined to be the facing position, the process proceeds to step S3407, and if it is determined to be the right angle position, the process proceeds to step S3408.

In step S3407, the B classification tool is displayed, and the Y-axis directions of the A classification tool and the D classification tool that have already been displayed are subjected to scaling display processing with respect to the Y-axis direction drawing amount. , And proceeds to step S3409.

On the other hand, if it is determined in step S3406 that the position is the right angle position, step S3408.
After the C classification tool is displayed, the Y-axis directions of the A classification tool and the D classification tool that have already been displayed are scaled and displayed with respect to the Y-axis direction drawing amount.
It proceeds to step S3409.

In step S3409, the fourth tool is extracted, in step S3410, the C classification tool is extracted, and in step S3411, the B classification tool is extracted.

In FIG. 35, in step S3412, the B classification tool is displayed, and the Y-axis direction of the A classification tool that has already been displayed is subjected to scaling reduction display processing with respect to the Y-axis direction drawing amount. , Step S3414
Go to. In step S3413, the C classification tool is displayed, and the Y-axis direction of the A classification tool that has already been displayed is subjected to scaling reduction display processing with respect to the Y-axis direction drawing amount, and the flow proceeds to step S3414.

In step S3414, the third tool is withdrawn, and the positional relationship between the third tool withdrawn in step S3414 in the next step S3415 and the second tool withdrawn in front of it. , It is determined whether it is a facing position or a right angle position. And
If it is determined that the position is the facing position, step S341.
If it is judged to be a right angle position to step 6, step S
3417 respectively.

In step S3416, the C classification tool is displayed, and the Y-axis direction of the B classification tool that has already been displayed is subjected to scaling reduction display processing with respect to the Y-axis direction drawing amount, and the A classification tool remains unchanged. After the position shifts, the process proceeds to step S3418.

On the other hand, if it is determined in step S3415 that the position is the right angle position, step S3417.
Then, the D classification tool is displayed, and the Y-axis direction of the already displayed A classification tool and B classification tool is scaled and reduced with respect to the amount of extraction in the X axis direction. After the scaling reduction display processing is performed while maintaining the distance according to the extraction amount of the classification tool, step S34
Proceed to 18.

A fourth tool is extracted in step S3418, a D classification tool is extracted in step S3419, and a B classification tool is extracted in step S3420.

(Seventh Embodiment) Next, a seventh embodiment of the present invention will be described with reference to FIGS.

The basic structure of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 36 is a diagram showing a screen display example of the progress of the change of the main image when the drawer menu is activated in the information processing apparatus according to the present embodiment, and FIGS. 37 and 38 are information according to the present embodiment. FIG. 39 is a flowchart showing the operation flow of the change of the main image when the drawer menu is activated in the processing device, and FIG. 39 is a screen table showing the relationship with the main image when closing the drawer menu in the information processing device according to the present embodiment. FIGS. 40 and 41 are flowcharts showing the flow of the operation relating to the main image when closing the drawer menu in the information processing apparatus according to the present embodiment, and FIG. 42 shows the present embodiment. It is a figure which shows the example of a screen display of the storage position of a drawer menu and the main image in such an information processing apparatus.

In FIG. 36, FIG. 39 and FIG. 42, a bar area is shown on the four sides in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, but it is not always necessary for the user to display the area. Not always visible.

In the present embodiment, the change of the main image according to the pull-out amount of the menu will be described by taking the B classification menu as an example, and the other rules are based on the rules of FIGS. 5 and 6.

FIG. 36 shows a screen display example showing how the main image A displayed in advance is transformed by pulling out the pull-out menu before displaying the menu.

The main image A is, for example, a photographic image, a sentence, or a mixture of a photograph and a sentence. Further, the main image A is a reproduced image that has already been stored in the built-in memory, or the main image A is in a standby state for shooting.
It is also assumed that the viewfinder image captured by the CCD of.

An example of the function of a reproduced image in the built-in memory is shown in FIG.
As described above, in the shooting standby state, it is possible to divide the categories into the same categories as those in the reproduction and to assign the functions having the similar properties. For example, the A classification menu is a function for searching a past image that is about to be combined with an image that is about to be photographed, and the B classification menu is for entering characters or the like for writing information to be written in the image before photographing. The function, C classification menu is a function for setting functions such as special effects on an image to be captured, D
It can be assumed that the classification menu is assigned with a function of presetting where to store the captured image.

In FIG. 37, the main image A is reproduced in full screen in step S3701 (see FIG. 3).
3600 in the screen display example of FIG. Next, step S
Arbitrary coordinates are detected in 3702, and the next step S370.
In 3, it is determined whether or not the "drawer menu display trigger area" is detected. Next, in step S1103, it is determined whether the coordinates in the "drawer menu display trigger area" have been detected. If it is determined that the coordinates in the "drawer menu display trigger area" are not detected, the process advances to step S3704 to determine whether or not to hold the coordinate input until entering the definition area. And
If it is determined that the coordinate input standby is held until the definition area is entered, the process returns to step S3703. If it is determined that the coordinate input standby is not held until the definition area is entered, the process returns to step S3701.

[0209] On the other hand, in step S3703,
If it is determined that the coordinates in the "drawer menu display trigger area" are detected, the process advances to step S3705 and the area detected in step S3703 is A.
Or it judges whether it is B or C or D. If it is determined to be A or D, step S3
If it is determined to be B or C in step 706, the process proceeds to step S3710 in FIG. 38, which will be described later.

[0210] In step S3706, the trigger area is highlighted and it is determined whether the buzzer is turned on. If the determination result is negative (NO), the process returns to step S3701, and if the determination result is affirmative (YES), the next step S3707 waits for X coordinate information reception, and the Y coordinate is ignored. Next step S37
At 08, it is determined whether or not the image of 3600 in the screen display example of FIG. 36 is deformed by the ratio of XX to X according to the X coordinate information, and the display ratio is constantly updated. If the determination result is negative (NO), step S3710.
If the determination result is affirmative (YES), the process proceeds to the next step S3709, and the image of 3600 in the screen display example of FIG. 36 is transformed with the ratio of X / 2 to X. To determine whether or not it has been fixed.
If the determination result is negative (NO), the process proceeds to step S3710, and if the determination result is affirmative (YES), the process operation is terminated.

In FIG. 38, in step S3710, it is determined whether or not the trigger area is highlighted and the buzzer is turned on. If the determination result is negative (NO), the process returns to step S3701, and if the determination result is affirmative (YES), the process proceeds to step S3711 to wait for Y coordinate information reception and ignore the X coordinate. To do. Next, in step S3712, the image of 3600 in the screen display example of FIG. 36 is transformed by the ratio of Y to Y according to the Y coordinate information, and it is determined whether or not the display ratio is constantly updated. If the determination result is negative (NO), the process returns to step S3710 in FIG. 37, and if the determination result is affirmative (YES),
In step S3713, it is determined whether or not the image of 3600 in the screen display example of FIG. 36 has been deformed and fixed at the ratio of Y / 2 to Y. If the determination result is negative (NO), the process returns to step S3710,
If the determination result is affirmative (YES), this processing operation ends.

That is, the main image A is reproduced in full screen, and next,
After the pull-out menu display trigger area is detected, thereafter, the pull-out amount of the menu is updated in synchronization with the detection information of the Y-axis coordinate being continuously changed. On the other hand, along with this, the main image A is scaled and reduced in the Y-axis direction at a ratio of Y-y to Y, and the main image A is halved in the Y-axis direction from the maximum withdrawal amount position of the B classification menu. It is held in a state where it is scaled and reduced. Alternatively, when the coordinate detection is turned off at an arbitrary position in the middle of drawing, the state is maintained as it is, and the input of an arbitrary function button in the menu is detected, so that the image processing or the like is executed.

Next, regarding the operation when closing the drawer menu in the information processing apparatus according to the present embodiment,
This will be described with reference to FIGS. 39 and 40.

Here, the change of the main image A according to the pull-out amount of the menu will be described by taking the B classification menu as an example, and the other rules are based on the rules of FIGS. 7 and 8.

In FIG. 40, X is determined in step S4001.
In the ratio of X / 2 to 3 in the screen display example of FIG.
The 900 image is transformed and fixed. Next, step S4
In 002, arbitrary coordinates are detected, and in step S4003, it is determined whether the display menu movement trigger area is the definition area. And the judgment result is negative (NO)
In the case of, it proceeds to step S4009 and determines whether or not the GUI function button is turned on. If the result is negative (NO), the process returns to step S4003,
If the determination result is affirmative (YES), the process advances to step S4010 to execute the functional process, and then the present process operation ends.

On the other hand, in step S4003,
If it is determined that the display menu movement trigger area is the definition area, the process advances to step S4004 to determine whether the area detected in step S4002 is A, B, C or D. If it is determined to be A or D, step S4005.
If it is determined to be B or C, the process proceeds to step S4012 of FIG. 41, which will be described later.

In step S4005, the trigger area is highlighted, the buzzer is turned on, and in the next step S4006, the X coordinate information is waited for and the Y coordinate is ignored. Next, in step S4007, the image of 3900 in the screen display example of FIG. 39 is deformed by the ratio of XX to X according to the X coordinate information, and it is determined whether the display ratio is constantly updated. And the judgment result is negative (NO)
In the case of, the process proceeds to step S4011, the display state is maintained, and then this processing operation is ended.

On the other hand, if the result of the determination in step S4007 is affirmative (YES), step S4008.
Go to and determine whether to keep the full-screen display with the aspect ratio. Then, if the determination result is negative (NO), the process proceeds to step S4011, and if the determination result is affirmative (YES), the present processing operation ends.

In FIG. 41, in step S4012, the trigger area is highlighted and it is determined whether or not the buzzer is turned on. If the determination result is negative (NO), the process returns to step S4003 in FIG. 40. If the determination result is affirmative (YES), the process proceeds to step S4013 to wait for Y coordinate information reception, and the X coordinate. Determines whether to ignore. If the determination result is negative (NO), step S400 in FIG.
3, and if the result of the determination is affirmative (YES), the flow advances to step S4014 to determine Y according to the Y coordinate information.
The ratio of Y-y to 3 in the screen display example of FIG.
The image of 900 is transformed, and it is determined whether the display ratio is constantly updated. If the determination result is negative (NO), the process returns to step S4011 in FIG. 40, and if the determination result is affirmative (YES), step S40.
The process proceeds to step 15 and it is determined whether or not to display and hold the entire screen in the normal / horizontal ratio. If the determination result is negative (NO), the process returns to step S4011 in FIG.
If the determination result is affirmative (YES), this processing operation ends.

That is, when the drawer menu is displayed on the full screen (full screen) (3900 in the screen display example of FIG. 39), 39 in the screen display example of FIG. 39 is displayed.
When the coordinates in the definition area of each function button in the menu indicated by 02 are detected, each function is processed, and the processing result according to the processing content is reflected in the main image A. Alternatively, when the input device 107 is slid in the direction indicated by the arrow at 3904 in the screen display example of FIG. 39, it is ignored.

A method of directly designating the B menu "menu display trigger area" from the state of 3900 in the screen display example of FIG. 39 (3903 in the screen display example of FIG. 39),
Alternatively, in the screen display example of FIG. 39, the input device 107 may be slid as it is from the touch panel sensor 106 of the display 803 without moving the input device 107 from the touch panel sensor 106 of the display 803.
An instruction is made in the “menu display trigger area” indicated by 3903 in the screen display example, and a standby state is set for a change in the coordinate information detected next.

Since the B classification menu is taken as an example here, the selected bar is highlighted and the buzzer sounds at the same time to enter the coordinate information reception standby state. Next, the image of 3900 in the screen display example of FIG. 39 is reduced and displayed according to the ratio of Yy to Y according to the Y coordinate information, and the display ratio is constantly updated according to the change of the detected coordinate. When the coordinate detection is turned off after the withdrawal amount y falls within the defined amount or the detected coordinates are updated to the position indicated by 3909 in the screen display example of FIG. 39, the main image A before displaying the menu is displayed. Return to the full screen display state of.

FIG. 42 shows the relationship between the storage position of the pull-out menu and the main image A. The method for displaying the transformed reduced image of the main image A differs depending on from which side the image is drawn.

For example, 42 in the image display example of FIG.
In 04, it is assumed that the color list of characters to be written by the input device 107 is laid out like a color palette.

Even if the drawer is not closed by selecting a color, FIG.
It is assumed that writing can be performed on the image in the state of 4204 in the image display example of No. 2, and the writing can be continued as it is while changing the color in the middle. In this case, when you close the drawer, it is converted to the ratio at the time of writing and displayed on the image, and when the drawer is closed, the image returns to the original ratio, A method of changing the magnification in the vertical direction is considered as a possibility.

Furthermore, 420 in the image display example of FIG.
2, 4204, 4206, and 4208, when it is desired to view the vertical and horizontal ratios in the same display as the original image, it is possible to view the image by a means such as grasping the corner of the scaled image with the input device 107 and scrolling. is there. For example, in FIG.
When the above-described operation is performed in the image state of 4204 in the image display example of No. 43, 43 in the image display example of FIG.
It becomes the state of 03.

(Eighth Embodiment) Next, an eighth embodiment of the present invention will be described with reference to FIGS. 43 to 45.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 43 is a diagram showing a screen display example of the progress of the change of the main image due to the change of the withdrawal amount in the information processing apparatus according to the present embodiment, and FIGS. 44 and 45 are related to the present embodiment. 9 is a flowchart showing a flow of an operation of the change of the main image due to the change of the withdrawal amount in the information processing apparatus.

In FIG. 43, bar areas are shown on the four sides in order to make it easy to understand the relationship between the four sides around the display 803 and the other sides, but not all of them are visible to the user. .

4300 to 4 in the screen display example of FIG.
In contrast to FIG. 42, reference numeral 303 denotes a B classification tool as an example, in the middle of the display method when the aspect ratio is kept constant with the reduction in the vertical direction, that is, the horizontal direction is also reduced. Show progress. Although this method can be envisioned as another embodiment having a completely different function or purpose, the user can arbitrarily select either one by the operation setting within the same model or the operation means performed while pressing any button. It is also possible to provide means for selecting the method.

Also, 430 in the screen display example of FIG.
Nos. 4 to 4307 show the case where the main image A is not changed at all and the pull-out menu is displayed in the form of being overlaid on it. This method is not sufficient for the intended purpose of the present invention, but since the present invention is based on the assumption that a CPU that can perform arithmetic processing at a very high speed is originally installed,
Although it is assumed that the image is reduced and displayed in real time, this embodiment is also shown as a reference as a transitional period until it becomes technically feasible.

In the case of the present embodiment, when the detected coordinate information is turned off while overlapping on the image during drawing,
Image processing is performed in the required time to rewrite the main image A. For example, the withdrawal amount is 430 in the screen display example of FIG.
If the detected coordinate information is turned off at position 5, the menu pull-out amount and the variable-magnification display of the main image A are rewritten to a display like 4308 in the screen display example of FIG. 43 after a required processing time has elapsed. If the detected coordinate information is turned off at 4306 in the screen display example of FIG. 43, the menu pull-out amount and the variable-magnification display of the main image A are displayed on the screen table of FIG. The display is rewritten to the display like 4309 in the illustrated example. Furthermore,
When the detected coordinate information is turned off at 4307 in the screen display example of FIG. 43, the menu pull-out amount and the variable-magnification display of the main image A are displayed in the screen display example of FIG. 43 after a required processing time has elapsed. The display is rewritten as 4310.

In FIG. 44, in step S4401, the entire display screen of the image display display 803 is used to display a photographic image or the like (full-screen image reproduction state). Next, in step S4402, arbitrary coordinates are detected. Next, in step S4403, it is determined whether the coordinates in the "drawer menu display trigger area" have been detected. If it is determined that the coordinates in the "drawer menu display trigger area" are not detected, the flow advances to step S4404 to determine whether to hold the coordinate input standby until entering the definition area. If it is determined that the coordinate input standby is not held until the definition area is entered, the process returns to step S4401, and if it is determined that the coordinate input standby is held until the definition area is entered,
The procedure returns to step S4403.

On the other hand, in step S4403,
If it is determined that the coordinates in the “drawer menu display trigger area” are detected, the process advances to step S4405 and the area detected in step S4403 is A.
Or it judges whether it is B or C or D. If it is determined to be A or D, step S4
If it is determined to be B or C in step 406, the process proceeds to step S4411 of FIG. 45, which will be described later.

In step S4406, the trigger area is highlighted and it is determined whether or not the buzzer is turned on. If the determination result is negative (NO), the process returns to step S4401, and if the determination result is affirmative (YES), the next step S4407 waits for X coordinate information reception, and the Y coordinate is ignored. Next step S44
At 08, it is determined whether or not to reduce the aspect ratio of the image of 4300 in the screen display example of FIG. 43 while maintaining the aspect ratio according to the X coordinate information, and constantly update the display ratio. If the determination result is negative (NO), the process proceeds to step S4410 to maintain the display state, then the present processing operation is ended, and if the determination result is affirmative (YES), the process proceeds to step S4409. Going forward, the ratio of vertical X / 2: horizontal Y / 2 is shown in FIG.
It is determined whether to deform and fix the image of 4300 in the screen display example. And the judgment result is negative (N
In the case of (O), the process proceeds to step S4410, and
If the determination result is affirmative (YES), this processing operation ends.

Next, in FIG. 45, first, step S
At 4411, the trigger area is highlighted and it is determined whether or not the buzzer is turned on. If the determination result is negative (NO), step S4401 of FIG.
If the determination result is affirmative (YES), the next step S4412 waits for Y coordinate information reception,
The X coordinate is ignored, and in the next step S4413, it is determined whether or not to reduce the aspect ratio of the image of 4300 in the screen display example of FIG. 43 while maintaining the aspect ratio according to the Y coordinate information and constantly update the display ratio. . If the determination result is negative (NO), the process proceeds to step S4410 in FIG. 44, and if the determination result is affirmative (YES),
In step S4414, it is determined whether or not the image of 4300 in the screen display example of FIG. 43 is deformed and fixed at a ratio of vertical X / 2: horizontal Y / 2. If the determination result is negative (NO), step S4 in FIG.
If the determination result is affirmative (YES), the process ends.

(Ninth Embodiment) Next, a ninth embodiment of the present invention will be described with reference to FIGS. 46 and 47.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

[0240] FIG. 46 is a "partial cutout help in the drawer menu" in the information processing apparatus according to the present embodiment.
FIG. 47 is a diagram showing a screen display example of a function, and FIG. 47 is a flowchart showing an operation flow of the “partial cut-out help in pull-out menu” function in the information processing apparatus according to the present embodiment.

In FIG. 46, in order to make it easy to understand the relationship between the four sides around the display 803 and other sides, the bar areas are shown on the four sides, but not all are visible to the user. .

According to the present invention, it is impossible to grasp the functions classified in each drawer until the user displays the "drawer menu" in the above description, so that the function of each property is It is assumed that they are classified or need to be remembered in advance.

Therefore, the present embodiment takes into consideration a function for assisting the user to use the device without hesitation even in a transitional state until he is used and memorized.

In a personal computer or the like, in general, before executing the function of a button such as an icon, simply place a pointing device such as a mouse on the function of the button to determine what kind of function the button will execute. The function that displays a brief balloon is called balloon help.

However, the present invention proposes an expression means that the contents can be confirmed by cutting off a part of the contents in the drawer with the same expression as when the drawer is displayed, instead of displaying the function names side by side.

In the screen display example of FIG. 46, 4605 is
This is a screen display example in the case where the help for cutting out a part of the contents of the A classification tool is displayed, and 4606 in the screen display example of FIG. 46 is shown as a diagram for comparison when the A classification tool is extracted and displayed. It is an example of a screen display.
Another feature is that the positions of visible icons are the same.

When this function is set in advance when the "drawer menu display trigger area" on each side is touched, the processing of this function is performed. When the prerequisite drawer menu is displayed as indicated by reference numeral 4606 in the screen display example of FIG. 46, the main image A is reduced in the horizontal direction, but in the screen display example of FIG.
05 has a feature that only a specific area is cut out and displayed, so that a part of the main image A is hidden but the image is not reduced.

First, when the "drawer menu display trigger area" is selected from the state in which only the main image A is displayed, a part of the drawer closest to the designated coordinates is displayed. From there, the inside of the A classification menu display trigger area is slid up and down while abutting the tip of the input device 107 against the exterior frame, the contents are scrolled. 4604 in the screen display example of FIG. 46 is a screen display example when the screen is scrolled to the bottom.

By the above means, the contents can be confirmed without displaying the drawer menu, and if the desired function button is not found, another drawer menu can be searched in the same manner. . When the icon of the desired function button is found, when the input device 107 is separated from the touch panel sensor 106, it is displayed as it is for a predetermined time (2 to 3 seconds), and when the function icon is directly selected by the input device 107 during that time. Also, it can be used as a shortcut function that can be operated more easily than the method in which the function is selected or executed, the pull-out menu is pulled out, and the desired function icon is selected.

4607 to 4 in the screen display example of FIG.
Reference numeral 609 indicates how the cutout help is displayed for each of the tools other than the A classification tool described at the beginning in response to the instruction in the drawer menu display trigger area, and in which direction the contents are scrolled. Is an example of the screen display (the icons in the help contents are omitted), and the arrow indicates the direction in which the scroll is performed.

47, in step S4701, step S4401 and step S4402 of FIG.
It is determined whether or not the "drawer menu trigger area" is detected through the same processing as. If the result of the determination is negative (NO), the flow advances to step S4710 to set the playback screen of only the main image A, and then the present processing operation is terminated. If the result of the determination is positive (YES), , Proceeds to step S4702, and determines whether help is on (ON) or off (OFF). If it is determined to be off, the process proceeds to step S505 and subsequent steps in FIG. 5, and if it is determined to be on, the process proceeds to step S4703 and the step S470.
It is determined whether the area detected in 1 is A, B, C or D. If A or D, the process advances to step S4704; if B or C, the process advances to step S4712.

[0252] In step S4704, the X coordinate information reception waits, the Y coordinate is ignored, and in step S4705, the X coordinate is accepted.
Coordinates are cut out according to the Y coordinate information within the menu trigger area definition, and the help display position is scrolled in the vertical direction. Next, in step S4706, a predetermined time (2
It is determined whether or not the display is being maintained (up to 3 seconds).
If the determination result is affirmative (YES), the process proceeds to step S4707, and if the determination result is negative (NO), the process proceeds to step S4709.

[0253] In step S4707, an arbitrary icon in the cutout help display is selected, and the next step S47.
Go to 08. In step S4708, after turning off the cutout help and executing the command of the selection icon,
This processing operation ends. Further, in step S4709, after the display of the cutout help is turned off, this processing operation ends.

On the other hand, in the step S4712, the reception of the Y coordinate information is awaited, the X coordinate is ignored, and the next step S471.
In 4713, the Y-coordinate is within the menu trigger area definition and the display position of the cut-out help is horizontally scrolled according to the information of the X-coordinate. Next, step S47144.
Then, it is determined whether or not the display is being maintained for a predetermined time (2 to 3 seconds). If the determination result is affirmative (YES), the process proceeds to step S4715, and if the determination result is negative (NO), the process proceeds to step S4709. In step S4715, an arbitrary icon in the cutout help display is selected, display of cutout help is turned off in the next step S4716, the command of the selected icon is executed, and then this processing operation is ended.

(Tenth Embodiment) Next, the first embodiment of the present invention
An embodiment of No. 0 will be described with reference to FIG.

The basic configuration of the information processing apparatus according to this embodiment is the same as that of the first embodiment described above with reference to FIG.
~ Since it is the same as Fig. 8, description will be given by diverting each of these figures.

FIG. 48 is a "partial cutout help in the drawer menu" in the information processing apparatus according to the present embodiment.
It is a figure which shows the example of a screen display of a function.

In FIG. 48, in order to make it easy to understand the relationship between the four sides around the display 803 and other sides, bar areas are shown on the four sides, but not all are visible to the user. .

This embodiment is adapted to be applied when the means shown in the ninth embodiment cannot be realized due to some constraint condition.

4801-4 in the screen display example of FIG.
Reference numeral 805 is an example of a screen display when coordinates are specified in the pull-out menu display trigger area of the A-classified menu.

The point of cutting out a part of the main image A without hiding it and assisting in quickly finding a function button is the same as the means shown in the ninth embodiment. Yes, other possible means of expression are listed.

4801 in the screen display example of FIG.
By securing a little more display area for this function,
It is a display means that has the effect of making the contents easier to see. Also,
Reference numeral 4802 in the screen display example of FIG. 48 is a display unit when this “draw-out menu partial cutout help” function is executed on the assumption that the maximum withdrawal amount shown in FIG. 22 is expanded. Further, reference numeral 4803 in the screen display example of FIG. 48 is a display unit for displaying the “help” function as a list without scrolling. Also, 4804 in the screen display example of FIG.
This is a display unit that minimizes the cut-out area area for the main image A by only displaying the names of the function items in “help” in characters. Further, reference numeral 4805 in the screen display example of FIG. 48 is a display unit in which scroll buttons are laid out in a software manner when an operation unit for sliding the side of the display 803 to scroll cannot be realized.

(Other Embodiments) The technology described in each of the above-described embodiments is applied to devices with a display screen such as a still camera, a video camera, an electronic portable terminal, a notebook computer, a head mounted display, and a car navigation system. It is also applicable to the operation of.

Also, it can be applied on a display screen of a stationary type personal computer or a workstation.
For example, in the case of a personal computer, a mouse is slid in any direction up, down, left or right, and when the cursor reaches an edge on the screen, the display position is maintained and a bar for pulling out a menu is displayed. The operation of the present invention can be performed by incorporating an operating means of clicking in that state and sliding the mouse toward the center while grasping. In this case, the list in the menu can be quickly displayed for displaying, and the user can arbitrarily adjust the amount of the display area.

In the case of a model equipped with a so-called cross key, in which the mechanical switches are laid out in a cross shape in the up, down, left, and right directions, by pressing the upper, lower, left, or right enclosure,
One of the sides is selected, and when the user releases the finger, a fixed display is performed in combination with the operation method. Depending on the user's option, the operation may be performed using the input device 107 or using only the key. It is possible to use them properly according to the operation situation.

In addition, in each embodiment of the present invention,
I explained as an example that the user can stop at any place during withdrawal, but as another method,
It is possible to envisage a method of limiting the place where the drawer is fixed in advance to several stages. This is a method that has an advantage that the processing speed can be further increased, and is a processing means that is considered according to the processing speed of the apparatus.

The object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or apparatus, and to supply a computer (or CPU or MPU of the system or apparatus).
It goes without saying that (etc.) can be achieved by reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

A storage medium for supplying the program code is, for example, a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, or a CD-RO.
M, CD-R, CD-RW, DVD-ROM, DVD-
RAM, DVD-RW, DVD + RW, magnetic tape, non-volatile memory card, ROM, etc. can be used.

Moreover, not only the functions of the above-described embodiments are realized by executing the program code read by the computer, but also the OS (operating system) running on the computer based on the instructions of the program code. It goes without saying that this also includes the case where the above) performs a part or all of the actual processing and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the case where the CPU or the like included in the function expansion board or the function expansion unit performs some or all of the actual processing and the processing realizes the functions of the above-described embodiments is also included.

[0272]

As described above, according to the present invention, in the menu display method in which there are no keys for executing a specific function around the display means and the four sides of the display means are display triggers, the entire main image is displayed. Without shrinking, you can grasp the type of each functional tool contained in the menu of large items classified into each category,
Further, by directly selecting the target button, the command can be issued more quickly, so that the visibility and operability of the display screen can be improved.

[Brief description of drawings]

FIG. 1 is a front view showing a configuration of an information processing device according to a first embodiment of the present invention.

FIG. 2 is a plan view showing the configuration of the information processing apparatus according to the first embodiment of the present invention.

FIG. 3 is a rear view showing the configuration of the information processing apparatus according to the first embodiment of the present invention.

FIG. 4 is a sectional view taken along line IV-IV in FIG.

FIG. 5 is a diagram showing an example of coordinate definition of a “drawer menu display trigger area” on the display in the information processing apparatus according to the first embodiment of the present invention.

FIG. 6 is a diagram showing an example of coordinate definition of a “drawer menu display trigger area” on the display in the information processing apparatus according to the first embodiment of the present invention.

FIG. 7 is a diagram showing a coordinate definition example of a “drawer menu display trigger area” on the display in the information processing apparatus according to the first embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of an information processing device according to the first embodiment of the present invention.

FIG. 9 is a flowchart showing a flow of functional operations of the information processing apparatus according to the first embodiment of the present invention.

FIG. 10 is a diagram showing a screen display example of a drawer menu starting operation of the information processing apparatus according to the first embodiment of the present invention.

FIG. 11 is a flowchart showing a flow of a display operation at the time of a drawer menu starting operation of the information processing apparatus according to the first embodiment of the present invention.

FIG. 12 is a flowchart showing a flow of display operation at the time of a drawer menu starting operation of the information processing apparatus according to the first embodiment of the present invention.

FIG. 13 is a screen display example when closing the drawer menu of the information processing apparatus according to the first embodiment of the present invention.

FIG. 14 is a flowchart showing a flow of a display operation when closing the drawer menu of the information processing apparatus according to the first embodiment of the present invention.

FIG. 15 is a flowchart showing a flow of display operation when closing the drawer menu of the information processing apparatus according to the first embodiment of the present invention.

FIG. 16 is a screen display example showing the layout method in the drawer menu according to the drawer amount of the information processing apparatus according to the first embodiment of the present invention.

FIG. 17 is a flowchart showing a flow of a layout display operation in a drawer menu according to a drawer amount of the information processing apparatus according to the first embodiment of the present invention.

FIG. 18 is a screen display example showing an image of the storage position of the drawer menu of the information processing apparatus according to the first embodiment of the present invention.

FIG. 19 is a screen display example in the case of performing stepwise display according to the function priority of the information processing apparatus according to the second embodiment of the present invention.

FIG. 20 is a diagram showing a range in a case where detection coordinates are turned off in a case where stepwise display is performed according to a function priority of the information processing apparatus according to the second embodiment of the present invention.

FIG. 21 is a flowchart showing a flow of a display operation in the case of performing stepwise display according to the function priority of the information processing apparatus according to the second embodiment of the present invention.

FIG. 22 is a screen display example regarding expansion of the maximum withdrawal amount of the information processing apparatus according to the third embodiment of the present invention.

FIG. 23 is a flowchart showing the flow of a display operation regarding expansion of the maximum withdrawal amount of the information processing apparatus according to the third embodiment of the present invention.

FIG. 24 is a screen display example of a detailed menu of low usage frequency of the information processing apparatus according to the fourth embodiment of the present invention.

[Fig. 25] Fig. 25 is a flowchart showing a flow of a display operation of a detailed menu of low usage frequency of the information processing apparatus according to the fourth embodiment of the present invention.

FIG. 26 is a screen display example of a detailed menu of low usage frequency of the information processing apparatus according to the fifth embodiment of the present invention.

FIG. 27 is a flowchart showing the flow of a display operation of a detailed menu of low use frequency of the information processing apparatus according to the fifth embodiment of the present invention.

FIG. 28 is a screen display example in the case of pulling out two or more pull-out menus of the information processing apparatus according to the sixth embodiment of the present invention (in the case of two at right angles).

FIG. 29 is a screen display example when pulling out two or more pull-out menus of the information processing apparatus according to the sixth embodiment of the present invention (when there are two parallel menus).

FIG. 30 is a screen display example in the case of pulling out two or more pull-out menus of the information processing apparatus according to the sixth embodiment of the present invention (three cases).

FIG. 31 is a screen display example in the case where two or more drawer menus of the information processing apparatus according to the sixth embodiment of the present invention are drawn (three cases).

FIG. 32 is an example of a screen display when pulling out two or more pull-out menus (four cases) of the information processing apparatus according to the sixth embodiment of the present invention.

FIG. 33 is a flowchart showing a flow of a display operation when pulling out two or more pull-out menus of the information processing apparatus according to the sixth exemplary embodiment of the present invention.

FIG. 34 is a flowchart showing a flow of display operation when pulling out two or more pull-out menus of the information processing apparatus according to the sixth exemplary embodiment of the present invention.

FIG. 35 is a flowchart showing a flow of display operation when pulling out two or more pull-out menus of the information processing apparatus according to the sixth exemplary embodiment of the present invention.

FIG. 36 is a screen display example of the changing progress of the main image at the time of a drawer menu starting operation of the information processing apparatus according to the seventh embodiment of the present invention.

[Fig. 37] Fig. 37 is a flowchart showing the flow of a display operation of changing progress of the main image at the time of a drawer menu starting operation of the information processing apparatus according to the seventh embodiment of the present invention.

FIG. 38 is a flowchart showing the flow of display operation of changing progress of main image at the time of pull-out menu activation operation of the information processing apparatus according to the seventh embodiment of the present invention.

FIG. 39 is a screen display example showing the relationship with the main image when closing the drawer menu of the information processing apparatus according to the seventh embodiment of the present invention.

[Fig. 40] Fig. 40 is a flowchart showing the flow of a display operation of the relationship with the main image when closing the drawer menu of the information processing apparatus according to the seventh embodiment of the present invention.

FIG. 41 is a flowchart showing the flow of a display operation relating to the main image when closing the drawer menu of the information processing apparatus according to the seventh embodiment of the present invention.

FIG. 42 is a screen display example showing the relationship between the storage position of the drawer menu and the change of the main image of the information processing apparatus according to the seventh embodiment of the present invention.

[Fig. 43] Fig. 43 is a screen display example showing the relationship of the change of the main image with the change of the withdrawal amount of the withdrawal menu of the information processing apparatus according to the eighth embodiment of the present invention.

FIG. 44 is a flow chart showing a flow of a display operation of a relationship of a change of a main image due to a change of a pull-out amount of a pull-out menu of the information processing apparatus according to the eighth exemplary embodiment of the present invention.

[Fig. 45] Fig. 45 is a flowchart showing the flow of a display operation of the relationship of the change of the main image with the change of the pull-out amount of the pull-out menu of the information processing apparatus according to the eighth embodiment of the present invention.

[Fig. 46] Fig. 46 is a screen display example of the "partial cutout help in a drawer menu" function of the information processing device according to the ninth embodiment of the present invention.

[Fig. 47] Fig. 47 is a flowchart showing the flow of a display operation of the "partial cutout help in a drawer menu" function of the information processing device according to the ninth embodiment of the present invention.

[Fig. 48] Fig. 48 is a screen display example of a "partial cutout help in a drawer menu" function of the information processing device according to the tenth embodiment of the present invention.

[Explanation of symbols]

100 Information Processing Device 101 Exterior Cover 102 Camera Part 103 Microphone (Microphone) 104 Shutter Button 105 Display (Display Means) 106 Touch Panel Sensor 107 Input Device (Pen-Type Pointing Device) 108 Speaker 109 Step 701 Function Button 801 CPU (Central Processing Unit) Device) 802 CCD (imaging device) 803 Image display 804 RAM (random access memory) 805 Flash memory 806 Microphone (microphone) 807 Shutter switch 808 Touch panel sensor 809 ROM (read only memory) 810 Battery 811 Speaker

Claims (47)

[Claims] 1. A function menu accommodating various functions is selected by selecting a plurality of sides surrounding the display screen of a display unit having a rectangular display screen provided in the main body of the information processing apparatus by an input device. An information processing device adapted to display on a display screen, wherein a part of the contents classified into a plurality of the function menu is cut out and partially displayed, and the input device is selected in the partially displayed state. By sliding in a direction parallel to the side, the function menu displayed on the display screen is scrolled, and the selection means displayed on the display screen is directly displayed without displaying the function tool of the function menu on the display screen. An information processing apparatus comprising: a control unit that controls to execute the function menu by operating the function menu. 2. The control means controls the function menu to be displayed on the display screen by maintaining a state in which the side is selected by the instruction means. Information processing equipment. 3. The control means, by selecting each of the four corners of the display screen with the input device, triggers a display standby of a function menu that is rarely used, and then displays the display screen as it is. 3. The function menu, which is less frequently used, is controlled to be displayed on the display screen by sliding the input device toward the central portion.
The information processing device according to 1. 4. The control means sets the function menu to 4
The information processing apparatus according to any one of claims 1 to 3, wherein the information processing apparatus is classified into two groups, and is controlled such that basic functions are assigned in the order of usage frequency, left, top, bottom, and right. 5. The information according to claim 4, wherein the classification of the function menu into four is classified into a search function, a character input function, a processing / editing function, and a saving / arranging function. Processing equipment. 6. The information processing apparatus according to claim 1, wherein the input device is a pointing device. 7. The information processing apparatus according to claim 1, wherein the input device is a touch pen. 8. The information processing apparatus according to claim 1, wherein the selection unit is a soft touch button. 9. The information processing apparatus according to claim 1, wherein the information processing apparatus is a portable information processing terminal. 10. A control unit for cutting and displaying a part of a function menu displayed on the display screen of a display unit having a rectangular display screen so that the function menu is displayed on the display screen. Scrolling means for scrolling the contents of the function menu by sliding the input device along a plurality of sides surrounding the display screen as they are when the part is cut out and displayed on the display screen, and a function tool of the function menu An information processing apparatus comprising: an instruction unit that directly executes the selection unit displayed on the display screen without displaying the item on the display screen to execute the function menu. 11. The information processing apparatus according to claim 10, wherein the function menu is classified into four functions of a search function, a character input function, a processing / editing function, and a saving / arranging function. 12. The input device is a pointing device, according to claim 10.
The information processing device according to 1. 13. The information processing apparatus according to claim 10, wherein the input device is a touch pen. 14. The information processing apparatus according to claim 10, wherein the selection unit is a soft touch button. 15. The information processing apparatus according to claim 10, wherein the information processing apparatus is a portable information processing terminal. 16. A function menu accommodating various functions is selected by selecting a plurality of sides surrounding the display screen of a display unit having a rectangular display screen provided in the main body of the information processing apparatus by an input device. A control method for controlling an information processing device to be displayed on a display screen, wherein a part of the contents classified into a plurality of the function menu is cut out and partially displayed, and in the partially displayed state By sliding the input device in a direction parallel to the selected side, the function menu displayed on the display screen is scrolled, and the function tool of the function menu is displayed on the display screen without being displayed on the display screen. Information processing, characterized in that a control step for controlling the function menu to be executed by directly operating the selected selection means is provided. Method of controlling the apparatus. 17. The control step of controlling to display the function menu on the display screen by maintaining a state in which the side is selected by the instruction means. Control method of information processing apparatus of the above. 18. The control step uses the input device to select each of the four corners of the display screen to trigger a display standby of a function menu that is rarely used, and to display the display screen from the state as it is. 17. The function menu, which is less frequently used, is controlled to be displayed on the display screen by sliding the input device toward the central portion.
Alternatively, the information processing apparatus control method according to Item 17. 19. The control step controls the function menu so that the function menu is classified into four groups and basic functions are assigned in the order of frequency of use: left, top, bottom, right. 19. A method for controlling an information processing device according to any one of 18 to 18. 20. Classifying the function menu into four
2. The classification into a search function, a character input function, a processing / editing function, and a saving / arranging function.
9. The method for controlling the information processing device according to item 9. 21. The method for controlling an information processing apparatus according to claim 16, wherein the input device is a pointing device. 22. The information processing apparatus control method according to claim 16, wherein the input device is a touch pen. 23. The method according to claim 16, wherein the selection unit is a soft touch button. 24. The information processing apparatus control method according to claim 16, wherein the information processing apparatus is a portable information processing terminal. 25. A function menu accommodating various functions is selected by selecting a plurality of sides surrounding the display screen of a display unit having a rectangular display screen provided in the main body of the information processing device by an input device. A control method for controlling an information processing device to be displayed on a display screen, comprising a control step of cutting out a part of the function menu displayed on the display screen and displaying it on the display screen. A scroll step of scrolling the contents of the function menu by sliding an input device along a plurality of sides surrounding the display screen as it is when cutting out a part of the function menu and displaying the cutout on the display screen, The selection means displayed on the display screen is directly displayed without displaying the function tool of the function menu on the display screen. And a step of instructing the function menu to be executed by instructing the information processing apparatus. 26. The control method of the information processing apparatus according to claim 25, wherein the function menu is classified into four of a search function, a character input function, a processing / editing function, and a saving / arranging function. 27. The input device according to claim 25, wherein the input device is a pointing device.
A method for controlling an information processing apparatus according to item 1. 28. The method according to claim 25 or 26, wherein the input device is a touch pen. 29. The method according to claim 25, wherein the selection unit is a soft touch button. 30. The information processing apparatus control method according to claim 25, wherein the information processing apparatus is a portable information processing terminal. 31. A function menu accommodating various functions is selected by selecting a plurality of sides surrounding the display screen of a display unit having a rectangular display screen provided in the main body of the information processing apparatus by an input device. A computer-readable control program for controlling an information processing device to be displayed on a display screen, wherein a part of the contents classified into a plurality of the function menu is cut out and partially displayed, and the partial By sliding the input device in a direction parallel to the selected side in the displayed state, the function menu displayed on the display screen is scrolled, and the function tool of the function menu is not displayed on the display screen. By directly operating the selection means displayed on the display screen, a control step for controlling to execute the function menu is executed. A control program of an information processing apparatus characterized by comprising a program code for causing a computer to execute the. 32. The control step of controlling to display the function menu on the display screen by maintaining a state in which the side is selected by the instruction means. Control program for the information processing device. 33. In the control step, by selecting each of the four corners of the display screen with the input device, the function waits as a trigger to wait for the display of a function menu that is infrequently used. 33. The control program for an information processing apparatus according to claim 31, wherein the input device is slid toward the center to control a function menu that is rarely used to be displayed on the display screen. . 34. The control step controls the function menu so that the function menu is classified into four groups, and basic functions are assigned in the order of frequency of use: left, top, bottom, right. 34. A control program for an information processing device according to any one of 33 to 33. 35. Classifying the function menu into four
4. It is classified into a search function, a character input function, a processing / editing function, and a saving / arranging function.
4. The control program for the information processing device according to item 4. 36. The control program for the information processing apparatus according to claim 31, wherein the input device is a pointing device. 37. The control program for an information processing apparatus according to claim 31, wherein the input device is a touch pen. 38. The control program of the information processing apparatus according to claim 31, wherein the selection unit is a soft touch button. 39. The information processing apparatus control program according to claim 31, wherein the information processing apparatus is a portable information processing terminal. 40. A function menu accommodating various functions is selected by selecting a plurality of sides surrounding the display screen of a display unit having a rectangular display screen provided in the main body of the information processing apparatus by an input device. A computer-readable control program for controlling an information processing device adapted to be displayed on a display screen, wherein control is performed so that a part of the function menu displayed on the display screen is cut out and displayed on the display screen. And a control step for cutting out a part of the function menu and displaying it on the display screen by scrolling the contents of the function menu by sliding the input device along a plurality of sides surrounding the display screen. The scroll step, and the function tool of the function menu is displayed on the display screen without being displayed. A control program for an information processing apparatus, comprising: a program code for causing a computer to execute an instruction step for executing the menu function by directly instructing a selection means displayed on a display screen. 41. The control program of the information processing apparatus according to claim 40, wherein the function menu is classified into four functions of a search function, a character input function, a processing / editing function, and a saving / arranging function. 42. The input device is a pointing device according to claim 40 or 41.
A control program for the information processing device according to item 1. 43. The control program for the information processing apparatus according to claim 40, wherein the input device is a touch pen. 44. The control program for an information processing apparatus according to claim 40, wherein the selection means is a soft touch button. 45. The information processing apparatus control program according to claim 40, wherein the information processing apparatus is a portable information processing terminal. 46. A storage medium storing the control program of the information processing apparatus according to claim 31. 47. The storage medium according to claim 46, wherein the information processing device is a portable information processing terminal.