JP5729756B2 - Portable electronic device, its control method and program - Google Patents

Description

  The present invention relates to a portable electronic device, a control method thereof, and a program. In particular, the present invention relates to a portable electronic device provided with a touch panel.

  In recent years, portable electronic devices such as mobile phones, smartphones, PDAs (Personal Digital Assistants), digital cameras, music players, and game machines have become widespread. In particular, portable electronic devices equipped with a touch panel are widely used with the enhancement of the functionality of portable electronic devices. This is because if the touch panel is used, icons and keys displayed on an LCD (Liquid Crystal Display) included in the portable electronic device can be directly operated, and menu settings and application operations can be performed intuitively. In this way, a very excellent operability is provided by combining a touch panel and a GUI (Graphical User Interface) using an LCD.

  Furthermore, the wider the area displayed on the LCD, the richer the display content and the more intuitive operation is possible, so the tendency of the LCD to become larger is remarkable. On the other hand, even in the situation where LCD screens are increasing, portable electronic devices themselves are becoming smaller and lighter, and some devices can be fixed with one hand and operated with one hand. There are many. As described above, when the size of the portable electronic device itself and the increase in the screen size of the LCD proceed at the same time, many areas of the surface on the operation side of the portable electronic device are occupied by the LCD and the touch panel. As a result, hard keys for recognizing user operations with a switch or the like are often arranged on a part or a side of a lower part of a surface (display surface) on which a touch panel is mounted. Then, since the portable electronic device has been reduced in size and weight, even if the portable electronic device can be operated with one hand, it is not possible to touch the hard key, and an action such as changing the portable electronic device is required.

  Even if it is a soft key that is operated using the touch panel, if you want to operate a soft key that is located on the opposite side of the hand holding the mobile electronic device, change the mobile electronic device. Action is required. Further, since the operation is performed while holding the portable electronic device, the finger used for the operation is often the thumb. However, the movable range of the thumb is limited, and there may be a case where a smooth operation with one hand in a portable electronic device cannot be realized.

  Further, in a thin portable electronic device, there is a risk that the portable electronic device may be accidentally dropped when it is changed. Furthermore, there are many scenes in which it is limited to one-handed operation when it is desired to operate a portable electronic device in a crowded train or the like.

  Here, in Patent Document 1, when a user touches the screen display unit with a touch panel, various operation buttons are displayed around the contacted position, and a predetermined operation can be performed without changing with one hand. A digital camera is disclosed.

JP 2007-052795 A

  The following analysis has been made from the viewpoint of the present invention.

  As described above, Patent Document 1 discloses an operation method for displaying various operation keys around a position touched on a screen. However, such an operation method is a feasible method because it is a digital camera specialized in the function of taking a photograph. Therefore, the operation method disclosed in Patent Document 1 cannot be applied to portable electronic devices having various functions such as a telephone, mail, and WEB (web) browser.

  An application such as a WEB browser is operated by an operation using a touch panel. When a certain position on the display screen is touched, it is an instruction to the application such as the WEB browser, or various operation buttons are displayed. It is necessary to clearly distinguish whether it is an instruction. For example, when the user touches the touch panel in the state where the WEB browser is activated and the user touches the touch panel in anticipation of returning to the previous page, the user's intention is Therefore, it is recognized as a portable electronic device with poor convenience and operability. Thus, there are problems to be solved in order to operate the portable electronic device with one hand.

  In one aspect of the present invention, a portable electronic device that can be easily operated by a user without changing the hand holding the portable electronic device, a control method thereof, and a program are desired.

According to a first aspect of the present invention, a display unit that displays a screen, an operation unit that receives an operation by a user, a first function that is executed when the operation unit receives a first operation, and the operation unit Is a portable electronic device comprising: a control unit that displays a virtual operation means for executing a second function on the display unit when the second operation is received , wherein the control unit is the portable electronic device When starting or when returning from the locked state where the operation by the operation unit is restricted, a third operation is received from the operation unit, and the virtual operation means is displayed based on the third operation. A portable electronic device is provided for determining whether or not .

According to a second aspect of the present invention, there is provided a method for controlling a portable electronic device including a display unit that performs screen display and an operation unit that receives an operation by a user, and the operation unit receives the first operation. When the step of executing the first function, when the operation unit accepts the second operation, and displaying the virtual operation means for performing a second function on the display unit, the portable electronic device Whether to accept the third operation from the operation unit and display the virtual operation means based on the third operation at the time of start-up or when returning from the locked state where the operation by the operation unit is restricted Determining whether or not, a method for controlling a portable electronic device is provided.

According to a third aspect of the present invention, there is provided a program that is executed by a computer that controls a portable electronic device that includes a display unit that displays a screen and an operation unit that receives an operation by a user. A process for executing a first function when an operation of 1 is received, a process for displaying a virtual operation means for executing a second function on the display unit when the operation unit receives a second operation; When starting up the portable electronic device or when returning from a locked state where the operation by the operation unit is restricted, a third operation is received from the operation unit, and the virtual operation is performed based on the third operation. And a process for determining whether to display the means .

  According to each aspect of the present invention, a portable electronic device that can be easily operated by a user without changing the hand holding the portable electronic device, a control method thereof, and a program are provided.

It is a figure for demonstrating the outline | summary of embodiment of this invention. It is a top view which shows an example of the whole structure of the portable electronic device which concerns on 1st Embodiment. It is a figure which shows an example of a structure of the portable electronic device which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the control part shown in FIG. It is a figure showing the state transition of the portable electronic device which concerns on 1st Embodiment. It is a figure which shows an example of a screen display when a portable electronic device is in a terminal locked state. It is a figure which shows an example of user operation at the time of canceling | releasing the terminal lock state of a portable electronic device and changing to left-hand mode. It is a figure which shows the relationship between the normal operation screen of a portable electronic device, and a key selection screen. It is a figure which shows an example of the operation method at the time of calling a key selection screen from the operation screen at the time of left hand mode. It is a figure for demonstrating the operation method in the key selection screen at the time of left hand mode. It is a figure for demonstrating the operation method in the key selection screen at the time of left hand mode. It is a figure for demonstrating the operation method in the key selection screen at the time of left hand mode. It is a figure for demonstrating the key selection screen at the time of right hand mode. It is a figure which shows an example at the time of arrange | positioning multiple touch operation detection areas.

  First, the outline of the embodiment will be described with reference to FIG. Note that the reference numerals of the drawings attached to this summary are attached to the respective elements for convenience as an example for facilitating understanding, and are not intended to limit the present invention to the illustrated embodiment.

  As described above, there is a desire to operate with one hand in portable electronic devices that are becoming smaller and lighter. However, since the operation is performed while holding the portable electronic device, the operated finger is often the thumb, and the movable range is limited. As a result, in order to press a hard key such as the MENU key, an action such as re-gripping the portable electronic device may be required. Therefore, a portable electronic device that facilitates the operation by the user without changing the hand holding the portable electronic device is desired.

  Therefore, the portable electronic device shown in FIG. 1 is provided. The portable electronic device shown in FIG. 1 executes a first function when a display unit that performs screen display, an operation unit that receives an operation by a user, and an operation unit receives a first operation. A control unit that displays virtual operation means for executing the second function on the display unit when the operation is accepted. If the user is using a portable electronic device and the operation such as an instruction given to a running application is the first operation, a function corresponding to the first operation is executed. .

  On the other hand, when trying to execute a function that is not necessarily linked to the running application, the second operation performed by the user is detected, and when the second operation is detected, the virtual operation means is displayed. This provides an opportunity (option) to perform the second function. For example, the second operation is set so that it can be easily operated with one hand, and when the second operation is performed, the option indicated by the virtual operation means is selected and the second function is executed. As a result, when the portable electronic device is operated with one hand, a predetermined operation can be performed without having to change the portable electronic device.

[First Embodiment]
Next, the first embodiment of the present invention will be described in more detail with reference to the drawings. FIG. 2 is a plan view showing an example of the overall configuration of the portable electronic device 1 according to the present embodiment. A portable electronic device 1 shown in FIG. 2 includes an LCD 10, a touch panel 20, and hard keys 30 to 32.

  The LCD 10 displays information necessary for the user to operate the portable electronic device 1. The LCD 10 is a monochrome or color liquid crystal panel. In the present embodiment, a liquid crystal panel will be described as a display device of the portable electronic device 1, but the display device is not limited to this, and may be a display device such as an organic EL (electrofluorescence).

  The touch panel 20 is a device that detects a user operation using a flat plate sensor. There are various types of touch panel methods including a capacitance method, but the method is not limited. A touch panel 20 is arranged so as to substantially overlap the LCD 10. Therefore, the display area of the LCD 10 corresponds to the operation area of the touch panel 20 as it is. Since the display area of the LCD 10 and the operation detection area on the touch panel 20 are substantially overlapped, only the LCD 10 is illustrated in the following drawings.

  The hard key 30 functions as a MENU key, the hard key 31 functions as a HOME key, and the hard key 32 functions as a BACK key. Various menus are displayed by pressing the MENU key, transition to the standby screen by pressing the HOME key, and transition to the previous screen by pressing the BACK key.

  Next, the internal configuration of the portable electronic device 1 will be described. FIG. 3 is a diagram illustrating an example of the configuration of the portable electronic device 1 according to the present embodiment. A portable electronic device 1 shown in FIG. 3 includes an LCD 10, a touch panel 20, hard keys 30 to 32, and a control unit 40. Since the LCD 10, the touch panel 20, and the hard keys 30 to 32 are as described above, description thereof is omitted.

  The control unit 40 includes a touch panel control unit 100, an input operation detection unit 200, an LCD control unit 300, and a screen display control unit 400. The control unit 40 realizes switching of operation modes based on user operations detected by the input operation detection unit 200, operation instructions for each application, generation and display of information necessary when the user operates the mobile electronic device 1, and the like. To do.

  The touch panel control unit 100 is connected to the touch panel 20 and plays a role as a driver for setting and driving the touch panel 20 as hardware. The touch panel control unit 100 detects the position (physical coordinates) where the user touches the touch panel 20 and transmits the coordinate information to the input operation detection unit 200.

  From the coordinate information received from the touch panel control unit 100, the input operation detection unit 200 calculates a position where the user touches the touch panel as a coordinate (logical coordinate) on the LCD 10. Note that the input operation detection unit 200 can also detect operations by the hard keys 30 to 32.

  The LCD control unit 300 is connected to the LCD 10 and plays a role as a driver for setting and driving the LCD 10 as hardware. The LCD control unit 300 generates a signal for driving the LCD 10 from the screen display information transmitted from the screen display control unit 400 and transmits the signal to the LCD 10.

  The screen display control unit 400 generates a display image such as a key selection screen that is directly seen when the user operates. The information required by the screen display control unit 400 includes contents such as what key is displayed and where the key is displayed.

  Next, the hardware configuration of the control unit 40 will be described. FIG. 4 is a diagram illustrating an example of a hardware configuration of the control unit 40. The control unit 40 includes a CPU (Central Processing Unit) 41, a storage unit 42, and a work memory 43, and is connected via a bus 44.

  The CPU 41 is a central processing unit that operates according to a program. Various functions and applications of the mobile electronic device 1 are realized by the CPU 41 executing the program.

  In the storage unit 42, the CPU 41 stores various setting information necessary for realizing each function of the mobile electronic device 1. Examples of information stored in the storage unit 42 include the current operation mode of the mobile electronic device 1, key information displayed on the screen, and the display direction of the key selection screen. Further, the storage unit 42 includes a nonvolatile memory 421 and a ROM (Read Only Memory) 422. The nonvolatile memory 421 holds information that needs to be stored even after the power supplied to the portable electronic device 1 is turned off. The ROM 422 is a storage device that stores fixed data such as various control programs executed by the CPU 41 and built-in contents.

  The work memory 43 is constituted by a RAM (Random Access Memory), and stores data temporarily required when the CPU 41 executes a program.

  Next, the operation of the mobile electronic device 1 will be described. The operation mode of the mobile electronic device 1 has a plurality of operation modes. There is a normal mode as the first operation mode. The normal mode is a mode in which screen display and screen transition are not performed in consideration of a mode (both hands, right hand, left hand) when the user performs an operation. There is a one-handed operation mode as the second operation mode. In the one-handed operation mode, the user performs screen display and screen transition considering mainly whether the user operates with the right hand or the left hand. The case of operating with the right hand is referred to as the right hand mode, and the case of operating with the left hand is referred to as the left hand mode, and will be described below.

  The portable electronic device 1 has a terminal lock state that transitions when no operation is performed for a certain period of time. This is a function for preventing a malfunction of the portable electronic device 1 by making a transition to the terminal lock state when the portable electronic device 1 is not operated for a certain period of time and restricting operations by the touch panel. FIG. 5 is a diagram illustrating the state transition of each mode and the terminal lock state.

  Next, an operation at the time of transition from the terminal lock state to the normal mode or the one-hand mode will be described. FIG. 6 is a diagram illustrating an example of a screen display when the mobile electronic device 1 is in the terminal lock state. The display area (display area) of the LCD 10 includes an upper pictogram area 501 for displaying an icon indicating a radio wave state and a remaining battery level, a time, etc., a lock state display area 502 indicating that the terminal is locked, and a terminal lock Each display area has a pointer area 503 in which a touch panel operation in a state can be performed. Further, an arrow 504 for guiding a slide operation in the upper left direction, an arrow 505 for guiding the slide operation in the upward direction, and an arrow 506 for guiding the slide operation in the upper right direction are displayed on the LCD 10. At the same time, as a result of the slide operation in the direction of each arrow, a message (left hand mode, normal mode, right hand mode) that clearly indicates the mode in which the portable electronic device 1 transitions is displayed. Note that, as described above, the terminal lock state exists in order to prevent malfunction of the mobile electronic device 1, and such an operation is invalid even if an area other than the circular pointer 503 is touched.

  When the user returns from the terminal locked state and uses the portable electronic device 1, the terminal locked state is released by sliding the circular pointer area 503 along a predetermined locus. In the portable electronic device 1 according to the present embodiment, it is determined whether the user has slid along one of the trajectories indicated by arrows 504 to 506, and the operation mode is determined.

  FIG. 7 is a diagram illustrating an example of a user operation when releasing the terminal lock state of the mobile electronic device 1 and shifting to the left-hand mode. When the user wants to change to the left-hand mode, the user touches the point 503a displayed at the center of the pointer area 503. Thereafter, the point 503a is slid to the point 503b according to the locus indicated by the arrow 504 while touching the point 503a. If the control unit 40 recognizes such a slide operation via the touch panel control unit 100 and the input operation detection unit 200, the terminal lock state of the portable electronic device 1 is released, and the mode shifts to the left-hand mode.

  Similarly, the point 503a is slid according to the trajectory indicated by the arrow 506 in the upper right direction to make a transition to the right-hand mode, and the point 503a is slid according to the trajectory indicated by the upward arrow 505 to be changed to the normal mode. it can.

  In this way, by displaying the trajectory for transitioning to each mode in advance with an arrow, it is possible to intuitively move to the one-hand mode, and to perform a slide operation in the upper left direction that is easy to operate with the left hand. The operation mode can be determined without changing the portable electronic device 1 by assigning the left-hand mode and assigning the right-hand mode to the right-handed slide operation that is easy to operate with the right hand. The arrow displayed when determining the operation mode is not limited to the direction shown in FIGS. 6 and 7, and may be the horizontal direction.

  Moreover, although the case where it returns from a terminal lock state when determining an operation mode was demonstrated, the scene which can determine an operation mode is not restricted to the return from a terminal lock state. For example, it is conceivable to determine the operation mode in a scene such as when the security mode is canceled or when returning from the standby mode or hibernation state.

  Next, touch panel operations in the left hand mode and the right hand mode will be described. In the left-hand mode and the right-hand mode, there is a key operation screen that displays keys that perform operations different from the icons and soft keys displayed on the LCD 10 of the portable electronic device 1. For example, the key operation screen is a screen that displays on the LCD 10 a key that realizes a function equivalent to the function assigned to the hard keys 30 to 32.

  Although the operation method on the key operation screen will be described later, the key operation screen is easily called with the left hand in the left hand mode and with the right hand in the right hand mode to realize key selection. As described above, the key selection screen is a screen virtually provided on the normal operation screen, and the normal operation screen and the key selection screen can be switched to each other (see FIG. 8). The key selection screen corresponds to the virtual operation means described above.

  Next, an operation method of the key selection screen will be described. FIG. 9 is a diagram illustrating an example of an operation method when a key selection screen is called from the operation screen in the left-hand mode. In FIG. 9, it is assumed that the thumb slides from point 508a to point 508b. In the left hand mode, the portable electronic device 1 always displays a touch operation detection area 507 for shifting to the key selection screen at the left end of the LCD 10. Since the active applications are displayed in the area other than the touch operation detection area 507, the key selection screen is displayed in a range that does not affect the display of these applications.

  When the control unit 40 detects an operation on the touch panel 20 by the user at any position in the touch operation detection area 507 and then detects that a slide operation has been performed, the screen display control unit 400 generates a display image, A key selection screen is displayed on the LCD 10 through the LCD control unit 300.

  FIG. 10 is an example of a display including a key selection screen after the user has slid from point 508a to point 508b. Virtual keys 509 to 511 in FIG. 10 are key selection screens. When the control unit 40 detects that the slide operation has been performed up to the position of the point 508b, the control unit 40 displays a key selection screen at a position centered on the point 508a. The virtual key 509 corresponds to the MENU key, the virtual key 510 corresponds to the HOME key, and the virtual key 511 corresponds to the BACK key.

  As described above, when the user touches an arbitrary position in the touch operation detection area 507 and slides it to the right by a certain amount while touching, the key selection screen is displayed centering on the position. At this time, the rightward slide amount (coordinate movement amount from the points 508a to 508b) is determined to be an optimum value depending on the shape of the mobile electronic device 1, but the user does not feel any stress during the slide operation. About half the width of the thumb is preferable.

  Next, an operation when the user selects a virtual key to be executed after the key selection screen is displayed will be described. When the user presses a virtual key displayed on the key selection screen, an operation corresponding to the pressed virtual key is performed. For example, when the virtual key 509 is pressed, an operation equivalent to the MENU key can be performed. When it is detected that the user further slides the thumb from the state shown in FIG. 10 and releases the finger from the touch panel 20 in the area corresponding to the virtual key 511, it is assumed that the virtual key 511 is selected and the BACK key Performs the same function as

  On the other hand, as shown in FIG. 11, when it is detected that the finger is released at a point 508d that is a position other than the key selection screen configured by the virtual keys 509 to 511, the user stops the operation on the key operation screen. Delete the key selection screen as if Even if the user's finger moves to the point 508d shown in FIG. 11, if the finger does not move away from the touch panel 20, the operation by the user is continued and the display of the key selection screen is maintained. That is, when the finger is slid to the position of the virtual key 511 (point 508e) and released as shown in FIG. 12 from the state moved to the position of the point 508d in FIG. 11, the virtual key 511 is selected. deal with. The above is the operation method of the key selection screen in the left-hand mode.

  Further, as shown in FIG. 13, the same operation can be performed in the right-hand mode by applying the left-hand mode operation symmetrically. Further, in the normal mode, the touch operation detection area in the left hand mode or the right hand mode is not displayed, and each function assigned to the hard key can be executed by pressing the hard keys 30 to 32. Note that the transition to the left-hand mode and the right-hand mode is not limited to returning from the terminal lock state or the like, but it is also possible to provide a key having a role of changing the handle. For example, a part of the keys displayed on the key selection screen can be provided with a key that allows the handle to be changed.

  As described above, when the mobile electronic device 1 is in the terminal lock state, the operation for releasing the lock state and the operation for selecting the operation mode can be performed simultaneously. As a result, the terminal lock state can be released and the operation mode can be selected with the minimum necessary operation, and a portable electronic device with high operability can be provided.

  Further, by providing a touch operation detection area at the left end of the LCD 10 in the left-hand mode and at the right end in the right-hand mode, the display of the running application is not disturbed and can be easily performed by the operating hand. It is possible to make a transition to the key selection screen. Furthermore, by displaying the key selection screen centering on the position detected in the touch operation detection area when transitioning to the key selection screen, it is easy regardless of the size of the hand or the position where the portable electronic device 1 is different for each user. It is possible to call the key selection screen by simple operation.

  In addition, by confirming the selection operation when the finger is released from the touch panel 20, it is possible to select a key by a single slide operation without the user releasing the finger after sliding the touch operation detection area. . At the same time, the display of the key selection screen is continued until the finger is released from the touch panel 20, so that the thumb is once slid away from the key selection screen, and after confirming the contents displayed on the key selection screen, the user desires. An operation for selecting a key is also possible.

  Thus, the portable electronic device 1 according to the present embodiment realizes an intuitive and simple operation using the touch panel without requiring any prior operation when realizing the function assigned to the hard key. ing. Of course, in left-hand mode and right-hand mode, you do not have to operate with one hand. If you operate with one hand in both hands, you can carry it faster and more efficiently than in normal mode. The electronic device 1 can be operated. As will be described later, the keys displayed on the key selection screen are not limited to hard keys, and soft keys can be arranged. Keys that are frequently used are assigned to the keys displayed on the key selection screen and can be operated quickly with one hand. In addition, it is possible to operate a key in an area that cannot be reached by the hand holding the portable electronic device 1 with another hand.

[Second Embodiment]
Next, a second embodiment will be described in detail with reference to the drawings. Since the hardware configuration of the portable electronic device 2 according to the present embodiment is not different from the hardware configuration of the portable electronic device 1 according to the first embodiment, the description corresponding to FIGS. 2 to 4 is omitted. In the present embodiment, the touch operation detection area described above will be described in more detail.

  The touch operation detection area according to the first embodiment has been described as being set at the left end in the left-hand mode and arranged at the right end in the right-hand mode. This embodiment demonstrates that it is not restricted to these arrangement | positioning.

  In the first embodiment, the area from the upper end to the lower end among the areas that can be displayed by the LCD 10 and the area from the upper end to the lower end has been described as the touch operation detection area 507. However, as shown in FIG. 14, there may be a plurality of touch operation detection areas (507b to 507d).

  Furthermore, it is not always necessary to arrange the touch operation detection area at the left end in the left hand mode and at the right end in the right hand mode, and a touch operation detection area common to the left hand mode and the right hand mode may be provided. Specifically, it is conceivable to arrange the touch operation detection areas at the left and right ends in both the left hand mode and the right hand mode.

  Alternatively, the arrangement of the touch operation detection area may be changed depending on the posture of the mobile electronic device 2. If the portable electronic device 2 includes an acceleration sensor or a gyro sensor and can detect that the posture of the portable electronic device 2 has changed, it is possible to arrange a touch operation detection area corresponding to the changed posture. For example, the touch operation detection area may be arranged on the left end when the user is in the vertical orientation, and the touch operation detection area may be arranged on the upper side or the lower side when the user is changed to the horizontal orientation. .

  As described above, by appropriately arranging the touch operation detection area according to the shape and use situation of the portable electronic device 2, the key operation screen can be easily called, and the convenience can be further improved.

[Third Embodiment]
Subsequently, a third embodiment will be described. Since the hardware configuration of the portable electronic device 3 according to the present embodiment is not different from the hardware configuration of the portable electronic device 1 according to the first embodiment, the description corresponding to FIGS. 2 to 4 is omitted. In this embodiment, the key selection screen will be described in more detail.

  In the first embodiment, the hard keys 30 to 32 are assigned to the keys displayed on the key selection screen. In the present embodiment, it will be described that the keys displayed on the key selection screen are not limited to hard keys.

  As described above, in the description of the first embodiment, hard keys are displayed on the key selection screen, but soft keys instead of hard keys can be used as targets on the key selection screen. It is also possible to display virtual keys to which different operations are assigned for each application. Specifically, when the WEB browser is being executed, frequently used keys such as “return”, “forward”, and “page update” can be displayed on the key selection screen. Further, when mail is being viewed by the mail application, keys such as “reply”, “forward”, and “delete” may be displayed on the key selection screen to perform these operations.

  Further, it is not necessary to display the key selection screen having the same content regardless of the detection position in the touch operation detection area, and the content of the key selection screen can be changed according to the detection position. Specifically, the touch operation detection area is divided into two upper and lower areas, and when a user operation on the touch panel 20 is detected in the upper half touch operation detection area, a hard key is displayed on the key selection screen, and the lower half When the operation of the touch panel 20 is detected in the touch operation detection area, the virtual key displayed on the key selection screen may be changed according to the application.

  Furthermore, as shown in FIG. 14, when a plurality of touch operation detection areas are arranged, it is possible to provide a selection screen (selection menu) for determining a key selection screen to be displayed for each area. In addition, the virtual key displayed on the key selection screen is determined based on the number of times the touch operation detection area is touched, and is determined by the left hand mode or the right hand mode. It is also possible to use a key disposed on the side surface or the back surface instead of the hard key disposed on

  The virtual keys to be displayed on the key selection screen do not have to be aligned in the horizontal direction, and can be arranged in any direction such as the vertical direction. These settings can be made by the selection menu and stored in the storage unit 42. .

  A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

  (Additional remark 1) The display part which performs a screen display, the operation part which receives operation by a user, and if the said operation part receives 1st operation, a 1st function will be performed and the said operation part will receive 2nd operation And a control unit that displays virtual operation means for executing the second function on the display unit.

  (Additional remark 2) The said control part is a portable electronic device which displays the display instruction | indication area | region for accepting said 2nd operation on the said display part.

  (Additional remark 3) The said control part receives 3rd operation from the said operation part at the time of starting from the said portable electronic device, or at the time of the return from the locked state where the operation by the said operation part is restrict | limited, The said 3rd A portable electronic device that determines whether or not to display the virtual operation means based on the operation.

  (Additional remark 4) The said control part is a portable electronic device which changes the display position of the said display instruction | indication area | region based on a said 3rd operation, when displaying the said virtual operation means.

  (Additional remark 5) The said operation part receives operation by the user with a touch panel, the said control part detects the 1st contact point by the user in the said display instruction | indication area | region, and the said 1st contact point is to a 2nd contact point A portable electronic device that displays the virtual operation means when moved.

  (Additional remark 6) Furthermore, after the said virtual operation means is displayed, the said control part is a portable electronic device which performs a said 2nd function according to the position where the contact was cancelled | released.

  (Supplementary note 7) A portable electronic device in which a plurality of display instruction areas are displayed on the display unit.

  (Additional remark 8) The said 2nd function is a portable electronic device which is the function previously assigned corresponding to the hard key, or the function designated by the user.

  (Supplementary note 9) A method for controlling a portable electronic device comprising a display unit for displaying a screen and an operation unit for accepting an operation by a user, wherein the first function is executed when the operation unit accepts the first operation. And a step of displaying a virtual operation means for executing a second function on the display unit when the operation unit receives the second operation.

  (Additional remark 10) Furthermore, the control method of the portable electronic device including the process of displaying the display instruction | indication area | region for receiving said 2nd operation on the said display part.

  (Additional remark 11) Furthermore, at the time of starting of the said portable electronic device or at the time of the return | restoration from the locked state where the operation by the said operation part is restrict | limited, Based on the said 3rd operation A method for controlling a portable electronic device, comprising the step of determining whether or not to display the virtual operation means.

  (Additional remark 12) When the said operation part receives operation by a user with a touch panel, the process which detects the 1st contact point by a user in the said display instruction | indication area | region, and the said 1st contact point move to the 2nd contact point A method for controlling a portable electronic device, further comprising displaying the virtual operation means on the display.

  (Additional remark 13) Furthermore, after the said virtual operation means is displayed, the control method of the portable electronic device including the process of performing a said 2nd function according to the position where the contact was cancelled | released.

  (Supplementary Note 14) A program that is executed by a computer that controls a portable electronic device that includes a display unit that performs screen display and an operation unit that receives an operation by a user. The program is executed when the operation unit receives a first operation. The program which performs the process which performs 1 function, and the process which displays the virtual operation means for performing a 2nd function on the said display part, if the said operation part receives 2nd operation.

  (Additional remark 15) The program which performs the process which displays the display instruction | indication area | region for accepting said 2nd operation on the said display part further.

  (Additional remark 16) Furthermore, based on the process which receives 3rd operation at the time of starting of the said portable electronic device, or at the time of the return from the locked state where the operation by the said operation part is restrict | limited, and said 3rd operation A program for executing a process for determining whether to display the virtual operation means.

  (Additional remark 17) When the said operation part receives operation by a user with a touch panel, the process which detects the 1st contact point by a user in the said display instruction | indication area | region, and the said 1st contact point move to the 2nd contact point A program for executing processing for displaying the virtual operation means.

  (Additional remark 18) Furthermore, after the said virtual operation means is displayed, the program which performs the process which performs a said 2nd function according to the position where the contact was cancelled | released.

  It should be noted that the disclosures of the above patent documents and the like are incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiment can be changed and adjusted based on the basic technical concept. Various combinations and selections of various disclosed elements are possible within the scope of the claims of the present invention. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea. For example, a pen or the like can be used instead of a finger when operating the touch panel.

1-3 Mobile electronic device 10 LCD
20 Touch Panel 30-32 Hard Key 40 Control Unit 41 CPU
42 Storage Unit 43 Work Memory 44 Bus 100 Touch Panel Control Unit 200 Input Operation Detection Unit 300 LCD Control Unit 400 Screen Display Control Unit 421 Nonvolatile Memory 422 ROM
501 Upper pictogram area 502 Lock state display area 503 Pointer area 503a, 503b, 508a-e Point 504-506 Arrow 507, 507a-d Touch operation detection area 509-511, 509a, 510a, 511a Virtual key

Claims (9)

A display unit for displaying a screen;
An operation unit that accepts user operations;
When the operation unit accepts a first operation, the first function is executed, and when the operation unit accepts a second operation, a virtual operation means for executing the second function is displayed on the display unit. A control unit;
A mobile electronic component must include a,
The control unit receives a third operation from the operation unit when the portable electronic device is activated or when returning from a locked state in which the operation by the operation unit is restricted, and based on the third operation Te, portable electronic device, wherein the determining child whether to display the virtual operation means.   The portable electronic device according to claim 1, wherein the control unit displays a display instruction area for accepting the second operation on the display unit. 3. The portable electronic device according to claim 2 , wherein, when displaying the virtual operation means, the control unit changes a display position of the display instruction area based on the third operation. The operation unit accepts an operation by a user through a touch panel,
Wherein the control unit detects a first contact point by a user in the display instruction area, according to claim 2 or 3 wherein the first contact point for displaying the virtual operating means when moved to a second contact point The portable electronic device as described in. Furthermore, the said control part is a portable electronic device of Claim 4 which performs a said 2nd function according to the position where the contact was cancelled | released after the said virtual operation means was displayed. The display instruction area, a portable electronic device according to any one of claims 2 to 5 are more displayed on the display unit. The second function is a function assigned to correspond to previously hard key or portable electronic device according to any one of claims 1 to 6 the user is specified functions. A display unit for displaying a screen;
An operation unit that accepts user operations;
A method for controlling a portable electronic device comprising:
A step of executing a first function when the operation unit receives a first operation;
When the operation unit accepts a second operation, displaying a virtual operation means for executing a second function on the display unit;
When starting up the portable electronic device or when returning from a locked state where the operation by the operation unit is restricted, a third operation is received from the operation unit, and the virtual operation is performed based on the third operation. Determining whether to display means;
A method for controlling a portable electronic device, comprising: A display unit for displaying a screen;
An operation unit that accepts user operations;
A program for causing a computer to control a portable electronic device comprising:
A process of executing a first function when the operation unit receives a first operation;
When the operation unit accepts a second operation, a process of displaying virtual operation means for executing a second function on the display unit;
When starting up the portable electronic device or when returning from a locked state where the operation by the operation unit is restricted, a third operation is received from the operation unit, and the virtual operation is performed based on the third operation. Processing to determine whether or not to display means;
A program that executes.

Images