JP2012043359A - Portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent a standby screen from being hidden by an icon of an operation key.SOLUTION: The portable terminal comprises: a display (122) for displaying character information and image information; a touch panel (121) that is disposed on the front surface of the display and that accepts an input; a control part (11) for allowing the display to display a wall paper image to set one or a plurality of partial areas within the wall paper image as one or a plurality of operation key allocation areas so as to allocate a specific operation key to the operation key allocation area; and storage part (14) for associating the operation key allocation area and an operation key allocated to the operation key allocation area with each other for storing. The control part performs a control, when the touch panel accepts an input, in response to the operation key associated with the operation key allocation area in a position where the input has been accepted.

Description

  The present invention relates to a mobile terminal that includes a touch panel and that can assign operation keys to wallpaper images.

  In recent years, mobile terminals such as mobile phones and PDAs (Personal Digital Assistants) that employ touch panels have been developed. By adopting a touch panel, operation keys (soft keys) can be reproduced on the display panel, reducing machine switches, and improving usability for reasons such as improved visibility and layout flexibility. Contributing to A portable terminal capable of changing the arrangement of operation keys is also known. For example, Patent Document 1 discloses a portable terminal that changes the arrangement of operation keys according to the size of a user's finger. Yes.

JP 2010-108080 A

  In a portable terminal having a conventional touch panel, if an operation key icon is placed on the standby screen, a part of the wallpaper image set as the standby screen is hidden by the icon as shown in FIG. There was a problem that. As shown in FIG. 14B, it is conceivable to separately display the wallpaper image and the icon of the operation key. However, in this case, there is a problem that the display area of the wallpaper image becomes narrow. In the portable terminal described in Patent Document 1, the arrangement of the soft keys can be changed, but a part of the wallpaper image is still hidden by the operation key icon. Also, if the operation key icon is displayed on the standby screen, it can be easily operated by another person, and it is necessary to lock it by a method such as fingerprint authentication or password entry in order to prevent operation by another person. there were.

  In order to solve the above problems, an object of the present invention is to prevent a wallpaper image from being hidden by an icon of an operation key, provide a user with a free operation layout, and improve security without locking. Is to provide.

  In order to solve the above problems, a mobile terminal according to the present invention includes a display unit that displays character information and image information, a touch panel unit that is disposed in front of the display unit and receives input, and a wallpaper image on the display unit. A control unit that sets one or a plurality of areas in the wallpaper image as operation key assignment areas and assigns specific operation keys to the operation key assignment area, the operation key assignment area, and the operation A storage unit that stores the operation keys allocated to the key allocation area in association with each other, and when the touch panel unit receives an input, the control unit stores the operation key in the operation key allocation area at a position where the input is received. Control according to the associated operation key is performed.

  In the mobile terminal according to the present invention, the control unit sets the operation key assignment area based on position information input from the touch panel unit when the operation key assignment area is set.

  Further, in the mobile terminal according to the present invention, the control unit calculates a color tone difference between adjacent pixels of the wallpaper image when setting the operation key assignment area, and borders a portion having a color tone difference equal to or greater than a predetermined threshold value. An area closed by the boundary is set as the operation key assignment area.

  In the mobile terminal according to the present invention, when the area of the region closed by the boundary is less than a predetermined threshold value, the control unit assigns a surrounding operation key assignment region having an area equal to or larger than the predetermined threshold value. It is characterized by being integrated into.

  In the mobile terminal according to the present invention, the control unit edits (integrates, divides, or inserts) the set operation key allocation area based on position information input from the touch panel unit. And

  According to the present invention, by assigning operation keys to one or more areas in a wallpaper image, it is possible to prevent the wallpaper image from being hidden by the icons of the operation keys, and to give a user a free operation layout. it can. Further, by not displaying the icon of the operation key on the wallpaper image, it is possible to improve the security without locking.

It is a block diagram which shows schematic structure of the portable terminal of embodiment by this invention. It is a perspective view of the input part of the portable terminal of embodiment by this invention. It is a flowchart which shows the operation key allocation operation | movement of the portable terminal of 1st Embodiment by this invention. It is a figure which shows an example of the image and character which are displayed on an input part at the time of operation key allocation operation | movement of the portable terminal of 1st Embodiment by this invention. It is a figure which shows the example which allocated the operation key to the wallpaper image of the portable terminal of 1st Embodiment by this invention. It is a figure explaining the color tone difference calculation process of 2nd Embodiment by this invention. It is a figure explaining the setting of the operation key allocation area | region of 2nd Embodiment by this invention. It is a flowchart which shows the operation key allocation operation | movement of the portable terminal of 2nd Embodiment by this invention. It is a figure which shows an example of the image and character which are displayed on an input part at the time of the key assignment operation | movement of the portable terminal of 2nd Embodiment by this invention. It is a figure which shows the example which allocated the operation key to the wallpaper image of the portable terminal of 2nd Embodiment by this invention. It is a flowchart which shows the operation key allocation operation | movement of the portable terminal of 3rd Embodiment by this invention. It is a figure which shows the example of integration of the operation key allocation area | region of the portable terminal of 3rd Embodiment by this invention. It is a figure which shows the example of a division | segmentation of the operation key allocation area | region of the portable terminal of 3rd Embodiment by this invention. It is a figure which shows the standby screen in which the icon of the conventional operation key is arrange | positioned.

  Hereinafter, embodiments of a portable terminal according to the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of a mobile terminal according to an embodiment of the present invention. The portable terminal according to the present embodiment includes a control unit 11, an input unit 12, an imaging unit 13, and a storage unit 14.

  The input unit 12 receives an operation input from a user and displays various information such as an input result according to each application program. The input unit 12 includes a touch panel unit 121 and a display unit 122. FIG. 2 is a perspective view of the input unit 12.

  The display unit 122 displays various image information and character information such as input reception icons such as operation keys, wallpaper images, and messages to notify the user. The display unit 122 includes a liquid crystal display (LCD) or an organic EL display.

    The touch panel unit 121 is disposed so as to overlap the front surface of the display unit 122, and includes a matrix switch that accepts input from a user's finger, stylus pen, or the like. For example, a resistance film method or a capacitance method is known. Yes. The touch panel unit 121 outputs a signal corresponding to a position where an input by the press is detected to the control unit 11 by detecting an input by a finger or a stylus or a slide. In the present invention, detecting that the touch panel unit is touched, pressed, or slid by a finger or a slitus is referred to as “accepting input”. Furthermore, if the touch panel unit is an optical system, detecting that the touch panel unit detects a finger, a slitus, or the like is “accepting input”.

  The imaging unit 13 includes an imaging lens, an imaging element, and the like, captures an image, and acquires a captured image. The captured image is output to the control unit 11 and subjected to image processing by an image processing unit (not shown).

  The storage unit 14 displays a memory that stores an image captured by the imaging unit 13, a memory that stores a program for operating the mobile terminal, and the like as one storage unit.

  The control unit 11 sets a wallpaper image (background image of the standby screen of the display unit 122), one or more settings of an operation key assignment area that is an area in the wallpaper image for assigning operation keys, and an operation key assignment area. Assign specific operation keys to.

  When setting the wallpaper image, the control unit 11 causes the display unit 122 to display a request message for the user such as “Please select a wallpaper image”. Then, based on the user's instruction, the image acquired by the imaging unit 13, the image acquired from the outside by connecting to the Internet and downloaded, or received by connecting to an external device is displayed as the wallpaper image 122. To display. In FIG. 1, a connection unit or a wireless transmission / reception unit for connecting to an external device is not shown.

  When the control unit 11 sets the operation key assignment area, for example, a request to the user such as “Set the area. Select the start point.” “Enclose the area.” Display a message. When the user traces the touch panel unit 121 with a stylus pen or a finger, the control unit 11 acquires position information input from the touch panel unit 121, sets the traced region as an operation key assignment region, and stores it in the storage unit 14. Remember.

  When assigning operation keys, the control unit 11 causes the display unit 122 to display a request message for the user such as “Please select an assignment key”. When the user selects an operation key to be assigned, the control unit 11 associates the selected operation key with the operation key assignment area and stores them in the storage unit 14.

  Next, the operation key assignment operation of the mobile terminal according to the present embodiment will be described with reference to FIGS. FIG. 3 is a flowchart showing the operation key assignment operation of the mobile terminal of this embodiment, and FIG. 4 is a diagram showing an example of images and characters displayed on the display unit 122 of the input unit 12 during the operation key assignment operation. .

  In step S101, selection of the operation key assignment mode from the user is accepted by the input unit 12, and when the operation key assignment mode is selected, the process proceeds to step S102.

  In step S102, the control unit 11 causes the display unit 122 to display an inquiry message as to whether to set (change) the wallpaper image. When setting a wallpaper image, the control unit 11 sets an image designated by the user as a wallpaper image. FIG. 4A is a diagram illustrating an example of a set wallpaper image.

  In step S103, the control unit 11 causes the display unit 122 to display a message requesting selection of an area, as shown in FIG. When the touch panel unit 121 is traced, the control unit 11 acquires the traced position information. FIG. 4C shows a state where the user has selected an area. In this embodiment, a state of tracing with the stylus pen B is shown.

  In step S104, the control unit 11 determines whether or not the traced shape is a closed shape from the acquired position information. If it is determined that the traced shape is a closed shape, the process proceeds to step S105. If it is determined that the traced shape is not a closed shape, a message requesting reselection of a region is displayed. The information is displayed on the display unit 122, and the process returns to step S103.

  In step S105, the control unit 11 sets an area traced by the touch panel unit 121 as an operation key assignment area.

  In step S106, the control unit 11 causes the display unit 122 to display a message requesting selection of an operation key to be assigned, as shown in FIG. When the user selects an operation key, a message indicating that the operation key assignment to the operation key assignment area is completed is displayed on the display unit 122 as shown in FIG.

  By repeating this process, different operation keys can be assigned to each set operation key assignment area in the wallpaper image. FIG. 5 is a diagram showing an example in which different operation keys are assigned to areas of the sun, clouds, sky, mountains, and lakes in the wallpaper image. Specifically, when the mobile terminal is a mobile phone capable of calling, the menu key in the sun area, the mail key in the cloud area, the web key in the sky area, the on-hook key in the mountain area, and the lake Operation keys necessary for use as a mobile phone, such as off-hook keys, are assigned to the area. It should be noted that an area excluding the operation key assignment area set from the wallpaper image, specifically, the area of the sun, cloud, mountain, and lake is described as an operation key assignment area when described with reference to FIG. It is also possible to set an empty area excluding the operation key assignment area as a new operation key assignment area.

  Thus, according to the mobile terminal of the present embodiment, since an operation key can be assigned to an arbitrary image region in the wallpaper image, the wallpaper image is prevented from being hidden by the icon of the operation key, Give the user a free operation layout. In addition, security can be improved by not displaying the icon of the operation key on the wallpaper image.

(Second Embodiment)
Next, a mobile terminal according to a second embodiment of the present invention will be described. The mobile terminal according to the present embodiment is different from the mobile terminal according to the first embodiment in that an operation key assignment area is automatically set by detecting a change in color tone of a wallpaper image.

  The control unit 11 of the present embodiment has a function of calculating a color tone difference between adjacent pixels of the wallpaper image. The function may be realized by a dedicated processor (for example, a DSP (Digital Signal Processor)). FIG. 6 is a diagram for explaining the tone difference calculation process. As an example of the format of an image used in a portable terminal, “jpeg” which is a general extension, the color tone of the image is expressed by RGB coordinates, and the shade of each color component is 8 bits (0 to 255). It is expressed. The control unit 11 calculates the color tone difference (color tone change amount) by obtaining the correlation between the color vectors in the color space coordinates, that is, the angle between the two vectors. Note that the correlations between the single color vectors between RG, between GB, and between BR are orthogonal, so the correlation is 0, and the color tone difference is maximum at this time.

  FIG. 7 is a diagram for explaining the setting of the operation key assignment area, and is an image that can actually be used as a wallpaper image. In the present embodiment, a case where the area A indicated by a thick frame in FIG. 7 is set as an operation key assignment area will be described. As shown in FIG. 6, the color tone of the blue sky in FIG. 7 is expressed as [90, 200, 240] in RGB coordinates, for example, and the color tone of the leaf in FIG. 7 is expressed as [40, 100, 40] in RGB coordinates. . The control unit 11 calculates the color difference between the two, detects a portion where the color difference is equal to or greater than a predetermined threshold as a boundary, and divides the blue sky region and the leaf region. Then, an area closed by the boundary is set as an operation key assignment area. It is preferable that the outermost periphery of the wallpaper image (touch panel unit 121) be the boundary.

  In section 1 indicated by an arrow in FIG. 7, there is a large change in color tone from the sky to the plant (for example, [90, 200, 240] in the RGB coordinates in the sky, [40, 100, 40] in the plant), and thus the control unit 11. Detects this part as a boundary. On the other hand, in a section 2 indicated by an arrow in FIG. 7, a change in color tone between a bright part and a dark part of a leaf (for example, [40, 100, 40] in a bright part in RGB coordinates and [20, 80, 20 in a dark part). ]) Has occurred, but since the color change is small, it is not detected as a boundary. Thereby, the object in a wallpaper image can be extracted more correctly.

  In addition, when the area of the region closed by the boundary is less than a predetermined threshold, the control unit 11 integrates it into a surrounding operation key assignment region having an area equal to or larger than the predetermined threshold. That is, an area that is too narrow to be used as an operation key is not set as an operation key assignment area, and the area is not subdivided more than necessary. For example, in section 3 indicated by an arrow in FIG. 7, although there is a large change in color tone such as a road or sky seen through the branches of a plant, the area is small, so it is not set as a separate operation key assignment area. The predetermined threshold is, for example, the area of a circle with a diameter of 5 mm in the case of finger input assumption, and the area of a circle of 2 mm in diameter in case of stylus pen assumption.

  Next, the key assignment operation of the mobile terminal according to the present embodiment will be described with reference to FIGS. FIG. 8 is a flowchart showing the key assignment operation of the mobile terminal of this embodiment, and FIG. 9 is a diagram showing an example of images and characters displayed on the display unit 122 of the input unit 12 during the key assignment operation.

  In step S201, the control unit 11 accepts selection of an operation key assignment mode from the user. When the operation key assignment mode is selected, the process proceeds to step S202.

  In step S202, the control unit 11 causes the display unit 122 to display an inquiry message as to whether to set (change) the wallpaper image. When setting a wallpaper image, the control unit 11 sets an image designated by the user as a wallpaper image.

  In step S203, the control unit 11 causes the display unit 122 to display a message for requesting setting of an area, as illustrated in FIG. Then, the control unit 11 calculates the color tone difference of the image, and detects a portion where the color tone difference is equal to or greater than a predetermined threshold as a boundary.

  In step S204, the control unit 11 determines whether or not there is an operation key assignment candidate region surrounded by the boundary. If it is determined that there is an operation key assignment candidate area, the process proceeds to step S205. If it is determined that there is no operation key assignment candidate area, a notification that there is no operation key assignment area is displayed on the display unit 122. The process returns to step S202.

  In step S205, the control unit 11 determines whether or not the area of the operation key assignment candidate region is equal to or greater than a threshold value. If it is determined that the area of the operation key assignment candidate area is equal to or greater than the threshold, the process proceeds to step S207. On the other hand, if it is determined that the area of the operation key assignment candidate area is less than the threshold value, the process proceeds to step S206, and the operation key assignment candidate area is integrated into an operation key assignment candidate area having an area equal to or larger than the surrounding threshold value.

  In step S207, the control unit 11 sets an operation key assignment candidate area as an operation key assignment area. When the setting of the operation key assignment area is completed, the set operation key assignment area is displayed on the display unit 122 as shown in FIG. 9B. In the present embodiment, the case where the operation key assignment area is a part surrounded by a thick frame is shown, but the area may be identified by coloring each area.

  In step S208, the control unit 11 causes the display unit 122 to display a message requesting selection of an operation key to be assigned, as shown in FIG. Then, similarly to FIGS. 4 and 5, operation keys are assigned to the operation key assignment area based on a user instruction to the touch panel unit 121. FIG. 10 shows a case where the mobile terminal is a mobile phone capable of making a call, a menu key in the sun area in the wallpaper image, a mail key in the cloud area, a Web key in the empty area, a hold key in the mountain area, It is a figure which shows the example which assigned the operation key required when using it as a mobile telephone like an on-hook key to a mountain area, an off-hook key to a lake area, and a forest area etc. as a clear key. Further, an area excluding the operation key assignment area set from the wallpaper image, specifically, the sun, cloud, mountain peak, mountain, lake, and forest areas are defined as operation key assignment areas. In this case, it is also possible to set the empty space that is an area excluding the operation key assignment area as a new operation key assignment area.

  As described above, according to the portable terminal of the second embodiment, the operation key assignment area can be automatically set by calculating the color difference using the control unit 11.

(Third embodiment)
Next, a mobile terminal according to a third embodiment of the present invention will be described. Assuming that one object may be composed of a plurality of colors, the mobile terminal of the present embodiment manually sets the operation key assignment area and then manually integrates the operation key assignment area. Can do. For example, in the mobile terminal of the second embodiment, when there is snow at the top of the mountain, the mountain is separated at the snow part and the hail part at the top of the mountain, but the mountain is 1 as in the first embodiment. Can be integrated into one. Also, after setting the operation key assignment area automatically, assuming that the operation key assignment area is automatically set, the number of operation key assignment areas may be less than the number of operation keys to be assigned. The operation key assignment area can be manually divided and inserted.

  The control unit 11 according to the present embodiment causes the display unit 122 to display an inquiry message to the user such as “Do you want to edit the area?”, For example. Based on the user's instruction, the operation key assignment area is edited (integrated, divided, or inserted). Here, the integration means that a plurality of operation key assignment areas designated by the user are set as one operation key assignment area. The division means that an area designated by the user is set as a new operation key assignment area. Insertion means that a template figure stored in the storage unit 14 added by the user or a figure drawn by handwriting is used as a new operation key assignment area.

  The control unit 11 compares the number of operation key assignment areas with the number of operation keys to be assigned when the number of operation keys to be assigned in advance by the user. If the number of operation key assignment areas is small, for example, , A request message to the user such as “the number of areas is insufficient. Please divide or add areas” may be displayed. Further, when the number of operation key assignment areas is larger than the number of operation keys to be assigned, an inquiry message as to whether to integrate operation key assignment areas may be displayed on the display unit 122.

  Next, the key assignment operation of the portable terminal according to the present embodiment will be described with reference to FIGS. FIG. 11 is a flowchart showing the key assignment operation of the mobile terminal according to the present embodiment, FIG. 12 is a view showing an example of integration of operation key assignment areas, and FIG. 13 is a view showing an example of division of operation key assignment areas. . Steps S301 to S307 are the same as steps S201 to S207 shown in FIG.

  In step S308, the control unit 11 causes the display unit 122 to display an inquiry message as to whether or not to edit the operation key assignment area, as shown in FIG. If the user edits the operation key assignment area, the process proceeds to step S309. If the user does not edit the operation key assignment area, the process proceeds to step S310.

  In step S309, the control unit 11 causes the display unit 122 to display a message requesting integration, division, or insertion, as illustrated in FIG. Then, the operation key assignment area is edited based on a user instruction. As shown in FIG. 12 (b), when the user selects the summit and ridge with the stylus pen as the operation key assignment area to be integrated, as shown in FIG. 12 (c), the summit and heel are one operation key assignment area. Integrated as. In addition, FIG.12 (b) shows the state which selected the peak and the ridge in order with one stylus pen B. FIG. Further, in this embodiment, the case where step S308 is entered after step S307 has been described. However, after the steps from step S301 to step S307 have been performed once, the process is temporarily ended, and the user gives an instruction to edit the operation key assignment area. You may make it start from step S308.

  When the image shown in FIG. 13A is set as a wallpaper image, as shown in FIG. 13B, three areas of the moon, the night sky, and the sea are automatically set as operation key assignment areas. At this time, if the number of operation keys to be assigned is four, the operation key allocation area is insufficient. Therefore, the operation key allocation area is divided based on a user instruction or a new operation key is assigned. Insert the allocation area. When the user newly adds a boundary as shown in FIG. 13C, the “night sky” is divided into two left and right operation key assignment areas. When the user inserts a new figure as shown in FIG. 13D, this figure is set as a new operation key assignment area.

  In step S308 to step S310, the control unit 11 causes the display unit 122 to display a message requesting selection of an operation key to be assigned, and assigns an operation key to the operation key assignment area based on a user instruction.

  As described above, according to the mobile terminal of the third embodiment, editing such as integrating, dividing, and adding operation key assignment areas can be performed. Even when the number of operation key allocation areas necessary for allocation is insufficient, the operation key allocation area can be easily added.

  Each of the above embodiments has been described as a representative example, but it will be apparent to those skilled in the art that many changes and substitutions can be made within the spirit and scope of the invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments, and various modifications and changes can be made without departing from the scope of the claims. For example, the mobile terminal according to the first embodiment can be provided with a function for editing the operation key assignment area. Also, for example, two operation keys may be associated with one operation key allocation area so that the first operation key is pressed once and the second operation key is pressed twice. Good.

DESCRIPTION OF SYMBOLS 11 Control part 12 Input part 13 Imaging part 14 Storage part 121 Touch panel part 122 Display part

Claims (5)

A display unit for displaying character information and image information;
A touch panel unit disposed on the front surface of the display unit for receiving input;
A control unit that displays a wallpaper image on the display unit, sets one or a plurality of areas in the wallpaper image as operation key assignment areas, and assigns specific operation keys to the operation key assignment areas;
A storage unit that stores the operation key assignment area and the operation key assigned to the operation key assignment area in association with each other;
When the touch panel unit receives an input, the control unit performs control according to the operation key associated with the operation key allocation region at a position where the input is received.   The mobile terminal according to claim 1, wherein the control unit sets the operation key assignment region based on position information input from the touch panel unit when the operation key assignment region is set.   The control unit calculates a color tone difference between adjacent pixels of the wallpaper image when setting the operation key allocation region, sets a portion having a color tone difference equal to or greater than a predetermined threshold as a boundary, and defines an area closed by the boundary. The mobile terminal according to claim 1, wherein the mobile terminal is set as the operation key assignment area.   The control unit, when the area of the area closed by the boundary is less than a predetermined threshold, integrates into a surrounding operation key assignment area having an area equal to or larger than the predetermined threshold. Item 4. The mobile terminal according to Item 3.   5. The mobile terminal according to claim 1, wherein the control unit edits the set operation key assignment area based on position information input from the touch panel unit. 6. .

Images