JP2020064683A - Electronic apparatus, control method, and program - Google Patents

Abstract

To improve input processing that has been executed in a prior art electronic apparatus in terms of operability.SOLUTION: In one aspect, an electronic apparatus comprises: a housing; physical key groups that are arranged along the edges of the housing; and a controller that executes processing on the basis of an operation to one of the physical keys in the physical key groups. The physical key groups include a first key group and a second key group; the controller allocates a first group to the first key group, and when detecting an operation to one of the physical keys in the first key group, allocates a second group associated with the first group allocated to the operated physical key to the second key group.SELECTED DRAWING: Figure 1

Description

  The present application relates to an electronic device, a control method, and a program.

  Some electronic devices include physical keys and a touch screen. For example, Patent Document 1 discloses an electronic device that executes various functions according to an operation detected via a physical key and a touch screen.

International Publication No. 2008/086302

  There is room for improvement in the operability of the input operation performed in the conventional electronic device.

  An electronic apparatus according to one aspect includes a housing, a physical key group arranged along an edge of the housing, and a controller that executes a process based on an operation of a physical key of the physical key group. The physical key group includes a first key group and a second key group, the controller assigns the first group to the first key group, and operates the physical keys of the first key group. When detected, the second group associated with the first group assigned to the operated physical key is assigned to the second key group.

  An electronic device according to one aspect includes a housing, a touch screen, a physical key group arranged along an edge of the housing, a software key group arranged along an edge of the touch screen, and a physical key of the physical key group. And a controller that executes processing based on an operation of the software key of the software key group, the controller assigns a first group to the physical key group, and detects an operation on the physical key of the physical key group. Then, the second group associated with the first group assigned to the operated physical key is assigned to the software key group.

  A control method according to one aspect is a control method for an electronic device including a housing and a physical key group including a first key group and a second key group arranged along an edge of the housing. Then, a first group is assigned to the first key group, and when an operation on a physical key of the first key group is detected, it is linked to the first group assigned to the operated physical key. And assigning the second group to the second key group.

  A control method according to one aspect includes a housing, a touch screen, a physical key group arranged along an edge of the housing, and a software key group arranged along an edge of the touch screen. When a first group is assigned to the physical key group and an operation on the physical key of the physical key group is detected, a first group associated with the first group assigned to the operated physical key is detected. Assign two groups to the software key group.

  A program according to one aspect provides an electronic device including a housing, and a physical key group including a first key group and a second key group arranged along an edge of the housing, the physical key group. To a second group associated with the first group assigned to the operated physical key, the first group is assigned to the Execute the process of assigning to the key group.

  A program according to one aspect includes an electronic device including a housing, a touch screen, a group of physical keys arranged along an edge of the housing, and a group of software keys arranged along an edge of the touch screen. When a first group is assigned to the key group and an operation on the physical key of the physical key group is detected, a second group linked to the first group assigned to the operated physical key is used as the software. Execute the process of assigning to the key group.

FIG. 1 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. FIG. 2 is a diagram showing an arrangement example of the key units according to the embodiment. FIG. 3 is a diagram illustrating an arrangement example of the touch screen according to the embodiment. FIG. 4 is a diagram illustrating an example of the structure of the touch screen according to the embodiment. FIG. 5 is a diagram showing an example of the first key data according to the embodiment. FIG. 6 is a diagram showing an example of the second key data according to the embodiment. FIG. 7 is a diagram showing an example of the first key data according to the embodiment. FIG. 8 is a diagram illustrating an example of an execution screen of the input process according to the embodiment. FIG. 9 is a schematic diagram for explaining a screen transition associated with the input processing according to the embodiment. FIG. 10 is a schematic diagram for explaining screen transitions associated with the input processing according to the embodiment. FIG. 11 is a flowchart showing an example of the flow of processing executed by the electronic device according to the embodiment. FIG. 12 is a diagram showing another arrangement example of the plurality of physical keys provided in the electronic device. FIG. 13 is a diagram showing another arrangement example of the plurality of physical keys provided in the electronic device. FIG. 14 is a diagram showing another structural example regarding the operation surface of the physical key provided in the electronic device according to the embodiment. FIG. 15 is a diagram showing another structural example regarding the operation surface of the physical key provided in the electronic device according to the embodiment. FIG. 16 is a diagram showing another example of the functional configuration of the electronic device according to the embodiment. FIG. 17 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 18 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 19 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 20 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 21 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 22 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 23 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 24 is a diagram showing another structural example of the electronic device according to the embodiment. FIG. 25 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. FIG. 26 is a diagram showing an arrangement example of the key units according to the embodiment. FIG. 27 is a diagram showing an example of the first key data according to the embodiment. FIG. 28 is a diagram showing an example of the second key data according to the embodiment. FIG. 29 is a diagram showing an example of an execution screen of the character input process according to the embodiment. FIG. 30 is a diagram illustrating an example of an execution screen of the character input process according to the embodiment. FIG. 31 is a schematic diagram for explaining screen transitions associated with character input processing according to the embodiment. FIG. 32 is a flowchart showing an example of the flow of processing executed by the electronic device according to the embodiment. FIG. 33 is a diagram showing an example of an execution screen for input processing according to the embodiment. FIG. 34 is a diagram illustrating an example of an execution screen of input processing according to the embodiment.

  A plurality of embodiments for carrying out an electronic device, a control method, and a program according to the present application will be described in detail with reference to the drawings.

  The electronic device according to the present application may be a device such as a smartphone, mobile phone, tablet, portable personal computer, media player, electronic book reader, navigator, wearable device, or game console.

  FIG. 1 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. In the following description, the same reference numerals may be given to the same components. In the following description, redundant description may be omitted.

  As shown in FIG. 1, the electronic device 1 includes a touch screen display 2, a physical key unit 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, and a storage 9. The controller 10, the speaker 11, the camera 12, the camera 13, the connector 14, and the motion sensor 15 are included.

  The touch screen display 2 has a display 2A and a touch screen 2B. The display 2A and the touch screen 2B may be located one on top of the other, side-by-side, or distant from each other, for example. When the display 2A and the touch screen 2B overlap each other, for example, one or more sides of the display 2A do not have to be along any side of the touch screen 2B.

  The display 2A is a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display). The display 2A displays objects such as characters, images, symbols, and figures on the screen. The screens including the objects displayed on the display 2A include a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of the application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen or a launcher screen.

  The touch screen 2B detects contact or proximity of a finger, a pen, a stylus pen, or the like to the touch screen 2B. The touch screen 2B can detect the position on the touch screen 2B when a plurality of fingers, pens, stylus pens, or the like come into contact with or approach the touch screen 2B. In the following description, a position where a plurality of fingers, pens, stylus pens, etc. detected by the touch screen 2B are in contact with or close to the touch screen 2B will be referred to as a “detection position”. The touch screen 2B notifies the controller 10 of the contact or proximity of a finger to the touch screen 2B together with the detection position. The touch screen 2B may notify the controller 10 of the detection of contact or proximity by notifying the detection position. The operation that the touch screen 2B can perform can be performed by the touch screen display 2 having the touch screen 2B. In other words, the operation performed by the touch screen 2B may be performed by the touch screen display 2.

  The controller 10 includes at least one of the contact or proximity detected by the touch screen 2B, the detection position, the change in the detection position, the duration of the contact or proximity, the interval at which the contact or proximity is detected, and the number of times the contact is detected. Based on the two, the type of gesture is determined. The electronic device 1 including the controller 10 can execute the operation that the controller 10 can perform. In other words, the operation performed by the controller 10 may be performed by the electronic device 1. The gesture is an operation performed on the touch screen 2B using a finger. The operation performed on the touch screen 2B may be performed on the touch screen display 2 including the touch screen 2B. Gestures that the controller 10 determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. Not limited to.

  The detection method of the touch screen 2B may be any method such as a capacitance method, a resistance film method, a surface acoustic wave method, an infrared method, and a load detection method.

  The physical key unit 3 receives an operation input from the user. The physical key unit 3 has a first key unit 3a, a second key unit 3b, a third key unit 3c, and a touch screen 3d.

  An arrangement example of the physical key units according to the embodiment will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram showing an arrangement example of the key units according to the embodiment. FIG. 3 is a diagram illustrating an arrangement example of the touch screen according to the embodiment.

The electronic device 1 according to the embodiment includes a substantially rectangular parallelepiped casing 1h, and the plane of the electronic device 1 has a substantially rectangular shape as shown in FIG. The first key unit 3a is configured to include a total of 10 physical keys including the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ shown in FIG. The physical keys 3a ₁ , ..., The physical keys 3a ₁₀ are arranged in one line along the left side edge F1 of the housing 1h of the electronic device 1 in a direction parallel to the y-axis shown in FIG. It The second key unit 3b is configured to include a total of 10 physical keys including the physical keys 3b ₁ , ..., And the physical key 3b ₁₀ shown in FIG. The physical keys 3b ₁ , ..., The physical keys 3b ₁₀ are arranged in a line along the edge F2 on the right side of the housing 1h of the electronic device 1 in a direction parallel to the y-axis shown in FIG. It The third key unit 3c is configured to include a total of three physical keys of the physical key 3c ₁ , the physical key 3c ₂ , and the physical key 3c ₃ shown in FIG. The physical key 3c ₁ , the physical key 3c ₂ , and the physical key 3c ₃ are arranged in a row along the edge F3 on the bottom side of the housing 1h of the electronic device 1 in a direction parallel to the x-axis shown in FIG. Will be placed. The number of physical keys forming each of the first key unit 3a, the second key unit 3b, and the third key unit 3c shown in FIG. 2 is an example, and the number of physical keys is not necessarily the same as the example shown in FIG. You don't have to. In the example shown in FIG. 2, the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ are arranged along the edge F1 on the right side of the housing 1h of the electronic device 1, but form the outline of the touch screen display. The arrangement may be along one side. Similarly, the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ may be arranged along one side forming the outline of the touch screen display. Similarly, the physical key 3c ₁ , the physical key 3c ₂ , and the physical key 3c ₃ may be arranged along one side forming the contour of the touch screen display 2B. That is, even if the first key unit 3a, the second key unit 3b, and the third key unit 3c are arranged along the outer side of the housing 1h, the side of the housing 1h on the touch screen display 2B side, the housing It may be arranged along the boundary between 1h and the touch screen display 2B.

The physical keys 3a ₁ , ..., And the physical key 3a ₁₀ constituting the first key unit 3a can detect the pressing of the keys. The physical keys 3b ₁ , ..., And the physical key 3b ₁₀ constituting the second key unit 3b can detect the pressing of the keys. The physical key 3c ₁ , the physical key 3c ₂ , and the physical key 3c ₃ that form the third key unit 3c can detect pressing of the key. Each physical key may individually detect the press of each physical key forming the first key unit 3a, the second key unit 3b, and the third key unit 3c. Each physical key forming the first key unit 3a, the second key unit 3b, and the third key unit 3c is configured such that the surface texture of each physical key has a texture different from that of other members of the electronic device 1. You may. Each physical key forming the first key unit 3a, the second key unit 3b, and the third key unit 3c adopts an arbitrary shape such as a cylindrical shape, a rectangular parallelepiped shape, or a roof shape as the surface shape of each physical key. You can do it. Each physical key forming the first key unit 3a, the second key unit 3b, and the third key unit 3c may have a structure capable of being pressed in two or more steps. The physical keys 3a ₁ , ..., And the physical key 3a ₁₀ that form the first key unit 3a are an example of a first physical key. The physical keys 3b ₁ , ..., And the physical key 3b ₁₀ that constitute the second key unit 3b are an example of a second physical key.

  As shown in FIG. 3, the touch screen 3d includes a touch screen 3da, a touch screen 3db, and a touch screen 3dc. The touch screen 3da is arranged below the first key unit 3a so as to extend in the longitudinal direction of the electronic device 1 along a direction parallel to the y-axis shown in FIG. The touch screen 3db is arranged below the second key unit 3b so as to extend in the longitudinal direction of the electronic device 1 along the direction parallel to the y-axis shown in FIG. The touch screen 3dc is arranged below the third key unit 3c so as to extend in the lateral direction of the electronic device 1 along the direction parallel to the x axis shown in FIG. The touch screen 3da can detect contact and proximity of a conductive object such as a finger to the first key unit 3a. The touch screen 3db can detect contact and proximity of a conductive object such as a finger to the second key unit 3b. The touch screen 3dc can detect contact and proximity of a conductive object such as a finger to the third key unit 3c.

An example of the structure of the touch screen 3d according to the embodiment will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of the structure of the touch screen according to the embodiment. FIG. 4 shows a part of the structure of the touch screen 3da among the touch screens included in the touch screen 3d. As shown in FIG. 4, the touch screen 3da includes a plurality of first electrodes 40a ₁ and a plurality of second electrodes 40a ₂ . The first electrode 40a ₁ extends in the lateral direction of the touch screen 3da. The second electrode 40a ₂ extends in the longitudinal direction of the touch screen 3da. The touch screen 3da arranges the plurality of first electrodes 40a ₁ and the plurality of second electrodes 40a ₂ in a lattice-like crossing state. The touch screen 3da detects contact or proximity of a finger or the like to the first key unit 3a at each position (detection point) where the plurality of _first electrodes 40a ₁ and the plurality of second electrodes 40a ₂ intersect. When a conductive object approaches the touch screen 3da, capacitive coupling occurs between the touch screen 3da and the object. The touch screen 3da detects a contact with a conductive object such as a finger by sensing capacitive coupling at a detection point. In the example shown in FIG. 4, a plurality of first key units 3a are provided due to the provision of the keyholes 40a ₃ for installing the physical keys 3a ₁ , ..., And the physical keys 3a ₁₀ . Although there is a portion where the electrode 40a ₁ and the plurality of second electrodes 40a ₂ are arranged in a non-uniform state without intersecting in a grid pattern, the controller 10 can calibrate the detection points. The detection method of the touch screen 3d may be an arbitrary method such as a capacitance method, a resistance film method, a surface acoustic wave method, an infrared method, and a load detection method, like the touch screen 2B.

Based on the detection result of the touch screen 3da, the controller 10 can determine which of the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ configuring the first key unit 3a is touched. Based on the detection result of the first key unit 3a, the controller 10 can determine which of the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ configuring the first key unit 3a is pressed. . Based on the detection result of the touch screen 3db, the controller 10 can determine which of the physical keys 3b ₁ , ..., And the physical key 3b ₁₀ that constitute the second key unit 3b is touched. Based on the detection result of the second key unit 3b, the controller 10 can determine which of the physical keys 3b ₁ , ..., And the physical key 3b ₁₀ configuring the second key unit 3b is pressed. . The controller 10, based on the detection result of the touch screen 3DC, can determine the physical key 3c 1 constituting the third key unit _3c, any key in the physical key 3c _2, and physical key 3c ₃ is touched . Based on the detection result of the third key unit 3c, the controller 10 determines which _{one of} the physical keys 3c ₁ , 3c ₂ and 3c ₃ constituting the third key unit 3c is pressed. Can be determined.

  For example, when the controller 10 detects, via the touch screen 3d, both a touch on a physical key forming the first key unit 3a and a touch on a physical key forming the second key unit 3b, the latest The processing for touch can be preferentially executed. The controller 10 detects both the touch on the physical key forming the first key unit 3a and the touch on the physical key forming the second key unit 3b, and then the first key via the touch screen 3d. When a touch other than the unit 3a and the second key unit 3b is detected, a touch other than the first key unit 3a and the second key unit 3b can be treated as an invalid operation. In addition, for example, when the controller 10 detects both the touch on the physical key configuring the first key unit 3a and the touch on the touch screen 2B via the touch screen 3d, the process for the latest touch is prioritized. Then you can run it. In this way, the controller 10 preferentially executes the process for the latest touch even when both the touch on the touch screen 2B and the touch on the touch screen 3d are detected.

  The controller 10 performs touch gestures such as long touch, tap, double tap, and slide on the physical keys forming the first key unit 3a and the physical keys forming the second key unit 3b via the touch screen 3d, for example. It may be detected.

  The illuminance sensor 4 detects illuminance. The illuminance is the value of the luminous flux incident on the unit area of the measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used, for example, to adjust the brightness of the display 2A.

  The proximity sensor 5 detects the presence of a nearby object in a non-contact manner. The proximity sensor 5 detects the presence of an object based on a change in magnetic field, a change in feedback time of reflected waves of ultrasonic waves, or the like. The proximity sensor 5 detects, for example, that the display 2A and the face are close to each other. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include, for example, the communication standards of cellular phones such as 2G, 3G, 4G, and 5G and the communication standards of short-range wireless. Examples of the communication standard of the cellular phone include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (registered trademark) (PDC, WORDC), and WDM (Worldwide Circulation). There are GSM (registered trademark) (Global System for Mobile Communications), PHS (Personal Handy-phone System), and the like. Examples of the short-range wireless communication standard include IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), WPAN (Wireless Personal Area), and the like. The communication standard of WPAN includes, for example, ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards mentioned above.

  The receiver 7 outputs the sound signal sent from the controller 10 as a sound. The receiver 7 can output, for example, the sound of a moving image reproduced by the electronic device 1, the sound of music, and the voice of the other party during a call. The microphone 8 converts the input user voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 may be used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium, such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disc, or a magneto-optical disc, and a reading device for the storage medium. The storage 9 may include a storage device used as a temporary storage area, such as a RAM (Random Access Memory).

  The programs stored in the storage 9 include an application executed in the foreground or background and a support program (not shown) that supports the operation of the application. When the application is executed in the foreground, for example, the screen related to the application is displayed on the display 2A. The support program includes, for example, an OS. The program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transitory storage medium.

  The storage 9 can store a control program 9A, an input control program 9B, first key data 9C, second key data 9D, condition data 9E, setting data 9Z, and the like. The control program 9A can cooperate with various applications stored in the electronic device 1 when providing various functions. The control program 9A may cooperate with the cloud storage via the communication unit 6 to access the files and data stored in the cloud storage. The cloud storage may store some or all of the programs and data stored in the storage 9.

  The control program 9A can provide a function for realizing processing relating to various operations of the electronic device 1, respectively. The function provided by the control program 9A includes a function of adjusting the brightness of the display 2A based on the detection result of the illuminance sensor 4. The function provided by the control program 9A includes a function of invalidating the operation on the touch screen 2B based on the detection result of the proximity sensor 5. The functions provided by the control program 9A include a function of realizing a call by controlling the communication unit 6, the receiver 7, the microphone 8, and the like. The function provided by the control program 9A includes a function of controlling the photographing process of the camera 12 and the camera 13. The function provided by the control program 9A includes a function of controlling communication with an external device connected via the connector 14. The function provided by the control program 9A includes a function of performing various controls such as changing the information displayed on the display 2A in accordance with the gesture determined based on the detection result of the touch screen 2B. The function provided by the control program 9A includes a function of detecting movement, stop, or the like of the user carrying the electronic device 1 based on the detection result of the motion sensor 15.

  The input control program 9B can provide a function for controlling the character input executed in the electronic device 1. The input control program 9B assigns the first group to each of the plurality of physical keys that make up the first key unit (first key group) 3a, and assigns the first key unit (first key group) 3a, for example. When an operation is detected on any one of the plurality of physical keys to which the group is assigned, the second key unit (second key group) 3b associated with the detected physical key is displayed. It is possible to provide a function of assigning a second group, which is preliminarily linked to the first group, to each of the plurality of constituent physical keys. The first group and the second group include various files, folders for storing the files, keys for inputting characters, and the like. Further, it is possible to associate a plurality of groups with the second group. In this case, the second group becomes the new first group, and the group associated with the second group becomes the new second group.

The first key data 9C is information on a group that is pre-assigned to each of the plurality of physical keys forming the first key unit 3a. FIG. 5 is a diagram showing an example of the first key data according to the embodiment. As shown in FIG. 5, the first key data 9C includes a “document”, a “picture”, and a physical key 3a ₁ , ..., And a physical key 3a ₇ constituting the first key unit 3a. Assignment of “video”, “news”, “SNS”, “learning”, and “game” is set. "Document", "picture", "video", "news", "SNS", "learning" assigned to each of the physical keys 3a ₁ , ..., And the physical key 3a ₇ constituting the first key unit 3a. “,” “Game” mean folders with their respective names. The first key data 9C is used when performing the output corresponding to each of the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ that configure the first key unit 3a in the input processing described later.

The second key data 9D is key information that is pre-assigned to each of the plurality of physical keys that form the second key unit 3b. FIG. 6 is a diagram showing an example of the second key data according to the embodiment. As shown in FIG. 6, the second key data. 9D, physical key _3a 1 constituting the first key unit 3a, · · ·, of physical keys _{3a 10,} for each physical key operation is detected, second A plurality of characters are assigned to the physical keys 3b ₁ , ..., And the physical key 3b ₁₀ that constitute the key unit 3b. For example, when an operation on the physical key 3a ₁ that constitutes the first key unit 3a is detected (3a ₁ = document), for each of the physical key 3b ₁ , the physical key 3b ₂ , and the physical key 3b ₃ , "Folder 1", "Folder 2", and "Folder 3" are set to be assigned. “Folder 1”, “folder 2”, and “folder 3” mean folders with their respective names. For example, when an operation on the physical key 3a ₅ that constitutes the first key unit 3a is detected (3a ₅ = SNS), for each physical key 3b ₁ , ..., Physical key 3b ₅ , “ Facebook (registered trademark), "LINE (registered trademark)", "Google+ (registered trademark)", "LinkedIn (registered trademark)", and "Twitter (registered trademark)" are set. “Facebook”, “LINE”, “Google+”, “LinkedIn”, and “Twitter” are application software. The second key data 9D is used when performing the output corresponding to each of the physical keys 3b ₁ , ..., And the physical key 3b ₅ that constitute the second key unit 3b in the input processing described later. In the example shown in FIG. 6, in the second key data 9D, there is no allocation to the physical keys 3b ₆ , ..., The physical key 3b _{10 and the} like that constitute the second key unit 3b, but folders other than the above, A directory for application software, files, etc. may be set. Note that the physical key 3c ₁ , the physical key 3c ₂ , and the physical key 3c ₃ may be associated with a function for controlling the operation of the electronic device 1.

Further, as shown in FIG. 7, the first key data 9C stores a file associated with the folder 1 associated with the document. That is, the first key data 9C stores a plurality of groups associated with the keys of the second key data 9D associated with the keys of the first key data 9C. Here, in the example shown in FIG. 7, the group is data. First key data. 9C, physical key _3b 1 constituting the second key unit 3b, · · ·, among physical key _{3b 10,} for each physical key operation is detected, the physical constituting the first key unit 3a A plurality of characters are assigned to the keys 3a ₁ , ..., And the physical key 3a ₁₀ . For example, when an operation on the physical key 3b ₁ that constitutes the second key unit 3b is detected (3b ₁ = folder 1), for each of the physical keys 3a ₁ , ..., Physical key 3a ₄ , It is set that “sample.txt”, “sample2.txt”, “sample3.txt”, and “sample.pdf” are assigned.

  In the above-described embodiment, a group associated with one physical key of the first key unit 3a is assigned to a plurality of physical keys of the second key unit 3b, and further, a group of physical keys of the second key unit 3b is assigned. Although a group is assigned to a plurality of physical keys of the first key unit 3a for one group, the present invention is not limited to this. For example, each physical key group of the first key unit 3a assigned to one group of the second key unit 3b is further associated with the physical key group of the second key unit 3b. You may. Further, for example, some physical keys of the plurality of physical keys of the first key unit 3a do not need to be associated with the group of keys of the second key unit. In this case, when the physical key that is displayed first and is not associated with the second group is operated, the processing of the group associated with the key is executed. Further, the key assigned to the plurality of physical keys of the second key unit 3b may not be associated with the group of the key of the first key unit 3a. In this case, when the physical key of the second key unit 3b is operated, the processing of the group associated with that key is executed.

  In the condition data 9E, various conditions for executing processing by the input control program 9B are set. Specifically, in the condition data 9E, the input processing start condition of the input control program 9B, the input processing end condition, and the like are set.

  The setting data 9Z includes information used for the processing executed by the control program 9A.

  The controller 10 includes an arithmetic processing unit. The processor includes, for example, a CPU (Central Processing Unit), a SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. Not limited. The controller 10 centrally controls the operation of the electronic device 1 to realize various functions.

  Specifically, the controller 10 executes the command included in the program stored in the storage 9, while referring to the data stored in the storage 9 as necessary. Then, the controller 10 controls the functional units according to the data and the commands, thereby realizing various functions. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, and the speaker 11, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. The detection unit includes, for example, the touch screen 2B, the physical key unit 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, the camera 13, and the motion sensor 15, but is not limited thereto.

  By executing the control program 9A, the controller 10 can realize processing relating to various operations of the electronic device 1.

  By executing the input control program 9B, the controller 10 can realize the processing of controlling the character input executed in the electronic device 1. When the controller 10 detects an operation on any one of the plurality of physical keys forming the first key unit 3a by executing the input control program 9B, for example, the operation is associated with the detected physical key. It is possible to realize a process of allocating at least one character preliminarily linked to the plurality of physical keys to each of the plurality of physical keys forming the second key unit 3b. The controller 10 is an example of a controller.

  The speaker 11 outputs the sound signal sent from the controller 10 as a sound. The speaker 11 is used to output a ring tone and music, for example. One of the receiver 7 and the speaker 11 may also have the other function.

  The camera 12 and the camera 13 convert the captured image into an electric signal. The camera 12 is an in-camera that captures an object facing the display 2A. The camera 13 is an out-camera that captures an object facing the opposite surface of the display 2A. The camera 12 and the camera 13 may be mounted on the electronic device 1 in a functionally and physically integrated state as a camera unit that can be used by switching between the in-camera and the out-camera.

  The connector 14 is a terminal to which another device is connected. The connector 14 may be a universal terminal such as a USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), light peak (Thunderbolt (registered trademark)), or earphone microphone connector. . The connector 14 may be a dedicated terminal such as a Dock connector. Devices connected to the connector 14 include, but are not limited to, external storage, speakers, and communication devices, for example.

  The motion sensor 15 can detect various information for determining the motion of the user carrying the electronic device 1. The motion sensor 15 may be configured as a sensor unit including an acceleration sensor, a direction sensor, a gyroscope, a magnetic sensor, an atmospheric pressure sensor, and the like.

  The electronic device 1 may include a GPS receiver and a vibrator in addition to the above-described functional units. The GPS receiver receives a radio wave signal in a predetermined frequency band from a GPS satellite. The GPS receiver performs demodulation processing of the received radio wave signal and sends the processed signal to the controller 10. The GPS receiver supports arithmetic processing of the current position of the electronic device 1. The electronic device 1 may include a receiver that can receive signals of positioning artificial satellites other than GPS satellites, and may perform arithmetic processing of the current position. The vibrator vibrates a part or the whole of the electronic device 1. The vibrator has, for example, a piezoelectric element, an eccentric motor, or the like in order to generate vibration. The electronic device 1 is equipped with a functional unit that is naturally used to maintain the functions of the electronic device 1, such as a battery, and a control unit that is naturally used to realize control of the electronic device 1.

  The electronic device 1 may access a storage server on the cloud via the communication unit 6 to acquire various programs and data.

  An example of processing of the electronic device 1 according to the embodiment will be described with reference to FIGS. 8 to 10. FIG. 8 is a diagram illustrating an example of an execution screen of the input process according to the embodiment. 9 and 10 are schematic diagrams for explaining screen transitions associated with the input processing according to the embodiment.

  When executing the input process, the electronic device 1 displays the execution screen 20 shown in FIG. 8 on the display 2A. The execution screen 20 has a first key area 22 and a second key area 23.

The first key area 22 is configured to include areas 22a ₁ , ..., Area 22a ₁₀ . The area 22a ₁ , ..., The area 22a ₁₀ are areas corresponding to the physical keys 3a ₁ , ..., The physical key 3a ₁₀ that compose the first key unit 3a. Regions _22a 1, · · ·, region _{22a 10} along a direction parallel to the y-axis shown in FIG. 7, the physical key _3a 1, · · ·, to be adjacent to the physical key _{3a 10,} arranged in a row Is displayed. The area 22a ₁ , ..., The area 22a ₁₀ display the names of the groups assigned to the physical keys 3a ₁ , ..., The physical key 3a ₁₀ . The second key area 23 includes areas 23b ₁ , ..., And an area 23b ₁₀ . The area 23b ₁ , ..., The area 23b ₁₀ are areas corresponding to the physical keys 3b ₁ , ..., And the physical key 3b ₁₀ that constitute the second key unit 3b, respectively. Region _23b 1, · · ·, region _{23b 10} along a direction parallel to the y-axis shown in FIG. 7, the physical key _3b 1, · · ·, to be adjacent to the physical key _{3b 10,} arranged in a row Is displayed. The area 23b ₁ , ..., The area 23b ₁₀ display the names given to the groups previously assigned to the physical keys 3b ₁ , ..., The physical key 3b ₁₀ . Although the name of the group is displayed in the first key area 22 and the second key area 23, the display is not limited to the name as long as it can display the group.

An example of screen transition in the input process will be described with reference to FIG. 9. As shown in FIG. 9, the electronic device 1 displays the execution screen 20 of the input process on the display 2A (step S12). Specifically, each group of the first group is associated with the first key unit 3a, and the name corresponding to the associated group is displayed in the areas 22a ₁ , ... 22a ₇ . Characters "document", "picture", "video", "news", "SNS", "learning", and "game" are displayed in the areas 22a ₁ , ..., 22a ₇ , respectively. Subsequently, when the electronic device 1 detects a touch on the physical key 3a ₁ , the electronic device 1 executes an output corresponding to the physical key 3a ₁ (step S14). Specifically, the electronic device 1 outputs, from the speaker 11, the reading voice of “Document” having the name of the group assigned to the physical key 3a ₃ . Further, the display of the area 22a ₁ corresponding to the physical key 3a ₁ is different from the display of other areas. For example, the background color is changed.

Subsequently, when the physical key 3a ₁ is pressed, the electronic device 1 executes the output corresponding to the physical key 3a ₁ (step S16). Specifically, the electronic device 1, a physical key _3b 1 associated with the physical key 3a _1, · · ·, to each physical key 3b _3, physical key _3b 1, · · ·, physical key 3b ₃ Allocate a group that has been previously linked to. For example, physical keys 3b _1, physical key 3b _2, for each of the physical key 3b _3, "Folder 1", "Folder 2", assigned to groups of "Folder 3", the physical key 3b _1, physical key 3b ₂ , The images of characters “folder 1”, “folder 2”, and “folder 3” are displayed in the regions 23b ₁ , 23b ₂ and 23b ₃ corresponding to the physical keys 3b ₃ , respectively.

Subsequently, the electronic device 1 detects a touch on the physical key 3b _3, executes an output corresponding to the physical key 3b ₃ (step S18). Specifically, the electronic device 1 outputs the reading voice of the character “folder 3” assigned to the physical key 3b ₃ from the speaker 11. Also, the physical key 3b ₃ display corresponding regions 23b ₃ differs from the other area display. For example, the background color is changed.

Subsequently, when the physical key 3b ₃ is pressed, the electronic device 1 executes the output corresponding to the physical key 3b ₃ (step S20). Specifically, the electronic device 1, a physical key _3a 1 which is associated with a physical key 3b _3, · · ·, each of the physical keys 3a _4, physical key _3a 1, · · ·, physical key 3a ₄ Allocate a group that has been previously linked to. For example, physical keys _3a 1, · · ·, for each physical key 3a _4, it allocates a group of "sample.txt", "sample2.txt", "sample3.txt", "sample.pdf", Physical The areas 22a ₁ , ..., 22a ₄ corresponding to the keys 3a ₁ , ..., 3a ₄ , respectively, are assigned “sample.txt”, “sample2.txt”, “sample3.txt”, “sample.pdf”. Display the image of the character.

Subsequently, when the electronic device 1 detects the touch on the physical key 3a ₄ , the electronic device 1 executes the output corresponding to the physical key 3a ₄ (step S22). Specifically, the electronic device 1 outputs, from the speaker 11, the reading voice of “sample.pdf” which is the name of the group assigned to the physical key 3a ₄ . Further, the display of the area 22a ₄ corresponding to the physical key 3a ₄ is different from the display of the other areas. For example, the background color is changed.

Subsequently, when the physical key 3a ₄ is pressed, the electronic device 1 executes the output corresponding to the physical key 3a ₄ (step S24). Specifically, since the “sample.pdf” linked to the physical key 3a ₄ is a data file, the selected file is executed. For example, the image of the data file is displayed by the set application software.

  In step S14 described above, the electronic device 1 outputs the reading voice of the character assigned to the physical key at regular time intervals after the first reading while the touch to another physical key or the depression of the physical key is not detected. It may be repeated. When an editing function such as line feed, deletion, and conversion is assigned to the physical key, a reading voice corresponding to the content of the corresponding editing function may be output. In step S14, the electronic device 1 does not have to perform any processing when the physical key is not assigned to the character and the editing function, and the vibrator informs the user that there is no assignment. Output of voice, notification by buzzer sound, etc. may be executed. Alternatively, the electronic device 1 may have a mechanism in which a physical key for which a character and an editing function are not assigned cannot be pressed.

In step S16, when the electronic device 1 detects the pressing of the physical key, the electronic device 1 may perform feedback by vibrating the vibrator or outputting a sound effect from the speaker 11. In step S16, when the physical keys 3b ₁ , ..., And the physical key 3b ₃ have a physical mechanism capable of displaying a Braille pattern on the operation surface, the electronic device 1 is associated with the physical key 3a _3. When assigning to the physical keys 3b ₁ , ..., Physical key 3b ₃ that are associated with the physical keys 3b ₁ , ..., Physical key 3b ₃ in advance, the characters corresponding to each group are assigned. The Braille patterns may be sequentially displayed to indicate the name of the group.

In the example shown in FIG. 9, the electronic device 1, group assigned to the first key unit 3a physical keys _3a 1, · · ·, is less than the number of physical keys _{3a 10,} the physical key 3a ₁ (third key unit The case has been described where the groups are assigned from the side opposite to the side on which 3c is arranged), but the present invention is not limited to this. For example, when the number of groups to be assigned is smaller than the number of physical keys 3a ₁ , ..., Physical key 3a ₁₀ , the electronic device 1 may assign groups by squeezing from the physical keys 3a ₁₀ . For example, the electronic device 1 may allocate groups to both sides of the physical key 3a ₁ and the physical key 3a ₁₀ when the group to be allocated is at least two smaller than the number of the physical keys 3a ₁ , ..., The physical key 3a _10. Good. Further, the electronic device 1, a physical key _3b 1 of the second key unit 3b, · · ·, the number of groups to be assigned to the physical key _{3b 10} is, physical key _3b 1, · · ·, than the number in the physical key _{3b 10} The same applies when the number is small.

  In the description of FIG. 9 described above, when the electronic device 1 outputs the reading voice of the character via the speaker 11, the image of the corresponding character may be highlighted on the display 2A. The electronic device 1 may change the display mode of the image of the character displayed on the display 2A depending on whether the physical key is touched or when the physical key is pressed.

  Although the electronic device 1 executes the operation based on the detection of the touch on the physical key in the above embodiment, the electronic device 1 may execute the operation based on the detection of the pressing of the physical key. In addition, the electronic device 1 may execute the operation when the pressing is detected after detecting the touch, or may execute the operation when the pressing is detected without detecting the touch. . Further, although the electronic device 1 outputs the voice corresponding to the detected operation, the display corresponding to the operated physical key may be highlighted without outputting the voice. In addition, the electronic device 1 may output a voice corresponding to the operated physical key and may highlight the display corresponding to the operated physical key. Further, the electronic device 1 preferably displays the image corresponding to the physical key on the display 2A corresponding to the physical key, but the image may not be displayed. Further, as will be described later, the electronic device 1 may not include the display.

Another example of the screen transition in the input process will be described with reference to FIG. As shown in FIG. 10, the electronic device 1 displays the execution screen 20 of the input process on the display 2A (step S32). Subsequently, when the electronic device 1 detects a touch on the physical key 3a ₅ , the electronic device 1 executes an output corresponding to the physical key 3a ₅ (step S34). Specifically, the electronic device 1 outputs the reading voice of “SNS” of the group assigned to the physical key 3a ₅ from the speaker 11. Further, in the electronic device 1, the physical keys 3b ₁ , ..., And the physical keys 3b ₅ associated with the physical keys 3a ₅ are respectively “Facebook (registered trademark)”, “LINE (registered trademark)”, The groups of “Google+ (registered trademark)”, “LinkedIn (registered trademark)”, and “Twitter (registered trademark)” are assigned, and the areas 23b ₁ corresponding to the physical keys 3b ₁ , ..., 3b ₅ , respectively. ..., in the area 23b _5, "Facebook", "LINE", "Google +", "LinkedIn", to display the character of "Twitter".

Subsequently, when the physical key 3a ₅ is pressed, the electronic device 1 executes the output corresponding to the physical key 3a ₅ (step S36). Specifically, the electronic device 1 confirms the input of the SNS that has been provisionally determined as the selected group. Here, the provisional decision is a state in which the selection is not fixed. The electronic device 1 can notify the user of the temporarily determined operation by outputting or highlighting a voice corresponding to the temporarily determined physical key. As a result, it is possible to know the group operating in a state in which the selected group can be changed before the operation is determined. Specifically, the electronic device 1, a physical key _3b 1 associated with the physical key 3a _5, · · ·, each of the physical keys 3b _5, physical key _3b 1, · · ·, physical key 3b ₅ Allocate a group that is linked to in advance and confirm. For example, to each of the physical keys 3b ₁ ... And the physical key 3b ₅ , groups of “Facebook”, “LINE”, “Google+”, “LinkedIn”, and “Twitter” are assigned, and the physical keys 3b ₁ , ... .., images of characters “Facebook”, “LINE”, “Google+”, “LinkedIn”, and “Twitter” are displayed in the regions 23b ₁ , ..., 23b ₅ corresponding to the physical keys 3b ₅ , respectively. Let

Subsequently, when the electronic device 1 detects a touch on the physical key 3b ₁ , the electronic device 1 executes an output corresponding to the physical key 3b ₁ (step S38). Specifically, the electronic device 1 outputs, from the speaker 11, the reading voice of the character “Facebook” assigned to the physical key 3b ₁ . Further, the display of the area 23b ₁ corresponding to the physical key 3b ₁ is different from the other areas. For example, the background color is changed. Then, when the physical key 3b ₁ is pressed, the electronic device 1 executes the output corresponding to the physical key 3b ₁ (step S40). Specifically, “Facebook” linked to the physical key 3b ₁ is executed by the application software.

The flow of processing executed by the electronic device according to the embodiment will be described with reference to FIG. 11. FIG. 11 is a flowchart showing an example of the flow of processing executed by the electronic device according to the embodiment. The processing illustrated in FIG. 11 is realized by the controller 10 executing the input control program 9B. In the description of FIG. 11, the physical keys 3a _m correspond to the physical keys 3a ₁ , ..., And the physical keys 3a ₁₀ that form the first key unit 3a. In the description of FIG. 11, the physical keys 3b _n correspond to the physical keys 3b ₁ , ..., And the physical keys 3b ₁₀ that form the second key unit 3b.

As shown in FIG. 11, the controller 10 determines whether it has detected a touch on any of the physical key 3a _m of the first key unit 3a (step S101).

As a result of the determination, when the controller 10 detects a touch on the physical key 3a _m (Yes at step S101), the controller 10 executes an output corresponding to the physical key 3a _m on which the touch is detected (step S102).

Subsequently, the controller 10 determines whether it has detected the pressing of the physical key 3a _m (step S103).

The controller 10, as a result of the judgment, when detecting a depression of the physical key 3a _m (step S103, Yes), executes the output corresponding to the physical key 3a _m which detects pressing (step S104), and the process of step S101 Return to procedure.

In step S103, the controller 10, the result of the determination, if detecting no depression of the physical key 3a _m (step S103, No), the process returns to the procedure of Step S101.

In step S101, the controller 10, the result of the determination, if not detecting the touch to the physical key 3a _m (step S101, No), and detects a touch to one of the physical keys 3b _n of the second key unit 3b It is determined (step S105).

As a result of the determination, when the controller 10 detects a touch on the physical key 3b _n (step S105, Yes), the controller 10 performs an output corresponding to the physical key 3b _n on which the touch is detected (step S106).

Subsequently, the controller 10 determines whether the pressing of the physical key 3b _n is detected (step S107).

When the controller 10 detects that the physical key 3b _n is pressed (Yes in step S107) as a result of the determination, the controller 10 executes the output corresponding to the physical key 3b _n in which the press is detected (step S108), and the process of step S101 described above. Return to procedure.

In step S107, if the controller 10 does not detect the pressing of the physical key 3b _n as a result of the determination (step S107, No), the process returns to the processing procedure of step S101.

In the above-mentioned step S105, when the controller 10 does not detect the touch to the physical key 3b _{n as} a result of the determination (step S105, No), does the controller 10 detect the touch to other than the first key unit 3a and the second key unit 3b? Is determined (step S109).

  As a result of the determination, the controller 10 ends the process illustrated in FIG. 11 when it detects a touch other than the first key unit 3a and the second key unit 3b (step S109, Yes). On the contrary, when the controller 10 does not detect a touch on anything other than the first key unit 3a and the second key unit 3b as a result of the determination (step S109, No), the process returns to the processing procedure of step S101.

  Here, as an operation corresponding to the physical key, when the group associated with the physical key is a group associated with a plurality of files such as folders or folders, the group associated with the group is There is a process to display in the key area. Further, as the operation corresponding to the physical key, when the group associated with the physical key is data such as a file or application software, there is a process of displaying the data or executing the application.

  According to the above-described embodiment, the electronic device 1 assigns a group to each of the plurality of keys arranged in a row, thereby making it easy to recognize where the group is assigned and improve operability. it can. Further, when the groups are associated with each other in a hierarchy and the group is selected, the group associated with the selected group can be associated with each of the other key units to facilitate selection of the desired group. . In addition, the two key units are alternately linked to the group, so that a simple operation can be performed and the conventional input can be improved in terms of operability.

  The electronic device 1 is provided with a first key unit 3a and a second key unit 3b including physical keys to which a group is assigned, along the sides of the touch screen display 2. The electronic device 1 may be provided with physical keys along the edge of the housing 1h, the boundary between the housing 1h and the touch screen display 2, and the side of the touch screen display 2. This allows the user to select and operate the physical key by moving the finger or the like along the edge of the housing 1h, the boundary between the housing 1h and the touch screen display 2, and the side of the touch screen display 2. The physical key can be operated by a simple operation.

12 and 13 are diagrams showing other arrangement examples of the plurality of physical keys provided in the electronic device. The electronic device 1 may divide a plurality of physical keys into some groups and arrange them. In the example shown in FIG. 12, the electronic device 1 provides a space 50a between the physical keys 3a ₃ and 3a ₄ and a space 50b between the physical keys 3a ₆ and 3a ₇ . Furthermore, the electronic device 1, provided with a space 50c between the physical key 3b ₃ and the physical key 3b _4, provide a space 50d between the physical key 3b ₆ and the physical key 3b _7. Thus, the electronic device 1, a plurality of physical keys _3a 1 _{to 3 A 10} included in the first key unit 3a, a group of physical keys _3a 1 to 3 A _3, and a group of physical keys _3a 4 to 3 A _6, physical key while separately disposed on and 3a ₇ to 3 a _10, a plurality of physical keys _3b 1 _{~3b 10} provided in the second key unit 3b, the physical key _3b 1 _{~3b 3} group and, physical keys _3b 4 _{~3b 6} and groups, arranging divided into physical key _3b 7 _{~3b 10.}

In the example shown in FIG. 13, the electronic device 1, provided with a partition 60a between the physical key 3a ₃ and the physical keys 3a _4, provided partition 60b between the physical key 3a ₆ and the physical keys 3a _7. Furthermore, the electronic device 1, provided with a partition 60c between the physical key 3b ₃ and the physical key 3b _4, provided partition 60d between the physical key 3b ₆ and the physical key 3b _7. Thereby, the electronic device 1 includes the plurality of physical keys 3a ₁ to 3a ₁₀ included in the first key unit 3a, the group of the physical keys 3a ₁ to 3a ₃ , and the physical keys 3a ₄ to 3a _6. And the physical keys 3a ₇ to 3a ₁₀ are divided into groups, and the plurality of physical keys 3b ₁ to 3b _{10 included} in the second key unit 3b are arranged as the physical keys 3b ₁ to 3b _1. and groups 3b _3, and a group of physical keys 3b ₄ ~ physical key 3b _6, arranged separately in the group of physical keys 3b ₇ ~ physical key _{3b 10.}

14 and 15 are diagrams showing another example of the structure of the operation surface of the physical key provided in the electronic device according to the embodiment. An operation surface of the physical key 3a ₁ is illustrated from among a plurality of physical keys included in the electronic device 1. In the example shown in FIG. 14, the electronic device 1 comprises, for example, six protrusions 70a~70f to expose the Braille pattern on the operating surface of the physical key 3a ₁ (surface on which a user operates touch). The protrusions 70a to 70f are installed such that they can be projected on the surface by an actuator or the like and can be housed inside. The physical key 3a ₁ may be installed in a state of being rotated by 90 degrees from the example shown in FIG. 14 in accordance with general lateral finger movement when reading Braille.

In the example shown in FIG. 15, the electronic device 1, a physical operation surface of the key 3a ₁ to divide into two regions 80a and the region 80b, the physical keys parallel linear partition 90 in the longitudinal direction of the physical key 3a ₁ It is provided on the operation surface of 3a ₁ . With the physical key 3a ₁ shown in FIG. 15, the electronic device 1 changes the processing content depending on which of the two areas 80a and 80b on the operation surface of the physical key 3a ₁ the touch is detected. You can

  Another example of the functional configuration of the electronic device 1 will be described with reference to FIG. FIG. 16 is a diagram showing another example of the functional configuration of the electronic device according to the embodiment. In the above embodiment, the electronic device 1 has been described as an example in which the physical key unit 3 is provided inside (see FIG. 1), but the physical key unit 3 can be configured as an externally attachable individual unit. As shown in FIG. 16, the electronic device 1 is connected to the external physical key unit 100 via the communication unit 6 in a communicable state. The external physical key unit 100 includes, for example, a communication unit 101, a memory 102, a physical key unit 103, and a microcomputer 104. The physical key unit 103 has a first key unit 103a, a second key unit 103b, a third key unit 103c, and a touch screen 103d. The electronic device 1 can receive the information of the user's operation on the external physical key unit 100 via the communication unit 6 and can execute the same processing as that of the above embodiment.

17 to 24 are diagrams showing other structural examples of the electronic device according to the embodiment. As shown in FIGS. 17 and 18, the electronic device 1 may have a structure in which a plurality of physical keys 3a _{1 to} 3a ₃ are arranged on the side surface of the housing 1h.

  Further, as shown in FIG. 19, the electronic device 1 may have a structure in which only a plurality of physical keys are arranged on the operation surface of the user. Further, as shown in FIG. 20, the electronic device 1 may have a structure in which only the touch screen 2B and a plurality of physical keys are arranged on the operation surface of the user. Further, as shown in FIG. 21, the electronic device 1 may have a structure in which only a plurality of physical keys and the numeric keypad 200 are arranged on the operation surface of the user. In addition, as shown in FIGS. 22 and 23, the electronic device 1 is a structure having a substantially circular shape, in which the touch screen display 2 is arranged inside, and physical keys are arranged on the outer periphery of the structure. It may be. Further, as shown in FIG. 24, the electronic device 1 may be a structure having a substantially columnar shape, in which the touch screen display 2 is arranged on the upper surface, and a plurality of physical keys are arranged on the side surface.

  Next, another example of the input process executed by the electronic device 1 will be described. Further, the electronic device 1 of the present embodiment uses a plurality of software keys (virtual keys, soft keys) as the second key unit. FIG. 25 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. FIG. 26 is a diagram showing an arrangement example of the key units according to the embodiment. The electronic device 1 shown in FIGS. 25 and 26 has the same configuration as that shown in FIGS. 1 and 2 except that only the first key unit 3a and the third key unit 3c are arranged as the physical key unit 3. It is similar to the electronic device 1 shown. The first key unit 3a of the physical key unit 3 of the electronic device 1 shown in FIGS. 25 and 26 is at a different position from the first key unit 3a of the electronic device 1 shown in FIGS. 1 and the second key unit 3b of the electronic device 1 shown in FIG.

Here, in the present embodiment, a case will be described in which characters are associated as a group. In this case, the first key data 9C and the second key data 9D are associated with a group including a plurality of characters or a group of one character. FIG. 27 is a diagram showing an example of the first key data according to the embodiment. FIG. 28 is a diagram showing an example of the second key data according to the embodiment. The first key data 9C is information on keys that are pre-assigned to each of the plurality of physical keys that form the first key unit 3a. FIG. 27 is a diagram showing an example of the first key data according to the embodiment. As shown in FIG. 27, the first key data 9C includes “a”, “ka”, and “a” for each of the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ that constitute the first key unit 3a. The characters "sa", "ta", "na", "ha", "ma", "ya", "ra", and "wa" are set. “A”, “ka”, “sa”, “ta”, “na”, “wa” assigned to each of the physical keys 3a ₁ , ..., Physical key 3a ₁₀ that constitute the first key unit 3a. ",""Ma","ya","ra","wa" characters, A line, K line, Sa line, Ta line, Na line, Ha line, Ma line, Ya line, La line, Wa line Means each line of. The first key data 9C is used when performing the output corresponding to each of the physical keys 3a ₁ , ..., And the physical key 3a ₁₀ that constitute the first key unit 3a in the character input processing described later.

The second key data 9D is key information that is pre-assigned to each of the plurality of physical keys that form the second key unit 3b. FIG. 28 is a diagram showing an example of the second key data according to the embodiment. As shown in FIG. 28, the second key data. 9D, physical key _3a 1 constituting the first key unit 3a, · · ·, of physical keys _{3a 10,} for each physical key operation is detected, second A plurality of characters are assigned to the software keys 2a ₁ , ..., Software key 2a ₅ that constitute the key unit 2a. For example, if the operation on the physical key 3a ₁ constituting the first key unit 3a is detected (3a ₁ = Oh), software keys _2a 1, · · ·, for each of the software keys 2a _5, " The characters “A”, “I”, “U”, “E”, and “O” are set to be assigned. For example, if the operation on the physical key 3a ₂ constituting the first key unit 3a is detected (3a ₂ = or), software keys _2a 1, · · ·, for each of the software keys 2a _5, " Characters such as "ka", "ki", "ku", "ke", and "ko" are assigned. For example, if the operation on the physical key 3a ₃ constituting the first key unit 3a is detected (3a ₃ = Is), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set that characters "sa", "shi", "su", "se", and "so" are assigned. For example, if the operation on the physical key 3a ₄ constituting the first key unit 3a is detected (3a ₄ = were), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set to assign the characters "ta", "chi", "tsu", "te", and "to". For example, if the operation on the physical key 3a ₅ constituting the first key unit 3a is detected (3a ₅ = Do), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set to assign the characters "na", "ni", "nu", "ne", and "no". For example, if the operation on the physical key 3a ₆ constituting the first key unit 3a is detected (3a ₆ = is), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set to assign the characters "ha", "hi", "fu", "he", and "ho". For example, if the operation on the physical key 3a ₇ constituting the first key unit 3a is detected (3a ₇ = or), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set that the characters "ma", "mi", "mu", "me", and "mo" are assigned. For example, when an operation on the physical key 3a ₈ constituting the first key unit 3a is detected (3a ₈ = or), for each of the software key 2a ₁ , the software key 2a ₃ , and the software key 2a ₅ , It is set to assign the characters “ya”, “yu”, and “yo”. For example, if the operation on the physical key 3a ₉ constituting the first key unit 3a is detected (3a ₉ = al), software keys _2a 1, · · ·, for each of the software keys 2a _5, " It is set to assign characters such as “ra”, “ri”, “ru”, “re”, and “ro”. For example, when an operation on the physical key 3a ₁₀ that constitutes the first key unit 3a is detected (3a ₁₀ = wa), for each of the software key 2a ₁ , the software key 2a ₃ , and the software key 2a ₅ , It is set to assign the letters "wa", "wo", and "n". The second key data 9D is used when executing the output corresponding to each of the software keys 2a ₁ , ..., And the software key 2a ₅ that constitute the second key unit 2a in the character input processing described later. In the example shown in FIG. 28, in the second key data 9D, there is no assignment to the software keys 2a ₆ , ..., Software key 2a ₁₀ that constitute the second key unit 2a, but other characters than the above Editing functions such as, line feed, deletion, and conversion may be set. A function for controlling the operation of the electronic device 1 may be associated with the physical keys 3c ₁ , ..., And the physical key 3c ₃ .

29 and 30 are diagrams illustrating an example of an execution screen of the input process according to the embodiment. The electronic device 1 associates the software keys 2a ₁ , ..., And the software key 2a ₅ included in the second key unit 2a with the respective areas of the touch screen display 2. Here, in the second key unit 2a, software keys 2a ₁ , ..., Software keys 2a ₅ are arranged side by side along the side of the touch screen display 2. In the example shown in FIG. 29, the second key unit 2a has software keys 2a ₁ , ..., 2a ₅ arranged side by side in the Y-axis direction. That is, the second key unit 2a is arranged in the same direction as the first key unit 3a. The software key 2a ₁ is assigned a region of y ₀ ≦ y ≦ y ₁ in the Y-axis direction, which is the direction in which the keys are arranged. Here, y is a value indicating the area of each software key in the Y-axis direction. y ₀ and y ₁ are coordinates in the Y-axis direction. Similarly, y ₂ , y ₃ , y ₄ , and y ₅ , which will be described later, are also coordinates in the Y-axis direction. Here, the coordinates y ₀ , y ₁ , y ₂ , y ₃ , y ₄ , y ₅ have a relationship of y ₀ <y ₁ <y ₂ <y ₃ <y ₄ <y ₅ . The coordinate y ₀ is one end of the touch screen display 2 in the Y axis direction. The coordinate y ₅ is the other end of the touch screen display 2 in the Y axis direction. The software key 2a ₂ is assigned a region of y ₁ ≦ y ≦ y ₂ . The software key 2a ₃ is assigned a region of y ₂ ≦ y ≦ y ₃ . The software key 2a ₄ is assigned a region of y ₃ ≦ y ≦ y ₄ . The software key 2a ₅ is assigned an area of y ₄ ≦ y ≦ y ₅ . The software keys 2a ₁ , ..., And the software keys 2a ₅ are arranged from end to end of the touch screen display 2 in the X-axis direction orthogonal to the Y-axis. That is, the software keys 2a ₁ , ..., And the software key 2a ₅ are arranged along two sides of the touch screen display 2.

In the example shown in FIG. 30, the second key unit 2a has software keys 2a ₁ , ..., Software keys 2a ₅ arranged side by side in the X-axis direction. That is, the second key units 2a are arranged in the direction orthogonal to the direction in which the physical keys of the first key unit 3a are arranged. The software key 2a ₅ has a longer width in the direction in which it is aligned than the other software keys 2a ₁ , ..., And the software key 2a ₄ . The software keys 2a ₁ , ..., The software keys 2a ₅ are from the end of the touch screen display 2 in the direction in which the physical keys 3a ₁ , ..., The software keys 3a _{5 of} the first key unit 3a are arranged. It is arranged. That is, the software keys 2a ₁ , ..., And the software key 2a ₅ are arranged along two sides of the touch screen display 2. Further, as shown in FIG. 30, the width of each software key may be different.

An example of the screen transition in the input process will be described with reference to FIG. FIG. 31 is a schematic diagram for explaining a screen transition associated with the input processing according to the embodiment. As shown in FIG. 31, the electronic device 1 displays the execution screen 20 of the input process on the display 2A (step S52). Blank keys are displayed in each area of the software keys 2a ₁ , ..., Software key 2a _{5 on} the display. Subsequently, when the electronic device 1 detects a touch on the physical key 3a ₃ , the electronic device 1 executes an output corresponding to the physical key 3a ₃ (step S54). Specifically, the electronic device 1 outputs a reading voice of the character “sa” assigned to the physical key 3a ₃ from the speaker 11.

Then, when the physical key 3a ₃ is pressed, the electronic device 1 executes the output corresponding to the physical key 3a ₃ (step S56). Specifically, the electronic device 1, the software key _2a 1 which is associated with a physical key 3a _3, · · ·, each of the software keys 2a _5, software keys _2a 1, · · ·, software keys 2a ₅ Assign at least one character that is previously associated with. For example, the software key _2a 1, ···, for each of the software key 2a _5, "of", "teeth", "to", "to", assigned a character of "their", software key _2a 1, ..., to each of the software key 2a _5, "of", "teeth", "to", "to", to display a character image of "its".

Subsequently, when the electronic device 1 detects a touch on the software key 2a ₃ , the electronic device 1 executes an output corresponding to the software key 2a ₃ (step S58). Specifically, the electronic device 1 outputs the reading voice of the character “su” assigned to the software key 2a ₃ from the speaker 11.

Then, when the software key 2a ₃ is pressed, the electronic device 1 executes the output corresponding to the software key 2a ₃ (step S60). Specifically, the electronic device 1 confirms the input of the character “su” assigned to the software key 2a ₃ and displays it in the character input field 40. Here, the electronic device 1 detects a long tap, a double tap, or the like as a press on the software key 2a ₃ . The operation of confirming the input, that is, the operation of executing the output corresponding to the software key 2a ₃ in step S60 is not limited to pressing the software key. For example, pressing a physical key may be used as an input determination operation.

The flow of processing executed by the electronic device according to the embodiment will be described with reference to FIG. 32. FIG. 32 is a flowchart showing an example of the flow of processing executed by the electronic device according to the embodiment. The process shown in FIG. 32 is realized by the controller 10 executing the input control program 9B. In the description of FIG. 32, the physical keys 3a _m correspond to the physical keys 3a ₁ , ..., And the physical keys 3a ₁₀ that form the first key unit 3a. In the description of FIG. 32, the software keys 2a _n correspond to the software keys 2a ₁ , ..., And the software key 2a ₅ that form the second key unit 2a.

As shown in FIG. 32, the controller 10 determines whether it has detected a touch on any of the physical key 3a _m of the first key unit 3a (step S201).

As a result of the determination, when the controller 10 detects a touch on the physical key 3a _m (Yes in step S201), the controller 10 performs an output corresponding to the physical key 3a _m that detected the touch (step S202).

Subsequently, the controller 10 determines whether it has detected the pressing of the physical key 3a _m (step S203).

The controller 10, as a result of the judgment, when detecting a depression of the physical key 3a _m (step S203, Yes), executes the output corresponding to the physical key 3a _m detecting the pressed (step S204), the process of step S201 Return to procedure.

In step S203, the controller 10, the result of the determination, if detecting no depression of the physical key 3a _m (step S203, No), the process returns to the procedure of step S201.

In step S201, the controller 10, the result of the determination, if not detecting the touch to the physical key 3a _m (step S201, No), and detects a touch to any one of the software keys 2a _n of the second key unit 2a It is determined (step S205).

The controller 10, as a result of the judgment, when detecting a touch to the software key 2a _n (step S205, Yes), executes the output corresponding to the software key 2a _n detects a touch (step S206).

Subsequently, the controller 10 determines whether it has detected the pressing of the software keys 2a _n (step S207). Here, a long tap and a double tap are illustrated as the pressing of the software key 2a _n . The pressing may be any operation that can be detected as an operation different from the touch.

The controller 10, as a result of the judgment, when detecting a depression of the software keys 2a _n (step S207, Yes), executes the output corresponding to the software key 2a _n detects a pressed (step S208), the process of step S201 Return to procedure.

In step S207, the controller 10, the result of the determination, if detecting no depression of the software keys 2a _n (step S207, No), the process returns to the procedure of step S201.

In step S205, the controller 10, the result of the determination, if not detecting the touch to the software keys 2a _n (step S205, No), it has detected a touch on the non-first key unit 3a and the second key unit 2a Is determined (step S209).

  As a result of the determination, the controller 10 ends the process illustrated in FIG. 32 when it detects a touch on a part other than the first key unit 3a and the second key unit 2a (step S209, Yes). On the contrary, when the controller 10 does not detect a touch on anything other than the first key unit 3a and the second key unit 3b as a result of the determination (step S209, No), the process returns to the processing procedure of step S201.

  Although an example of character input has been described in the present embodiment, the same applies to the case of a combination of folders and data associated in the above hierarchy. According to the above-described embodiment, the electronic device 1 assigns a group to each of a plurality of physical keys and software keys arranged in a row, so that it is easy to recognize where the group is assigned and operability is improved. Can be higher. Further, when the groups are associated with each other in a hierarchy and the group is selected, the group associated with the selected group can be associated with each of the other key units to facilitate selection of the desired group. . In addition, the two key units are alternately linked to the group, so that a simple operation can be performed and the conventional input can be improved in terms of operability.

  The electronic device 1 is provided with software keys assigned to groups along the sides of the touch screen display 2. The electronic device 1 may be provided with software keys along the edge of the housing 1h, the boundary between the housing 1h and the touch screen display 2, and the side of the touch screen display 2. Thereby, the user selects and operates the software key by moving the finger or the like along the edge of the housing 1h, the boundary between the housing 1h and the touch screen display 2, and the side of the touch screen display 2. It is possible to perform the operation for the key with a simple operation.

  FIG. 33 is a diagram showing an example of an execution screen for input processing according to the embodiment. FIG. 33 shows an example in which the operation target is character conversion processing. As shown in FIG. 33, the electronic device 1 displays the execution screen of the input process on the display 2A (step S62). A character input field 40 and a prediction conversion candidate unit 42 are displayed on the screen. The predictive conversion candidate unit 42 has a plurality of regions 44. The region 44 is one character, which is a character of each group associated with the “sa” key in this embodiment. The prediction conversion candidate unit 42 is associated with the area 44 of “sa” of the second key unit, and displays the characters associated with each physical key of the first key unit 3a. Each physical key of the first key unit 3a has an "arrow indicating the movement of a candidate", "difference", "check", "sa", "chain", "sa (half-width)", "sa", "saga". , “Fast”, and “arrows indicating movement of candidates” are assigned. The predictive conversion candidate unit 42 displays the character corresponding to each key in each area 44. The physical key at the end of the first key unit 3a is assigned with "an arrow indicating the movement of the candidate" associated with the operation of scrolling the candidate.

Subsequently, when the electronic device 1 detects a touch or press on the physical key 3a ₁ , the electronic device 1 executes an output corresponding to the physical key 3a ₁ (step S64). Specifically, the electronic device 1 executes a process of moving the candidate assigned to the physical key 3a ₁ . As a result, the character assigned to the physical key 3a ₃ changes. The predictive conversion candidate unit 42 has, for each key, an “arrow indicating the movement of the candidate”, “insignificant”, “*”, “invitation”, “saga”, “sha”, “sha”, “*”, “tea”. , "Arrow indicating movement of candidate" is assigned.

Subsequently, when the electronic device 1 detects a touch on the physical key 3a ₂ , the electronic device 1 executes an output corresponding to the physical key 3a ₂ (step S66). Specifically, the selected character is read aloud. In the case of the present embodiment, the voice "Ocha no Sa" is output to specify the Chinese character. Then the electronic device 1 detects the depression to physical keys 3a _2, executes an output corresponding to the physical key 3a ₂ (step S68). Specifically, to determine the "tea" corresponding to the physical key 3a ₂ as an input character, and displays the "Tea" in the character input box 40 as an input character.

  In this way, the electronic device 1 may associate the character input conversion candidates as a group. In the above embodiment, the physical key is associated, but the software key may be associated.

FIG. 34 is a diagram illustrating an example of an execution screen of input processing according to the embodiment. FIG. 34 shows an example in which the operation target is character conversion processing. As shown in FIG. 34, the electronic device 1 displays the execution screen 20 of the input process on the display 2A. Subsequently, when the electronic device 1 detects a touch on the physical key 3b ₃ , the electronic device 1 executes an output corresponding to the physical key 3b ₃ (step S72). Specifically, the electronic device 1 outputs the reading voice of the character “sa” assigned to the physical key 3b ₃ from the speaker 11.

Subsequently, the electronic device 1, when the physical key 3b ₃ is pressed, performing the output corresponding to the physical key 3b ₃ (step S74). Specifically, the electronic device 1, the software key _2a 1 which is associated with a physical key 3a _3, · · ·, each of the software keys 2a _5, software keys _2a 1, · · ·, software keys 2a ₅ Assign at least one character that is previously associated with. For example, the software key _2a 1, ···, for each of the software key 2a _5, "of", "teeth", "to", "to", assigned a character of "their", software key _2a 1, ..., to each of the software key 2a _5, "of", "teeth", "to", "to", to display a character image of "its".

Subsequently, when the electronic device 1 detects a touch on the software key 2a ₃ , the electronic device 1 executes an output corresponding to the software key 2a ₃ (step S76). Specifically, the electronic device 1 outputs the reading voice of the character “su” assigned to the software key 2a ₃ from the speaker 11.

Then, when the software key 2a ₃ is pressed, the electronic device 1 executes the output corresponding to the software key 2a ₃ (step S78). Specifically, the electronic device 1 causes the character “su” assigned to the software key 2a ₃ to be displayed in the character input box 40 as an input candidate. Here, the electronic device 1 detects a long tap, a double tap, or the like as a press on the software key 2a ₃ .

  The electronic device 1 associates the conversion candidate corresponding to each character of the software key with each physical key of the first key unit 3a. The electronic device 1 displays one character, in the present embodiment, a character of each group associated with the “su” key, in the plurality of areas 48 of the prediction conversion candidate unit 42 (step S80). Here, the conversion candidate is not limited to one character (hiragana, katakana, kanji) and may be a word or a sentence. For each physical key of the first key unit 3a, "arrow indicating the movement of the candidate", "su", "su", "element", "nest", "immediately", "great", "great", “Gap” and “arrow indicating the movement of candidates” are assigned. The predictive conversion candidate unit displays the character corresponding to each key in each area 48. The physical key at the end of the first key unit 3a is assigned with "an arrow indicating the movement of the candidate" associated with the operation of scrolling the candidate.

Subsequently, when the electronic device 1 detects a touch on the physical key 3a ₈ , the electronic device 1 executes a process corresponding to the physical key 3a ₈ (step S82). Specifically, the selected group is read aloud. In the case of the present embodiment, the sound "wonderful, suha is obedient, baha, clear weather" is output. Then the electronic device 1 detects the depression to physical keys 3a _8, executes an output corresponding to the physical key 3a ₈ (step S84). Specifically, to determine the "wonderful" corresponding to the physical key 3a ₈ as an input character, and displays the "great" in the character input column 40 as an input character.

  In this way, the electronic device 1 may associate the character input conversion candidates as a group. The conversion candidate may be a word. In the above embodiment, the combination of the first key unit and the second key unit is not limited, and may be a physical key and a physical key or a combination of a physical key and a software key. The first key unit and the second key unit may be switched depending on the key for input.

  The specification has been described in terms of characteristic embodiments in order to fully and clearly disclose the technology according to the appended claims. However, the appended claims are not to be limited to the above-described embodiments, and all modifications and alternatives that can be made by a person skilled in the art within the scope of the basic matters shown in the present specification. It should be embodied in possible configurations.

1 electronic device 2 touch screen display 2A display 2B touch screen 3 physical key unit 3a first key unit 3b second key unit 3c third key unit 3d touch screen 4 illuminance sensor 5 proximity sensor 6 communication unit 7 receiver 8 microphone 9 storage 9A Control program 9B Input control program 9C First key data 9D Second key data 9E Condition data 9Z Setting data 10 Controller 11 Speaker 12 Camera 13 Camera 14 Connector 15 Motion sensor 100 External physical key unit

Claims (6)

A housing,
A group of physical keys arranged along the edge of the housing,
A controller that executes processing based on an operation of a physical key of the physical key group;
Equipped with
The physical key group includes a first key group and a second key group,
The controller assigns a first group to the first key group,
An electronic device that, when detecting an operation on a physical key of the first key group, assigns a second group associated with the first group assigned to the operated physical key to the second key group. . A housing,
Touch screen,
A group of physical keys arranged along the edge of the housing,
A group of software keys arranged along the edge of the touch screen,
A physical key of the physical key group and a controller that executes processing based on an operation of the software key of the software key group,
The controller assigns a first group to the physical key group,
An electronic device that, when detecting an operation on a physical key of the physical key group, assigns a second group associated with the first group assigned to the operated physical key to the software key group. A housing,
A control method for an electronic device, comprising: a physical key group including a first key group and a second key group arranged along an edge of the housing,
Assigning a first group to the first key group,
When detecting an operation on a physical key of the first key group, a control method for allocating a second group linked to the first group allocated to the operated physical key to the second key group. . A housing,
Touch screen,
A group of physical keys arranged along the edge of the housing,
A method of controlling an electronic device, comprising: a software key group arranged along an edge of the touch screen,
Assign the first group to the physical key group,
A control method of allocating a second group associated with the first group allocated to the operated physical key to the software key group when an operation on the physical key of the physical key group is detected. A housing,
An electronic device comprising: a physical key group including a first key group and a second key group arranged along an edge of the housing,
Assign the first group to the physical key group,
When an operation on a physical key of the physical key group is detected, a process of assigning a second group associated with the first group assigned to the operated physical key to the second key group is executed. program. A housing,
Touch screen,
A group of physical keys arranged along the edge of the housing,
An electronic device comprising a group of software keys arranged along the edge of the touch screen,
Assign the first group to the physical key group,
A program that, when detecting an operation on a physical key of the physical key group, executes a process of assigning a second group linked to the first group assigned to the operated physical key to the software key group.

Images