JP2020024755A - Electronic apparatus, control method, and control program - Google Patents

Abstract

To improve operability of contents displayed on a display in a prior art electronic apparatus.SOLUTION: In one aspect, an electronic apparatus comprises: a housing; one or more physical keys that are arranged along an edge of the housing; a storage that stores a rule for classifying elements included in contents; and a controller that classifies the elements included in the contents on the basis of the rule, and allocates the classified elements in the contents to the one or more physical keys.SELECTED DRAWING: Figure 1

Description

  The present application relates to an electronic device, a control method, and a control program.

  Some electronic devices include a physical key, a touch screen, and the like. For example, Patent Literature 1 discloses an electronic device that executes various functions according to an operation detected via a physical key and a touch screen.

International Publication No. 2008/086302

  In conventional electronic devices, there is room for improvement in the operability of various contents such as characters, graphics, sounds, images, moving images, and web pages composed of a combination thereof displayed on a display.

  An electronic device according to one aspect includes a housing, one or more physical keys arranged along an edge of the housing, storage for storing rules for classifying elements included in content, And a controller that classifies elements included in the content based on the content and assigns the classified elements of the content to one or more physical keys.

  An electronic device according to another aspect includes a housing, a display, a first physical key group including a plurality of physical keys arranged in a first row along an edge of the housing, and a first physical key group along the edge of the housing. A second physical key group including a plurality of physical keys arranged in a second column, a storage for storing rules for classifying elements included in the content, and a controller for classifying elements included in the content based on the rules And The controller sets the content in a predetermined area on the display, and assigns the area to one of the physical keys of the first physical key group. When an operation of a physical key of the first physical key group is detected, the controller classifies, based on rules, content elements included in an area corresponding to the detected physical key. The controller assigns the classified element to one of the physical keys of the second physical key group.

  A control method according to one aspect is directed to an electronic device including a housing, one or more physical keys arranged along an edge of the housing, and a storage for storing rules for classifying elements included in content. Is a control method. The control method classifies elements included in the content based on the rule, and assigns the classified elements of the content to one or more physical keys.

  A control method according to another aspect includes a housing, a display, a first physical key group including one or more physical keys arranged in a first row along an edge of the housing, A control method for an electronic device, comprising: a second physical key group including one or a plurality of physical keys arranged in a second row along the line; and a storage for storing rules for classifying elements included in the content. The control method sets the content in a predetermined area on the display, assigns the area to one of the physical keys of the first physical key group, and detects an operation of the physical key of the first physical key group. The elements of the content included in the area corresponding to the physical key whose operation has been detected are classified based on rules, and the classified elements are assigned to any of the physical keys of the second physical key group.

  A control program according to one aspect provides an electronic device including a housing, one or more physical keys arranged along an edge of the housing, and a storage for storing rules for classifying elements included in content. Perform the following steps. The control program causes the electronic device to execute a step of classifying elements included in the content based on rules and assigning the classified elements to one or more physical keys.

  A control program according to another aspect includes a housing, a display, a first physical key group including one or more physical keys arranged in a first row along an edge of the housing, An electronic device including a second physical key group including one or more physical keys arranged in a second column along with a storage for storing rules for classifying elements included in the content includes the following steps. Let it run. The control program sets, in the electronic device, content in a predetermined area on a display, and assigns the area to one of physical keys of a first physical key group; When the operation is detected, the element of the content included in the area corresponding to the physical key where the operation is detected is classified based on the rule, and the classified element is set as one of the physical keys of the second physical key group. And executing the assigning step.

FIG. 1 is an exemplary block diagram illustrating an example of a functional configuration of the electronic apparatus according to the embodiment. FIG. 2 is a diagram illustrating an example of key data according to the embodiment. FIG. 3 is a diagram illustrating an example of an element classification rule according to the embodiment. FIG. 4 is a diagram illustrating an example of a user attribute correspondence priority table according to the embodiment. FIG. 5 is a diagram illustrating an example of the user attribute data according to the embodiment. FIG. 6 is a diagram illustrating an outline of assignment of elements included in a web screen to physical keys according to the embodiment. FIG. 7 is a diagram illustrating an outline of assignment of elements included in the web screen to physical keys according to the embodiment. FIG. 8 is a diagram illustrating an outline of assignment of elements included in a web screen to physical keys according to the embodiment. FIG. 9 is a diagram illustrating an outline of assignment of elements included in a web screen to physical keys according to the embodiment. FIG. 10 is a diagram illustrating an outline of assignment of elements included in the web screen to the physical keys according to the embodiment. FIG. 11 is a diagram illustrating an outline of assignment of elements included in the web screen to physical keys according to the embodiment. FIG. 12 is a diagram illustrating an outline of assignment of elements included in a web screen to physical keys according to the embodiment. FIG. 13 is a diagram illustrating an example of an operation of the electronic device according to the embodiment. FIG. 14 is a diagram illustrating an example of an operation of the electronic device according to the embodiment. FIG. 15 is a diagram illustrating an example of an operation of the electronic device according to the embodiment. FIG. 16 is a diagram illustrating an example of an operation of the electronic device according to the embodiment. FIG. 17 is a flowchart illustrating an example of the flow of a process of the electronic device according to the embodiment. FIG. 18 is a flowchart illustrating an example of a flow of a process of the electronic device according to the embodiment. FIG. 19 is a diagram illustrating an example of the entire image of the web screen according to the embodiment. FIG. 20 is a flowchart illustrating another example of the processing flow of the electronic device according to the embodiment. FIG. 21 is a diagram illustrating an outline of assignment of elements included in the spreadsheet screen to the physical keys according to the embodiment. FIG. 22 is a diagram illustrating an outline of assignment of elements included in a spreadsheet screen to physical keys according to the embodiment. FIG. 23 is a diagram illustrating an outline of assignment of elements included in the spreadsheet screen to the physical keys according to the embodiment. FIG. 24 is a diagram illustrating an outline of assignment of elements included in a spreadsheet screen to physical keys according to the embodiment. FIG. 25 is a diagram illustrating another example of the key data according to the embodiment. FIG. 26 is a diagram illustrating a correspondence relationship between a physical key and an allocation element according to the embodiment. FIG. 27 is a view illustrating another example of the operation of the electronic device according to the embodiment. FIG. 28 is a diagram illustrating an outline of assignment of elements included in the document editing screen according to the embodiment to physical keys.

  A plurality of embodiments for implementing an electronic device, a control method, and a control program according to the present application will be described in detail with reference to the drawings.

  The electronic device according to the present application may be a device such as a smartphone, a mobile phone, a tablet, a portable personal computer, a media player, an electronic book reader, a navigator, a wearable device, or a game machine.

  FIG. 1 is an exemplary block diagram illustrating an example of a functional configuration of the electronic apparatus according to the embodiment. In the following description, similar components may be denoted by the same reference numerals. In the following description, duplicate description may be omitted. In the following description, content is processed by software such as an aggregate of digital data composed of characters, graphics, sounds, images, moving images, and combinations thereof, as represented by web pages, and applications. Digital data. The content is, as represented by a web page screen (hereinafter, web screen), a screen displayed on a display or the like in a state composed of characters, graphics, sounds, images, moving images, and combinations thereof, and It includes a screen displayed on a display or the like as software such as an application is executed. In the embodiment described below, a web screen and a screen displayed on a display as software is executed will be described as examples of content.

  As shown in FIG. 1, the electronic device 1 includes a touch screen display 2, buttons 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, a controller 10, a speaker 11, a camera 12, a camera 13, a connector 14, and a motion sensor 15.

  The touch screen display 2 has a display 2A and a touch screen 2B. The display 2A and the touch screen 2B may be located, for example, in an overlapping manner, side by side, or apart from each other. When the display 2A and the touch screen 2B are positioned so as to overlap with each other, for example, one or more sides of the display 2A may not be along any side of the touch screen 2B.

  The display 2A is a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display, etc.). The display 2A displays objects such as characters, images, symbols, and figures on the screen. The screen including the object displayed by the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of an application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen.

  The touch screen 2B detects contact or proximity of a finger, a pen, a stylus pen, or the like to the touch screen 2B. The touch screen 2B can detect a position on the touch screen 2B when a plurality of fingers, a pen, a stylus pen, or the like contacts or approaches the touch screen 2B. In the following description, a position where a plurality of fingers, a pen, a stylus pen, or the like detected by the touch screen 2B contacts or approaches the touch screen 2B is referred to as a “detection position”. The touch screen 2B notifies the controller 10 of the contact or proximity of the finger to the touch screen 2B together with the detected position. The touch screen 2B may notify the controller 10 of the detection of the contact or the proximity by notifying the detection position. The touch screen display 2 having the touch screen 2B can perform an operation that can be performed by the touch screen 2B. In other words, the operation performed by the touch screen 2B may be performed by the touch screen display 2.

  The controller 10 determines at least one of a contact or proximity detected by the touch screen 2B, a detection position, a change in the detection position, a time during which the contact or proximity is continued, an interval at which the contact or proximity is detected, and the number of times the contact is detected. The gesture type is determined based on the first and second gestures. The electronic device 1 including the controller 10 can execute an operation that can be performed by the controller 10. In other words, the operation performed by the controller 10 may be performed by the electronic device 1. The gesture is an operation performed on the touch screen 2B using a finger. The operation performed on the touch screen 2B may be performed on the touch screen display 2 having the touch screen 2B. Gestures that the controller 10 determines through the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. It is not limited to.

  The detection method of the touch screen 2B may be any method such as a capacitance method, a resistance film method, a surface acoustic wave method, an infrared method, and a load detection method.

  The button 3 receives an operation input from a user. The button 3 may include one or a plurality of physical keys arranged along an edge of the housing of the electronic device 1. The button 3 includes a first physical key group including a plurality of physical keys arranged in a first row along the edge of the housing of the electronic device 1 and a plurality of physical keys arranged in a second row along the edge of the housing. And a second physical key group including the first physical key.

  The illuminance sensor 4 detects illuminance. The illuminance is a value of a light beam incident on a unit area of a measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used, for example, for adjusting the brightness of the display 2A.

  The proximity sensor 5 detects the presence of a nearby object in a non-contact manner. The proximity sensor 5 detects the presence of an object based on a change in a magnetic field or a change in a return time of a reflected ultrasonic wave. The proximity sensor 5 detects, for example, that the display 2A and the face have approached. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 performs wireless communication. The wireless communication standards supported by the communication unit 6 include, for example, communication standards for cellular phones such as 2G, 3G, 4G, and 5G, and communication standards for short-range wireless communication. As a communication standard of a cellular phone, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (registered trademark), Worldwide Communications Digital, Mobile Communications, Mobile Communications, Mobile Phone GSM (registered trademark) (Global System for Mobile Communications), PHS (Personal Handy-phone System) and the like. The short-range wireless communication standards include, for example, IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), WPAN (Wireless Personal Area, etc.). The WPAN communication standard includes, for example, ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards described above.

  The receiver 7 outputs a sound signal transmitted from the controller 10 as sound. The receiver 7 can output, for example, the sound of a moving image reproduced by the electronic device 1, the sound of music, and the voice of the other party during a call. The microphone 8 converts an input user's voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 may be used as a work area for temporarily storing a processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disk, or a magneto-optical disk, and a storage medium reading device. The storage 9 may include a storage device such as a RAM (Random Access Memory) used as a temporary storage area.

  The programs stored in the storage 9 include an application executed in the foreground or background, and a support program (not shown) for supporting the operation of the application. For example, when the application is executed in the foreground, a screen related to the application is displayed on the display 2A. The support program includes, for example, an OS. The program may be installed in the storage 9 via wireless communication by the communication unit 6 or via a non-transitory storage medium.

  The storage 9 can store a control program 9A, key data 9B, element classification rules 9C, a user attribute correspondence priority table 9D, setting data 9Z, and the like. The control program 9A can cooperate with various applications stored in the electronic device 1 in providing various functions. The control program 9A may access the files and data stored in the cloud storage in cooperation with the cloud storage via the communication unit 6. The cloud storage may store some or all of the programs and data stored in the storage 9.

  The control program 9 </ b> A can provide functions for realizing processes related to various operations of the electronic device 1. The functions provided by the control program 9A include a function of adjusting the brightness of the display 2A based on the detection result of the illuminance sensor 4. The functions provided by the control program 9A include a function of invalidating an operation on the touch screen 2B based on the detection result of the proximity sensor 5. The functions provided by the control program 9A include a function of realizing a telephone call by controlling the communication unit 6, the receiver 7, the microphone 8, and the like. The functions provided by the control program 9A include a function of controlling the shooting processing of the camera 12 and the camera 13. The functions provided by the control program 9A include a function of controlling communication with an external device connected via the connector 14. The functions provided by the control program 9A include a function of performing various controls such as changing information displayed on the display 2A according to a gesture determined based on a detection result of the touch screen 2B. The functions provided by the control program 9A include a function of detecting a movement, a stop, and the like of a user carrying the electronic device 1 based on a detection result of the motion sensor 15.

  The functions provided by the control program 9A include functions related to content operations and the like. The content is, as represented by a web page, a set of digital data composed of characters, graphics, sounds, images, moving images, and combinations thereof, and a set of digital data processed by software such as an application. Body. The content is, as represented by a web page screen (hereinafter, web screen), a screen displayed on a display or the like in a state composed of characters, graphics, sounds, images, moving images, and combinations thereof, and It includes a screen displayed on a display or the like as software such as an application is executed.

  For example, the electronic device 1 sets the content displayed on the touch screen display 2 to a predetermined area on the touch screen display 2 and sets the set area to the A function for realizing a process of assigning to any one of the physical keys of one physical key group is also included. In addition, this function includes, for example, when the electronic device 1 detects an operation of a physical key of the first physical key group, an element of a content included in an area corresponding to the detected physical key is used as an element. A function for realizing a process of classifying based on the classification rule 9C is also included. In addition, for this function, the electronic device 1 refers to the user attribute setting value (hereinafter, user attribute data) in the setting data 9Z described later and the user attribute correspondence priority table 9D, and based on the element classification rule 9C. A function for implementing a process of selecting an element corresponding to the priority corresponding to the user attribute data from the classified elements is also included. That is, when the range of the priority corresponding to the user attribute data is the priority 1 to 3, the element corresponding to the priority of the priority 1 to 3 is selected from the elements classified based on the element classification rule 9C. Only sort. In addition, this function includes, for example, a function for realizing a process in which the electronic device 1 assigns an element selected based on the user attribute data to one of the physical keys of the second physical key group. In addition, for this function, for example, when the number of content elements is larger than the number of physical keys, the electronic device 1 assigns different elements to the same physical key in accordance with a predetermined pattern. The function for realizing is included. In addition, for this function, for example, the electronic device 1 sets a category for enabling user selection collectively for each of the elements selected based on the user attribute data, and sets the set category to the first category. It is possible to provide a function for realizing a process of assigning a physical key to a physical key of the group. For example, when the address bar, the menu parts, the link parts, the text in the page, and the image in the page are classified as elements included in the content, the electronic device 1 corresponds to “address” as a division corresponding to the address bar, and corresponds to the menu parts. "Menu" as a section to be performed, "link" as a section corresponding to each link, "text" as a section corresponding to text in a page, and "image" as a section corresponding to an image in a page. It can be assigned to each physical key of the physical key group.

  The functions provided by the control program 9A relating to the operation of the content and the like include, for example, a function of the electronic device 1 realizing a process of outputting a sound corresponding to the section or element assigned to the physical key detected by the operation. It is. When the “address bar”, which is an element of the web screen, is assigned to the physical key whose operation has been detected, it is possible to realize a process in which the electronic device 1 outputs a voice that reads out the address described in the address bar. When an “address” is assigned to the physical key where the operation is detected as a division corresponding to the element on the web screen, the electronic device 1 determines that the physical key where the operation is detected is “address” as the division corresponding to the element. "Can be realized. In a case where “menu components” which are elements of the web screen are assigned to the physical key whose operation has been detected, it is possible to realize a process of outputting a voice indicating that the electronic device 1 is a menu and reading out the contents of the menu. When “menu” is assigned to the physical key whose operation is detected as a category corresponding to the element on the web screen, the electronic device 1 determines that the physical key whose operation is detected is “menu” as a category corresponding to the element. "Can be realized. When “text in page”, which is an element of the web screen, is assigned to the physical key whose operation is detected, it is possible to realize a process in which the electronic device 1 outputs a voice that reads out the content described in the text. When “text” is assigned to the physical key where the operation is detected as the division corresponding to the element on the web screen, the electronic device 1 determines that the physical key where the operation is detected is “text” as the division corresponding to the element. "Can be realized. When “link components” which are elements of the web screen are assigned to the physical key whose operation has been detected, it is possible to realize a process in which the electronic device 1 outputs a voice that reads out the content described in the link. When “link” is assigned to the physical key where the operation is detected as a division corresponding to the element on the web screen, the electronic device 1 determines that the physical key where the operation is detected is “link” as the division corresponding to the element. "Can be realized. When the “image in page” which is an element of the web screen is assigned to the physical key whose operation is detected, it is possible to realize a process in which the electronic device 1 outputs a voice that reads out the ID given to the image. When “image” is assigned to the physical key where the operation is detected as the division corresponding to the element on the web screen, the electronic device 1 determines that the physical key where the operation is detected is “image” as the division corresponding to the element. "Can be realized.

  The key data 9B includes data on the configuration of the physical key provided in the electronic device 1. For example, the key data 9B includes an arrangement position of a physical key set based on a predetermined position of the electronic device 1, the number of physical keys, and the like. Further, the key data 9B includes management information of elements and divisions of the content assigned to the physical key. The management information is referred to when a process corresponding to the operated physical key (for example, a voice output for reading out the content of the element or the section) is performed.

FIG. 2 is a diagram illustrating an example of the key data 9B according to the embodiment. As illustrated in FIG. 2, the key data 9B includes, for each physical key group, data indicating a key configuration of a physical key constituting the physical key group, an allocation function for the physical key, an allocation category or an allocation element for the physical key. In. In the example shown in FIG. 2, the key structure corresponding to the first physical key group G1 has a five physical key "30a ₁ ～30A _5". In the example shown in FIG. 2, the physical key 30a ₁ is assigned the operation function "one back", it is allocated operating function "one advances" in the physical key 30a _5. In the example shown in FIG. 2, as the first round assignment segment, a physical key 30a ₂ ~30a _4, "address", "Menu" is assigned a classification of "links". In the example shown in FIG. 2, as the allocation division, the second and subsequent rounds of the physical keys constituting the first physical key group G1 exist. That is, as shown in FIG. 2, as second round assignment segment, segment of "text" is assigned to the physical key 30a _2. Further, in the example shown in FIG. 2, the key structure corresponding to a second physical key group G2 has a ten physical key _"30b 1 _{~30b 10".} In the example shown in FIG. 2, the physical key 30b ₁ is assigned the operation function "one back", the physical key 30b ₁₀ is assigned the operation function "one advances". In the example shown in FIG. 2, as the first round of allocation elements, the physical key _30b 7 _{~30b 9,} "Menu E1- (3)", "Menu E1- (2)", "address E1- (1)" Elements are assigned. Note that, in the example shown in FIG. 2, as the allocation element, the second and subsequent rounds of allocation exist for a plurality of physical keys constituting the second physical key group G2. That is, as shown in FIG. 2, as second round of allocation elements, the physical key _30b 2 _{~30b 9,} "text E2-(8)", "Menu E2-(7)", "Menu E2-(6 ) "," Link e2- (5) "," link e2- (4) "," link e2- (3) "," link e2- (2) ", and" link e2- (1) " Have been assigned. Further, as shown in FIG. 2, as a three round of allocation elements, the physical key _30b 6 _{~30b 9,} "Menu E2-(12)", "text E2-(11)", "Menu E2-(10 )) And “text e2- (9)”. Further, as shown in FIG. 2, the elements “menu e3- (2)” and “menu e3- (1)” are allocated to the physical keys 30b ₈ and 30b ₉ as the fourth round of the allocated elements. . The data of the allocation division and the allocation element shown in FIG. 2 are recorded in the key data 9B along with the processing realized by the controller 10 by executing the control program 9A. Further, the data of the allocation category and the allocation element recorded in the key data 9B may be updated each time the allocation to the physical key is changed. The timing at which the assignment of the physical key is changed includes the timing at which the screen displayed on the touch screen display 2 is changed.

  The element classification rule 9C corresponds to a rule for classifying elements included in content. FIG. 3 is a diagram illustrating an example of an element classification rule according to the embodiment. As shown in FIG. 3, the element classification rule 9C is displayed on a web screen such as a web page that can be browsed by a predetermined browser, a spreadsheet screen displayed when the spreadsheet application is executed, and a document edit application is executed. Document editing screen, etc. The element classification rule 9C includes, as classification elements from the web screen, an address bar, menu parts, link parts, in-page text, in-page images, and the like. The address bar corresponds to, for example, a widget used in a web browser in which a URL (Uniform Resource Locator), a homepage address, and the like are described. Each section of the menu corresponds to, for example, various navigation menus arranged on the web screen. Each link corresponds to, for example, a hyperlink described on a web screen. The text in a page corresponds to, for example, text data described on a web screen. The in-page image corresponds to, for example, image data pasted on a web screen. Similarly, the element classification rule 9C includes menu elements, worksheets, charts, texts in worksheets (cells), and the like as classification elements from the spreadsheet screen. Similarly, the element classification rule 9C includes menu items, a document input area, a chart, a text in the document input area, and the like as classification elements from the document editing screen.

  In addition, the element classification rule 9C includes, as shown in FIG. 3, information on the classification set to enable the user to select the elements classified from the content collectively for each element. For example, regarding the web screen, the element classification rule 9C is set as “address” set as a section corresponding to the address bar, “menu” set as a section corresponding to each section of the menu, and as a section corresponding to each section of the link. The information includes “link”, “text” set as a section corresponding to the text in the page, and “image” set as a section corresponding to the image in the page. Similarly, the element classification rule 9C also includes, for the spreadsheet screen and the document edit screen, information on divisions set to enable collective user selection for each element.

  Further, as shown in FIG. 3, the element classification rule 9C includes information on the priority at the time of assigning the element of the content to the physical key. The priority information included in the element classification rule 9C is information that has been set in advance according to the target screen (content type). For example, regarding the web screen, the element classification rule 9C indicates that the priority is “1” for “text in page”, the priority is “2” for “link parts”, the priority is “3” for “address bar”, and “menu parts”. Includes information of priority "4" and "image in page" of priority "5". Similarly, the element classification rule 9C also includes priority information when assigning content elements to physical keys for the spreadsheet screen and the document editing screen. The priority information included in the element classification rule 9C may include a case where the classification element is not given priority (for example, “no priority”). The priority is only reference data in the physical key assignment process based on the user attribute correspondence priority table 9D described later. If the priority information included in the element classification rule 9C is set to “no priority” that does not give priority to the classification element, the priority information corresponding to the user attribute is included in the content. Since it is not used for assigning an element to a physical key, a user attribute correspondence priority table 9D (see FIG. 4) and user attribute data (see FIG. 5), which will be described later, need not be stored in the storage 9.

  The user attribute correspondence priority table 9D is referred to by the function provided by the control program 9A when the electronic device 1 executes a process of assigning an element (for example, an element on a web screen) included in the content to a physical key. . FIG. 4 is a diagram illustrating an example of a user attribute correspondence priority table according to the embodiment. As shown in FIG. 4, the user attribute correspondence priority table 9D stores information indicating the range of the priority of the element to be assigned to the physical key for each user attribute of the electronic device 1. Here, the user attribute is information that can be arbitrarily set to determine whether or not an element included in the content is a useful element for the user of the electronic device 1. For example, information on the user's eyesight Etc. can be adopted. When the user attribute corresponds to “attribute 1” (when attribute 1 is set as the user attribute), the controller 10 refers to the user attribute corresponding priority table 9D to check all the priorities included in the content. Assign the element to the physical key. Further, when the user attribute corresponds to “attribute 2” (when attribute 2 is set as the user attribute), the controller 10 refers to the user attribute corresponding priority table 9D and checks the element included in the content. From among them, the elements of the priorities 1 to 3 are assigned to the physical keys. Further, when the user attribute corresponds to “attribute 3” (when attribute 3 is set as the user attribute), the controller 10 refers to the user attribute corresponding priority table 9D and checks the element included in the content. From among them, only the element of priority 1 is assigned to the physical key. A user whose visual acuity is 0.7 or more with both eyes is "attribute 1", a user whose visual acuity is 0.02 or more and less than 0.7 with both eyes is "attribute 2," In the example shown in FIG. 4, as the user's visual acuity is weaker, more visual information (information considered to be visually recognized to a greater degree) is excluded from the physical key assignment target in the example shown in FIG. Is done. As described above, the electronic device 1 can provide an operation environment corresponding to the user by changing the assignment of the element classified from the content to the physical key in accordance with the user attribute, thereby improving the operability of the content. Can be.

  In the above-described user attribute correspondence priority table 9D, a range of priorities corresponding to user attributes is set in advance. For example, a physical key is assigned to an element that the user of the electronic device 1 does not need. The electronic device may be provided with a table that can be set arbitrarily so as not to be set.

  The setting data 9Z is data that the electronic device 1 refers to when executing various processes by a function provided by the control program 9A. FIG. 5 is a diagram illustrating an example of the user attribute data according to the embodiment. As shown in FIG. 5, the setting data 9Z can store data arbitrarily set as a user attribute (for example, “attribute 1”).

  The controller 10 includes an arithmetic processing device. The arithmetic processing device includes, for example, a CPU (Central Processing Unit), an SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. Not limited. The controller 10 controls the overall operation of the electronic device 1 to realize various functions.

  Specifically, the controller 10 executes instructions included in a program stored in the storage 9 while referring to data stored in the storage 9 as necessary. Then, the controller 10 controls the functional unit according to the data and the command, thereby realizing various functions. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, and the speaker 11, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. The detection unit includes, for example, the touch screen 2B, the button 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, the camera 13, and the motion sensor 15, but is not limited thereto.

  The controller 10 can realize processing related to various operations of the electronic device 1 by executing the control program 9A. By executing the control program 9 </ b> A, the controller 10 can realize processing related to operation of content displayed on the touch screen display 2 and the like. For example, the controller 10 can implement a process of classifying elements included in content displayed on the touch screen display 2 based on the element classification rule 9C and assigning the classified elements to one or a plurality of physical keys. For example, the controller 10 sets the content displayed on the touch screen display 2 to a predetermined area on the touch screen display 2, and sets the area where the content has been set to one of the physical keys of the first physical key group. Can be realized. For example, when detecting an operation on a physical key of the first physical key group, the controller 10 classifies the elements of the content included in the area corresponding to the detected physical key based on the element classification rule 9C. Processing can be realized. For example, the controller 10 can implement a process of selecting an element corresponding to the priority corresponding to the user attribute data from the classified elements. For example, the controller 10 can implement a process of assigning an element selected based on a user attribute to one of the physical keys of the second physical key group. For example, the controller 10 sets a section for enabling the user to select all the elements selected based on the user attribute collectively for each element, and assigns the set section to the physical keys of the first physical key group. Can be realized. For example, the controller 10 can realize a process of outputting a sound corresponding to an element or a division of an element assigned to the physical key whose operation has been detected.

  The speaker 11 outputs a sound signal transmitted from the controller 10 as a sound. The speaker 11 is used, for example, to output a ringtone and music. One of the receiver 7 and the speaker 11 may have the other function.

  The cameras 12 and 13 convert the captured images into electric signals. The camera 12 is an in-camera for photographing an object facing the display 2A. The camera 13 is an out-camera for photographing an object facing the surface on the opposite side of the display 2A. The camera 12 and the camera 13 may be mounted on the electronic device 1 in a functionally and physically integrated state as a camera unit that can be used by switching between the in-camera and the out-camera.

  The connector 14 is a terminal to which another device is connected. The connector 14 may be a general-purpose terminal such as a USB (Universal Serial Bus), an HDMI (registered trademark) (High-Definition Multimedia Interface), a light peak (Thunderbolt (registered trademark)), or an earphone microphone connector. . The connector 14 may be a dedicated terminal such as a Dock connector. Devices connected to the connector 14 include, but are not limited to, for example, external storage, speakers, and communication devices.

  The motion sensor 15 can detect various types of information for determining an operation of a user who carries the electronic device 1. The motion sensor 15 may be configured as a sensor unit including an acceleration sensor, a direction sensor, a gyroscope, a magnetic sensor, a barometric pressure sensor, and the like.

  The electronic device 1 may include a GPS receiver and a vibrator in addition to the functional units described above. The GPS receiver receives a radio signal in a predetermined frequency band from a GPS satellite. The GPS receiver demodulates the received radio signal and sends the processed signal to the controller 10. The GPS receiver supports arithmetic processing of the current position of the electronic device 1. The electronic device 1 may include a receiver capable of receiving signals from positioning artificial satellites other than the GPS satellites, and may execute a current position calculation process. The vibrator causes a part or the whole of the electronic device 1 to vibrate. The vibrator has, for example, a piezoelectric element or an eccentric motor to generate vibration. The electronic device 1 includes a functional unit, such as a battery, which is naturally used to maintain the functions of the electronic device 1 and a control unit, which is naturally used to realize control of the electronic device 1.

  The electronic device 1 may access a storage server on the cloud via the communication unit 6 and acquire various programs and data.

  An example of a physical key assignment method corresponding to a web screen according to the embodiment will be described with reference to FIGS. 6 to 12. 6 to 12 are diagrams illustrating an outline of assignment of elements included in a web screen to physical keys according to the embodiment. In the following description, it is assumed that a user attribute (for example, attribute 1) of the user of the electronic device 1 is set in advance.

The electronic device 1 shown in FIG. 6 has a substantially rectangular parallelepiped casing, and the plane of the electronic device 1 has a substantially rectangular shape as shown in FIG. The first physical key group G1 is configured to include a total of five physical keys of the physical keys 30a ₁ ,..., And the physical key 30a ₅ shown in FIG. The physical keys 30a ₁ ,..., And the physical keys 30a ₅ are arranged in a row along the edge F1 of the housing of the electronic device 1 in a direction parallel to the y-axis shown in FIG. The second physical key group G2 is configured to include a total of ten physical keys of the physical keys 30b ₁ ,..., And the physical key 30b ₁₀ shown in FIG. The physical keys 30b ₁ ,..., And the physical keys 30b ₁₀ are arranged in a row in a direction parallel to the x axis shown in FIG. The number of physical keys constituting each of the first physical key group G1 and the second physical key group G2 shown in FIG. 6 is an example, and is not necessarily composed of the same number of physical keys as the example shown in FIG. You may. Further, the arrangement position of the first physical key group G1 shown in FIG. 6 is an example, and may be arranged along an edge of a housing different from the edge F1 of the housing shown in FIG. Similarly, the second physical key group G2 shown in FIG. 6 may be arranged along an edge of a housing different from the edge F2 of the housing shown in FIG. In the example shown in FIG. 6, the physical keys 30a ₁ ,..., Physical keys 30a ₅ are arranged along the edge F1 of the housing of the electronic device 1; May be arranged along. Similarly, the physical keys 30b ₁ ,..., And the physical keys 30b ₁₀ may be arranged along one side of the outline of the touch screen display 2. In the example illustrated in FIG. 6, the electronic device 1 displays the web screen C1 on the touch screen display 2.

For example, at the timing when the web screen C1 is displayed on the touch screen display 2, the electronic device 1 displays the web screen C1 on three areas on the touch screen display 2, the areas A1, A2, and Set to A3. Subsequently, the electronic device 1 allocates space A1 to a physical key 30a ₂ of the first physical key group G1, allocates a region A2 on the physical keys 30a ₃ of the first physical key group G1, an area A3 first assigned to the physical key 30a ₄ physical keys G1.

The electronic device 1, for example, when detecting the operation of the physical keys 30a _2, as shown in FIG. 8, the elements of a web screen C1 included in the region A1 corresponding to the physical key 30a _2, based on factors classification rules 9C Classify. That is, the electronic device 1 extracts the elements such as the address bar, the menu parts, the link parts, the in-page text, and the in-page image included in the web screen C1 as the physical key assignment targets. In the example shown in FIG. 8, the elements e1- (1), e1- (2), and e1- (3) are classified as the elements of the web screen C1 included in the area A1. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the user attribute from the elements e1- (1), e1- (2), and e1- (3). The element corresponding to the priority corresponding to the data is selected. For example, when the element e1- (1), the element e1- (2), and the element e1- (3) are selected, the electronic device 1 assigns the element e1- (1) to the second physical key group G2. assigned to the physical key 30b ₉ contained the elements E1- (2), assigned to the physical key 30b ₈ included in the second physical key group G2, element E1- and (3), the second physical key group G2 assigned to the physical key 30b ₇ included.

The electronic device 1, for example, when detecting the operation of a physical key 30a _3, as shown in FIG. 9, the elements of a web screen C1 included in the region A2 corresponding to the physical key 30a _3, based on the element classification rules 9C Classify. In the example shown in FIG. 9, as elements of the web screen C1 included in the area A2, twelve elements from an element e2- (1) to an element e2- (12) are classified. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute corresponding priority table 9D, and converts the twelve elements e2- (1) to e2- (12) into user attribute data. The element corresponding to the corresponding priority is selected. For example, when all the elements from the element e2- (1) to the element e2- (12) are selected, the electronic device 1 first determines the eight elements e2- (1) to element e2- (8). assign elements from physical key 30b ₉ included in the second physical key group G2 to the physical key 30b ₂ respectively. Subsequently, the electronic device 1 returns to the physical key 30b ₉ again folded, four elements to elements e2- (9) ~ element E2-(12), respectively, from the physical key 30b ₉ to physical key 30b ₆ Assign in order. As described above, the electronic device 1 is included in the second physical key group G2 when the number of elements to which a physical key is to be assigned is larger than the number of physical keys included in the second physical key group G2. This can be dealt with by repeatedly allocating different elements to the same physical key by circulating the physical key.

The electronic device 1, for example, when detecting the operation of the physical key 30a _4, as shown in FIG. 10, the elements of a web screen C1 included in the area A3 corresponding to a physical key 30a _4, based on the element classification rules 9C Classify. In the example illustrated in FIG. 10, the elements e3- (1) and e3- (2) are classified as the elements of the web screen C1 included in the area A3. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and corresponds to the priority corresponding to the user attribute data from the elements e3- (1) and e3- (2). Select the elements that did. For example, when the element E3- (1) and elements E3- (2) is selected, the electronic device 1, the elements E3- (1), assigned to the physical key 30b ₉ included in the second physical key group G2 the element E3- (2), assigned to the physical key 30b ₈ included in the second physical key group G2.

  For example, as shown in FIG. 11, the electronic device 1 has a direction (1) parallel to the y-axis direction and a direction (2) parallel to the x-axis direction with reference to the coordinates (X1, Y1) of the touch screen display 2. By scanning the touch screen display 2 on the screen, elements on the web screen C1 can be classified and numbered in the classified order. FIG. 12 shows, for example, a transition of scanning for an area A2 on the touch screen display 2 on which the web screen C1 is set. The electronic device 1 starts the scan SC1 in a direction (1) parallel to the y-axis direction (step S1). The electronic device 1 detects the area HT1 on the web screen C1 by the scan SC1 (Step S2). The electronic device 1 starts the scan SC2 for the region HT1 in the direction (2) parallel to the x-axis direction (step S3). The electronic device 1 assigns an identification number e2- (1) to an element included in the area HT2 detected by the scan SC2, and an identification number e2 to an element included in the area HT3 detected subsequent to the area HT2. -(2) is given (step S4). As described above, after scanning the entire area A2, the electronic device 1 scans other areas on the touch screen display 2 on which the web screen C1 is set in the same manner as the area A2, and includes the web screen C1 in the web screen C1. Perform classification and numbering of elements to be performed. The electronic device 1 assigns the elements on the web screen C1 to the physical keys in the order in which the elements are numbered.

The electronic device 1, after allocated to the physical key included elements classified from web screen C1 to the second physical key group G2, allocation areas A1 to physical keys 30a _2, allocation of area A2 to the physical key 30a ₃ and deallocates the area A3 to the physical key 30a _4, respectively assigned to the newly physical key of the first physical key group G1 of the division sorted element from among elements included in the web screen C1. The electronic device 1, for example, among the sorted elements from the web screen C1, assigned a classification corresponding to the page in the image "image" in the physical key 30a _2, a segment corresponding to the page in the text "text" the assignment to a physical key 30a _3, assigning a "link" is a classification corresponding to the link each part to a physical key 30a _4.

  At the time of performing the assignment shown in FIGS. 6 to 12, the electronic device 1 records data related to the assignment in the key data 9B as management information so that the correspondence between the physical key and the element assigned to the physical key can be understood. (See FIG. 2).

  In the examples shown in FIGS. 6 to 12 described above, the electronic device 1 executes the scan of the web screen C1 in response to the detection of the operation of the physical keys of the first physical key group G1, and performs the scan of the elements included in the web screen C1. Classification, selection, and assignment of the selected elements to physical keys are performed, but are not limited to this example. For example, the electronic device 1 includes the web screen C1 in the web screen C1 for each of the areas A1, A2, and A3 at the timing set in the three areas on the touch screen display 2, the areas A1, A2, and A3. Classification of the element to be performed and assignment of the classified element to the physical key may be automatically performed.

  Subsequently, an example of the operation of the electronic device according to the embodiment will be described with reference to FIGS. 13 to 16 are diagrams illustrating an example of the operation of the electronic device according to the embodiment. 13 to 16 shown below are executed by the electronic device 1 according to the operation on the physical key when the user operates the physical key after the assignment of the element including the content to the physical key is completed. The operation is shown. That is, the electronic device 1 executes a process of outputting, for example, information on an element assigned to the physical key as a voice in response to a user operation on the physical key.

  In the example illustrated in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (Step S11).

The electronic device 1 detects an operation on the physical keys 30a ₂ of the first physical key group G1, and outputs the audio M1 read aloud classification of elements assigned to the physical key 30a ₂ (the "image") (Step S12 ).

After an operation has been accepted for physical keys 30a _2, the electronic device 1 detects an operation on the physical keys 30b ₂ of the second physical key group G2, voice read the ID of the image assigned to the physical key 30b ₂ M2 Is output (step S13).

  In the example illustrated in FIG. 14, similarly to the example illustrated in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (Step S21).

The electronic device 1 detects an operation on the physical keys 30a ₃ of the first physical key group G1, and outputs the audio M3 read aloud classification of elements assigned to the physical key 30a ₃ a ( "Text") (step S22 ).

After an operation has been accepted for physical keys 30a _3, the electronic device 1 detects an operation on the physical keys 30b ₂ of the second physical key group G2, the contents described in the text assigned to the physical key 30b ₂ The voice M4 to be read is output (step S23).

  In the example illustrated in FIG. 15, similarly to the example illustrated in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (Step S31).

The electronic device 1 detects an operation on the physical keys 30a ₄ of the first physical key group G1, and outputs the audio M5 read aloud classification of elements assigned to the physical key 30a ₄ (the "link") (step S32 ).

After an operation has been accepted for physical keys 30a _4, the electronic device 1 detects the operation of the second physical key group G2 with respect to the physical key 30b _2, the link to the described contents assigned to the physical key 30b ₂ The voice M6 to be read is output (step S33). Following manipulations of physical keys 30b _2, the electronic device 1, the physical detects an operation on the key 30b _3, and outputs the audio M7 to read the contents linked described in assigned to a physical key 30b ₃ (step S34 ).

  In the example illustrated in FIG. 16, similarly to the example illustrated in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (Step S41).

The electronic device 1 detects an operation on the physical keys 30a ₅ of the first physical key group G1, the selection of the division of different elements assigned from the physical keys 30a ₂ in the second round and subsequent physical key 30a ₄ A voice M8 indicating the transition is output (step S42).

Following the operation for the physical key 30a _5, upon receipt of the second round of the operation of the physical key 30a _2, the electronic device 1, the second round of the physical key 30a ₂ to Allocated element classification ( "address") Is output (step S43).

After accepting the manipulations of physical keys 30a ₂ of the second round, when it detects an operation on the physical keys 30b ₂ of the second physical key group G2, the electronic device 1, the address bar assigned to the physical key 30b ₂ A voice M10 for reading the described content is output (step S44).

  The process flow of the electronic device 1 according to the embodiment will be described with reference to FIGS. FIG. 17 and FIG. 18 are flowcharts illustrating an example of the flow of processing of the electronic device according to the embodiment. The processing illustrated in FIGS. 17 and 18 is realized by the controller 10 executing the control program 9A.

  With reference to FIG. 17, a process (see FIGS. 6 to 12 and the like) relating to assignment of content elements to physical keys will be described. As shown in FIG. 17, the controller 10 determines whether the content has been displayed on the touch screen display 2 (Step S101).

  When the controller 10 displays the content as a result of the determination (step S101, Yes), the controller 10 sets the displayed content in a predetermined area on the touch screen display 2 (step S102).

  The controller 10 assigns each area to a physical key of the first physical key group G1 (Step S103).

  The controller 10 determines whether an operation on the physical keys of the first physical key group G1 has been detected (Step S104).

  When the controller 10 detects an operation on the physical keys of the first physical key group G1 as a result of the determination (step S104, Yes), the controller 10 scans an area corresponding to the detected physical key (step S105). ).

  The controller 10 classifies the elements detected by the scan based on the element classification rule 9C (step S106).

  The controller 10 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects an element corresponding to the priority corresponding to the user attribute data from the elements classified in step S106 (step S107).

  The controller 10 assigns the elements selected in Step S107 to the physical keys of the second physical key group G2 (Step S108).

  The controller 10 assigns the element categories selected in step S107 to the physical keys of the first physical key group G1 (step S109).

  The controller 10 determines whether the processing for the content being displayed has been completed (Step S110).

  As a result of the determination, when the processing for the content being displayed is completed (step S110, Yes), the controller 10 ends the processing illustrated in FIG.

  On the other hand, if the result of the determination is that the processing for the content being displayed has not been completed (step S110, No), the controller 10 returns to the determination in step S104.

  In step S104, if the result of the determination is that the operation on the physical keys of the first physical key group G1 has not been detected (step S104, No), the controller 10 repeats the determination.

  In step S101, if the result of determination is that content is not being displayed (step S101, No), the controller 10 ends the process shown in FIG.

  As described above, the electronic device 1 according to the embodiment changes the assignment of the element classified from the content to the physical key according to the user attribute, thereby changing the web screen and the application displayed on the touch screen display 2. Operability of various contents such as screens can be improved.

  With reference to FIG. 18, a process (see FIGS. 13 to 16 and the like) executed in response to detection of an operation on a physical key after completion of assignment of an element included in the content to the physical key will be described. As shown in FIG. 18, the controller 10 determines whether the content is being displayed (Step S201).

  As a result of the determination, when the content is being displayed (step S201, Yes), the controller 10 determines whether an operation on a physical key is detected (step S202).

  When the controller 10 detects an operation on a physical key as a result of the determination (step S202, Yes), the controller 10 determines whether the operation is an operation on a physical key of the first physical key group G1 (step S203).

  If the result of the determination is that the operation is an operation on the physical keys of the first physical key group G1 (step S203, Yes), the controller 10 executes processing corresponding to the physical keys of the first physical key group G1 (step S203). S204), returning to the determination in step S201.

  On the other hand, if the result of the determination is that the operation is not an operation on a physical key of the first physical key group G1 (step S203, No), the controller 10 determines whether the operation is an operation on a physical key of the second physical key group G2. A determination is made (step S205).

  If the result of determination is that the operation is for a physical key of the second physical key group G2 (step S205, Yes), the controller 10 executes processing corresponding to the physical key of the second physical key group G2 (step S205). S206), and returns to the determination in step S201.

  On the other hand, if the result of determination is that the operation is not an operation on a physical key of the second physical key group G2 (step S205, No), the controller 10 returns to the determination of step S201.

  In step S202, when the result of the determination is that the operation on the physical key has not been detected (No in step S202), the controller 10 returns to the determination in step S201.

  In step S201, when the result of the determination is that the content is not being displayed (step S201, No), the controller 10 ends the process shown in FIG.

(Other embodiments)
In the above embodiment, after the electronic device 1 sets the content displayed on the touch screen display 2 in a predetermined area on the touch screen display 2, the electronic device 1 classifies the content elements, and classifies the classified elements according to the user attributes. The example in which the selected element is assigned to the physical key of the selected element has been described, but the present invention is not limited to this example. For example, the electronic device 1 may execute the assignment of the element classified from the content to the physical key without setting the content in the predetermined area on the touch screen display 2.

  For example, the control program 9A classifies and classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C without setting the predetermined area on the touch screen display 2. A function is provided for implementing a process of selecting elements based on user attributes and assigning the selected elements to one or more physical keys. Then, the controller 10 classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C by the function provided by the control program 9A, and classifies the classified elements based on the user attributes. And a process of assigning the selected elements to one or more physical keys.

  FIG. 19 is a diagram illustrating an example of the entire image of the web screen according to the embodiment. For example, as shown in FIG. 19, the electronic device 1 scans the entire content (for example, the web screen C1) displayed on the touch screen display 2 and becomes an assignment target from the web screen C1 to a physical key. Elements (for example, elements e- (1) to e- (33)) may be classified, the classified elements may be selected based on user attributes, and the selected elements may be assigned to physical keys. Hereinafter, a flow of processing when the content is not set in a predetermined area on the touch screen display 2 will be described with reference to FIG.

  FIG. 20 is a flowchart illustrating another example of the processing flow of the electronic device 1 according to the embodiment.

  As illustrated in FIG. 20, the controller 10 determines whether the content is displayed on the touch screen display 2 (Step S301).

  When the controller 10 displays the content as a result of the determination (step S301, Yes), the controller 10 scans the content (step S302).

  The controller 10 classifies the elements detected by the scan based on the element classification rule 9C (step S303).

  The controller 10 refers to the user attribute data and the user attribute correspondence priority table 9D and selects an element corresponding to the priority corresponding to the user attribute data from the elements classified in step S303 (step S304).

  The controller 10 assigns the elements selected in Step S304 to the physical keys of the second physical key group G2 (Step S305).

  The controller 10 assigns the element categories selected in step S304 to the physical keys of the first physical key group G1 (step S306), and ends the processing shown in FIG.

  In step S301, when the controller 10 determines that the content is not displayed (No in step S301), the controller 10 ends the process illustrated in FIG.

  In the processing illustrated in FIG. 20, when the content is displayed on the touch screen display 2, the electronic device 1 classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C, and performs classification. The selected element is selected based on the user attribute, and the selected element is assigned to one or more physical keys. For this reason, the processing shown in FIG. 20 does not need to set the content in a predetermined area on the touch screen display 2 as in the processing shown in FIG. No need to detect the operation of, and all the assignment of the elements included in the content to the physical keys can be completed at the timing when the content is displayed on the touch screen display 2, and as compared with the processing shown in FIG. The convenience for the user can be further improved.

  In the above embodiment, the example has been described in which the electronic device 1 classifies and selects the elements included in the content displayed on the touch screen display 2 included in the electronic device 1 and assigns the elements to the physical keys. Not done. The electronic device 1 is also similar to the above embodiment for contents displayed on an external display device communicably connected in a state where data can be exchanged via the communication unit 6 or the connector 14, for example. In addition, elements included in the content can be classified and sorted, and assigned to a physical key.

  In addition, as described above, the electronic device 1 scans the web screen C1 displayed on the touch screen display 2 to classify the elements included in the web screen C1, select the classified elements, and select the classified elements. The assignment to the physical key is performed, but is not limited to this example. For example, when displaying the web screen C1 on the touch screen display 2, the electronic device 1 analyzes elements included in the web screen C1 by executing analysis of a source code of a web page that is a source of the web screen C1. Classification may be automatically performed based on the classification rule 9C, and then the classified element may be selected and the selected element may be assigned to a physical key. In other words, even if the content is not displayed on the touch screen display 2, the electronic device 1 can extract the elements included in the content if there is a method for extracting the elements of the content, such as a source code analysis of a web page. They can be sorted and sorted and assigned to physical keys.

  The outline of the assignment to the physical key corresponding to the screen of the application according to the embodiment will be described with reference to FIGS.

The outline of the assignment of the elements included in the spreadsheet screen to the physical keys will be described with reference to FIGS. FIG. 21 to FIG. 24 are diagrams illustrating an outline of assignment of elements included in the spreadsheet screen to the physical keys according to the embodiment. In the case of assigning the elements included in the spreadsheet displayed on the touch screen display 2 to the physical keys, the assignment of the elements included in the web screen C1 illustrated in FIGS. The same is true. That is, as shown in FIG. 21, the electronic device 1 sets the spreadsheet C3 in the areas A4, A5, and A6 on the touch screen display 2. The electronic device 1 allocates an area A4 in the physical key 30a ₂ of the first physical key group G1, allocate space A5 in physical key 30a ₃ of the first physical key group G1, a region A6 first physical keys assigned to the physical key 30a ₄ of G1.

The electronic device 1, for example, when receiving an operation of the physical keys 30a ₂ the area A4 is allocated corresponding to the menu of the spreadsheet screen C3, as shown in FIG. 22, elements of the spreadsheet screen C3 included in the region A4 Are classified based on the element classification rule 9C. That is, the electronic device 1 executes the classification regarding each part of the menu included in the spreadsheet screen C3. In the example shown in FIG. 22, the elements e101 to e122 are classified as the elements of the spreadsheet C3 included in the area A4. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects an element corresponding to the priority corresponding to the user attribute data from the classified elements e101 to e122. For example, when the element e101~e122 are sorted, the electronic device 1, the elements e101, assigned to the physical key 30b ₉ included in the second physical key group G2, the element e102, the second physical key group G2 as to assign the physical key 30b ₈ contained, assigned to a physical key included with each element were selected second physical key group G2.

The electronic device 1, for example, when receiving an operation of the physical key 30a ₃ the area A5 is allocated corresponding to the worksheet in spreadsheet screen C3, as shown in Figure 23, the spreadsheet screen C3 included in the area A5 Elements are classified based on the element classification rule 9C. That is, the electronic device 1 executes the classification regarding the worksheet included in the spreadsheet screen C3. In the example illustrated in FIG. 23, as a part of the elements of the spreadsheet screen C3 included in the area A5, for example, elements e (n−b) − (1) to e (n−b) − (10) Are classified. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and for example, the elements e (nb)-(1) to e (nb)-(10) From the elements corresponding to the priority corresponding to the user attribute data. For example, when the elements e (n−b) − (1) to e (n−b) − (10) are selected, the electronic device 1 converts the element e (n−b) − (1). , assigned to the physical key 30b ₉ included in the second physical key group G2, the element e (n-b) - ( 2) , and as to assign the physical key 30b ₈ included in the second physical key group G2 Are assigned to the physical keys included in the second physical key group G2.

The electronic device 1, for example, when receiving an operation of the physical key 30a ₄ the areas A6 corresponding to the graph of the spreadsheet screen C3 is allocated, as shown in FIG. 24, elements of the spreadsheet screen C3 included in the region A6 Are classified based on the element classification rule 9C. That is, the electronic device 1 executes the classification related to the chart included in the spreadsheet screen C3. In the example illustrated in FIG. 24, the elements en- (1) and en- (2) are classified as the elements of the spreadsheet C3 included in the area A6. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the priority corresponding to the user attribute data from the classified elements en- (1) and element en- (2). The element corresponding to is selected. For example, if the element en- (1) and elements en- (2) is selected, the electronic device 1, the element en- (1), assigned to the physical key 30b ₉ included in the second physical key group G2 the element en- (2), assigned to the physical key 30b ₈ included in the second physical key group G2.

FIG. 25 is a diagram illustrating another example of the key data 9B according to the embodiment. FIG. 26 is a diagram illustrating a correspondence relationship between a physical key and an allocation element according to the embodiment. At the time of performing the assignment shown in FIGS. 21 to 24, the electronic device 1 converts the data relating to the assignment into key data so that the correspondence between the physical key and the element assigned to the physical key can be understood as shown in FIG. Record on 9B. In the example shown in FIG. 25, at the (n−a) -th cycle of the allocation division / element (a is a natural number), the line () is assigned to the physical keys 30a ₂ , 30a ₃ and 30a ₄ of the first physical key group G1. 1), line (2) and line (3) are assigned. Further, in the example shown in FIG. 25, the n-a cruiser eye assignment segment / component (a is a natural number), the physical key 30b ₉ ~ physical key 30b ₃ of the second physical key group G2, column (A) ~ Column (G) is assigned. For example, the line (1) indicates the first row among the rows arranged on the worksheet as shown in FIG. 26, and the column (A) is arranged on the worksheet as shown in FIG. The A-th column in each column is shown. In this manner, on the spreadsheet screen C3, in consideration of the operability of the worksheet, each row on the worksheet is assigned to the physical keys of the first physical key group G1, and the physical keys of the second physical key group G2 are assigned. Each column on the worksheet may be assigned.

  FIG. 27 is a view illustrating another example of the operation of the electronic device according to the embodiment. FIG. 27 is a diagram illustrating an example in which the user operates the physical key after the assignment of the elements included in the spreadsheet screen C3, which has been described with reference to FIGS. 3 shows an operation performed by the electronic device 1 in response to the command.

As shown in FIG. 27, the electronic device 1, among the physical key of the first physical key group G1, the manipulations of physical keys 30a ₅ the function of "one Forward" is assigned is detected, the The element assigned to the physical key of one physical key group G1 is shifted from the first round element to the second round element (step S51).

The electronic device 1, among the physical key of the first physical key group G1, the manipulations of physical keys 30a ₂ the element of "text" is assigned is detected, the cell text contained in the worksheet first The state transits to a state where it can be operated by the physical keys of the second physical key group G2 (step S52).

The electronic device 1 detects the operation of the second physical key group G2 of physical keys 30b _9, physical key 30b ₉ assigned to the cell in the text is to have elements described contents ( "time (t)" ) Is output (step S53).

The electronic device 1 detects the operation of the second physical key group G2 of physical keys 30b _8, read the physical key 30b ₈ assigned written in cell text is to have component content ( "2πt") The sound M12 is output (step S54).

FIG. 28 is a diagram illustrating an outline of assignment of elements included in the document editing screen according to the embodiment to physical keys. Regarding the assignment of elements included in the document editing screen displayed on the touch screen display 2 to physical keys, the web screen C1 (FIGS. 6 to 12 and the like) and the spreadsheet screen C3 (FIGS. 21 to 24 and the like) ) Is basically the same. That is, as shown in FIG. 28, the electronic device 1 sets the document editing screen C4 displayed on the touch screen display 2 to the areas A7, A8, and A9 on the touch screen display 2. The electronic device 1 allocates an area A7 in the physical key 30a ₂ of the first physical key group G1, allocate space A8 to physical key 30a ₃ of the first physical key group G1, a region A9 first physical keys assigned to physical key 30a ₄ of G1. Although detailed description is omitted, the electronic device 1 classifies the elements of the document editing screen C4 included in each of the areas A7, A8, and A9 based on the element classification rule 9C, and classifies the classified elements with user attribute data. And the selected element is assigned to a physical key of the second physical key group G2.

  In this specification, the characteristic embodiments have been described in order to completely and clearly disclose the technology according to the appended claims. However, the appended claims should not be limited to the embodiments described above, but should include all modifications and alternatives that may occur to those skilled in the art within the scope of the basics presented herein. It should be embodied in a possible configuration.

Reference Signs List 1 electronic device 2 touch screen display 2A display 2B touch screen 3 button 4 illuminance sensor 5 proximity sensor 6 communication unit 7 receiver 8 microphone 9 storage 9A control program 9B key data 9C element classification rule 9D user attribute correspondence priority table 9Z setting data 10 Controller 11 Speaker 12 Camera 13 Camera 14 Connector 15 Motion sensor

Claims (6)

A housing,
One or more physical keys arranged along an edge of the housing;
Storage for storing rules for classifying elements included in the content,
A controller configured to classify elements included in the content based on the rules and to assign the classified elements to one or more physical keys. A housing,
A first physical key group including one or more physical keys arranged in a first row along an edge of the housing;
A second physical key group including one or more physical keys arranged in a second row along the edge of the housing;
Storage for storing rules for classifying elements included in the content,
A controller for classifying elements included in the content based on the rule,
The controller is
Setting the content in a predetermined area on a display, assigning the area to one of the physical keys of the first physical key group,
When detecting an operation of a physical key of the first physical key group, classifying elements of the content included in the area corresponding to the detected physical key based on the rule,
An electronic device, wherein the classified element is assigned to one of the physical keys of the second physical key group. A housing,
One or more physical keys arranged along an edge of the housing;
Storage for storing rules for classifying elements included in the content,
In a control method of an electronic device comprising:
A control method, wherein elements included in the content are classified based on the rules, and the classified elements are assigned to one or a plurality of physical keys. A housing,
A first physical key group including one or more physical keys arranged in a first row along an edge of the housing;
A second physical key group including one or more physical keys arranged in a second row along the edge of the housing;
A storage for storing rules for classifying elements included in the content.
Setting the content in a predetermined area on a display, assigning the area to one of the physical keys of the first physical key group,
When detecting an operation of a physical key of the first physical key group, classifying elements of the content included in the area corresponding to the detected physical key based on the rule,
A control method, wherein the classified elements are assigned to any of the physical keys of the second physical key group. A housing,
One or more physical keys arranged along an edge of the housing;
Storage for storing rules for classifying elements included in the content,
Electronic devices with
A step of classifying elements included in the content based on the rules and assigning the classified elements to one or more physical keys. A housing,
A first physical key group including one or more physical keys arranged in a first row along an edge of the housing;
A second physical key group including one or more physical keys arranged in a second row along the edge of the housing;
Storage for storing rules for classifying elements included in the content,
Setting the content in a predetermined area on a display and assigning the area to one of the physical keys of the first physical key group;
When detecting an operation of a physical key of the first physical key group, the elements of the content included in the area corresponding to the detected physical key are classified based on the rule, and the classified element is Assigning to one of the physical keys of the second physical key group.