JP5744252B2 - Electronic device, electronic device control method, electronic device control program - Google Patents

Description

  Embodiments described herein relate generally to an electronic device, an electronic device control method, and an electronic device control program.

  In recent years, electronic devices such as tablet PCs and smartphones that can search for keywords or the like designated by users have become widespread.

  In these electronic devices, for example, if a keyword or the like is clearly specified by a cursor display or the like, a good search result can be obtained.

  In recent years, for example, electronic devices that allow a user to specify a keyword or the like by tracing a video display screen using a pen or a finger have become widespread.

  However, when using a pen or a finger, for example, it may be difficult to clearly specify a keyword or the like. Therefore, there is a problem that it is difficult to obtain a good search result.

  For this reason, it has been a problem that a user can obtain better search results in an electronic device that specifies a keyword or the like by tracing a video display screen.

JP 2006-65754 A

  It has been an issue for a user to obtain better search results in an electronic device that specifies a keyword or the like by tracing a video display screen.

  The electronic device according to the embodiment includes a first text corresponding to the first area when at least a part of the first area is designated by an operation on the screen by a user among texts displayed on the screen. The first attribute of the second text, or the second attribute of the second text corresponding to the second area including the first area and a part of the surrounding area, or an area smaller than the first area, The third attribute of the third text corresponding to the third area included in the area, or the fourth attribute of the fourth text corresponding to the fourth area including a part of the first area and a part of the surrounding area. A display control unit capable of displaying a menu for executing at least two or more processes on the screen according to at least two of the above.

  In addition, when one of a plurality of processes is selected via the menu, the first text, the second text, the third text, or the selected text is selected according to the type of the selected process. A processing unit that executes the selected process using any one of the fourth texts is provided.

Further, a first process corresponds to one attribute of at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute, and the other attribute is different from the first process. 2 processes correspond,
When the first process is selected, the processing unit uses text corresponding to at least one of the first attribute, the second attribute, the third attribute, or the fourth attribute. Performing the first process;
When the second process is selected, the processing unit uses text corresponding to the other attribute of at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute. The second process is executed.

1 is a diagram showing an external appearance of an electronic device (tablet PC) according to an embodiment. The block diagram which shows an example of a structure of the electronic device (tablet PC) concerning embodiment. The figure which shows the operation | movement state of the electronic device (tablet PC) concerning embodiment. The block diagram which shows the system of the electronic device (tablet PC) concerning embodiment. 6 is a flowchart for explaining the operation of the electronic apparatus (tablet PC) according to the embodiment.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating an appearance of an electronic device (tablet PC) according to the embodiment.

  In this embodiment, the electronic device (tablet PC) 10 detects, for example, a keyword traced by a user with a pen or finger input 11 from text output to the video display unit 17, and complements the keyword and the surroundings of the keyword. A user action menu based on the attribute information of the candidate area is output.

  Further, when one of the output user action menus is designated, the supplement candidate area information is complemented based on the designation.

  In addition, the supplemented action is executed.

  Here, a description will be given using a tablet PC as an example of the electronic device 10, but the present invention is not limited to this, and this embodiment is an electronic device such as a notebook personal computer (PC), a smartphone, or a mobile phone. The present invention can also be applied to devices, portable or stationary televisions, and the like.

  FIG. 2 is a block diagram illustrating an example of the configuration of the electronic device (tablet PC) according to the embodiment.

  The electronic device (tablet) 10 includes a central processing unit (CPU) 101, a north bridge 102, a main memory 103, a south bridge 104, a graphics processing unit (GPU) 105, a random access memory (VRAM) 105A, a sound controller. 106, BIOS-ROM (basic input / output system-read only memory) 107, LAN (local area network) controller 108, hard disk drive (HDD (storage device)) 109, optical disk drive (ODD) 110, USB controller 111A, card A controller 111B, a wireless LAN controller 112, an embedded controller / keyboard controller (EC / KBC) 113, an EEPROM (electrically erasable programmable ROM) 114, and the like are provided.

  The CPU 101 is a processor that controls the operation of each unit in the electronic device (tablet) 10.

  The CPU 101 executes the BIOS stored in the BIOS-ROM 107. The BIOS is a program for hardware control.

  The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the GPU 105 via, for example, a PCI EXPRESS serial bus.

  The GPU 105 is a display controller that controls a video display unit (LCD) 17 used as a display monitor of the electronic device (tablet) 10.

  A display signal generated by the GPU 105 is sent to a video display unit (LCD) 17. The GPU 105 can also send a digital video signal to the external display 1 via the HDMI (registered trademark) control circuit 3 and the HDMI terminal 2.

  The HDMI terminal 2 is the aforementioned external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display 1 such as a television with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to an external display 1 called an HDMI monitor via the HDMI terminal 2.

  The south bridge 104 controls each device on a peripheral component interconnect (PCI) bus and each device on a low pin count (LPC) bus. Further, the south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the HDD 109 and the ODD 110.

  Further, the south bridge 104 has a function of executing communication with the sound controller 106.

The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B or the HDMI control circuit 3. The LAN controller 108 is, for example, a wired communication device that executes IEEE 802.3 standard wired communication, while the wireless LAN controller 112 is, for example, a wireless communication device that executes IEEE 802.11g standard wireless communication. The USB controller 111A executes communication with an external device (connected via the USB connector 19) that complies with, for example, the USB 2.0 standard.

  For example, the USB controller 111A is used for receiving an image data file stored in a digital camera, for example. The card controller 111B executes writing and reading of data with respect to a memory card such as an SD card inserted into a card slot provided in the computer (notebook PC) main body 11.

  The EC / KBC 113 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard 13 and the touch sensor 16 are integrated. The EC / KBC 113 has a function of turning on / off the electronic device (tablet) 10 in accordance with the operation of the power button 14 by the user.

  The display control in this embodiment is performed, for example, by causing the CPU 101 to execute a program recorded in the main memory 103, the HDD 109, or the like.

  Note that the above description is an example, and the electronic apparatus according to this embodiment can be configured by hardware different from the above configuration.

  FIG. 3 is a diagram illustrating an operation of the electronic apparatus (tablet PC) according to the embodiment.

  As described above, in this embodiment, the electronic device (tablet PC) 10 detects, for example, a keyword traced by the user with the pen or the finger input 11 from the text output to the video display unit 17.

  Here, “scheduled opening of the XX Memorial Hall in 1/23 in Kochi Prefecture” is displayed and output as text.

  Then, from this text “The XX Memorial Hall is scheduled to open in 1/23 in Kochi Prefecture”, a “race operation” is performed on the video display unit 17 by a pen or finger input 11, for example, as shown in FIG. As shown, “Mr. XX Memorial” is designated.

  Here, since the user performs the “race operation” with the pen or finger input 11, it is difficult to clearly specify the keyword.

  In other words, at this time, the user may want to designate “Mr. XX Memorial” or may wish to designate “Mr. XXX”.

  Therefore, in this embodiment, even if the range designated by the user (in this case, “Memorial Mr. XX”) is unclear, the range intended by the user is determined based on the action contents using the words in that region. Estimate and complement.

  Further, even if the range designated by the user is unclear, the action menu is presented using words included in the surrounding area.

  That is, in this embodiment, a user action menu based on the attributes of the keyword and the information of the complementary candidate area around the keyword is output.

  As shown in FIG. 3, the user action menu is displayed on, for example, the user action menu display unit 32.

  Here, in the user action menu display unit 32, as an operation menu, for example, “first search site” 32a, “second search site” 32b, “schedule addition” 32c, “check how to go” 32d, “check person” "32e" is displayed.

  Further, when one of the output user action menus 32 is designated by the user, the supplementary candidate area (selection range 31) information is complemented based on this designation.

  In addition, the supplemented action is executed.

  FIG. 4 is a block diagram illustrating a system of the electronic device (tablet PC) according to the embodiment.

  In this embodiment, the electronic device (tablet PC) 1 includes a text display unit 101 for displaying text and a pen by a user as described in “Scheduled to open XX Memorial Hall in 1/23 in Kochi Prefecture”. Alternatively, the pen input recognition unit 102 that recognizes the information input by the finger input 11, the selection range 31 that is input by the pen, and the surroundings of the selection range 31, for example, “XX3 Memorial Hall is on 1/23” are extracted. The selection range extraction unit 103 and the attribute determination unit 104 that determines the attribute of “1/23 Memorial Hall is OH” extracted by the selection range extraction unit 103 are included.

  The electronic device (tablet PC) 1 is supplemented by an action presentation unit 105 that displays (or presents) the user action menu display unit 32 and a selection range complementation unit 106 that complements the selection range 31 shown in FIG. An action execution unit 107 that executes an action is provided.

  The electronic device (tablet PC) 1 stores in advance an attribute determination rule storage unit 108 in which attribute determination rules used in the attribute determination unit 104 are stored in advance, and an action selection rule used in the action presentation unit 105. An action selection rule storage unit 109 is provided.

  FIG. 5 is a flowchart for explaining the operation of the electronic apparatus (tablet PC) according to the embodiment.

  Step S100 is a start step here. Then, it progresses to step S101.

  Step S101 is a step of displaying text on the video display unit 17, for example, in response to a user operation (not shown). Here, as shown in FIG. 3, “Scheduled to open XX Memorial Hall in 1/23 in Kochi Prefecture” is displayed.

  At this time, the text displayed on the video display unit 17 may be a Web page or a handwritten memo. For example, in the case of a handwritten memo, handwritten character recognition may be performed for subsequent processing and converted so that language processing can be performed. Then, it progresses to step S102.

  Step S <b> 102 is a step of determining whether the electronic device (tablet PC) 1 has displayed text on the video display unit 17. If it is determined that the text is displayed, the process proceeds to step S103 (Yes). If it is not determined that the text is displayed, the processing here is repeated (No).

  Step S <b> 103 is a step in which the user traces the keywords displayed on the video display unit 17. Here, for example, “Mr. XX Memorial” shown in FIG. 3 is traced.

  That is, for example, the user uses the pen input unit 102 to trace a place where the user wants to take action.

  Here, “tracing” of this embodiment will be described.

  Here, “tracing” circles an area of a character (keyword) to be limited. Enclose the area of the character (keyword) you want to limit in a square. Draw a line under the character (keyword) you want to limit. Draw a wavy line under the character (keyword) you want to limit. The selection range 31 is designated using a method such as the above.

  At this time, in the case of a device that performs handwriting input with a pen such as the electronic device (tablet PC) 1, it is generally difficult to clearly specify the start point and end point of the range. For this reason, the user designates an approximate range. Here, for example, it is assumed that a circle around “Mr. XX” is circled. Then, it progresses to step S104.

  Step S104 is a step of detecting whether or not the keyword has been “traysed” by the user. If it is detected that the keyword “tracing” has been performed, the process proceeds to step S105 (Yes). If it is not detected that the keyword “tracing” has been performed, the processing here is repeated (No).

  Step S105 is a step of extracting information about surrounding candidate regions including the keyword ("Memorial Mr. XX") traced by the user. In this case, for example, “Mr. XX memorial is on 1/23” is extracted. For example, a certain region before and after the range (selection range 31) specified by the selection range extraction unit 103 is extracted and set as a candidate region. Then, it progresses to step S106.

  Step S106 is a step of determining the attribute of the information of the supplement candidate area.

  For example, the attribute determination unit 104 uses the attribute determination rule 108 to check the attribute of the word included in the candidate area.

  An example of the attribute determination rule 108 is shown in the table of FIG.

  The attribute can be given using this table, for example.

  For example, the attribute determination rule 108 describes rules such as “date: (number) / (number)”, “person name: (person name)”, and “location: (person name) [memorial / museum]”. .

  Then, for example, (number), (person name), and the like are given by the morphological analysis in the candidate area, and the attribute is given by the attribute determination rule 108.

  As shown in FIG. 4B, for example, “Mr. XX Memorial Hall” is given a location attribute by the attribute rule ID03. Then, it progresses to step S107.

  Step S107 is a step of determining whether the attribute has been determined. If it is determined that the attribute has been determined, the process proceeds to step S108 (Yes). If it is determined that the attribute cannot be determined, the process proceeds to step S113 (No).

  Step S108 is a step of displaying a user action menu (such as the user action display unit 32) based on the determined attribute. Then, it progresses to step S109.

  Here, the action presentation unit 105 uses the action selection rule 109 to display a menu that matches each attribute with reference to, for example, a menu dictionary.

  At this time, in the action selection rule, for example, the rule is described as follows.

  That is, for example, the date is added to the schedule.

  Person name → Check with the first search engine (search site). Check with a second search engine (search site). Find someone. Location → Display the map. Check with the first search engine (search site). Check with a second search engine (search site). Find directions, etc.

  For example, according to this rule, an action is presented 203 to the user.

  Step S109 is a step in which the user selects and designates one of the action menus (32a, 32b, 32c, 32d, 32e), for example. Then, it progresses to step S110.

  Step S110 is a step of determining whether one of the action menus (32a, 32b, 32c, 32d, 32e) has been selected and designated. If it is determined that one of the action menus has been selected and designated, the process proceeds to step S111 (Yes). When it is determined that one of the action menus is not selected and designated, the processing here is repeated (No).

  Step S111 is a step of complementing the information (“selection range” 31) of the supplement candidate area based on the selection designation.

  Here, the selection range complementing unit 106 determines the attribute by the menu specified by the selection, and complements the selection range by determining any of the words as the range-specified word by the user.

  For example, when the user selects “Check the way to go” 32d, it is determined as the “location” attribute, and “Mr. XX Memorial” is determined as the range designation word of the user.

  When the “first search site” 32a is selected, both “person name / location” are selected. For this reason, the action presentation unit 105 displays a deeper action menu, and “searches Mr. XX at the first search site” and “searches Mr. XX at the first search site” corresponding to “person name”. Present. Then, it progresses to step S112.

  Step S112 is a step of executing the supplemented action.

  Here, using the determined word, the word is input to the selected action.

  For example, when the user selects the “Check the way to go” 32d, the user understands that “I want to check the way to the XX Memorial Hall”, and the action execution unit 107 sets the destination as “ Search for “Mr.

  For example, in order to find out how to go, a word determined as a destination may be input to a web transfer guidance service and searched, and the result may be presented to the user.

  Further, when examining a person, the determined word may be input to a search site of a Web service and searched, and the result may be presented to the user.

  Then, it progresses to step S113.

  Step S113 is an end step, and the process here ends.

  As another embodiment, instead of the action presenting unit 105 presenting an action menu, for example, the user may input an action by voice. In this case, the system includes a voice recognition unit. For example, after the “race operation”, when the user inputs “how to go” by voice, the system is complemented with “Mr.

  That is, the electronic device according to this embodiment is, for example, a keyword (“Scheduled opening of Mr. XX's Memorial Hall in Kochi Prefecture in 1/23”) output from the video display unit 17 by a user ( For example, “Mr. XX memorial”) is detected, and the user action menu 32 based on the information attribute of the keyword and the complementary candidate area (selection range 31) around the keyword is output.

  Further, when one of the output user action menus 32 is designated, the supplement candidate area information is complemented based on this designation.

  In addition, the supplemented action is executed.

  In addition, the attribute of the information of the complement candidate area is determined based on a preset attribute determination rule 108.

  Moreover, the information of the complement candidate area includes text around the keyword traced by the user.

  Moreover, the said complement process is estimated using the word contained around the said keyword.

  The keyword can be traced with a pen or a finger.

  A plurality of the user actions (32a, 32b, 32c, 32d, 32e) are configured in the user action menu 32.

  By configuring as described above, in this embodiment, it becomes possible for the user to obtain a better search result in an electronic device that specifies a keyword or the like by tracing the video display screen.

  Note that all the control processing procedures of the above-described embodiment can be executed by software. For this reason, it is possible to easily realize the same effect as that of the above-described embodiment only by installing and executing this program on a normal computer through a computer-readable storage medium storing the program for executing the control processing procedure. it can.

  Note that the above embodiment is not limited to the description itself, and in the implementation stage, the constituent elements can be variously modified and embodied without departing from the spirit of the invention.

  Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment.

  For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 10 ... Electronic device (tablet), 11 ... Pen or finger input, 17 ... Image | video display part (LCD), 31 ... Selection range, 32 ... User action menu display part.

[Appendix]
[Additional Item 1]
Among the texts displayed on the screen, when at least a part of the first text is designated by the user's operation on the screen, the attribute of the first text or the first text is displayed. The second text attribute corresponding to the second area including one area and the surrounding area, or the third text corresponding to the third area that is smaller than the first area and included in the first area Or a menu for executing at least one process in accordance with at least one of the attributes of the fourth text corresponding to the fourth area including a part of the first area and the surrounding area. A display control unit that can be displayed on the screen;
When the first process of at least one process is selected via the menu, the first text or the second text or the third text selected according to the type of the first process A processing unit that executes the first process using any of the fourth texts,
At least one of the at least one process selectable by the menu is for obtaining information related to either the first text, the second text, the third text, or the fourth text. Video processing device that is search processing.
[Additional Item 2]
The display control unit, when the first text is designated, at least one or more according to at least one of the attribute of the second text, the attribute of the third text, or the attribute of the fourth text Item 2. The video processing apparatus according to Item 1, wherein a menu for executing the process is displayed on the screen.
[Additional Item 3]
When the first process is selected, the processing unit uses either the second text, the third text, or the fourth text selected according to the type of the first process, Item 2. The video processing apparatus according to Item 1, wherein the first processing is executed.
[Additional Item 4]
The video processing device according to any one of supplementary notes 1 to 3, wherein the first text can be specified by tracing the vicinity of the first region on the screen with a pen or a finger.
[Additional Item 5]
Among the texts displayed on the screen, when at least a part of the first text is designated by the user's operation on the screen, the attribute of the first text or the first text is displayed. The second text attribute corresponding to the second area including one area and the surrounding area, or the third text corresponding to the third area that is smaller than the first area and included in the first area Or a menu for executing at least one process in accordance with at least one of the attributes of the fourth text corresponding to the fourth area including a part of the first area and the surrounding area. And enabling the display on the screen;
When the first process of at least one process is selected via the menu, the first text or the second text or the third text selected according to the type of the first process Performing the first process using any of the fourth texts,
At least one of the at least one process selectable by the menu is for obtaining information related to either the first text, the second text, the third text, or the fourth text. A control method of a video processing apparatus which is a search process.
[Additional Item 6]
In the displaying step, when the first text is designated, at least one of the attribute of the second text, the attribute of the third text, or the attribute of the fourth text is determined. The control method of the video processing apparatus according to claim 5, wherein a menu for executing one or more processes is displayed on the screen.
[Additional Item 7]
In the step of executing the first process, when the first process is selected, either the second text, the third text, or the fourth text selected according to the type of the first process The control method of the video processing apparatus according to appendix 5, wherein the first process is executed using a computer.
[Appendix 8]
8. The video processing device control method according to claim 5, wherein the first text can be specified by tracing the vicinity of the first area on the screen with a pen or a finger.
[Additional Item 9]
Among the texts displayed on the screen, when at least a part of the first text is designated by the user's operation on the screen, the attribute of the first text or the first text is displayed. The second text attribute corresponding to the second area including one area and the surrounding area, or the third text corresponding to the third area that is smaller than the first area and included in the first area Or a menu for executing at least one process in accordance with at least one of the attributes of the fourth text corresponding to the fourth area including a part of the first area and the surrounding area. And enabling the display on the screen;
When the first process of at least one process is selected via the menu, the first text or the second text or the third text selected according to the type of the first process A control program for causing a video processing device to execute the step of executing the first process using any one of the fourth texts,
At least one of the at least one process selectable by the menu is for obtaining information related to either the first text, the second text, the third text, or the fourth text. A control program that is a search process.
[Additional Item 10]
In the displaying step, when the first text is designated, at least one of the attribute of the second text, the attribute of the third text, or the attribute of the fourth text is determined. 10. A control program for causing a video processing apparatus according to claim 9 to display a menu for executing one or more processes on the screen.
[Additional Item 11]
In the step of executing the first process, when the first process is selected, either the second text, the third text, or the fourth text selected according to the type of the first process The control program for making the video processing apparatus of Claim 9 which performs a said 1st process perform using this.
[Additional Item 12]
The control for causing the video processing apparatus according to any one of appendix 9 to appendix 11, wherein the first text can be specified by tracing the vicinity of the first area on the screen with a pen or a finger. program.

Claims (21)

The first attribute of the first text corresponding to the first area when at least a part of the first area is designated by the user's operation on the screen among the text displayed on the screen, or the The second attribute of the second text corresponding to the second area including the first area and a part of the surrounding area, or the third area that is smaller than the first area and included in the first area Or at least two of the fourth attribute of the fourth text corresponding to the fourth area including the part of the first area and the part of the surrounding area. A display control unit capable of displaying a menu for executing at least two or more processes on the screen;
When one of a plurality of processes is selected via the menu, the first text, the second text, the third text, or the fourth selected according to the type of the selected process A processing unit that executes the selected process using any of the texts;
The first process corresponds to one attribute of at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute, and the second process is different from the first process. Corresponds to
When the first process is selected, the processing unit uses text corresponding to at least one of the first attribute, the second attribute, the third attribute, or the fourth attribute. Performing the first process;
When the second process is selected, the processing unit uses text corresponding to the other attribute of at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute. An electronic device that executes the second process. The operation for designating the first area is a handwriting operation on the screen by a user,
The electronic device according to claim 1, wherein the first region is determined according to a locus input by handwriting. The operation for designating the first region is an operation performed by a user tracing the screen with a finger,
The electronic device according to claim 1, wherein the first region is determined according to a trajectory traced with a finger.   The at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute correspond to two of an attribute related to a person, an attribute related to a place, or an attribute related to a date and time. 4. The electronic device according to any one of items 3.   At least one of the plurality of processes that can be selected by the menu is a process for acquiring information related to either the first text, the second text, the third text, or the fourth text. The electronic device according to any one of claims 1 to 4.   At least one of the plurality of processes selectable by the menu is for obtaining a way to a place corresponding to any of the first text, the second text, the third text, or the fourth text. The electronic device according to any one of claims 1 to 4, wherein the electronic device is a process of:   At least one of the plurality of processes selectable by the menu is a process for registering a schedule corresponding to any of the first text, the second text, the third text, or the fourth text. The electronic device according to any one of claims 1 to 4. The first attribute of the first text corresponding to the first area when at least a part of the first area is designated by the user's operation on the screen among the text displayed on the screen, or the The second attribute of the second text corresponding to the second area including the first area and a part of the surrounding area, or the third area that is smaller than the first area and included in the first area Or at least two of the fourth attribute of the fourth text corresponding to the fourth area including the part of the first area and the part of the surrounding area. Allowing a menu for executing at least two or more processes to be displayed on the screen;
When one of a plurality of processes is selected via the menu, the first text, the second text, the third text, or the fourth selected according to the type of the selected process Executing the selected process using any of the text, and including at least one of the first attribute, the second attribute, the third attribute, or the fourth attribute The first process corresponds, the second attribute corresponds to the second process different from the first process,
When the first process is selected, the first process by using a pre-Symbol text corresponding to one attribute of the at least two first attribute or the second attribute, or the third attribute and the fourth attribute Run
If the second process is selected, the second process using the prior SL text corresponding to the other attributes of the at least two first attribute or the second attribute, or the third attribute and the fourth attribute Control method of electronic equipment to execute. The operation for designating the first area is a handwriting operation on the screen by a user,
The method for controlling an electronic device according to claim 8, wherein the first region is determined according to a locus input by handwriting. The operation for designating the first region is an operation performed by a user tracing the screen with a finger,
The method for controlling an electronic device according to claim 8 or 9, wherein the first region is determined according to a trajectory traced with a finger.   The at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute correspond to two of an attribute related to a person, an attribute related to a place, or an attribute related to a date and time. 11. A method for controlling an electronic device according to any one of 10 above.   At least one of the plurality of processes that can be selected by the menu is a process for acquiring information related to either the first text, the second text, the third text, or the fourth text. The method for controlling an electronic device according to any one of claims 8 to 11.   At least one of the plurality of processes selectable by the menu is for obtaining a way to a place corresponding to any of the first text, the second text, the third text, or the fourth text. The method for controlling an electronic device according to claim 8, wherein the control method is an electronic device.   At least one of the plurality of processes selectable by the menu is a process for registering a schedule corresponding to any of the first text, the second text, the third text, or the fourth text. The method for controlling an electronic device according to any one of claims 8 to 11. The first attribute of the first text corresponding to the first area when at least a part of the first area is designated by the user's operation on the screen among the text displayed on the screen, or the The second attribute of the second text corresponding to the second area including the first area and a part of the surrounding area, or the third area that is smaller than the first area and included in the first area Or at least two of the fourth attribute of the fourth text corresponding to the fourth area including the part of the first area and the part of the surrounding area. Allowing a menu for executing at least two or more processes to be displayed on the screen;
When one of a plurality of processes is selected via the menu, the first text, the second text, the third text, or the fourth selected according to the type of the selected process A control program for causing an electronic device to execute the selected process using any of the text, wherein the first attribute, the second attribute, the third attribute, or the fourth Of at least two of the attributes, the first process corresponds to one attribute, the second process different from the first process corresponds to the other attribute,
When the first process is selected, the first process by using a pre-Symbol text corresponding to one attribute of the at least two first attribute or the second attribute, or the third attribute and the fourth attribute Run
If the second process is selected, the second process using the prior SL text corresponding to the other attributes of the at least two first attribute or the second attribute, or the third attribute and the fourth attribute Control program to execute. The operation for designating the first area is a handwriting operation on the screen by a user,
The control program for making the electronic device of Claim 15 perform the said 1st area | region according to the locus | trajectory input by handwriting. The operation for designating the first region is an operation performed by a user tracing the screen with a finger,
The control program for making the electronic device of Claim 15 or 16 define the said 1st area | region according to the locus | trajectory traced with the finger | toe.   The at least two of the first attribute, the second attribute, the third attribute, or the fourth attribute correspond to two of an attribute related to a person, an attribute related to a place, or an attribute related to a date and time. A control program for causing an electronic device according to any one of 17 to be executed.   At least one of the plurality of processes that can be selected by the menu is a process for acquiring information related to either the first text, the second text, the third text, or the fourth text. A control program for causing an electronic device according to any one of claims 15 to 18 to be executed.   At least one of the plurality of processes selectable by the menu is for obtaining a way to a place corresponding to any of the first text, the second text, the third text, or the fourth text. The control program for making the electronic device of any one of Claims 15 thru | or 18 perform.   At least one of the plurality of processes selectable by the menu is a process for registering a schedule corresponding to any of the first text, the second text, the third text, or the fourth text. A control program for causing an electronic device according to any one of claims 15 to 18 to be executed.

Images