JP2011034151A - Communication device and portable electronic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide communication device and portable electronic device that can perform refining search with high usability. <P>SOLUTION: The communication device and the portable electronic device have a display unit, an input detection unit, a communication unit and a control unit. The control unit determines a logical operation result for a key object abstracting conditions of refining item objects included in a key box object, capable of containing the plurality of key objects; determines a conformity ratio of each item object in a group object having the plurality of item objects to the logical operation result; and extracts the item objects satisfying the range of the calculated conformity ratios from the item objects in the group object for displaying on a screen, when the input detection unit detects the directions of moving the key box object, in contact or noncontact state, while the group object, the key object and the key box object are displayed on a screen by the display unit. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a communication device and a portable electronic device that select an object based on an input to an area where an image is displayed by a display unit.

  In a communication device such as a cellular phone, there are various input devices other than an input device for pressing a keyboard, a numeric keypad, or a button as a device for inputting an operator's instruction. For example, Patent Document 1 describes a mobile terminal that detects, as an input, a tilt angle of a mobile terminal and a gesture such as “shake” or “tilt” from a signal obtained from an acceleration sensor. Further, the apparatus described in Patent Document 1 describes that an icon group representing information content is controlled from an inclination angle of a portable terminal, and an icon that moves from moment to moment is displayed on a display.

JP 2002-149616 A

  Further, as an input device, there is a touch panel or the like in which an operator contacts (touches) an area where an image is displayed and detects the contact as an input. Since the operator can perform an operation while directly touching the screen, an intuitive operation is possible and high operability can be realized.

  Here, the communication device may perform a narrowing search when acquiring information via the Internet or when extracting a part of a file from one folder. In such a narrowing search, a search condition as a key is compared with information of each file, and a file satisfying the search condition is extracted. In addition, as a display method of the files extracted by the narrowing search, there is a method of determining the relevance rate with the search condition and displaying the extracted files in order of the relevance rate. In this way, by displaying the search results in a list in descending order of the relevance ratio, it is possible to confirm from the files that conform to the search conditions input by the operator.

  However, in this method, it is not possible to know how many files are extracted as a narrowing result when the relevance ratio is constant until the search results are displayed in number. Further, when the number of files to be extracted is set, the high relevance ratio to be extracted changes depending on the search condition. For this reason, since the search is repeated while setting various conditions, it is difficult to improve operability.

  In addition, it is difficult to easily perform a narrow search using the logical operation results of a plurality of search keys as search conditions.

  The present invention has been made in view of the above, and an object of the present invention is to provide a communication device and a portable electronic device that can execute a narrow search with higher operability.

  In order to solve the above-described problems and achieve the object, the present invention is a communication device, which is input by contacting a display unit that displays an image and a region where the image is displayed by the display unit. An input detection unit that detects an input instruction, a communication unit that communicates with another terminal, a control based on the input instruction detected by the input detection unit, and a control of an image displayed on the display unit A control unit, and the control unit includes a group object having a plurality of communication destination specifying objects that are address information when communication is performed in the communication unit, and the communication destination specifying object among the group objects A key object that abstracts the conditions for narrowing down and a key box object that can include a plurality of the key objects are displayed on the screen by the display unit. When the input detection unit detects a contact with the key box object and a movement instruction in the contact state in the state, a logical operation result for the key object included in the key box object is obtained, and each communication destination in the group object is obtained. A matching rate of the specific object with respect to the result of the logical operation is obtained, and a communication destination specifying object that satisfies the range of the calculated matching rate is extracted from the communication destination specifying object in the group object and displayed on the screen of the display unit In addition, when the input detecting unit detects that one of the extracted communication destination specific objects is selected and an instruction to be determined is input, the address information associated with the selected communication destination specific object Based on the above, communication in the communication unit is started.

  In order to solve the above-described problems and achieve the object, the present invention is a portable electronic device, in which a display unit that displays an image and a region where the image is displayed by the display unit are in contact with each other. An input detection unit that detects an input instruction to be input; and a control unit that performs control based on the input instruction detected by the input detection unit and controls an image to be displayed on the display unit; The control unit includes a group object having a plurality of item objects, a key object that abstracts a condition for narrowing down the item objects from the group object, and a key box object that can include a plurality of the key objects. In a state where the display unit displays on the screen, the input to the key box object and the movement instruction in the contact state are input. When the detection unit detects, the logical operation result for the key object included in the key box object is obtained, the relevance ratio for the result of the logical operation of each item object in the group object is obtained, and the range of the calculated relevance ratio is calculated. A satisfying item object is extracted from the item objects in the group object and displayed on the screen of the display unit.

  Here, when the control unit detects that a predetermined first input operation has been performed on the key box object by the input detection unit, the control unit executes the control on a plurality of key objects included in the key box object. It is preferable to perform control to change the setting of the logical operation from the currently set operation equation (that is, before detecting that the predetermined first input operation has been performed) to another operation equation.

  In addition, when the control unit detects that the input detection unit has performed a predetermined second input operation on the key box object, the control unit displays the key object included in the key box object on the screen. When it is detected that any one of the displayed key objects is selected, it is preferable to perform control to delete the key object from the key box object.

  Further, when the control unit detects that the key object is moved into the display area of the key box object by the input detection unit in a state where the key object is displayed on the screen by the display unit, It is preferable to perform control to include the key object in the key box object.

  Further, the control unit detects an amount of movement of the key box object by the input detection unit, and calculates a range of the relevance ratio of the item object to be extracted based on the amount of movement of the key box object. It is preferable to perform control.

  Moreover, it is preferable that the said control part makes the group of the extracted item object a new group object.

  The control unit may display an item object included in the group object on the display unit, and display the extracted item object in the vicinity of the key object.

  In addition, the control unit varies the range of the relevance ratio calculated according to the distance between the key object and the group object, and extracts the item object having a lower relevance ratio as the distance is closer, and extracts the distance It is preferable to extract only item objects having a higher relevance ratio as the distance is farther.

  In addition, the control unit calculates the range of the relevance ratio of the item object to be extracted according to the movement distance of the key object in the display area of the group object. It is preferable to extract including low item objects, and to extract only item objects having a higher matching rate as the moving distance is shorter.

  In addition, the control unit may be configured so that the input object is extracted by the input detection unit in a state where the key object is selected and an item object is extracted based on the range of the relevance ratio at the time of the state. When a tap on the key object is detected, it is preferable that the range of the relevance ratio of the item object to be extracted is narrower than that before the occurrence of the tap.

  Moreover, it is preferable that the control unit narrows the range of the matching rate of the item object to be extracted as the tap time is longer.

  Further, it is preferable that the control unit narrows the range of the matching rate of the item object to be extracted as the number of taps increases.

  Further, the control unit displays the group object larger on the display unit as the number of the item objects included in the group object is larger, and the group object as the number of the item objects included in the group object is smaller. It is preferable to display the object small on the display unit.

  Moreover, it is preferable that the said control part attaches an outline to the outer periphery of the said group object, and displays it on the said display part.

  Further, the control unit is a contact sensor disposed on a front surface of the display unit, and detects a force applied to the display unit as an input, and the control unit receives a load. It is preferable that the operated key object is determined by associating the displayed position with the image displayed on the display unit.

  The communication device and the portable electronic device according to the present invention have an effect that a narrow search can be executed with high operability.

FIG. 1 is a block diagram showing a schematic configuration of a portable electronic communication device as an embodiment of the communication device and the portable electronic device of the present invention. FIG. 2 is a block diagram showing a schematic configuration of software of the portable electronic communication device shown in FIG. FIG. 3 is an explanatory diagram illustrating an example of an image displayed on the display device. FIG. 4 is a flowchart showing an example of the processing operation of the portable electronic communication device. FIG. 5A is an explanatory diagram for explaining the operation of the portable electronic communication device. FIG. 5B is an explanatory diagram for explaining the operation of the portable electronic communication device. FIG. 5C is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 5-4 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 6 is a flowchart showing an example of the processing operation of the portable electronic communication device. FIG. 7A is an explanatory diagram for explaining the operation of the portable electronic communication device. FIG. 7-2 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 7C is an explanatory diagram for explaining the operation of the mobile electronic communication device. 7-4 is explanatory drawing for demonstrating operation | movement of a portable electronic communication apparatus. FIG. 8 is a flowchart showing an example of the processing operation of the portable electronic communication device. FIG. 9A is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 9-2 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 9C is an explanatory diagram for explaining the operation of the mobile electronic communication device. 9-4 is explanatory drawing for demonstrating operation | movement of a portable electronic communication apparatus. FIG. 10 is a flowchart showing an example of the processing operation of the portable electronic communication device. FIG. 11 is a flowchart showing an example of the processing operation of the portable electronic communication device. FIG. 12A is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 12-2 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 12C is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 12D is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 13A is a flowchart illustrating an example of a processing operation of the portable electronic communication device. FIG. 13-2 is a flowchart illustrating an example of a processing operation of the portable electronic communication device. FIG. 14A is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 14-2 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 14C is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 15 is a graph for explaining the operation of the portable electronic communication device. FIG. 16A is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 16-2 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 17 is an explanatory diagram for explaining the operation of the mobile electronic communication device. FIG. 18 is a graph for explaining the operation of the portable electronic communication device.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a portable electronic communication device is described as an example of a communication device, and more specifically, a mobile phone is described as an example. However, the application target of the present invention is not limited to a mobile phone. For example, PHS (Personal Handy phone) System), PDA, navigation device, notebook computer, game machine, and the like.

  FIG. 1 is a block diagram showing a schematic configuration of a portable electronic communication device as an embodiment of the communication device and the portable electronic device of the present invention. As shown in FIG. 1, the portable electronic communication device 10 basically includes a CPU (Central Processing Unit) 22, a communication unit 26, an audio processing unit 30, a display device 32, an input device 34, a ROM 36, A RAM 38, an internal storage 40, and an external storage interface (I / F, interface) 42 are included. The portable electronic communication device 10 is connected to the external storage 46 via the external storage I / F 42. In addition to the above-described configuration, the mobile electronic communication device 10 has various configurations that are included in the mobile electronic communication device, such as an imaging unit and various terminals. In addition, the external shape of the portable electronic communication device is composed of two members connected by a hinge, and can have various shapes such as a foldable shape, a shape in which two members are slid, and a single box shape. can do.

  The CPU 22 is a processing unit that comprehensively controls the overall operation of the mobile electronic communication device 10. That is, the communication unit is configured so that various processes of the mobile electronic communication device 10 are executed in an appropriate procedure according to the operation of the input device 34 and the software stored in the ROM 36 and the internal storage 40 of the mobile electronic communication device 10. 26, the operation of the display device 32, and the like are controlled. Various processes of the portable electronic communication device 10 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. The operations of the communication unit 26, the audio processing unit 30, the display device 32, and the like include, for example, transmission / reception of signals by the communication unit 26, input / output of audio by the audio processing unit 30, display of images by the display device 32, and the like. .

  The CPU 22 executes processing based on programs (for example, operating system programs, application programs, etc.) stored in the ROM 36 and the internal storage 40. The CPU 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processor Unit), and executes various processes of the portable electronic communication device 10 described above according to a procedure instructed by the software. That is, the CPU 22 sequentially reads instruction codes from the operating system program, application program, and the like stored in the ROM 36 and the internal storage 40 and executes processing.

  The CPU 22 has a function of executing a plurality of application programs. Examples of application programs executed by the CPU 22 include an image display application program for displaying an image on the display device 32, an operation detection application program for calculating an operation input based on an input detected by the input device 34, and a narrowing search. There are a plurality of application programs such as a search application program for performing communication, an Internet application program for performing Internet communication, a mail application program for creating mail, and a telephone application program for making calls.

  The communication unit 26 establishes a radio signal line by a CDMA system or the like with a base station via a channel assigned by the base station, and performs telephone communication and information communication with the base station.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 50 and an audio signal output from the receiver 52. That is, the sound processing unit 30 amplifies the sound input from the microphone 50, performs AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data to be converted into the CPU 22 Output to. Further, the audio data sent from the CPU 22 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), amplification, etc. to convert it into an analog audio signal, which is then output to the receiver 52.

  The display device 32 includes a display panel such as a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) panel, and a video corresponding to video data supplied from the CPU 22 and an image corresponding to the image data. Is displayed on the display panel.

  The input device 34 is a touch panel arranged on the front surface of the display device 32, and detects the contact as an input when the operator touches the surface. The input device 34 detects the touched position, the strength of the touch, and the like. As the touch panel, various types of touch panels such as a matrix switch, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method can be used. Here, when an image of a key to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a decision key, and a call key are displayed on the display device 32 is displayed by the operator. When the input device 34 is pressed, the input device 34 detects the pressed position (the position where the touch has occurred). The CPU 22 of the portable electronic communication device 10 performs the process on the assumption that the key operation corresponding to the position where the input device 34 has detected contact is input.

  A ROM (Read Only Memory) 36 is a read-only storage device, and stores firmware used for driving the portable electronic communication device 10 such as BIOS. A RAM (Random Access Memory) 38 is a readable / writable storage device, and is composed of, for example, an SRAM (Static Random Access Memory) or a DRAM (Dynamic Random Access Memory). The ROM 36 and the RAM 38 constitute a main storage device. In the ROM 36 and RAM 38, computer programs and temporary data used in the software processing process are assigned by the CPU 22, and the assigned data are temporarily stored in the work area.

  The internal storage (internal memory) 40 is a readable and writable storage device provided in the portable electronic communication device 10, for example, a hard disk. The internal storage 40 is used as an auxiliary storage device, and stores software and data used for processing by the CPU 22. In addition to these tasks, the internal storage 40 also has an image folder for storing communication and downloaded image data, a standby image folder for storing image files used for standby images, and the like. In addition to these, the internal storage 40 stores and manages, for example, communication, downloaded audio data, software used by the CPU 22 to control the internal storage 40, the telephone number and mail address of the communication partner, and the like. An address book, voice files such as dial tone and ring tone, temporary data used in software processing, and the like are stored.

  The external storage I / F 42 is a terminal connected to the removable external storage 46. By connecting the external storage I / F 42 and the external storage 46, data can be transmitted and received between the CPU 22 and the external storage 46. The external storage (external memory) 46 is a storage device that can be attached to and detached from the portable electronic communication device 10 via the external storage I / F 42, and includes a memory card such as an SD card (registered trademark) or a compact flash (registered trademark). A removable HDD (Hard Disk Drive) can be used. As a combination of the external storage I / F 42 and the external storage 46, a removable disk drive and a removable disk may be combined.

  Next, the software configuration of the portable electronic communication device 10 will be described with reference to FIG. Here, FIG. 2 is a block diagram illustrating a schematic configuration of software of the portable electronic communication device, and FIG. 3 is an explanatory diagram illustrating an example of an image displayed on the display device. In FIG. 2, for the sake of explanation, each software (application program) is shown as being provided separately. However, signal exchange and data processing among the CPU 22, ROM 36, RAM 38, internal storage 40, etc. However, each part is not visually provided separately. Further, FIG. 2 shows software related to item object narrowing search and image display as software, but the portable electronic communication device 10 includes various software in addition to the software shown in FIG. An object is an item to be operated by an operator (displayed by abstracting data to be operated), a group object (folder), an item object (file), a key object ( Search condition), and a search key box object that can include a plurality of key objects. Note that the folder (directory) is not only a folder created by the operator, but also a folder created by the portable electronic communication device 10 by the narrowing search and a temporary set for managing a set of files detected by the narrowing search. Includes folders created automatically. Examples of the file include image data, audio data, Internet home page data, address book data in which mail addresses and telephone numbers are registered, and the like. In addition, as search conditions, the character used as a keyword, the numerical value used as a threshold (date and time, the number of people in the case of an image), the genre of a file (for example, in the case of an image, landscape, portrait, etc. Classic, hip hop, rock, etc., in the case of an address book, group category, etc.).

  Here, with reference to FIG. 3, each unit displayed on the screen when the refinement search is performed will be described. As shown in FIG. 3, the display device includes a group object 102 having a plurality of item objects 104, a key object 106 that is a search condition (abstracting the search condition), and an item object from among the group objects 102. A search key box object 108 that can include a plurality of key objects serving as a narrowing condition is displayed. In the example illustrated in FIG. 3, the group object 102 is a folder in which a plurality of item objects 104 are stored. A group object named “Mr. A” and a group object named “Mr. B” are displayed. Has been. In each group object 102, the outer periphery of the display area of the group object is surrounded by a dotted line. That is, the boundary line between the group object and another part is displayed. An item object 104 belonging to the group object 102 is displayed inside the group object 102.

  The item object 104 is composed of an image file, and a thumbnail image of the image file is displayed as the item object 104 on the display device. Further, the key object 106 is described in terms of a narrowing condition, and is displayed at a position separated from the group object 102 by a certain distance or more. The search key box object 108 is also displayed at a position separated from the group object 102 by a certain distance or more. A method for operating the image displayed on the display device 32 and a control method for narrowing search based on the operation will be described later.

  As illustrated in FIG. 2, the software of the mobile electronic communication device 10 includes a search unit 60 that performs a narrow search, a display unit 62 that controls an image displayed on the display device 32, and an input that detects an input from the input device 34. A content control unit 66 that transmits and receives data to and from the internal storage 40 and the external storage 46. Hereinafter, the configuration of each unit will be described.

  The search unit 60 includes a search control unit 68, an object control unit 70, an object display unit 72, an object operation unit 74, an object management unit 76, an object information database 78, a content management unit 80, and a search index database. 82, a content information database 84, and a content access unit 86. The search unit 60 reads a group object in which a plurality of item objects are collected, calculates a matching rate between each item object in the group object and the search condition, and the matching rate is determined from the item objects in the group object. A narrowing search is performed by extracting item objects that satisfy, that is, the matching rate is in a predetermined range. In the present embodiment, the search unit 60 performs extraction from items having a high relevance rate, and extracts item objects determined to be included between 100% and the determined ratio. A method for determining the range of the precision to be extracted will be described later.

  The search control unit 68 exchanges information with the object control unit 70 and the content management unit 80, and performs a narrow-down search for item objects based on information supplied from each unit. The object control unit 70 exchanges information with the object display unit 72, the object operation unit 74, and the object management unit 76, and controls the behavior of various objects such as group objects, item objects, key objects, and search key box objects. . Specifically, selection of an object to be displayed, determination of a position to display an object, creation of a new group object based on determination of the search control unit 68, determination of a group object to which each item object belongs, Move, create key objects, etc.

  The object display unit 72 sends information on the object to be displayed, determined based on the control by the object control unit 70, to the display control unit 88 of the display unit 62. That is, the object display unit 72 sends to the display control unit 88 information on which group object, item object, key object, and search key box object are displayed and how each object is displayed at which position.

  The object operation unit 74 determines an object to be operated and an operation of the object based on the input signal sent from the input unit 64, and performs object control on the determined signal of the operation target object and the determined operation signal. Send to part 70.

  The object management unit 76 has a function of managing each object, and the object information database 78 is a storage unit that stores information about each object. Here, as information about each object, information indicating which group object the object belongs to, information for calculating the relevance ratio of the object in the narrowing search, information on the key object, etc. Various information necessary for the operation of the object is stored. Note that the object information database 78 stores information related to objects displayed on the screen of the display device 32. The object management unit 76 appropriately reads information in the object information database 78, sends it to the object control unit 70, and updates the information stored in the object information database 78 when the information about the object is updated.

  Next, the content management unit 80 includes a search index database 82, a content information database 84, and a content access unit 86, and photographs, music data, address book data, etc. stored in the internal storage 40 and the external storage 46, etc. These files are read out via the content control unit 66, and each file is written into the internal storage 40 or the external storage 46.

  The search index database 82 stores information related to search conditions used for narrowing search. Note that the search index database 82 also stores information on search conditions other than information on search conditions displayed as key objects on the screen of the display device 32 as necessary.

  The content information database 84 stores audio data, image files, Internet sites, and the like as item objects. That is, file information (audio information and image information) corresponding to the item object displayed on the screen is stored. The content information database 84 also stores file information of item objects other than the item objects displayed on the display device 32 as necessary. The content access unit 86 exchanges information with the content control unit 66, reads the file information, software information, and the like acquired by the content control unit 66. Information is sent to the content control unit 66.

  The display unit 62 includes a display control unit 88 and a drawing engine unit 90, generates an image signal of an image to be displayed on the display device 32 based on information sent from the object display unit 72 of the search unit 60, and Send to display device 32. The display control unit 88 creates an image to be displayed based on information sent from the object display unit 72, that is, information on which object is displayed in which position and how. The drawing engine unit 90 converts the image created by the display control unit 88 into an image signal, and sends the converted image signal to the display device 32. In this way, the display device 32 displays the image created by the display unit 62 based on the information sent from the search unit 60. When other software is activated, the display unit 62 generates an image based on information sent from various software other than the information sent from the object display unit 72.

  The input unit 64 includes an input interface (I / F) control unit 92, and sends an operation of the operator detected by the input device 34 to the object operation unit 74. The input interface control unit 92 converts the signal sent from the input device 34 into a signal that can be analyzed by the search unit 60 and sends the signal to the object operation unit 74.

  The content control unit 66 has a file system 94, reads information from the internal storage 40 and / or the external storage 46, sends the read information to the content access unit 86, and receives the information sent from the content access unit 86. To the internal storage 40 and / or the external storage 46. The file system 94 has a function of managing information reading and writing.

  By the way, in the narrowing search, there is a case where it is desired to obtain an item object that matches the result of a logical operation (for example, AND operation, OR operation, NAND operation, NOR operation, XOR (exclusive OR) operation) for a plurality of key objects. is there.

  Therefore, in this embodiment, item objects that match the results of logical operations on a plurality of key objects can be obtained by intuitive and visual operations.

  In the present embodiment, a search key box object 108 that can include a plurality of key objects is provided and displayed, a logical operation is performed on the key objects included in the search key box object 108, and the logical operation is performed. The item object that matches the result is extracted from the group object 102.

  FIG. 4 is a flowchart showing an example of the processing operation of the portable electronic communication device when a key object is added (included) to the search key box object 108.

  Here, for the sake of convenience, description will be made assuming that an AND operation and an OR operation are used as the logical operation. However, as described above, other logical operations (for example, NAND operation, NOR operation, XOR operation, etc.) are performed. It is also possible to use it.

  First, the search part 60 determines whether the key object 106 was dragged as step S10. As a criterion for determining whether or not the drag movement destination of the key object is within the search key box object display area, for example, whether or not the coordinates touched by the operator are within the search key box object display area. Alternatively, whether or not the display area of the search key box object and the display area of the dragged key object overlap can be used.

  If the search unit 60 determines in step S10 that the key object 106 has been dragged (Yes), the logical operation currently set in the search key box object 108 (eg, even if it is a default logical operation) is determined in step S12. It may be a logical operation selected by an operator as will be described later).

  If the search unit 60 determines in step S12 that the logical operation currently set in the search key box object 108 is an AND operation (Yes), the key object currently included in the search key box object 108 is determined in step S14. An AND operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). When the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S14. If the search condition created by performing an AND operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S14. You may skip without executing. Further, the search key box object 108 is displayed in a predetermined color (for example, red) so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an AND operation. You may make it do.

  If it is determined in step S12 that the logical operation currently set in the search key box object 108 is not an AND operation (No), the search unit 60 determines in step S16 the key object currently included in the search key box object 108. An OR operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). When the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S16. If the search condition created by performing an OR operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S16. You may skip without executing. Further, the search key box object 108 is displayed in a predetermined color (for example, yellow) so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an OR operation. You may make it do.

  Next, an example of a specific operation example will be described with reference to FIGS. FIGS. 5A to 5D are explanatory diagrams for explaining the operation of the portable electronic communication device when an operation of adding (including) the key object 106 to the search key box object 108 is performed. It is. FIGS. 5A to 5D show examples of screen display. Further, in the explanatory diagrams shown in FIGS. 5A to 5D, only one search key box object 108 and three key objects 106 are shown, and other group objects and item objects, key objects, and search included therein are included. Illustration of the key box object is omitted. The search key box object 108 is set with an AND operation as a logical operation, and does not include any key object.

  First, as shown in FIG. 5A, the key object 106 “Mr. A” is moved by the operator, and as shown in FIG. 5B, the key object 106 “Mr. A” is moved to the search key box object 108. When in the display area, the key object 106 “Mr. A” is included in the search key box object 108.

  Next, as shown in FIG. 5C, when the key object 106 “one person” is moved by the operator and the key object 106 “one person” is within the display area of the search key box object 108, it is called “one person”. The key object 106 is included in the search key box object 108. Then, the search unit 60 performs an AND operation on the key object 106 “Mr. A” and the key object 106 “one person” to create a search condition.

  Further, as shown in FIG. 5-4, the key object 106 “320 × 240” (image size) is moved by the operator, and the key object 106 “320 × 240” is moved within the display area of the search key box object 108. Then, the key object 106 “320 × 240” is included in the search key box object 108. Then, the search unit 60 performs an AND operation on the key object 106 “Mr. A”, the key object 106 “one person”, and the key object 106 “320 × 240” to create a search condition.

  FIG. 6 is a flowchart showing an example of the processing operation of the portable electronic communication device when the logical operation set in the search key box object 108 is changed.

  Here, for the sake of convenience, the description will be made assuming that an AND operation and an OR operation are used as the logical operation. However, as described above, other logical operations (for example, NAND operation, NOR operation, XOR operation, etc.) May also be used. That is, various arithmetic expressions can be used as arithmetic expressions used for the theoretical calculation.

  First, the search part 60 determines whether the search key box object 108 was single-tapped as step S20.

  If it is determined in step S20 that the search key box object 108 has been single-tapped (Yes), the search unit 60 determines in step S22 whether the logical operation currently set in the search key box object 108 is an AND operation. To do.

  If it is determined in step S22 that the logical operation currently set in the search key box object 108 is not an AND operation (No), the search unit 60 determines in step S24 the key object currently included in the search key box object 108. An AND operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). Further, when the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S24. If the search condition created by performing the AND operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S24. You may skip without executing. Further, the search key box object 108 is displayed in a predetermined color (for example, red) so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an AND operation. You may make it do.

  If the search unit 60 determines in step S22 that the logical operation currently set in the search key box object 108 is an AND operation (Yes), the key object currently included in the search key box object 108 is determined in step S26. An OR operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). When the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S26. If the search condition created by performing the OR operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S26. You may skip without executing. Further, the search key box object 108 is displayed in a predetermined color (for example, yellow) so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an OR operation. You may make it do.

  Next, an example of a specific operation example will be described with reference to FIGS. 7A to 7D are explanatory diagrams for explaining the operation of the portable electronic communication device when an operation for changing the logical operation set in the search key box object 108 is performed. is there. FIGS. 7A to 7D show examples of screen display. In the explanatory diagrams shown in FIGS. 7A to 7D, only one search key box object 108 is shown, and other group objects, item objects included therein, key objects, and search key box objects are not shown. is doing. It is assumed that the logical operation currently set in the search key box object 108 is an AND operation, and the search key box object 108 is displayed in red.

  First, as shown in FIG. 7A, when the search key box object 108 is single-tapped by the operator, the logical operation currently set in the search key box object 108 is an AND operation. 60 sets an OR operation as a logical operation in the search key box object 108, executes an OR operation on the key object 106 currently included in the search key box object 108, and creates a search condition. If the search condition created by performing the OR operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 performs the OR operation. It is not necessary to execute. Further, as shown in FIG. 7B, the search unit 60 can search the search key box so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an OR operation. The object 108 is displayed in a predetermined color (for example, yellow).

  Next, as shown in FIG. 7C, when the search key box object 108 is single-tapped by the operator, the logical operation currently set in the search key box object 108 is an OR operation. The unit 60 sets an AND operation as a logical operation in the search key box object 108, performs an AND operation on the key object 106 currently included in the search key box object 108, and creates a search condition. If the search condition created by performing the AND operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 performs the AND operation. It is not necessary to execute. Also, as shown in FIG. 7-4, the search unit 60 allows the search key box to visually and intuitively understand that the logical operation currently set in the search key box object 108 is an AND operation. The object 108 is displayed in a predetermined color (for example, red).

  Here, the case where the AND operation and the OR operation are used as the arithmetic expression used for the logical operation has been described. However, as described above, other logical operations (for example, NAND operation, NOR operation, XOR operation, etc.) May be used to switch the arithmetic expression. For example, each time the search key box object 108 is single-tapped, the logical operation set in the search key box object 108 is changed as AND operation → OR operation → NAND operation → NOR operation → XOR operation →. May be. Further, the logical operation set in the search key box object 108 may be changed according to the number of times the search key box object 108 is tapped (double tap, triple tap, etc.).

  FIG. 8 is a flowchart showing an example of the processing operation of the portable electronic communication device when the key object included in the search key box object 108 is excluded (not included).

  First, in step S30, the search unit 60 determines whether a predetermined time has elapsed with the search key box object 108 being touched and stationary (tap and hold). If the search unit 60 determines in step S30 that the search key box object 108 has been touched and is stationary and the predetermined time has not elapsed (No), the search unit 60 ends the processing.

  If the search unit 60 determines in step S30 that the search key box object 108 has been touched and is stationary and a predetermined time has passed (Yes), the search object 60 includes the key objects included in the search key box object 108 as step S32. Display a list of Even if the touch is released in this state, the list display is not ended until the condition for ending the list display is satisfied.

  In step S <b> 34, the search unit 60 determines whether a place other than the search key box object 108 and the key objects listed is selected (touched). If the search unit 60 determines in step S34 that a place other than the search key box object 108 and the key object listed in the list has been selected (Yes), the search unit 60 ends the process.

  If the search unit 60 determines in step S34 that a location other than the search key box object 108 and the key object listed in the list has not been selected (touched) (No), in step S36, the key object is dragged and the list display area is displayed. It is determined whether or not it has been moved outside. If it is determined in step S36 that the key object has been dragged and has not been moved outside the list display area (No), the search unit 60 ends the process.

  If it is determined in step S36 that the key object has been dragged and moved out of the list display area (Yes), the search unit 60 searches for the key object that has been dragged and moved out of the list display area in step S38. In addition, it is determined whether or not the logical operation currently set in the search key box object 108 is an AND operation.

  If the search unit 60 determines in step S38 that the logical operation currently set in the search key box object 108 is an AND operation (Yes), the key object currently included in the search key box object 108 is determined in step S40. An AND operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). When the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S40. If the search condition created by performing the AND operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S40. You may skip without executing.

  If it is determined in step S38 that the logical operation currently set in the search key box object 108 is not an AND operation (No), the search unit 60 determines in step S42 the key object currently included in the search key box object 108. An OR operation is performed on 106 to create a search condition. The created search condition may be stored in the object information database 78 (see FIG. 2). If the search key box object 108 includes one key object 106, the search unit 60 may skip without executing step S42. If the search condition created by performing the OR operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 proceeds to step S42. You may skip without executing. Further, the search key box object 108 is displayed in a predetermined color (for example, yellow) so that it can be visually and intuitively understood that the logical operation currently set in the search key box object 108 is an OR operation. You may make it do.

  Note that the search unit 60 repeats the processing from step S34 to step S42 until a predetermined time elapses in a state where the selection state of the search key box object 108 and the list of the key object 106 is released.

  Next, an example of a specific operation example will be described with reference to FIGS. Here, FIGS. 9-1 to 9-4 illustrate the operation of the portable electronic communication device when an operation is performed to exclude (make sure that the key object included in the search key box object 108 is not included). It is explanatory drawing for demonstrating. FIGS. 9-1 to 9-4 show examples of screen display. Also, in the explanatory diagrams shown in FIGS. 9-1 to 9-4, only one search key box object 108 is shown, and the other group objects and the item objects, key objects, and search key box objects included therein are not shown. is doing. It is assumed that the logical operation currently set in the search key box object 108 is an AND operation, and the search key box object 108 is displayed in a predetermined color (for example, red).

  First, as shown in FIG. 9A, when a predetermined time elapses when the search key box object 108 is touched by the operator and is stationary (tap and hold), as shown in FIG. A list box 110 is displayed in the vicinity of the box object 108. Then, a list of key objects 106 included in the search key box object 108 is displayed in the list box 110. In FIG. 9B, three key objects are displayed in the list box 110: a key object 106 “Mr. A”, a key object 106 “one person”, and a key object 106 “320 × 240”.

  Next, as illustrated in FIG. 9C, when the key object 106 “320 × 240” is dragged and moved out of the list box 110 by the operator, the search unit 60 starts from the search key box object 108 to “320”. Except for the key object 106 of “× 240” (so as not to be included), an AND operation is performed on the key object 106 currently included in the search key box object 108 to create a search condition. If the search condition created by performing the AND operation on the key object 106 currently included in the search key box object 108 is already stored in the object information database 78, the search unit 60 performs the AND operation. It is not necessary to execute.

  Next, a predetermined time elapses when the selection state of the search key box object 108 and the list of the key object 106 is released, or as shown in FIG. 9-4, the operator searches the search key box object 108. When a place other than the list box 110 is touched, the search unit 60 deletes the list box 110 (ends the display of the list box 110).

  For example, when the operator double taps the search key box object 108 or the list box 110 in FIGS. 5-1 to 5-4 and FIGS. 9-1 to 9-4, the state of the search key box object 108 is changed. It is also possible to return to the previous state (for example, when a key object is added, the addition is canceled, and when the key object is deleted, the deletion is canceled).

  Next, the operation of the mobile electronic communication device 10, specifically, the search method for the narrow search and the image display method associated therewith will be described with reference to FIGS. 10 to 18. Here, FIG. 10 is a flowchart showing an example of the processing operation of the portable electronic communication device.

  First, when each software shown in FIG. 2 is activated, a group object having a plurality of item objects, a plurality of key objects, and a plurality of search key box objects are displayed on the screen as shown in FIG. Is displayed on the display device 32. As described above, when a group object having a plurality of item objects, a plurality of key objects, and a plurality of search key box objects are displayed, a narrow search is performed when a predetermined operation is performed. Note that a plurality of two types of key objects, A mode key object and B mode key object, are displayed as key objects. Similarly, as the search key box object, two types of key objects, an A mode search key box object and a B mode search key box object, are displayed. Note that the A mode and the B mode are different in that the range (threshold value) of the matching rate of the item object to be extracted, which is determined based on the operation of the key object and the search key box object, is obtained by different methods. For this reason, the A-mode key object and the B-mode key object may have the same search condition (keyword, reference value, reference condition) for narrowing down. Similarly, some A-mode search key box objects and B-mode search key box objects have the same search conditions (keywords, reference values, reference conditions) for narrowing down. Hereinafter, the A mode key object and the A mode search key box object may be collectively referred to as an A mode object, and the B mode key object and the B mode search key box object may be collectively referred to as a B mode object.

  In step S112, the search unit 60 determines whether a touch operation has been performed. That is, the input device 34 detects an operation by the operator, and determines whether the signal is input to the object operation unit 74 via the input unit 64. If it is determined in step S112 that the touch operation has not been performed (No), the search unit 60 ends the process.

  If it is determined that the touch operation has been performed (Yes) in Step S112, the search unit 60 determines whether the touch coordinates are within the object region as Step S114. That is, it is determined whether the position touched by the operator is an area corresponding to the object. Here, for the object displayed on the screen of the display device 32, the area of the input device 34 corresponding to the screen display of the display device 32 is set as the object area. If it is determined that the touch coordinates are within the object area (Yes), the search unit 60 proceeds to step S116, and if it is determined that the touch coordinates are not within the object area (No), the search unit 60 ends the process. That is, when the touch coordinates are within the object area, the search unit 60 determines that an instruction to operate the object has been input, and shifts to the operation of the object.

  If it is determined Yes in step S114, the search unit 60 determines whether the touch coordinates are within the group object region as step S116. That is, it is determined whether or not a group object is designated as an operation target. If it is determined in step S116 that the touch coordinates are within the area of the group object (Yes), that is, the group object is the operation target, the search unit 60 proceeds to the object movement mode in step S118. Here, the object movement mode means that when the operator moves the position in contact with the input device 34 from the state in which the group object is designated, that is, when the touch coordinates are changed, the group moves according to the change. In this mode, the position of the object is moved. In the object movement mode, when the touch operation is finished, that is, when the operator does not touch the input device 34, it is determined that the movement of the group object is finished, and the position where the touch operation is finished is determined. Set as a group object and end the process.

  If the search unit 60 determines in step S116 that the touch coordinates are not within the area of the group object (No), that is, if the group object is not an operation target, the search coordinates in step S120 indicate that the touch coordinates are in the area of the A mode object. It is determined whether it is within. That is, it is determined whether or not an A mode object is designated as an operation target. If it is determined in step S120 that the touch coordinates are within the area of the A mode object (Yes), the search unit 60 proceeds to the object adsorption A mode in step S122. The object adsorption A mode will be described after the description of the flowchart shown in FIG. 10 is completed. The search unit 60 ends the process when the object adsorption A mode process in step S122 ends.

  Next, if it is determined in step S120 that the touch coordinates are not within the area of the A mode object (No), that is, if the A mode object is not an operation target, the touch coordinates are within the area of the B mode object as step S124. Determine if there is. That is, it is determined whether or not a B-mode object is designated as an operation target. If it is determined in step S124 that the touch coordinates are within the region of the B mode object (Yes), the search unit 60 proceeds to the object adsorption B mode in step S126. The object adsorption B mode will be described later. When the object adsorption B mode process in step S126 ends, the search unit 60 ends the process.

  If the search unit 60 determines in step S124 that the touch coordinates are not within the region of the B-mode object (No), that is, the B-mode object is not an operation target, the search unit 60 ends the processing. Note that the search unit 60 repeatedly performs the processes from step S114 to before the end of the process for the number of times corresponding to the number of item objects. That is, the above determination is repeated as many times as the number of item objects included in the group object, and each item object is also operated in correspondence with the operation of the group object and the operation of the key object. Specifically, when the group object is moved, each item object included in the group object is also moved according to the movement. By performing the control in this way, the search unit 60 can perform an operation according to the item object touched by the operator.

  In addition, when there are a plurality of group objects on the screen, the search unit 60 performs the determination of step S116 for each group object, and when there are a plurality of A mode objects, the search unit 60 performs the process of step S120 for each A mode object. If there are a plurality of B mode objects, the determination in step S124 is performed for each B mode object.

  Next, the object adsorption A mode will be described with reference to FIGS. 11 and 12-1 to 12-4. FIG. 11 is a flowchart showing an example of the processing operation of the portable electronic communication device when the mode is shifted to the object adsorption A mode. Here, the object adsorption A mode is a mode in which the range of the relevance ratio of the item object extracted from the group object is changed according to the distance between the A mode object and the group object. That is, in this mode, the threshold value of the matching rate of the item object to be attracted to the A mode object is changed according to the distance between the A mode object and the group object. Specifically, the closer the distance between the A-mode object and the group object, the wider the range of the matching rate of the item object to be extracted, and also extract the item objects with a low matching rate, and the distance between the A-mode object and the group object The farther is, the narrower the range of the matching rate of the item object to be extracted, and only the item objects having a high matching rate are extracted. In the present embodiment, since the setting is such that item objects with a high relevance rate are extracted in order, when the range of the relevance rate is wide, item objects with a lower relevance rate are also extracted.

  First, when the search unit 60 shifts to the object adsorption A mode in step S122 (see FIG. 10), in step S130, the search unit 60 calculates the distance between the A mode object and the target group object. Here, since the A mode object has been moved by the operator, the position of the A mode object is the position of the A mode object detected during the calculation in step S130. The reference position of the group object is a preset position of the area of the group object, for example, the center of the area or the end of the area. Furthermore, the target group object is a group object to be subjected to a narrowing search.

  After calculating the distance in step S130, the search unit 60 determines whether the distance between the objects (A mode object and group object) is within D in step S132. Here, the distance D is a distance in which the distance between the A mode object and the group object is a predetermined distance or more, and is a distance that is set not to perform a narrowing search.

  If it is determined in step S132 that the distance between the objects is within D (Yes), the search unit 60 stops the suction hold timer in step S134. The adsorption hold timer is a timer that operates when the distance between objects is greater than D. Details will be described later. If the target group object is in a suction hold mode described later, the suction hold timer is stopped, and then the suction group mode described later is entered.

  After stopping the adsorption hold timer in step S134, the search unit 60 determines whether the target group object is in the normal mode as step S136. Here, the normal mode is a mode in an initial state, and is a state in which the matching rate of the item objects in the group object with respect to the A mode object is not calculated. If it is determined in step S136 that the target group object is not in the normal mode (No), the search unit 60 proceeds to step S142. If the normal mode is not set in step S136, the suction mode is selected.

  If it is determined in step S136 that the target group object is in the normal mode (Yes), the search unit 60 shifts the object state to the suction mode in step S138. That is, the object state is shifted from the normal mode to the suction mode. When the search unit 60 shifts to the suction mode in step S138, the search unit 60 searches for the target group object with the A mode object in step S140. Specifically, the relevance ratio for the A mode object is calculated for each item object belonging to (included in) the target group object.

  If the relevance rate of each item object is calculated in step S140 or if No is determined in step S136, the search unit 60 calculates the relevance rate to be attracted from the distance as step S142. That is, based on the distance between the A mode object and the target group object calculated in step S130, the range of the matching ratio to be attracted to the A mode object is calculated. Here, as described above, as the range of the relevance ratio, a wider range is calculated as the distance is smaller, and a narrower range is calculated as the distance is longer.

  After calculating the range of the relevance ratio in step S142, the search unit 60 takes out the suction target and displays it in step S144. That is, out of the item objects included in the group object, the matching rate calculated in step S140 extracts the item object included in the range of the matching rate calculated in step S142, and the extracted item object is used as a suction target. Display around the mode object. When the retrieval unit 60 displays the suction target around the A mode object in step S144, the process proceeds to step S152.

  Next, if the search unit 60 determines in step S132 that the distance between the objects is not within D (No), that is, if it is determined that the distance between the objects is greater than D, in step S146, the target group object is in the suction mode. It is determined whether it is. If the search unit 60 determines that the suction mode is not set (No) in step S146, the search unit 60 proceeds to step S152.

  If it is determined in step S146 that the suction mode is selected (Yes), the search unit 60 shifts the object state to the suction hold mode in step S148. That is, the mode of the target group object is set to the suction hold mode. Here, the suction hold mode is a process that does not calculate the range of the relevance rate and does not extract the item object from the target group object. In addition, as described above, the target group object and the A mode object are in a state of being separated by a certain distance or more.

  When the search unit 60 shifts to the suction hold mode in step S148, the search unit 60 starts counting the suction hold timer in step S150. Here, the suction hold timer is a measuring unit that serves as a reference for determining whether to shift from the suction hold mode to the normal mode. Note that the time measurement can be executed by using time measurement means built in the apparatus or time measurement software. When the timer 60 starts counting in step S150, the search unit 60 proceeds to step S152. Note that the search unit 60 repeats the processing from step S130 to immediately before step S152 for each object. That is, when a plurality of target group objects are selected, the above processing is performed for each group.

  Next, when it is determined No in step S146, when the process of step S144 or step S150 ends, the search unit 60 determines whether the suction hold timer has timed out as step S152. Note that the time used as a reference for the timeout is set in advance.

  If the search unit 60 determines in step S152 that the timeout has not occurred (No), the search unit 60 proceeds to step S158. If it is determined in step S152 that the timeout has occurred (Yes), the search unit 60 shifts the object state to the normal mode in step S154. That is, the object state is shifted from the suction hold mode to the normal mode. In the suction mode, the suction hold timer is not counted, and thus the process does not proceed to step S154. When the search unit 60 shifts to the normal mode in step S154, the search unit 60 discards the search information of the target group object in step S156. That is, the information on the relevance ratio of each item object included in the target group object calculated in step S140 with respect to the key object is discarded. Thereafter, the search unit 60 proceeds to step S158.

  When it is determined No in step S152 or when the process of step S156 is completed, the search unit 60 determines whether the drag state is released as step S158. That is, it is determined whether the input to the input device by the operator is completed and the A mode object is not selected. If it is determined in step S158 that the drag state has not been released (No), the search unit 60 proceeds to step S130 and repeats the above processing. If the search unit 60 determines in step S158 that the drag state has been released (Yes), the search unit 60 ends the process.

  Next, an example of a specific operation example will be described with reference to FIGS. 12-1 to 12-4. Here, FIGS. 12A to 12D are explanatory diagrams for explaining the operation of the portable electronic communication device when the operation is performed in the object adsorption A mode. 12A to 12D show examples of screen display. Also, in the explanatory diagrams shown in FIGS. 12-1 to 12-4, only one group object and item objects included therein and one A-mode search key box object are illustrated, and other group objects and items included in the group objects are included. An object, a key object, and a search key box object are not shown. The A-mode search key box object includes three key objects: a key object “Mr. A”, a key object “one person”, and a key object “320 × 240”, and performs an AND operation as a logical operation. Is set.

  First, when an area corresponding to the A mode search key box object 108a is touched by the operator, the search unit 60 determines that the A mode search key box object 108a has been selected, and shifts to the object adsorption A mode.

  Next, when the operator moves the A-mode search key box object 108a and the distance between the A-mode search key box object 108a and the group object 102a is within a certain distance as shown in FIG. 12A, the group object 102a. Becomes the adsorption mode, and the relevance ratio of each item object included in the group object 102a to the search condition of the logical operation result of the key object included in the A mode search key box object 108a is calculated. In this embodiment, the item object is an image file, and the A-mode search key box object 108a includes three keys: a key object “Mr. A”, a key object “one person”, and a key object “320 × 240”. Since the object is included and the AND operation is set as the logical operation, the relevance rate (this is determined based on whether or not it is a 320 × 240 size image file in which the person “Mr. A” is shown alone) In this case, the matching rate is also calculated. The high relevance rate is that the image file that can be determined to be completely photographed alone is 100% relevance rate, and the image can be determined to be indistinct or small and other people can be captured. For files, the precision is low. Moreover, whether something is reflected in the image can be automatically analyzed by using image analysis software and a face recognition system. After calculating the relevance ratio of each item object, the search unit 60 calculates the range of the relevance ratio of the item object to be attracted based on the distance between the A-mode search key box object 108a and the group object 102a. From the item objects, an item object having a matching rate included in the range of the matching rate is extracted, and as shown in FIG. 12B, the extracted item object 104a is moved to the A mode search key box object 108a side. Thus, the state is attached to the A-mode search key box object 108a.

  For the key object “320 × 240”, it can be determined whether or not the image size is 320 × 240 and the concept of precision is not used. When a key object that does not have such a concept of relevance rate is included in the A mode search key box object 108a, the item object and the A mode search key box included in the group object 102a are related to the key object. The search may be performed based on whether the condition is met without considering the distance to the object 108a.

  Further, when the A mode search key box object 108a is further moved from the position shown in FIG. 12A to the group object 102a side and the distance between the A mode search key box object 108a and the group object 102a becomes narrow (short), the suction is performed. The range of the matching rate of the item object to be calculated is calculated wider, and the item objects having a lower matching rate are extracted, and as shown in FIG. 12B, more item objects 104b are attracted to the search key box object 108a. It becomes a state.

  Next, when the operator releases the input device 34 and releases the drag state in a state where the input device 34 is not touched, the item object to be extracted (sucked) by the search unit 60 is determined. That is, the range of the relevance ratio of the item object to be extracted is determined, and the item objects satisfying the range of the relevance ratio are extracted. The group of extracted item objects becomes a new group object 102b.

  Next, as shown in FIG. 12-3, when the operator touches the group of extracted item objects and moves the extracted group of item objects away from the original group object 102a, as shown in FIG. 12-4. Are displayed separately as a new group object 102b. At this time, the new group object 102b is obtained by adding the name of the key object included in the search key box object 108a to the name of the original group object 102a. That is, the search condition used for extraction is displayed as the name of the group object 102b. This makes it easier to understand the attributes of the group object.

  Although the case where the A mode search key box object 108a is operated has been described here, the A mode key object and the group object 102a are similarly operated when the A mode key object (see FIG. 3) is operated. The range of the relevance ratio is determined according to the distance between and the item objects satisfying the range of the relevance ratio are extracted from the group object 102a.

  Next, the object adsorption B mode will be described with reference to FIGS. FIGS. 13A and 13B are flowcharts illustrating an example of the processing operation of the portable electronic communication device when the mode is shifted to the object adsorption B mode. Here, the object adsorption B mode is a mode in which the range of the relevance ratio of the item object extracted from the group object is changed according to the distance that the B mode object has moved within the group object. That is, in this mode, the threshold value of the matching rate of the item object to be attracted to the B mode object is changed according to the distance that the B mode object has moved within the group object. Specifically, the longer the distance that the B-mode object moves within the group object, the wider the range of the matching rate of the item object to be extracted, and the item objects with a lower matching rate are also extracted. The shorter the distance moved in is, the narrower the range of the matching rate of the item object to be extracted, and only the item object having a high matching rate is extracted. In this embodiment, the setting is such that the item objects having the highest relevance ratio are extracted in order, so that when the range of the relevance ratio is widened, the item objects having a lower relevance ratio are also extracted.

  First, when the search unit 60 shifts to the object adsorption B mode in step S126 (see FIG. 10), in step S160, the search unit 60 determines whether it is within the group object area. That is, it is determined whether the touch coordinates are within the group object area while the B-mode object is being operated. That is, it is determined whether or not the B mode object has been moved to the area of the group object.

  If it is determined in step S160 that the area is within the group object (Yes), the retrieval unit 60 stops the adsorption suspension timer in step S162. The adsorption hold timer is a timer that counts time when the B-mode object is not in the area of the group object, and is used when the object state of the group object is an adsorption hold mode to be described later.

  After stopping the adsorption hold timer in step S162, the search unit 60 determines in step S164 whether the state (object state) of the target group object is the adsorption mode. Here, the target group object is a group object from which item objects are extracted. The adsorption mode is a mode in which the relevance ratio of each item object included in the group object to the B mode object is calculated, and the target group object can be attracted to the B mode object. Note that the suction mode can be shifted by performing the processing of steps S192 and S194 described later. In the suction hold mode, the suction hold timer is stopped to shift to the suction mode.

  If it is determined in step S164 that the suction mode is selected (Yes), the search unit 60 calculates the moving distance and speed from the previous coordinate and current coordinate, the previous time and current time, as step S166. Thereafter, in step S168, the search unit 60 calculates a precision that is subtracted from the movement distance (or speed), and subtracts it from the acquired precision. Here, the acquired matching rate is a matching rate that is a threshold value. In this embodiment, in order to extract the item objects in descending order of the matching rate, the matching rate to be subtracted based on the moving distance is calculated, and the acquisition matching rate that is the lower limit value is set, thereby matching the item object to be extracted. A range of rates can be set. In addition, since the detection timing of the coordinate and time is the same, the movement distance and the movement speed are in a proportional relationship, so the acquisition precision calculated by using either the movement distance or the speed is the same. Become.

  After calculating the acquisition precision in step S168, the search unit 60 determines in step S170 whether there are item objects that are equal to or higher than the acquisition precision. That is, it is determined whether there is an item object with a matching rate included in the range of matching rates. If it is determined in step S170 that there is an item object having an acquisition matching rate or higher (Yes), the search unit 60 moves the item object having an acquisition matching rate or higher to the B-mode object in step S172. That is, the item object of the matching rate included in the range of the matching rate is attracted to the B-mode object. Thereafter, the process proceeds to step S188. If the search unit 60 determines in step S170 that there is no item object equal to or higher than the acquisition precision (No), the search unit 60 proceeds to step S188 because there is no item object to be attracted. In step S170 and step S172, the target item object may be a difference item object for the previous process. That is, it is determined whether there is an item object to be newly attracted, and when there is an item object to be newly attracted, it may be attracted to the B-mode object.

  Next, if it is determined in step S164 that the suction mode is not set (No), the search unit 60 determines in step S174 whether the object state of the target group object is the normal mode. If it is determined in step S174 that the mode is not the normal mode (No), the search unit 60 proceeds to step S188. If the search unit 60 determines that the normal mode is selected (Yes) in step S174, the object state is shifted to the suction candidate mode in step S176, and the suction candidate timer starts counting in step S178. The process proceeds to step S188. Here, the suction candidate mode is a mode set during the transition from the normal mode to the suction mode. While in the suction candidate mode, suction is not performed even if the B-mode object is within the group object area. Further, when the B-mode object is within the group object area for a certain period of time in the suction candidate mode, the mode shifts to the suction mode. Accordingly, since the B-mode object is moved before the suction starts, the item object of the group object that has passed through can be prevented from being sucked even if it passes through the area of the group object other than the desired group object in a short time. it can.

  Next, if it is determined in step S160 that the area is not within the group object area (No), the search unit 60 stops the suction candidate timer in step S180. After stopping the adsorption candidate timer in step S180, the search unit 60 determines in step S182 whether the object state of the target group object is the adsorption mode. If the search unit 60 determines that the suction mode is not set (No) in step S182, the search unit 60 proceeds to step S188. If it is determined in step S182 that the suction mode is selected (Yes), in step S184, the search unit 60 shifts the object state to the suction hold mode, and then starts a suction hold timer in step S186. Steps S184 and S186 are the same as steps S148 and S150 in the flowchart shown in FIG. Note that the search unit 60 repeats the processing from step S160 to immediately before step S188 for each object. That is, when a plurality of target group objects are selected, the above processing is performed for each group.

  Next, when it is determined No in Step S170, Step S174, and Step S182, the search unit 60 ends the processing of Step S172, Step S178, and Step S186, sets the current coordinates as the previous coordinates, and sets the current time as Step S188. Retreat to the previous coordinate. That is, the coordinates and time are updated. When the coordinates and time are updated in step S188, the search unit 60 determines whether the adsorption candidate timer has timed out in step S190. That is, it is determined whether a certain time or more has elapsed while the B-mode object is in the target group object region.

  If it is determined in step S190 that timeout has occurred (Yes), the search unit 60 moves the object state to the suction mode in step S192, and then searches for the target group object in step B194 using the B mode object. Specifically, the relevance ratio for the B mode object is calculated for each item object belonging to (included in) the target group object. After performing the search in step S194, the search unit 60 proceeds to step S202.

  If it is determined in step S190 that the timeout has not occurred (No), the search unit 60 determines in step S196 whether the adsorption suspension timer has timed out. If the search unit 60 determines in step S196 that the timeout has not occurred (No), the search unit 60 proceeds to step S202. If it is determined in step S196 that the time-out has occurred (Yes), the search unit 60 shifts the object state to the normal mode in step S198. That is, the object state is shifted from the suction hold mode to the normal mode. Next, when the search unit 60 shifts to the normal mode in step S198, in step S200, the search unit 60 discards the search information for the target group object. That is, the information on the relevance ratio of each item object included in the target group object calculated in step S194 with respect to the B mode object is discarded. Thereafter, the search unit 60 proceeds to step S202.

  When it is determined No in step S196 or when the processes of steps S194 and S200 are completed, the search unit 60 determines whether the drag state is released as step S202. That is, it is determined whether the input to the input device by the operator is finished and the B-mode object is not selected. If it is determined in step S202 that the drag state has not been released (No), the search unit 60 proceeds to step S160 and repeats the above processing. If the search unit 60 determines in step S202 that the drag state has been released (Yes), the search unit 60 proceeds to step S204.

  In step S204, the search unit 60 determines whether the target group object is in the suction mode. If it is determined in step S204 that the suction mode is not set (No), the search unit 60 ends the process.

  If it is determined in step S204 that the suction mode is selected (Yes), the search unit 60 shifts the object state to the hit mode in step S206, and proceeds to step S208. Here, the hit mode is a state in which the B mode object is in the region of the target group object, and when the tap (click) process is detected by the input device 34, the acquired matching rate is changed to narrow the range of the matching rate. Mode.

  The search part 60 determines whether it was touched as step S208. That is, it is determined whether the input device 34 has been touched by the operator. If it is determined in step S208 that the touch is not made (No), the search unit 60 proceeds to step S220. If the search unit 60 determines that it is touched (Yes) in step S208, the search unit 60 determines in step S210 whether the touched key object, that is, the B-mode object that is performing a narrow search. If the search unit 60 determines in step S210 that the B-mode object is not touched (No), that is, if another part is touched, the search unit 60 ends the process.

  If it is determined in step S210 that the B-mode object is touched (Yes), the search unit 60 starts counting the hit release timer in step S212. Here, the hit release timer is a measuring means that serves as a reference for determining whether to release the hit mode. When the hit release timer is started in step S212, the search unit 60 adds the acquired matching rate as step S214. Specifically, the acquisition precision ratio to be added according to the interval between the touch detected in step S208 and the release of the previous touch (drag release in step S204 or when the touch was released in the previous step S208). Is calculated. In the present embodiment, as the time interval is longer, the acquisition accuracy rate to be added (that is, a value that changes the acquisition accuracy rate) is increased, and as the time interval is shorter, the acquisition accuracy rate to be added is decreased. In other words, the longer the time interval, the larger the fluctuation range that increases the acquisition accuracy rate and narrows the range of the accuracy rate, and the shorter the time interval, the smaller the fluctuation range that increases the acquisition accuracy rate and the range of the accuracy rate Do not make it too narrow.

  After adding the acquired matching rate in step S214, the search unit 60 determines whether there is an item object that is equal to or less than the acquired matching rate in step S216. That is, it is determined whether there is an item object that is less than or equal to the acquired matching rate (not included in the range of matching rate) among the item objects that are attracted to the B-mode object. If the search unit 60 determines in step S216 that there is no item object equal to or lower than the acquisition precision (No), the search unit 60 proceeds to step S220. If it is determined in step S216 that there are item objects equal to or less than the acquired matching rate (Yes), the search unit 60 moves item objects equal to or lower than the acquired matching rate to the original group object in step S218. That is, the state where the item object having the acquisition precision or less is attracted to the B-mode object is returned to the state belonging to the original group object. Thereafter, the search unit 60 proceeds to step S220.

  When it is determined No in step S208 and step S216, and when the process of step S218 is completed, the search unit 60 determines whether the hit release timer has timed out in step S220. If it is determined in step S220 that the timeout has not occurred (No), the search unit 60 proceeds to step S208, repeats the above processing, and if it is determined that the timeout has occurred (Yes), the processing ends. That is, the search unit 60 repeatedly performs the hit mode process until a time-out occurs or an area other than the B-mode object is touched.

  Next, an example of a specific operation example will be described with reference to FIGS. FIGS. 14A to 14C are explanatory diagrams for explaining the operation of the portable electronic communication device when the operation is performed in the object adsorption B mode. FIG. 15 is a graph for explaining the operation of the portable electronic communication device. FIGS. 16A, 16B, and 17 are also explanatory diagrams for explaining the operation of the portable electronic communication device when the operation is performed in the object adsorption B mode. FIG. 18 is a graph for explaining the operation of the portable electronic communication device. 14-1 to 14-3, FIG. 16-1, FIG. 16-2, and FIG. 17 also display group objects and B-mode objects that are related to the operation target, and display some group objects, The key object was omitted. The B-mode search key box object includes two key objects, a key object “Mr. A” and a key object “plurality”, and an AND operation is set as a logical operation. .

  First, as shown in FIG. 14A, when an area corresponding to one of the B mode objects, in this embodiment, the B mode search key box object 108b is touched by the operator, the search unit 60 performs the B mode search. It determines with the key box object 108b having been selected, and transfers to object adsorption | suction B mode.

  Next, the B-mode search key box object 108b is moved by the operator. At this time, if the B-mode search key box object 108b passes in a short time, the group object 102a does not enter the suction mode, so no narrowing search is performed, and as shown in FIG. The item object is not picked up. In this way, by setting so as not to shift to the suction mode when passing for only a short time, the B-mode search key box object can be used even when the B-mode search key box object 108b is to perform a narrow search of the group object 102c. It is not necessary to move 108b so as to bypass the area of the group object 102a.

  In addition, when the B-mode search key box object 108b is moved within the area of the group object 102a by being operated by the operator and moving for a certain period of time or more than a certain speed, the group object 102a enters the suction mode. Thereby, the search unit 60 calculates the relevance ratio of each item object included in the group object 102a with respect to the search condition of the B-mode search key box object 108b. In the present embodiment, the item object is an image file, and the B-mode search key box object 108b includes two key objects, a key object “Mr. A” and a key object “multiple”. Since the AND operation is set as the operation, the relevance ratio (in this case, also the coincidence ratio) is calculated based on whether or not the image file includes a plurality of persons. Note that the accuracy rate is 100% for an image file that can be determined to be completely captured in multiple images, and it can be determined that the image is indistinct or multiple objects that appear to be people are captured. In the case of the image file, the precision is low. After calculating the relevance ratio of each item object, the search unit 60 calculates the acquired relevance ratio (that is, the range of the relevance ratio) based on the moving distance and moving speed of the B-mode search key box object 108b, and the group object 102a. From the item objects, an item object having a matching rate included in the range of the matching rate is extracted, and the extracted item object 104c is moved to the B-mode search key box object 108b side as shown in FIG. 14-3. Thus, the state is attached to the B-mode search key box object 108b.

  Here, the acquisition matching rate changes as shown in the graph of FIG. 15 according to the moving distance and moving speed in the area of the group object. Specifically, as shown in FIG. 15, at a time t1 after entering the area of the group object and after a predetermined time has elapsed, the object state becomes the suction mode, and the calculation of the acquisition matching rate starts. After that, while the B-mode object is moved slowly, such as between time t1 and time t2, the rate of change of the acquisition precision is small, that is, gradually changes, such as between time t2 and time t3. In addition, while the B-mode object is moved quickly, the rate of change of the acquisition accuracy rate is large, that is, the acquisition accuracy rate changes greatly. Thereby, the way of changing the range of the relevance ratio can be adjusted depending on how the operator moves the B-mode object, and operability can be improved.

  Next, as shown in FIG. 16A, with the item object 104c in the group object attached to the B-mode search key box object 108b, the B-mode search key box object 108b is moved out of the group object area. Then, when released from the dragged state, as shown in FIG. 16-2, it is displayed separately as a new group object 102d. At this time, the new group object 102d is obtained by adding the name of the B-mode search key box object 108b to the name of the original group object 102a. That is, the search condition used for extraction is displayed as the name of the group object. This makes it easier to understand the attributes of the group object.

  In addition, as shown in FIG. 17, the B-mode search key box object 108b is released from the dragged state while the B-mode search key box object 108b is in the area of the group object 102a. When the object 108b is touched, that is, when the B-mode search key box object 108b is tapped in a state where the B-mode search key box object 108b is within the area of the group object 102a, the search unit 60 obtains the acquisition precision Is calculated again and the acquisition precision is changed to a higher value. As a result, among the item objects that are attracted to the B-mode search key box object 108b, the item objects that have a matching rate equal to or less than the acquired matching rate return from the sucked state to the state that belongs to the group object. That is, it will be in the state which is not adsorbed. As described above, when the tapping is performed, the acquisition matching rate is increased, so that the item object having a low matching rate can be removed when the item objects are attracted too much. For this reason, it is possible to attract a desired number of item objects without redoing the process from the beginning.

  Here, when the acquisition precision is changed by tapping (that is, clicking) the B-mode object, it is preferable to change the rate of change (slope) of the acquisition precision according to the tap timing, as shown in FIG. . For example, as shown in FIG. 18, when the tap interval is slow, the rate of change (slope) of the acquisition precision is gradually increased, that is, the acquisition precision is gradually increased, and the tap interval is fast. In the case of (tapped at a short interval), it is preferable to make the rate of change (slope) of the acquisition accuracy rate abruptly, that is, the acquisition accuracy rate increases rapidly. In this way, by changing the rate (inclination) of the change in the acquisition precision according to the tap timing (interval), the operator can easily and appropriately adjust the adsorption state of the item object, and the operability Can be high. In the above embodiment, the acquisition change rate is changed based on the tap interval and time, but the present invention is not limited to this, and the acquisition accuracy rate to be converted with one tap is set in advance. Based on the number of taps, the amount of change (the rate of change) of the acquisition precision may be determined.

  Here, the case where the B-mode search key box object 108b is operated has been described, but when the B-mode key object (see FIG. 3) is operated, similarly, the group object, the B-mode key object, Based on the positional relationship, the range of the precision of the item object to be extracted is calculated, and the item objects satisfying the range of the precision are extracted.

  In this way, the mobile electronic communication device 10 includes a desired key object in a search key box object that can include a plurality of key objects, and sets a desired logical operation so that the operator can intuitively It is possible to visually narrow down a search using the logical operation results of a plurality of key objects as search conditions, and it is possible to easily obtain a search result desired by the operator.

  Also, confirmation of key objects included in the search key box object (see FIG. 9-2), addition of key objects to the search key box object (see FIGS. 5-1 to 5-4), search key box object The key object can be deleted intuitively (see FIG. 9-3) and the logical operation set in the search key box object (see FIGS. 7-1 to 7-4) can be intuitively performed with a simple operation. .

  In the present embodiment, the case has been described in which the color of the search key box object is changed according to the logical operation set in the search key box object, but the present invention is not limited to this. For example, the shape of the search key box object may be changed according to the logical operation set for the search key box object.

  Further, the mobile electronic communication device 10 thus calculates the range of the matching rate of the item object to be extracted based on the positional relationship between the group object and the search key box object or the key object, and satisfies the range of the matching rate. By extracting the item object, the operator can visually recognize the state of the search result. Thereby, it is possible to easily obtain a search result desired by the operator. In addition, since the degree of precision can be easily adjusted by the operation of the operator, the operability of the operator can be improved.

  Further, by displaying the extracted item objects by adsorbing them to the search key box object or key object, it is possible to recognize the number of extracted item objects, and in this respect, the operability can be improved. In the present embodiment, the item object is displayed by being attracted to the search key box object or the key object and displayed, but the present invention is not limited to this. It is only necessary to visually recognize that the item object has been extracted by searching the search key box object or key object, and the number of extracted item objects may be displayed.

  Moreover, it is preferable that the display area is set in proportion to the number of item objects to which the group object belongs. That is, it is preferable to display a group object with a small number of belonging item objects in a smaller area, and display a group object with a large number of belonging item objects in a larger area. Further, it is preferable to display the same in the case of a collection of item objects attracted by the key object. Thereby, the adsorption state of the item object can be easily grasped visually, and the operability can be improved.

  Moreover, it is preferable that the group object and / or the collection of item objects display a line on the outer periphery (contour line) of the display area. Thus, by clearly indicating the outer periphery of the display area with a line, the size of the display area can be accurately grasped, and the touch operation by the operator can be appropriately performed.

  Here, in the above embodiment, the precision ratio range is calculated after calculating the precision ratio of each item object. However, the order of processing of the precision ratio calculation and the precision ratio range calculation may be either. Since the calculation amount can be reduced, it is preferable that the relevance ratio of the item object is used once it is calculated until it is discarded. In the present embodiment, the relevance ratio of each item object is calculated by the search unit, but the present invention is not limited to this. It suffices to determine the relevance ratio of each item object, and information on the relevance ratio supplied from an external device via a network or the like may be used.

  In the above-described embodiment, the image file has been described as an example. However, as described above, the image file can be used for searching a music file, a home page, and the like. Further, it may be used for searching for a communication destination (a partner to be contacted). In this case, the group object is a so-called address book, and the item object is an individual address (communication destination specifying object). In this case, examples of the key object include “address name is A line”, a part of a telephone number, a part of a mail address, a group of addresses, and the like. The individual address stores information such as name, telephone number, mail address, and address. In addition, it may be possible to shift to a mode for making a call to an individual address extracted as a result of searching in the address book, or to a mail creation screen for creating a mail to be transmitted to the extracted individual address. You may do it. In this case, the communication unit communicates with the specified communication destination based on the information stored in at least one individual address selected by the operator's operation on the input device from the extracted individual addresses. Then send an email or make a call.

  For example, when the item object is an image representing a telephone number in the address book data, when one is selected from a plurality of item objects by the user, the CPU 22 makes a call with the telephone number corresponding to the selected item object. Execute the process that requests When the item object is an image representing a mail address in the address book data, when one is selected from a plurality of item objects by the user, the CPU 22 transmits to the mail address corresponding to the selected item object. Display the screen for composing mail on the display device. When the item object is an image representing an address (URL: Uniform Resource Locator) of the WEB page, when one is selected from the plurality of item objects 14 by the user, the CPU 22 corresponds to the selected item object. Connect to the URL (download the linked file and execute the application program corresponding to the file).

  In the above embodiment, the relevance ratio is calculated based on the degree of coincidence with the keyword and the condition. However, in addition to this, the present invention calculates the relevance ratio in consideration of parameters such as the number of times of browsing and popularity. It may be.

  Moreover, although the said embodiment demonstrated as an example the mobile telephone provided with the touch panel as a suitable aspect, it is not limited to this. As described above, it can be used for various communication devices. Examples of the communication unit include a communication unit that connects to a public communication network via a base station, and a communication unit that directly communicates with other terminals. Examples of the connection destination include a server and other terminals.

  Moreover, in the said embodiment, although the liquid crystal display device was used as a display device and the touch panel was used as an input device, it is not limited to this. For example, a projection display unit such as a projector may be used as the display device, and a contact detection unit that detects a contact input to the display area of the projected image may be used as the input device. Specifically, the operator places a hand in the display area, brings the hand to the area where the object is displayed, and moves the hand in the display area from that state. The same control can be performed by detecting such movement of the hand by the contact detection means.

  Note that the mobile electronic communication device 10 of the present embodiment is also applicable to a mobile electronic device that is equipped with a WEB browser that can display a WEB page and displays an image corresponding to the search result of the WEB page on the display device. . In this case, the item object is an image representing a URL. The group object is an image surrounding the URL group extracted by the search. When the portable electronic communication device 10 displays these images on a display device and is selected by touching an area where one item object is displayed, the WEB specified by the URL corresponding to the selected item object is displayed. The page is acquired by the communication unit and displayed on the display device.

  As described above, the communication device and the portable electronic device according to the present invention are useful for extracting an object that meets a search condition from a plurality of objects.

10 Mobile electronic communication device 22 CPU
26 Communication Unit 30 Audio Processing Unit 32 Display Device 34 Input Device 36 ROM
38 RAM
40 Internal storage 42 External storage interface 46 External storage 50 Microphone 52 Receiver 60 Search unit 62 Display unit 64 Input unit 66 Content control unit 68 Search control unit 70 Object control unit 72 Object display unit 74 Object operation unit 76 Object management unit 78 Object information Database 80 Content management unit 82 Search index database 84 Content information database 86 Content access unit 88 Display control unit 90 Drawing engine unit 92 Input interface control unit 94 File system 102 Group object 104 Item object 106 Key object 108 Search key box object 110 List box

Claims (16)

A display for displaying an image;
An input detection unit that detects an input instruction input by touching a region where an image is displayed by the display unit;
A communication unit that communicates with other terminals;
A control unit that performs control based on an input instruction detected by the input detection unit, and that controls an image to be displayed on the display unit,
The control unit is a key that abstracts a group object having a plurality of communication destination identification objects that are address information when performing communication in the communication unit, and a condition for narrowing down the communication destination identification object from the group objects In the state in which an object and a key box object that can include a plurality of key objects are displayed on the screen by the display unit, the input detection unit is configured to contact the key box object and to move in the contact state. Is detected,
Obtaining a logical operation result for the key object included in the key box object;
Obtaining a matching rate for the result of the logical operation of each communication destination specific object in the group object;
A communication destination specifying object satisfying the calculated range of the relevance ratio is extracted from the communication destination specifying object in the group object and displayed on the screen of the display unit, and further, one of the extracted communication destination specifying objects is displayed. When the input detection unit detects that an instruction to be selected and an instruction to be determined has been input, communication with the communication unit is started based on address information associated with the selected communication destination specific object. A featured communication device. A display for displaying an image;
An input detection unit that detects an input instruction input by touching a region where an image is displayed by the display unit;
A control unit that performs control based on an input instruction detected by the input detection unit, and that controls an image to be displayed on the display unit,
The control unit includes a group object having a plurality of item objects, a key object that abstracts a condition for narrowing down the item objects from the group object, and a key box object that can include a plurality of the key objects. When the input detection unit detects a contact with the key box object and a movement instruction in the contact state in a state of being displayed on the screen by the display unit,
Obtaining a logical operation result for the key object included in the key box object;
Obtaining the precision of the result of the logical operation of each item object in the group object;
A portable electronic device, wherein an item object that satisfies the calculated range of precision is extracted from an item object in the group object and displayed on the screen of the display unit.   When the control unit detects that a predetermined first input operation has been performed on the key box object by the input detection unit, the control unit performs a logical operation to be performed on a plurality of key objects included in the key box object. The portable electronic device according to claim 2, wherein control is performed to change the setting from the currently set arithmetic expression to another arithmetic expression.   When the control unit detects that a predetermined second input operation has been performed on the key box object by the input detection unit, the control unit displays the key object included in the key box object on the screen by the display unit, 4. The portable electronic device according to claim 2, wherein when it is detected that any one of the displayed key objects is selected, control is performed to delete the key object from the key box object.   When the control unit detects that the key object is moved into the display area of the key box object by the input detection unit while the key object is displayed on the screen by the display unit, the key unit 5. The portable electronic device according to claim 2, wherein control for including an object in the key box object is performed. The control unit detects an amount by which the key box object is moved by the input detection unit,
6. The portable electronic device according to claim 2, wherein control for calculating a range of the relevance ratio of an item object to be extracted based on an amount of movement of the key box object is performed.   The portable electronic device according to claim 2, wherein the control unit sets a set of extracted item objects as a new group object.   The said control part displays the item object contained in the said group object on the said display part, The said extracted item object is displayed on the vicinity of the said key object, The any one of Claim 2 to 7 characterized by the above-mentioned. The portable electronic device according to Item. The control unit varies the range of the precision that is calculated according to the distance between the key object and the group object,
9. The item object according to any one of claims 2 to 8, wherein the item objects having a lower relevance ratio are extracted as the distance is shorter, and only the item objects having a higher relevance ratio are extracted as the distance is longer. The portable electronic device described. The control unit calculates a range of the relevance ratio of the item object to be extracted according to a moving distance of the key object in the display area of the group object,
10. The item object having a lower relevance ratio is extracted as the moving distance is longer, and only the item object having a higher relevance ratio is extracted as the movement distance is shorter. The portable electronic device according to Item. In the state where the key object is selected and the item object is extracted based on the range of the relevance ratio at the time of the state, the control unit is configured to perform the key object in the input detection unit. When a tap to is detected,
11. The portable electronic device according to claim 10, wherein the range of the relevance ratio of the item object to be extracted is narrower than that before the occurrence of the tap.   The portable electronic device according to claim 11, wherein the control unit narrows the range of the matching rate of the item object to be extracted as the tap time is longer.   The portable electronic device according to claim 11, wherein the control unit narrows the range of the matching rate of the item object to be extracted as the number of taps increases.   The control unit displays the group object larger on the display unit as the number of the item objects included in the group object is larger, and displays the group object as the number of the item objects included in the group object is smaller. The portable electronic device according to claim 2, wherein the portable electronic device displays a small size on the display unit.   The portable electronic device according to any one of claims 2 to 14, wherein the control unit adds an outline to an outer periphery of the group object and displays the outline on the display unit. The input detection unit is a contact sensor disposed on the front surface of the display unit,
Detecting the force applied to the display as an input,
16. The control unit according to any one of claims 2 to 15, wherein the control unit determines an operated key object by associating a position where a load is input with an image displayed on the display unit. The portable electronic device as described in.

Images