JP2010049654A - Terminal device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to accurately and easily select one or more of a plurality of objects. <P>SOLUTION: In response to a touch operation on an object display area for setting one or more of a plurality of displayed objects to a selected state (step B2), a central control part 11 specifies target objects on the basis of the touch area and the object display area (step B5), compares the number of specified target objects and the number of objects which can be selected (step B7), and controls whether the target objects are enlarged for display or set to the selected state (step B8), on the basis of the comparison result (step B12). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

The present invention relates to a terminal device and a program for selecting one or more objects from a plurality of objects displayed on a display means.

In general, some terminal devices such as mobile phones can perform contact operations and non-contact operations as operations on a display unit (display screen) that displays various data and information. That is, a transparent contact sensor that detects contact of an object is disposed on the surface of the display unit, and the contact sensor detects contact of an operating instrument or a finger with the display unit as a contact operation. In addition, a non-contact sensor that detects the movement of an object existing at a short distance due to capacitance or the like is provided, and the non-contact sensor is used to operate the display device on the display unit (which may not be in contact with the display unit). And the movement of a finger is detected as a non-contact operation.

Such an operation performed on the display unit includes an operation of instructing one or more objects from a plurality of objects displayed on the display unit to select them. For example, an operation of instructing a data icon to be deleted from a plurality of data icons (objects) displayed on the display unit to make a selection state, a plurality of function icons (objects) displayed on the display unit For example, the icon of the function to be started is designated to select the selected state.

In this case, since it is difficult to indicate a precise position, an object different from the user's intention may be selected. In particular, in the case of non-contact operation, the operation tool or finger is likely to be erroneously operated due to the distance between the display position of the object and in the case of contact operation, the indicated position is hidden by the operation tool or finger. It is easy to make a mistake by the cause. In addition, when an operation is performed with a finger, an erroneous operation in which an object other than the object desired by the user is also selected due to the thickness of the finger is likely to occur. In such a case, there is a trouble that the selection operation has to be performed again from the beginning.
Therefore, conventionally, a conventional technique is known in which the periphery of the indicated position is enlarged and displayed (see Patent Document 1).
JP 2005-056286 A

However, in the technique of Patent Document 1 described above, since the periphery of the designated position is uniformly enlarged and displayed, it remains unclear which object is a candidate for the selected state. Even if the user can specify the desired object and select it, the surrounding area is enlarged and displayed, so that extra processing is required and the user is comfortable with the enlarged display. It was not a good feeling of operation.

An object of the present invention is to enable a user to accurately and easily perform a selection operation for selecting one or more objects from a plurality of objects.

In order to solve the above-described problem, the invention described in claim 1 is a terminal device for selecting one or more objects from a plurality of objects displayed on the display means, and instructions issued on the display means Detection means for detecting an operation, specification means for specifying an instruction target object based on the indication position of the instruction operation detected by the detection means and the display position of the object displayed on the display means, and the specification means A comparison means for comparing the number of objects to be designated specified by the number of selectable objects determined according to the display purpose of the object displayed on the display means, and a comparison result by the comparison means And a control means for controlling whether to display the instruction target object in an enlarged manner or in a selected state based on And wherein the door.

As an invention dependent on claim 1, the control means enlarges the instruction target object when the number of the instruction target objects is larger than the number of selectable objects as a result of the comparison by the comparison means. The invention according to claim 2, which is characterized in that, is provided.

As an invention dependent on claim 1, the control means places the instruction target object in a selected state when the number of instruction target objects is equal to or less than the number of selectable objects as a result of the comparison by the comparison means. According to the third aspect of the present invention, the invention may be provided.

As an invention dependent on claim 1, the control means has a size determined based on the indication position of the indication operation detected by the detection means and the display position of the object displayed on the display means. The invention according to claim 4, wherein the instruction target object is enlarged and displayed.

As an invention dependent on claim 4, the control means detects the degree of overlap or the degree of proximity between the indication position of the indication operation detected by the detection means and the display position of the object displayed on the display means, 6. The invention according to claim 5, wherein the size is determined for each of the instruction target objects according to the degree of overlap or the degree of proximity.

As an invention dependent on claim 1, the control means enlarges the indication target object at a display position determined based on the indication position of the indication operation detected by the detection means. The invention according to claim 6 may be used.

As an invention dependent on claim 1, the control means displays the instruction target displayed in an enlarged manner when the instruction operation detected by the detection means is canceled in a state where the instruction target object is displayed in an enlarged display. 8. The invention according to claim 7, wherein a predetermined instruction target object is selected from the objects based on the size thereof.

The invention according to claim 7 is characterized in that the control means releases the enlarged display of the instruction target object and then places the predetermined instruction target object in a selected state. It may be an invention.

As an invention dependent on claim 1, the control means instructs the detection means again after the instruction operation detected by the detection means is released in a state where the indication target object is enlarged. When an operation is detected, a predetermined instruction target object is selected based on an instruction position of the instruction operation and a display position of the instruction object displayed in an enlarged manner. Item 9 may be the invention.

In order to solve the above-described problem, the invention described in claim 10 is a function for detecting an instruction operation performed on a display means for a computer, an indication position of the detected instruction operation, and the display means. Based on the display position of the object displayed on the screen, the number of the specified target object, the number of the specified target object, and the display purpose of the object displayed on the display means A program for realizing a function for comparing the number of selectable objects, and a function for controlling whether the instruction target object is enlarged or displayed based on the comparison result. And

According to the present invention, a user can perform a selection operation for selecting one or more objects from a plurality of objects accurately and easily, and work efficiency can be improved.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone as a terminal device, and FIG. 1 is a block diagram showing a communication network system in which the mobile phone can be used.
The mobile phone 1 is provided with a call function, an e-mail function, an Internet connection function (Web access function), and the like. When the mobile phone 1 is connected to the wireless communication network (mobile communication network) 2 from the nearest base station 2A and exchange 2B, the mobile phone 1 can communicate with other mobile phones 1 via the wireless communication network 2. It becomes. Further, when the mobile phone 1 is connected to the Internet 3 via the wireless communication network 2, the mobile phone 1 can access and browse a website, and contents such as music and movies can be viewed via the Internet 3 and the wireless communication network 2. Can be downloaded.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
The central control unit 11 operates by supplying power from the battery unit 12 including a secondary battery, and controls the overall operation of the mobile phone 1 according to various programs in the storage unit 13. Etc. The storage unit 13 includes a program storage unit M1, various information temporary storage units M2, and the like. The program storage unit M1 stores a program and various applications for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 4 to 7, and stores various information necessary for the program. Yes. The various information temporary storage unit M2 is a work area that temporarily stores various information necessary for the mobile phone 1 to operate, such as screen information, flag information, and timer information.

The radio communication unit 14 includes a radio unit, a baseband unit, a demultiplexing unit, and the like. For example, during operation of a call function, an e-mail function, an internet connection function, etc., data is transmitted to and received from the nearest base station 2A. When the call function is in operation, a signal is taken from the receiving side of the baseband unit and demodulated into a received baseband signal, and then the voice is output from the transmitting speaker SP via the audio signal processing unit 15, and the receiving microphone The input audio data from the MC is taken from the audio signal processing unit 15 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband unit and transmitted from the antenna.

The display unit 16 uses a high-definition liquid crystal or an organic EL, and displays various information such as character information, a standby image, a data icon, a function icon, and the like. A touch screen (touch screen) TD is configured by laminating and arranging a contact operation unit (transparent contact sensor) 17 that detects contact of an object such as an instrument. Note that the entire surface of the display unit 16 is not limited to the touch screen TD, and a part thereof may be the touch screen TD.

When a contact operation (touch operation) is performed on the display unit 16, the contact operation unit 17 detects a contact with the display unit 16 as a touch operation, and gives the detection result to the central control unit 11. In addition to the contact, the contact operation unit 17 can detect pushing (pressing) of an operating instrument or a finger. The central control unit 11 detects the presence or absence of a touch operation or a pressing operation based on an operation signal from the contact operation unit 17 or detects the operation position (touch area). Then, in a state where a plurality of icons (objects) such as menu items are displayed on the display unit 16, the central control unit 11 displays the one or more objects from the plurality of objects in a selected state. When a pointing operation (touch operation) to a position is performed, the pointing target object is specified based on the pointing position (touch area) of the pointing operation and the display position (object display area) of the object. Here, the “instruction target object” means a candidate object (selection candidate object) to be selected.

In other words, the “instruction target object” means an object instructed by a touch operation by the user in a state where a plurality of objects are displayed. For example, a plurality of objects such as menu items are 3 × 3. When the user tries to select the desired object and touches the display position with his / her finger, the display position of another object adjacent to the object is erroneously displayed. When touched, the central control unit 11 identifies each object touched by the finger as an instruction target object.

Whether to compare the number of target objects specified in this way with the number of selectable objects determined according to the display purpose of the object, and to enlarge the target object based on the comparison result , To control the selection state. Here, the “number of objects that can be selected” is determined according to the display purpose for which the object is displayed as a list, and is the number of objects that can be selected at one time. Is a number.

For example, if an object is displayed for the purpose of selecting data to be deleted, the total number of displayed objects can be selected if all displayed data can be deleted at once. The number of possible objects becomes one, and if only one can be deleted, one is the number of selectable objects. Further, when an object is displayed for the purpose of selecting a function to be activated, one of them is the number of selectable objects. If a plurality of functions (tasks) can be executed in parallel, the number of executions of the multitask is the number of selectable objects. The reason why the instruction target object is enlarged is to facilitate the selection operation when the user selects an object desired from the instruction target objects.

The key operation unit 18 inputs dial input, character input, command input, and the like, and the central control unit 11 executes processing according to the input operation signal. The RTC (real time clock module) 19 constitutes a clock unit, and the central control unit 11 acquires the current date and time from the RTC 19. The notification unit 20 includes a sound speaker 21, an LED (light emitting diode) 22, and a vibration motor 23. The notification unit 20 is driven when an incoming call is received to notify an incoming call, and is also driven when an alarm is notified.

FIG. 3 is an external view of the mobile phone 1.
The mobile phone 1 is a two-axis hinge type that can be changed into a plurality of styles according to the connection state of a plurality of casings constituting the device main body (device main body), and includes an operation unit casing 1A and a display unit casing 1B. Are connected via a hinge 1C so as to be foldable and openable and rotatable. The hinge portion 1C is provided with an opening / closing hinge shaft for folding and closing the operation portion housing 1A and the display portion housing 1B. A rotating hinge shaft for rotating with respect to the other housing is provided.

Such a two-axis hinge type mobile phone 1 has a plurality of styles (closed style, closed style) depending on how the operation unit housing 1A and the display unit housing 1B are connected. 3A shows an open style in a state where the fold between the operation unit casing 1A and the display unit casing 1B is opened. A key operation unit 18 is disposed on the inner surface of the operation unit housing 1A, and a touch screen TD is disposed on the inner surface of the display unit housing 1B. Note that a transmission speaker SP is disposed on the inner surface side of the operation unit housing 1A, and a reception microphone MC is disposed on the inner surface of the display unit housing 1B. FIG. 3B shows a view style in which the display unit housing 1B is folded 180 degrees in the open style and then folded, and the touch screen TD that is inside in the open style faces outward in the view style. It becomes like this.

Next, the operation concept of the mobile phone 1 in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. That is, in addition to the recording medium, an operation specific to this embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 4 is a flowchart showing an outline of the overall operation of the mobile phone 1.
First, when a power-on operation for turning on the power is performed (YES in step A1), the central control unit 11 starts power supply and executes a power-on process for initializing a predetermined memory and the like. After performing a standby process of reading and displaying a standby image or performing location registration by communicating with the base station 2A (step A2), the operation unit 20 is accessed to check whether there is an operation. Then, the presence / absence of a multi-object display operation is checked (step A3). Here, “multiple object display operation” is an operation for displaying a plurality of objects. For example, an arbitrary data icon display operation for deleting data, an address book data icon display operation, a function icon (menu) When this multi-object display operation is performed, for example, a display operation or the like, in response to this, the process proceeds to execution of an object control process described in detail later (step A4).

When an incoming call is detected (YES in step A5), the call is set in a call-ready state and a call process for storing a call history and displaying information related to the call is executed (step A6), and then the above-described step A3 is performed. Return to. When a power-off operation is performed (YES in step A7), a power-off process is executed (step A8), and this flow ends. When other operations are performed (YES in step A9) ) As a process according to the operation, for example, a call transmission process, a mail transmission process, etc. are executed (step A10).

FIG. 5 is a flowchart for explaining the object control process (step A4 in FIG. 4) in detail.
First, the central control unit 11 executes a multi-object display process to display a plurality of objects on the touch screen TD. For example, as a plurality of objects, an arbitrary data icon for deleting data as shown in FIG. 8A is displayed, a data icon of an address book is displayed as shown in FIG. As shown in FIG. 8C, a function icon (menu) is displayed (step B1).

Note that the “delete execution” icon in FIG. 8A is an operation button (touch key) for instructing to delete the data of the selected icon among the icons “a” to “m”. It is. For example, when the icon “c” is in a selected state, the data “c” is deleted in response to a touch operation on “delete execution”. In addition, when the icons “c”, “h”, and “j” are selected, the data “c”, “h”, and “j” are in response to the touch operation to “delete execution”. When all the icons “a” to “m” are selected, all the data is deleted in response to the touch operation to “Delete execution”.

In FIG. 8B, the left and right triangle mark icons in the figure are operation buttons (touch) for instructing the left or right movement of the address book index label icon (for example, ka, sa, tana, na). Key). The label icon is an operation button (touch key) that instructs to display a list of icons of the address book data included in the label row. The address book data icon is an operation button (touch key) for instructing detailed display of the address book data. In FIG. 8C, each function icon is an operation button (touch key) for instructing activation of the function.

In a state where a plurality of objects are displayed on the touch screen TD in this way, an operation waiting state is entered while checking for the presence of a touch operation on the touch screen TD (step B2). Now, when a touch operation on the touch screen TD is detected based on an operation signal from the contact operation unit 17 (YES in step B2), the touch area (instruction position of the instruction operation) is detected (step B3), An object display area (object display position) is detected (step B4), and an instruction target object is specified based on the touch area and each object display area (step B5). For example, an object in which a touch area and a display area overlap is specified as an instruction target object, or an object (a nearby object) displayed within a predetermined distance from the touch area is specified as an instruction target object. In this case, the degree of overlap (contact area) between the touch area and each object display area is detected, or the degree of approach is detected.

For example, as shown in FIG. 9A, when a plurality of objects “1”, “2”, “3”, “4”,... Are displayed on the touch screen TD, When a touch operation is performed, the central control unit 11 specifies an instruction target object based on the touch area and the display area of each object. At that time, as shown in FIG. When the finger touch area overlaps the objects “1”, “2”, “3”, and “4”, the objects “1”, “2”, “3”, and “4” are designated as target objects. To be identified as In the example of FIG. 9B, the degree of overlap (contact area) between the touch area and each object display area is greatest for the object “1”, and hereinafter “3”, “2”, “4” In order of objects.

Then, based on the current display content displayed on the touch screen TD, the number of selectable objects is detected (step B6). That is, as the number of selectable objects determined according to the object display purpose, for example, if a plurality of arbitrary data icons for deleting data are displayed, the total number of displayed objects can be selected. If it is detected as a number and a function icon is displayed, “1” is detected as the number of selectable objects. Then, the number of instruction target objects specified as described above is compared with the number of selectable objects to check whether the number of instruction target objects> the number of selectable objects (step B7).

If the number of instruction target objects is equal to or less than the number of selectable objects (NO in step B7), for example, the number of selectable objects such as function icon display is “1” and the number of instruction target objects is In the case of “1”, since the instruction target object can be narrowed down, after this instruction target object is selected (step B12), the object is indicated in order to clearly indicate that it has been selected. The object is identified and displayed by changing the display color or blinking (step B13). Then, a selection flag (not shown) corresponding to the identified and displayed object is turned on (step B14). The selection flag is a flag for indicating that the object is in a selected state. If the number of selectable objects is two or more, two or more instruction target objects are in a selected state and the selection flag is selected. Is turned on.

In this way, when one or more objects are selected, it is checked whether a touch operation has been performed on any of the objects (step B10). Here, the operation on the selected object is, for example, a touch operation to “delete execution” in the example of FIG. 8A, and an address book data icon in the example of FIG. 8B. Touch operation for selecting and transitioning to the detailed display, in the example of FIG. 8C, is a touch operation for selecting the function icon and activating the function, in response to such operation, As processing corresponding to the operation, for example, data deletion processing, detailed display processing, function activation processing, and the like are executed on the object for which the selection flag is turned on (step B11).

On the other hand, if the number of instruction target objects> the number of selectable objects (YES in step B7), for example, when the number of selectable objects is “1” as in the function icon display, a plurality of instruction target objects Is specified, an enlarged display process for enlarging each instruction target object is executed (step B8). And after performing the selection process which makes the one or more objects of each instruction | indication object object into a selection state (step B9), it moves to the above-mentioned step B10, and operation to any object in a selection state is carried out. In response, processing corresponding to the operation is executed (step B11). Note that the touch operation on the selected object in step B10 may be omitted, and the process in step B11 may be performed. For example, in step B12 to step B14, a function icon may be selected and displayed in a selected state, and after the selection flag is turned on, the function of the function icon may be activated in step B11.

FIG. 6A is a flowchart for explaining the above-described enlarged display process (step B8 in FIG. 5) in detail.
First, the central control unit 11 enlarges each instruction target object at a constant magnification (step C1), and then displays the enlarged object in the vicinity of the original object (step C2). Here, FIG. 9 is a diagram illustrating a display example in this case, where (a) is a display example of a plurality of objects, and (b) is a diagram illustrating a display example in a state where the finger is touched. FIG. 10 is a diagram illustrating a display example subsequent to FIG. 9, in which (a) is a diagram illustrating <enlarged display 1>, (b) is a diagram illustrating <enlarged display 2>; c) is a diagram showing <enlarged display 3>.

As shown in FIGS. 9A and 9B, when the objects “1”, “2”, “3”, and “4” are specified as the instruction target objects, FIG. ), The objects “1”, “2”, “3”, and “4” are enlarged by a factor of 1.7 and displayed superimposed on the vicinity of the original position. When such an enlarged display process (step B8 in FIG. 5) is completed, the process proceeds to the next selection process (step B9).

In the above-described embodiment, in the enlargement display process shown in FIG. 6A, each instruction target object is enlarged at a constant magnification. However, depending on the degree of overlap between the touch area and the object display area, the object is displayed. The enlargement magnification may be determined and displayed in an enlarged manner. FIG. 6B is a flowchart showing an enlarged display process (Modification 1). First, the central control unit 11 calculates the enlargement magnification for each instruction target object based on the touch area and the object display area (step C11). That is, the degree of overlap (overlapping area) between the touch area and the object display area is detected, and the enlargement magnification is calculated for each instruction target object so that the larger the area, the larger the “magnification”.

Then, after enlarging the instruction target object with the calculated magnification (step C12), the display position (display region) is calculated based on the touch area and the calculated magnification (step C13). In this case, the display position of the enlarged object is calculated so that it does not overlap with the touch area, and the enlarged object is arranged and displayed at this display position (step C14). FIG. 10B is a diagram showing a display state in the enlarged display process (Modification 1). In this example, the order in which the overlapping area is large is the order of objects of “1”> “3”> “2”> “4”, and the instruction target object is enlarged and displayed at an enlargement ratio according to the size of the area. . In this case, it is enlarged and displayed at a position that does not overlap the touch area of the finger as much as possible. The enlarged object may be similar to the original object or may not be similar. For example, in FIG. 10B, “2”, “3”, and “4” are enlarged and displayed in a similar shape to the original object, but “1” is displayed in a horizontally long shape instead of a similar shape. Yes.

In the above-described enlargement display process (Modification 1), the enlargement magnification is calculated according to the overlap area between the touch area and the object display area. However, the enlargement size is calculated according to the overlap area. Also good. FIG. 6C is a flowchart showing an enlarged display process (Modification 2). First, the central control unit 11 calculates the size of each instruction target object based on the touch area and the object display area (step C21). That is, the degree of overlap between the touch area and the object display area is detected, and the enlarged size is calculated for each instruction target object so that the display size increases as the degree of overlap increases.

Then, after enlarging the instruction target object by the calculated size (step C22), the display position (display area) is calculated based on the calculated size (step C23), and the enlarged object is arranged and displayed at the display position (step C14). ). In this case, the instruction target objects are arranged and displayed in the vertical direction in descending order, or at that time, the larger objects are arranged and displayed so as to be arranged at the top and near the touch area. FIG. 10C is a diagram showing a display state in the enlarged display process (Modification 2). In this example, the order in which the overlapping areas are large is the order of objects “1”> “3”> “2”> “4”, and the instruction target object is enlarged and displayed with an enlarged size corresponding to the size of the area. . In this case, the largest “1” object is arranged at the top and is arranged near the touch area.

FIG. 7A is a flowchart for explaining the above-described selection process (step B9 in FIG. 5) in detail.
First, the central control unit 11 waits until it detects the release of an operation (touch operation) on an object that is in a selected state (step D1). Here, when the touch operation is canceled, the display is erased in order to cancel the enlarged display of the object, and then objects corresponding to the maximum number of objects that can be selected are arranged in the order of increasing / magnifying magnification described above. While selecting (step D2), this selected object is identified and displayed (step D3). In the example of FIG. 9B, when the object “1” is selected, the object is identified and displayed as shown in FIG. In this case, the display color of the object is changed or blinked to identify and display the object. Then, a selection flag (not shown) corresponding to the selected object is turned on (step D4).

In the above-described embodiment, in the selection process illustrated in FIG. 7A, when the touch operation is canceled, the objects are selected in order of increasing magnification / size. An object whose display area overlaps the released position may be selected. FIG. 7B is a flowchart showing the selection process (Modification 1). First, when detecting the release of the touch operation (step D11), the central control unit 11 detects the released position (touch release position) (step D12). If the finger touch area is at the position shown in FIGS. 10A to 10C, the finger is moved to the center of the object “1” while the finger is still touched, and then the touch is performed. If the operation is canceled, the center of the object “1” is detected as the touch release position.

Then, the display area of the enlarged object is detected (step D13), the display is erased to cancel the enlarged display of the object, and then the object is selected based on the touch release position and the object display area. (Step D14). That is, as many objects as the number of selectable objects are selected in ascending order from the touch release position as objects whose display area overlaps the touch release position. Then, the selected object is identified and displayed (step D15), and the selection flag corresponding to the selected object is turned on (step D16).

In the above-described selection process (Modification 1), the object is selected in response to the release of the touch operation. However, after the touch operation is released, the object is selected when the touch operation is performed again. You may make it select. FIG. 7C is a flowchart showing the selection process (Modification 2). First, when the central control unit 11 detects the release of the touch operation (step D21), the central control unit 11 waits again until the touch operation is performed (step D22). If a touch operation is detected again, the touch area is detected (step D23). In this case, not only a simple touch operation but also a touch operation that draws a locus for designating a range (area) may be used. For example, a circle or a rectangle may be drawn so as to surround a desired object.

Then, the display area of the enlarged object is detected (step D24), the display is erased to cancel the enlarged display of the object, and then the object is selected based on the touch area and the object display area. (Step D25). In other words, in the case of a touch operation in which the maximum number of selectable objects is selected in the order closest to the touch area as the object whose display area overlaps the touch area, or in the case of a touch operation that draws a locus such as a circle or a rectangle, Select an object in the area surrounded by the trajectory. Then, the selected object is identified and displayed (step D26), and the selection flag corresponding to the selected object is turned on (step D27).

As described above, in this embodiment, when the central control unit 11 performs a touch operation on the object display area in order to select one or more objects from the plurality of displayed objects, Specify the indication target object based on the touch area and the object display area, and enlarge the indication target object based on the comparison result between the number of specified indication target objects and the number of selectable objects. Since the selection state is controlled, the selection operation for selecting one or more objects from a plurality of objects can be performed accurately and easily by the user, and work efficiency can be improved. It becomes.

As a result of comparing the number of instruction target objects with the number of selectable objects, if the number of instruction target objects is larger than the number of selectable objects, the instruction target object is enlarged and displayed. Can accurately and easily select an object to be selected from the enlarged objects.

As a result of comparing the number of instruction target objects with the number of selectable objects, if the number of instruction target objects is equal to or less than the number of selectable objects, the instruction target object is selected. The user can immediately select a desired object with a comfortable operation feeling.

Since the instruction target object is enlarged and displayed in a size determined based on the touch area and the object display area, the user can accurately and easily select the object to be selected according to the enlarged display mode. can do. For example, an object closer to the display area in the touch area is more likely to be an object that the user wants to select, so if the object is enlarged and displayed at a high magnification, the user It can be selected accurately and easily.

Since the size of each instruction target object is determined according to the degree of overlap between the touch area and the object display area, a larger object can be displayed as the overlapping area is larger.

Since the instruction target object is enlarged and displayed in the display area determined based on the touch area, the user can easily confirm the enlarged object. For example, if the display area is determined so as not to overlap with the touch area, the object is displayed without being hidden by the operation tool or the finger, and the user can easily confirm.

When a touch operation is canceled while the instruction target object is displayed in an enlarged state, a predetermined object is selected from the enlarged objects based on the size of the object, so that the user Can easily select a desired object. For example, an object that is enlarged and displayed at a high magnification can be selected by simply releasing the touch operation.

At this time, since the enlarged display of the object is canceled and the predetermined object is selected, the user can check not only the selected object but also other display contents. In addition, the operation for canceling the enlarged display and returning to the normal display can be omitted.

In the state where the instruction target object is displayed in an enlarged manner, when the touch operation is performed again after the touch operation is released, a predetermined object is displayed based on the touch area and the object display area displayed in an enlarged manner. Since the selection state is set, the user can once stop the touch operation and perform another operation for selecting a desired object from the enlarged display object.

In the embodiment described above, an object in which the touch area and the display area overlap is specified as the instruction target object. However, if there is no object that overlaps the touch area, that is, an object touched by a finger or the like. If none exists, the object displayed in the vicinity of the touch area may be specified as the instruction target object. In this case, the degree of proximity between the touch area and the instruction target object may be detected, and the enlargement magnification and display size of the instruction target object may be calculated according to the degree of proximity. As a result, the closer to the touch area, the larger the object can be displayed. In addition to specifying an object touched by a finger or the like as an instruction target object, an object displayed in the vicinity of the touch area may be specified as an instruction target object.

Further, in the above-described embodiment, as a display example, an arbitrary data icon display for deleting data, an address book data icon display, and a function icon (menu) display are used as the multiple object display. There may be. The display position and size of the object are not limited to those shown in the embodiment, and may be any object such as an object displayed at an irregular position or an object having a different size or shape.

In the above-described embodiment, the touch area or the display area is used as the operation position of the touch operation or the display position of the object. However, an operation point or a display point such as the center of the area may be used.

In the embodiment described above, the contact operation unit 17 detects the contact of the operation tool or the finger with a contact sensor (touch panel) disposed on the surface of the display unit. Detects any operation performed on the display unit 16, such as detecting the movement of an operating instrument or finger on the display unit (even in a non-contact area) by a non-contact sensor that detects the movement of an object existing at a distance. An operation detection unit may be provided.
In addition, the terminal device is not limited to a mobile phone, and may be any terminal device having a plurality of operation systems such as a personal computer, a PDA, a digital camera, and a music player.

The block diagram which showed the communication network system which can use the mobile telephone applied as a terminal device. FIG. 2 is a block diagram showing basic components of the mobile phone 1. In the external view of the mobile phone 1, (a) is an open style in which the operation unit casing 1A and the display unit casing 1B are folded open, and (b) is 180 degrees of the display unit casing 1B in the open style. The figure which showed the view style of the state folded after inversion. 3 is a flowchart showing an outline of the overall operation of the mobile phone 1. The flowchart for explaining an object control process (step A4 of FIG. 4) in detail. (A) is a flowchart for explaining the above-described enlarged display process (step B8 in FIG. 5) in detail, (b) is a flowchart showing the enlarged display process (modified example 1), and (c) is an enlarged display. The flowchart which showed a process (modification 2). (A) is a flowchart for explaining the selection process (step B9 in FIG. 5) in detail, (b) is a flowchart showing the selection process (modified example 1), and (c) is a selection process (modified). The flowchart which showed Example 1). It is the figure which showed the example of a display of multiple objects, (a) is the arbitrary data icon display for deleting data, (b) is the data icon display of an address book, (c) is the display of a function icon (menu). FIG. It is the figure which showed the example of a display, (a) is the example of a display of multiple objects, (b) is the figure which showed the example of a display of the state touched with the finger | toe. FIGS. 9A and 9B are diagrams illustrating display examples, where FIG. 9A illustrates <enlarged display 1>, FIG. 9B illustrates <enlarged display 2>, and FIG. 9C illustrates <enlarged display>. The figure which showed the display 3>.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Mobile telephone 11 Central control part 13 Memory | storage part 16 Display part 17 Contact operation part 18 Key operation part TD Touch screen M1 Program storage part M2 Various information temporary storage part

Claims (10)

A terminal device for selecting one or more objects from a plurality of objects displayed on a display means,
Detecting means for detecting an instruction operation performed on the display means;
Specifying means for specifying an instruction target object based on an instruction operation instruction position detected by the detection means and a display position of the object displayed on the display means;
A comparing means for comparing the number of the instruction target objects specified by the specifying means with the number of selectable objects determined according to the display purpose of the object displayed on the display means;
Control means for controlling whether to display the selected object to be enlarged or selected based on a comparison result by the comparison means;
A terminal device comprising: The control unit enlarges and displays the instruction target object when the number of the instruction target objects is larger than the number of selectable objects as a result of the comparison by the comparison unit.
The terminal device according to claim 1, which is configured as described above. The control means places the instruction target object in a selected state when the number of instruction target objects is equal to or less than the number of selectable objects as a result of comparison by the comparison means.
The terminal device according to claim 1, which is configured as described above. The control means enlarges and displays the instruction target object in a size determined based on the instruction position of the instruction operation detected by the detection means and the display position of the object displayed on the display means;
The terminal device according to claim 1, which is configured as described above. The control means detects the degree of overlap or proximity between the indication position of the indication operation detected by the detection means and the display position of the object displayed on the display means, and according to the degree of overlap or proximity Determining the size of each instruction target object;
The terminal device according to claim 4, which is configured as described above. The control means enlarges and displays the instruction target object at a display position determined based on the instruction position of the instruction operation detected by the detection means.
The terminal device according to claim 1, which is configured as described above. When the instruction operation detected by the detection unit is released in a state where the instruction target object is enlarged and displayed, the control unit is based on the size of the instruction target object displayed in an enlarged manner. To select a specified target object,
The terminal device according to claim 1, which is configured as described above. The control means releases the enlarged display of the instruction target object and then puts the predetermined instruction target object in a selected state.
The terminal device according to claim 7, which is configured as described above. When the instruction operation is detected again by the detection means after the instruction operation detected by the detection means is canceled in a state in which the instruction target object is enlarged and displayed, the control means A predetermined instruction target object is selected based on the instruction operation instruction position and the display position of the instruction object displayed in an enlarged manner;
The terminal device according to claim 1, which is configured as described above. Against the computer,
A function of detecting an instruction operation performed on the display means;
A function of specifying an instruction target object based on the detected indication position of the indication operation and the display position of the object displayed on the display means;
A function of comparing the number of the specified instruction target objects with the number of selectable objects determined according to the display purpose of the objects displayed on the display means;
A function for controlling whether the instruction target object is enlarged or selected based on the comparison result; and
A program to realize

Images