JP2019200726A - Computation device and program - Google Patents

Abstract

To effectively reduce discomfort felt by a user even when an object unintended by the user is selected.SOLUTION: A computation device comprises a computation unit for calculating an emphasis degree used for controlling an emphasis expression of a selection object, which is selected based on a coordinate of an operation subject in an input device, among a plurality of objects displayed in a display device. The selection object is the one with the shortest distance to the coordinate in the display device in the case where the coordinate of the operation subject in the input device is converted into a coordinate in the display device. In the case of estimating selection of the selection object which is different from the one intended by the user, the computation unit calculates the emphasis degree to be lower so that the emphasis expression is alleviated compared with the case where the selection object intended by the user is selected.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an arithmetic device and a program.

  2. Description of the Related Art In recent years, many techniques for reducing the burden associated with user input operations have been developed in GUI (Graphical User Interface). For example, Patent Literature 1 discloses a technique that considers the moving direction of a cursor in a method of selecting a selection target having the shortest distance between the center points from the cursor among a plurality of selection targets.

JP 2012-27879 A

  However, even when the technique disclosed in Patent Document 1 is used, it may be difficult to correctly select a selection object intended by the user. Further, in this case, there is a possibility that the user who performs the operation gets the attention and gives a strong sense of incongruity.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to effectively reduce the user's uncomfortable feeling even when an object not intended by the user is selected. It is an object of the present invention to provide a new and improved arithmetic device and program that can be used.

  In order to solve the above-described problem, according to an aspect of the present invention, the display device is used for controlling highlighted expression of a selected object selected based on the coordinates of an operation subject in the input device among a plurality of objects displayed by the display device. An arithmetic unit that calculates an emphasis degree, and the selected object has the shortest distance from the coordinates in the display device when the coordinates of the operation subject in the input device are converted into the coordinates in the display device. And the arithmetic unit relaxes the emphasized expression when it is estimated that the selected object different from the user's intention is selected, as compared with the case where the selected object intended by the user is selected. An arithmetic unit is provided that calculates the degree of enhancement so as to be low.

  Further, the calculation unit may estimate that the selected object that is different from the user's intention is selected based on a speed related to a coordinate change of the operation subject in the input device exceeding a threshold value. .

  Further, the calculation unit may calculate the enhancement degree lower as the speed related to the coordinate change is higher.

  The display device and the input device may be formed as separate bodies.

  In order to solve the above-described problem, according to another aspect of the present invention, the computer emphasizes a selected object selected based on the coordinates of an operation subject in the input device among a plurality of objects displayed by the display device. An arithmetic unit that calculates an emphasis degree used for controlling the expression, and the selected object converts the coordinates of the operating subject in the input device to the coordinates in the display device when the coordinates in the display device are converted. The object having the shortest distance, and the calculation unit estimates that the selected object that is different from the user's intention is selected, as compared with the case where the selected object intended by the user is selected. , A program for functioning as an arithmetic unit that calculates the degree of emphasis low so that the emphasis expression is relaxed It is provided.

  As described above, according to the present invention, even when an object not intended by the user is selected, it is possible to effectively reduce the user's uncomfortable feeling.

It is a figure for demonstrating the emphasis expression of the selection object based on the emphasis degree which the arithmetic unit which concerns on one Embodiment of this invention calculates. It is a block diagram which shows the function structural example which concerns on the same embodiment. It is a flowchart which shows the flow of the emphasis degree calculation which concerns on the same embodiment. It is a figure for demonstrating the emphasis expression of the selection object by a conventional method.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

<1. Embodiment>
<< 1.1. Overview >>
First, the outline of the present invention will be described. In recent years, input methods using a GUI have become widespread. Further, in the input method as described above, many techniques for reducing the input burden on the user have been developed.

  For example, Patent Document 1 selects a selection target that has the closest distance between the center point and the coordinates of the cursor according to the user's operation on the touch pad or the like from a plurality of selection targets displayed on the display device. An input method is disclosed.

  According to the input method as described above, it is possible to greatly reduce the input burden on the user as compared with the case of using an input device that directly inputs characters, such as a keyboard or a numeric keypad.

  In addition, according to the input method as described above, the user can intuitively operate the user by tracing the touch pad with a finger without gazing at the hand. For this reason, the input method as described above, for example, can improve safety even when performing some operation while driving in a moving body such as a vehicle, and can be used in various environments. Be expected.

  On the other hand, Patent Document 1 discloses a technique for reducing the possibility of selecting a selection object that is different from the user's intention by considering the moving direction of the cursor. Even in such a case, it may be difficult to specify a correct selection object.

  In this case, the user may feel a strong sense of incongruity in selecting a selection object that is different from the one intended by the user, and may pay more attention to the selection object than necessary. Such an event is not preferable from the viewpoint of safety, particularly during the operation of the moving body.

  For this reason, even if it is a case where the selection target object different from a user's intention is selected, the method of reducing the above discomfort was calculated | required.

  The technical idea according to the present invention has been conceived by paying attention to the above points, and effectively reduces the user's discomfort even when an object that is not intended by the user is selected. Make it possible. For this reason, the arithmetic device 10 according to the embodiment of the present invention is used for controlling the emphasized expression of a selected object selected based on the coordinates of the operation subject in the input device among the plurality of objects displayed by the display device. A calculation unit 110 that calculates the enhancement degree is provided.

  Here, the object corresponds to the above-described selection object, and refers to various elements that can be selected by a user input operation among various elements such as icons and characters displayed on the display device. The selected object may be an object having the shortest distance from the coordinates on the display device when the coordinates of the operation subject in the input device are converted into the coordinates on the display device.

  In addition, the calculation unit 110 according to an embodiment of the present invention emphasizes that when a selection object that is different from the user's intention is estimated, compared to a case where the selection object that the user intends is selected. One of the features is that the degree of emphasis is calculated to be low so that the expression is relaxed.

  Here, a comparison between the emphasized expression of the selected object according to the present invention and the emphasized expression of the selected object according to the conventional method will be described. FIG. 4 is a diagram for explaining the emphasized expression of the selected object according to the conventional method.

  In the lower part of FIG. 4, the operation trajectory of the user's finger F that is an operation subject performing the tracing operation in the input device 20 that is a touch pad is shown in time series from left to right in the drawing. In the upper part of FIG. 4, in the GUI displayed by the display device 30, the highlighted expression of the selected object selected based on the coordinates of the finger F on the input device 20 is shown in time series from left to right in the figure. Has been.

  Referring to FIG. 4, first, as shown on the left in the figure, a plurality of objects O1 to O5 based on the coordinates P1 when the coordinates of the finger F in the input device 20 are converted in association with the coordinates of the display device 30. Among these, the object O1 having the shortest distance from the coordinate P1 is selected as the selected object. At this time, the object O1, which is the selected object, is expressed with emphasis over the other objects O2 to O5. Note that FIG. 4 shows an example in which a background color change is adopted as an emphasized expression of the selected object.

  Next, the user visually recognizes the selected object and performs a tracing operation using the finger F on the input device 20 in order to select the object intended by the user. Here, it is assumed that the object intended by the user is the object O2.

  At this time, the user's finger F draws a trajectory in the direction of the object O2 starting from the object O1 that is the first selected object, and finally reaches the coordinate P3 as shown on the right in the figure. Thus, the object O2 intended by the user is selected as the selected object.

  However, in this case, as shown in the center of the figure, in the course of the trajectory, the object O4 having the shortest distance from the coordinate P2 is temporarily selected as the selected object.

  Here, the object O4 is a selection object different from the user's intention, but in the comparison method, the object O4 is displayed using the same emphasis expression as the objects O1 and O2, which are the selection objects on the left and right in the drawing. ing.

  In this case, it is assumed that a user who visually recognizes that the object O4 that he did not intend has been emphasized (that is, selected) during the tracing operation is distracted by the object O4 and feels a strong sense of discomfort. The

  Here, when the cursor corresponding to the coordinates P1 to P3 shown in the figure is not displayed on the display device 30, the user determines that the position of the finger F on the input device 20 is incorrect, and moves the finger F to the upper right direction. At this time, if another object exists between the object O2 and the object O5, the object is selected as the selected object, and the user's attention is further drawn. It becomes.

  On the other hand, FIG. 1 is a diagram for explaining the emphasized expression of the selected object based on the enhancement degree calculated by the arithmetic device 10 according to the present embodiment.

  In the lower part of FIG. 1, the operation trajectory of the finger F of the user who is the main subject of the tracing operation in the input device 20 which is a touch pad is shown in time series from left to right in the drawing. Further, in the upper part of FIG. 1, in the GUI displayed by the display device 30, the highlighted expression of the selected object selected based on the coordinates of the finger F in the input device 20 is shown in time series from left to right in the figure. Has been.

  Here, the operation trajectory of the finger F shown in FIG. 1 may be the same as that shown in FIG. That is, also in FIG. 1, the objects O1, O4, and O2 are sequentially selected as selection objects based on the coordinates P1 to P3.

  On the other hand, in FIG. 1 showing the emphasized expression of the selected object based on the emphasis degree calculated by the arithmetic device 10 according to the present embodiment, unlike FIG. 4 showing the emphasized expression by the comparison method, the object that is the selected object that the user does not intend. It can be seen that the emphasized expression of O4 is relaxed compared to the objects O1 and O2.

  As described above, according to the arithmetic device 10 according to the present embodiment, when it is estimated that a selection object different from the user's intention is selected, the enhancement degree used for controlling the enhancement expression of the selection object is By calculating lower than the case where the selection object intended by the user is selected, it is possible to effectively reduce the user's uncomfortable feeling and prevent the user's attention from being excessively necessary.

  According to said function which the arithmetic unit 10 which concerns on this embodiment has, even if it is a case where operation in driving | running | working of a mobile body is performed, it becomes possible to ensure more safety, for example. In addition, the control method according to the present embodiment is particularly effective in a GUI that does not display a cursor corresponding to the coordinates P1 to P3 and the like in order to prevent the user from drawing attention more than necessary.

  Hereinafter, features and functions of the arithmetic device 10 according to the present embodiment will be described in detail. Note that, in this specification, the case where the enhancement degree calculated by the arithmetic device 10 according to the present embodiment is used for controlling the emphasis expression by a display device provided in a moving body such as a vehicle will be described as a main example. The technical idea according to the present embodiment is not limited to such an example, and can be widely applied to GUIs that perform object selection by a tracing operation or the like.

<< 1.2. Functional configuration example >>
Next, a functional configuration example according to an embodiment of the present invention will be described in detail. FIG. 2 is a block diagram illustrating a functional configuration example according to the present embodiment. Referring to FIG. 2, the arithmetic device 10 according to the present embodiment includes an arithmetic unit 110. The arithmetic device 10 is connected to the input device 20 and the display device 30 via a network.

(Calculation device 10)
The arithmetic device 10 according to the present embodiment calculates the degree of enhancement used for controlling the emphasized expression of the selected object based on the coordinate information input from the input device 20. In addition, the arithmetic device 10 according to the present embodiment inputs the calculated enhancement degree to the display device 30.

((Calculation unit 110))
The computing unit 110 according to the present embodiment calculates the degree of enhancement used for controlling the emphasis expression of the selected object selected based on the coordinates of the operation subject in the input device 20 among the plurality of objects displayed by the display device 30. To do. Here, as described above, the selected object may be an object having the shortest distance from the coordinates on the display device when the coordinates of the operation subject in the input device 20 are converted into the coordinates on the display device.

  Further, the calculation unit 110 according to the present embodiment has a function of estimating whether or not the selected object is an object intended by the user with respect to selection of the selected object. Here, when the calculation unit 110 according to the present embodiment estimates that a selection object different from the user's intention is selected, the calculation unit 110 compares the selection object of the selection object with the selection object intended by the user. One of the features is that the degree of emphasis is calculated low so that the emphasis expression is relaxed.

  The computing unit 110 according to the present embodiment may estimate whether or not the selected object is an object intended by the user based on, for example, the speed related to the coordinate change of the operating subject in the input device 20.

  More specifically, the calculation unit 110 may estimate that a selection object different from the user's intention has been selected based on the fact that the speed related to the coordinate change exceeds a threshold value.

  For example, in the example shown in FIG. 1, it is assumed that the finger F of the user who is the operation subject stops moving when the object O2 intended by the user is finally selected and emphasized. The Further, the user who visually recognizes that the object O1 selected first is emphasized moves the finger F faster and moves the coordinates closer to the object O2 as the display position of the object O1 and the intended object O2 increases. It is assumed that

  That is, the speed related to the coordinate change of the finger F as the operation subject is slow when the selected object is an object intended by the user, and is fast when the selected object is an object different from the user's intention. is expected.

  For this reason, the calculation unit 110 according to the present embodiment calculates the speed related to the coordinate change of the operating subject from the time-series coordinate information of the operating subject input from the input device 20, and the user performs the calculation based on the speed. It may be estimated whether the object is the intended object. According to the above function of the calculation unit 110 according to the present embodiment, it is possible to accurately estimate whether or not the selected object is an object intended by the user.

  On the other hand, the estimation of the user intention related to the selected object is not limited to the above method. The computing unit 110 according to the present embodiment can also identify an object intended by the user based on, for example, the user's line of sight estimated from an image of the user's eyeball as a subject. In this case, the calculation unit 110 estimates that the selected object is different from the user's intention based on the selected object being different from the target object estimated from the user's line of sight. Is possible.

  In addition, the calculation unit 110 according to the present embodiment may calculate the enhancement degree of the selected object based on the calculated speed related to the coordinate change of the operating subject. For example, the calculation unit 110 according to the present embodiment may calculate the enhancement degree lower as the speed related to the coordinate change is faster, and may calculate the enhancement degree higher as the speed related to the coordinate change is slower.

  For example, the calculation unit 110 according to the present embodiment may calculate the enhancement degree so as to be inversely proportional to the speed related to the coordinate change. In addition, for example, when the speed related to the coordinate change is 60 dots / s or more, the calculation unit 110 may calculate the enhancement degree step by step, for example, by reducing the enhancement degree by 80%.

  Note that the highlighted expression of the selected object according to the present embodiment may be realized by various modes. The highlighted expression of the selected object according to the present embodiment may be realized by, for example, a change in the background color of the object, a change in the outline of the object, an enlargement of the object, a superimposition of marks on the object, an animation such as blinking, or the like. . At this time, the degree of emphasis related to the emphasis expression may be controlled by changing, for example, the transmittance of the color of the object or the mark, the brightness, the brightness, the enlargement ratio, the line thickness, the blinking speed, and the like.

  For this purpose, the calculation unit 110 according to the present embodiment may calculate the transmittance of the background color for realizing the calculated enhancement degree and input the transmittance to the display device 30.

  The computing unit 110 according to the present embodiment is realized by, for example, one or more processors. Examples of the processor include a CPU (Central Processing Unit) and an MCU (Micro Controller Unit).

  In the above, the function which the arithmetic unit 10 which concerns on this embodiment has was described. Note that the arithmetic device 10 according to the present embodiment may have a function of generally controlling the display of the GUI by the display device 30. Further, the arithmetic device 10 according to the present embodiment may be realized as the same device as the display device 30. The functional configuration of the arithmetic device 10 according to the present embodiment can be flexibly modified according to specifications and operations.

(Input device 20)
The input device 20 according to the present embodiment is realized by a touch pad or the like. The input device 20 according to the present embodiment inputs the detected coordinates of the operating subject to the arithmetic device 10 in time series.

(Display device 30)
The display device 30 according to the present embodiment has a function of displaying a GUI including a plurality of selectable objects. In addition, the display device 30 according to the present embodiment has a function of highlighting and displaying the selected object based on the degree of enhancement calculated by the arithmetic device 10 and the transmittance of the background color used for controlling the degree of enhancement. .

  The display device 30 according to the present embodiment may be, for example, a liquid crystal display (LCD) device or an organic light emitting diode (OLED) device.

  Note that the display device 30 and the input device 20 according to the present embodiment may be formed as separate devices and may be arranged at positions separated from each other. For example, when the display device and the input device are formed as an integrated device such as a touch panel, the user can visually recognize the position of the finger and the selected object at the same time. Even in this case, it is assumed that the user feels a relatively uncomfortable feeling because his / her finger is in the vicinity of the selected object.

  On the other hand, when the display device 30 and the input device 20 are formed as separate devices, the user directly associates the position of the finger on the input device 20 with the position of the selected object displayed on the display device 30. Is difficult. For this reason, as shown in FIG. 1, the user first places a finger at a position of the input device 20 and then performs a blind operation so that the intended object is selected while visually confirming the highlighted expression of the selected object. It will be.

  In this case, unlike the touch panel, since the user cannot view the finger position and the selected object at the same time, the uncomfortable feeling to be remembered when an unintended object is selected also increases. Therefore, the enhanced expression control according to the present invention. It is assumed that the effect of is exerted more highly.

  In addition, when the display apparatus 30 and the input device 20 are provided in moving bodies, such as a vehicle, the display apparatus 30 may be arrange | positioned at an instrument panel, for example, and may be implement | achieved as a head-up display. On the other hand, the input device 20 may be disposed at an arbitrary place such as on a steering wheel, for example.

<< 1.3. Flow of enhancement level calculation >>
Next, the flow of emphasis degree calculation used for controlling the emphasis expression of the selected object by the arithmetic device 10 according to the present embodiment will be described in detail. FIG. 3 is a flowchart showing a flow of enhancement degree calculation according to the present embodiment.

  In the example illustrated in FIG. 3, the calculation device 10 according to the present embodiment determines whether or not the selection object is intended based on the speed related to the coordinate change of the operation subject (finger) in the input device 20. An estimation case will be described as an example.

  In the example illustrated in FIG. 3, when a change in color such as a background color is employed as the emphasized expression of the selected object, the arithmetic device 10 according to the present embodiment transmits the above color for realizing the enhancement degree. A case where the rate is calculated will be described as an example.

  If FIG. 3 is calculated, the arithmetic part 110 of the arithmetic unit 10 first sets the transmittance of the above color as transmittance α = 0 (S1101).

  Next, the input device 20 detects the finger position coordinates P (t) (S1102).

  Next, the display device 30 highlights the selected object based on the finger position coordinates P (t) detected in step S1102 and the transmittance α (α = 0) set in step S1101 (S1103).

  Next, the input device 20 detects the finger position coordinates P (t + 1) after a predetermined time (S1104).

  Next, based on the finger position coordinate P (t) detected in step S1102 and the finger position coordinate P (t + 1) detected in step S1104, the calculation unit 110 of the calculation device 10 operates the finger that is the operation subject. The velocity v related to the coordinate change is calculated (S1105).

  Subsequently, the calculation unit 110 determines whether or not the speed v related to the coordinate change calculated in step S1105 exceeds a threshold value (S1106). That is, the calculation unit 110 determines whether or not the selected object is an object intended by the user based on the velocity v related to the coordinate change. At this time, the calculation unit 110 may perform the above determination using a mathematical expression such as | v |> x. Note that x in the above formula is a threshold value.

  Here, when the velocity v related to the coordinate change is equal to or less than the threshold (S1106: NO), the calculation unit 110 sets the transmittance α = 0 (S1107). That is, the calculation unit 110 estimates that the selected object is an object intended by the user, and sets the enhancement degree high.

  On the other hand, when the velocity v related to the coordinate change exceeds the threshold (S1106: YES), the calculation unit 110 sets the transmittance α according to the velocity v (S1108). In other words, the calculation unit 110 estimates that the selected object is an object different from the user's intention, and sets the enhancement degree low. At this time, the calculation unit 110 may set the degree of enhancement lower, that is, the transmittance α higher as the speed v is higher.

  Next, the display device 30 highlights the selected object based on the finger position coordinates P (t + 1) detected in step S1103 and the transmittance α set in step S1107 or S1108 (S1109).

  Next, the calculation unit 110 substitutes the finger position coordinate P (t + 1) detected in step S1104 for the held finger position coordinate P (t) (S1110).

  Next, the calculation unit 110 determines whether or not the finger contact is no longer performed on the input device 20 (S1111). For example, when the input of finger position coordinates from the input device 20 is not performed for a predetermined time or more, the calculation unit 110 may determine that the finger contact is not performed.

  If it is determined that the finger contact continues (S1111: NO), the calculation unit 110 returns to step S1104 and repeats the subsequent processing based on the detected finger position coordinate P (t + 1). To do.

  On the other hand, when it is determined that the finger is no longer touched (S1111: YES), the calculation unit 110 sets the transmittance α = 0 (S1112).

  Subsequently, the display device 30 highlights the selected object based on the transmittance α (α = 0) set in step S1112 (S1113).

<2. Summary>
As described above, the arithmetic device 10 according to an embodiment of the present invention is an emphasis expression of a selected object selected based on the coordinates of an operation subject in the input device 20 among a plurality of objects displayed by the display device 30. A calculation unit 110 that calculates an enhancement degree used for control is provided.

  In addition, the calculation unit 110 according to an embodiment of the present invention emphasizes that when a selection object that is different from the user's intention is estimated, compared to a case where the selection object that the user intends is selected. One of the features is that the degree of emphasis is calculated to be low so that the expression is relaxed.

  According to said structure, even if it is a case where the object which a user does not intend is selected, it becomes possible to reduce a user's discomfort effectively.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

  In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in the computer to exhibit the same functions as the configuration of the arithmetic unit 10, and it can be read by the computer in which the program is recorded. Recording media can also be provided.

10 arithmetic units, 110 arithmetic units, 20 input units, 30 display units

Claims (5)

An arithmetic unit that calculates an emphasis degree used for controlling an emphasis expression of a selected object selected based on the coordinates of an operation subject in the input device among a plurality of objects displayed by the display device;
With
The selected object is the object having the shortest distance from the coordinates in the display device when the coordinates of the operation subject in the input device are converted into the coordinates in the display device,
When the calculation unit estimates that the selected object different from the user's intention is selected, the emphasized expression is relaxed as compared with the case where the selected object intended by the user is selected. Calculating the degree of enhancement low,
Arithmetic unit. The calculation unit estimates that the selected object different from the user's intention is selected based on a speed related to a coordinate change of the operation subject in the input device exceeding a threshold value.
The arithmetic device according to claim 1. The calculation unit calculates the enhancement degree lower as the speed related to the coordinate change is faster.
The arithmetic device according to claim 2. The display device and the input device are formed as separate bodies,
The arithmetic unit according to claim 1. Computer
An arithmetic unit that calculates an emphasis degree used for controlling an emphasis expression of a selected object selected based on the coordinates of an operation subject in the input device among a plurality of objects displayed by the display device;
With
The selected object is the object having the shortest distance from the coordinates in the display device when the coordinates of the operation subject in the input device are converted in the coordinates of the display device,
When the calculation unit estimates that the selected object different from the user's intention is selected, the emphasized expression is relaxed as compared with the case where the selected object intended by the user is selected. Calculating the degree of enhancement low,
Arithmetic unit,
Program to function as.

Images