JP7111513B2 - Information processing device and information processing method - Google Patents

Description

The present invention relates to an information processing device and an information processing method.

Conventionally, there has been proposed a computer device that detects a swipe-in action from one of four edges of a touch panel and executes processing associated with the detected edge (see Patent Document 1, for example).

Japanese Patent Publication No. 2016-511854

However, when a touch panel is used in an in-vehicle device such as a car navigation system, the user (driver) cannot keep looking at the touch panel while driving. In particular, when a plurality of screens are displayed on the touch panel, the size of each screen becomes small, making it difficult for the user to perform a touch operation on the desired screen.
SUMMARY OF THE INVENTION It is an object of the present invention to provide an information processing apparatus and an information processing method that improve the operability of a touch panel displaying a plurality of screens.

An information processing apparatus of the present invention comprises a touch panel, a screen display control unit that divides a display area of the touch panel into a plurality of sub-display areas, controls screen display of each sub-display area, and an operator in a hover state. An operation position detection unit that detects an operation position of an operation performed on a touch panel, and a hover that detects a hover operation based on the operation position detected by the operation position detection unit and executes processing corresponding to the detected hover operation. an operation detection unit, wherein the hover operation detection unit detects movement of the operator from an end of the touch panel to a preset setting area of the touch panel as a first hover operation, and One of the plurality of sub-display areas is selected based on the position of the end of the touch panel that is the starting point of the hover operation, and after detecting the first hover operation, the operation position detection unit determines the operation position of the operator. can no longer be detected, the selection of the sub-display area is cancelled .

Further, the hover operation detection unit selects selectable processing on the screen displayed in the selected sub-display area when a position within the setting area is detected as the end point of the first hover operation. The second hover operation may be shifted to a state in which the second hover operation can be accepted.

Further, the hover operation detection unit detects movement of the operation element in a preset direction from the setting area as the second hover operation, and specifies a movement direction of the operation element in the second hover operation. Then, the processing associated with the specified movement direction may be executed.

Further, the hover operation detection unit confirms the second hover operation when the manipulator that moves in the preset direction moves outside the touch panel, and associates the second hover operation with the identified movement direction. It is also possible to adopt a configuration in which the processing described above is executed.

Further, the information processing device includes a notification unit, and the hover operation detection unit causes the notification unit to perform a notification operation corresponding to the selected sub-display area when the first hover operation is detected. good too.

Further, the hover operation detection unit may display a preset display color in the selected sub-display area as the notification operation when the first hover operation is detected.

Further, when the first hover operation is detected, the hover operation detection unit may output, from a speaker, a sound notifying the screen displayed in the selected sub-display area as the notification operation.

Further, the hover operation detection unit detects an end portion of the touch panel as an operation position, but the hover operation detection unit detects a position within the setting area as an operation position. A configuration may be adopted in which it is not detected as a hover operation.

Further, the hover operation detection unit cancels the selection of the sub-display area when the movement direction of the operator detected after the detection of the first hover operation is not the movement direction set as the second hover operation. It is good also as a structure which carries out.

Further, the hover operation detection unit may be configured to output a sound for notifying the cancellation of selection from a speaker when canceling the selection of the sub-display area .

The information processing method of the present invention includes a display step of displaying a screen in each display area of a touch panel divided into a plurality of sub-display areas, and an operation position of an operation performed on the touch panel by an operator in a hover state. and a hover operation detection step of detecting a hover operation based on the operation position detected by the operation position detection step and executing a process corresponding to the detected hover operation, wherein the hover The operation detection step detects movement of the operator from an edge of the touch panel to a preset setting area of the touch panel as a first hover operation, and detects an edge of the touch panel that is a starting point of the first hover operation. any one of the plurality of sub-display areas is selected based on the position of the part, and if the operation position detection step fails to detect the operation position of the operator after the detection of the first hover operation, the sub-display area It is characterized by canceling the selection of the display area.

Further, the hover operation detecting step selects a selectable process on the screen displayed in the selected sub-display area when a position within the setting area is detected as the end point of the first hover operation. It is preferable to transition to a state in which the second hover operation to be performed can be accepted.

Further, the hover operation detection step detects movement of the operator in a preset direction from the set area as the second hover operation, and specifies a movement direction of the operator in the second hover operation. and execute the process associated with the specified movement direction.

Further, the hover operation detecting step confirms the second hover operation when the operator moving in the preset direction moves outside the touch panel, and associates the second hover operation with the identified moving direction. It is recommended that the process be executed.

Further, the hover operation detection step preferably causes the notification unit to perform a notification operation corresponding to the selected sub-display area when the first hover operation is detected.

Further, in the hover operation detection step, when the first hover operation is detected, it is preferable to display a preset display color in the selected sub-display area as the notification operation.

Further, in the hover operation detection step, when the first hover operation is detected, it is preferable that, as the notification operation, a sound for notifying the screen displayed in the selected sub-display area is output from a speaker.

Further, in the hover operation detection step, when the operation position detection step detects an end portion of the touch panel as the operation position, but the position within the setting area cannot be detected as the operation position, the hover operation is performed as the first hover operation. It should not be detected as an operation.

Further, the hover operation detecting step cancels the selection of the sub-display area when the moving direction of the operator detected after the detection of the first hover operation is not the moving direction set as the second hover operation. do it.

Further, in the hover operation detecting step, it is preferable that, when canceling the selection of the sub-display area, a sound notifying the cancellation of the selection is output from a speaker.

According to the present invention, it is possible to improve the operability of a touch panel on which a plurality of screens are displayed.

1 is a configuration diagram showing a configuration of an information processing device; FIG. It is a figure which shows the example of a display of a touch panel. It is a figure which shows the example of a display of a touch panel. It is an explanatory view explaining a detection method of hover operation. It is an explanatory view explaining a detection method of hover operation. It is an explanatory view explaining the first hover operation. It is a figure which shows a fixed area|region. It is an explanatory view for explaining the second hover operation. FIG. 11 is an explanatory diagram for explaining a hover operation in the case of two screens; FIG. 11 is an explanatory diagram for explaining a hover operation in the case of one screen; 4 is a flowchart showing the operation of the information processing device;

Embodiments of the present invention will be described with reference to FIGS. 1 to 11. FIG.
FIG. 1 is a configuration diagram showing the configuration of an information processing apparatus 1 of this embodiment. First, the configuration of the information processing apparatus 1 will be described with reference to FIG.

The information processing device 1 of this embodiment is mounted on a vehicle 5 . The information processing device 1 may be configured exclusively, or may be configured as part of an in-vehicle device (ECU (Electronic Control Unit), navigation device, driving support device, etc.) of the vehicle 5 .

The information processing apparatus 1 includes a display unit 10 that displays images, and a control section 20 that controls display of the display unit 10 .

The display unit 10 includes a touch panel 11 and button switches 17 . The touch panel 11 includes a flat-type display device 13 such as a liquid crystal panel, and an operation position detection unit 15 that detects an operation position of an operation performed on the display device 13 . The operation position detected by the operation position detection unit 15 is the position on the touch panel 11 , specifically, coordinate information indicating the position of the touch panel 11 . The operations detected by the operation position detection unit 15 include touch operations and hover operations. A touch operation is an operation performed by touching the touch panel 11 with an operator such as a user's finger or a pointing device (an object having electrical conductivity). A hover operation is an operation performed in a hover state in which the operator is not touched on the touch panel 11 but is separated from the touch panel 11 by a predetermined distance.

The button switches 17 are hardware switches, and for example, a plurality of button switches 17 are provided in a housing (not shown) that houses the display unit 10 . The button switch 17 includes, for example, switches for turning on/off the power of the information processing apparatus 1 and operating various settings. The various settings include, for example, a setting for changing screens to be displayed in a plurality of sub-display areas, which will be described later, and a change in the number of screens to be displayed on the touch panel 11 .

The control unit 20 is an electronic circuit unit including a CPU (central processing unit) 30, a memory 40, various interface circuits (not shown), and the like.

The CPU 30 operates as a screen display control section 31 , an application execution section 32 and a hover operation detection section 33 by reading and executing programs (a control program 41 and an application program 42 ) stored in the memory 40 . Details of these functions will be described later.

The memory 40 is a storage device including at least one of a non-volatile storage device such as ROM (Read Only Memory) and flash ROM, and a volatile storage unit such as RAM (Random Access Memory). The memory 40 stores a control program 41 and an application program 42 executed by the CPU 30 . Also, the memory 40 functions as a work memory for the CPU 30 .

The control program 41 is a program for controlling the operation of the information processing apparatus 1 , and the application program 42 is a program for a specific purpose executed by the CPU 30 while the control program 41 is being executed by the CPU 30 .
The application program 42 is displayed as an application 42 below. The applications 42 include, for example, a navigation application (navigation application), a reproduction application for reproducing music data, moving image data, and still image data, a voice call application, a weather forecast application, a web browser application, and the like.

Operation signals are input to the control unit 20 from the operation position detection unit 15 and the button switch 17 . Screen display of the display unit 40 is controlled by a control signal output from the control section 20 to the display unit 40 .

A speaker 51, a storage device 52, a gyro sensor 53, a GPS (Global Positioning System) receiver 54, an FM (Frequency Modulation) multiplex receiver 55, a beacon receiver 56, and a vehicle communication section 57 are connected to the control section 20. .

The control unit 20 outputs an alarm sound, voice guidance, etc. through the speaker 51 .
The storage device 52 also stores map data 521 and content data 523 . The map data 521 is data including information on roads and facilities adjacent to the roads. The content data 523 is moving image data, still image data, and music data.

The gyro sensor 53 detects the angular velocity of the vehicle 5 and outputs a sensor signal indicating the detected angular velocity to the controller 20 . The GPS receiver 54 measures the position of the vehicle 5 (for example, the latitude and longitude of the vehicle) based on GPS signals received from GPS satellites, and outputs the measurement results to the control unit 20 .

The FM multiplex receiver 55 receives wide-area road traffic information transmitted from a broadcasting station (not shown) and outputs it to the control unit 20 . The beacon receiver 56 receives road traffic information in the vicinity of the vehicle 5 by a beacon (radio wave beacon, optical beacon) transmitted from a roadside device (not shown), and outputs the information to the control unit 20 . The vehicle communication unit 57 performs mutual communication (inter-vehicle communication) with another vehicle (not shown).

Next, the screen display control section 31, the application execution section 32 and the hover operation detection section 33 will be described.

2 and 3 are diagrams showing display examples of the touch panel 11. FIG.
The screen display control unit 31 divides the display area 100 of the touch panel 11 into a plurality of sub-display areas, and performs multiple-screen display control to display a screen in each of the plurality of divided sub-display areas. A display area 100 of the touch panel 11 is a display area of a display device 111 which is a liquid crystal panel. FIG. 2 shows an example in which the display area 100 is divided into four rectangular sub-display areas: a first sub-display area 110, a second sub-display area 120, a third sub-display area 130, and a fourth sub-display area 140. show.

The number of divisions into which the display area 100 is divided can be changed. For example, it is possible to divide the display area 100 into two sub-display areas, a first sub-display area 110 and a second sub-display area 120, or to divide the display area 100 into one display area. It is also possible to display one screen in this display area.

Also, the display size of the sub-display area can be changed. A cross point 170 is displayed at the contact point where the four sub-display areas meet. The user touches the display position of the cross point 170 with the operator, and moves the operator on the touch panel 11 while touching the touch panel 11 with the operator. In the display area 100, for example, as shown in FIG. 2, the lower left of the display area 100 is set as the origin, the horizontal direction of the display area 100 is the x axis, and the vertical direction of the display area 100 is the y axis. When the touch operation is detected, the operation position detection unit 15 outputs an operation signal including two-dimensional coordinates (x, y) indicating the touch position on the touch panel 11 as coordinate information to the screen display control unit 31 .

Screen display control section 31 changes the display position of cross point 170 and changes the display size of the four sub-display areas according to the operation signal input from operation position detection section 15 . Specifically, the screen display control unit 31 changes the display position of the crosspoint 170 so as to follow the movement of the operator, and the display position of the crosspoint 170 after change becomes the contact point of the four sub-display areas. Change the display size of each sub-display area as follows. FIG. 3 shows a state in which the display size of each sub-display area is changed by changing the display position of the cross point 170 from the display state of the touch panel 11 shown in FIG.

Further, by performing an operation to move the cross point 170 to the outside of the display area 100, the number of divisions of the display area 100 can be changed.
The user touches the display position of the cross point 170 with the operator, moves the operator on the touch panel 11 while touching, and moves the operator to the outside of the touch panel 11 . For example, it is assumed that the manipulator is moved from the inside to the outside of the display area 100 through the upper edge 151 (see FIG. 3), which is the upper edge of the display area 100 .

The screen display control section 31 detects the movement direction of the manipulator and the finally detected coordinates from the manipulation signal input from the manipulation position detection section 15 . The last detected coordinates are coordinates of the touch panel 11 last detected by the operation position detection unit 15 immediately before the operator moving on the touch panel 11 leaves the touch panel 11 .
If the detected moving direction of the manipulator is toward the upper side 151 and the finally detected coordinates are the coordinates of the upper side 151 or the coordinates near the upper side 151, the screen display control unit 31 displays the first sub-display. Area 110 and second sub-display area 120 are erased. In addition, screen display control section 31 divides display area 100 into two sub-display areas: third sub-display area 130 and fourth sub-display area 140 . The position in the x-axis direction separating the third sub-display area 130 and the fourth sub-display area 140 is the x-coordinate of the final touch position.

By the operation described above, the number of divisions into which the display area 100 is divided can be changed. Similarly, it is assumed that the manipulator touching the cross point 170 passes through the lower edge 152 (see FIG. 3) of the lower edge of the display area 100 and moves to the outside of the display area 100 . In this case, screen display control section 31 erases third sub-display area 130 and fourth sub-display area 140, and divides display area 100 into two sub-display areas, first sub-display area 110 and second sub-display area 120. Split into sub display areas.

Similarly, it is assumed that the operator touching the cross point 170 passes through the left edge 153 (see FIG. 3) at the left end of the display area 100 and moves to the outside of the display area 100 . In this case, screen display control section 31 erases first sub-display area 110 and third sub-display area 130 and divides display area 100 into two sub-display areas, second sub-display area 120 and fourth sub-display area 140 . Split into sub display areas.

Similarly, it is assumed that the operator touching the cross point 170 passes through the right edge 154 (see FIG. 3) at the right end of the display area 100 and moves to the outside of the display area 100 . In this case, screen display control section 31 erases second sub-display area 120 and fourth sub-display area 140 and divides display area 100 into two sub-display areas, first sub-display area 110 and third sub-display area 130 . Split into sub display areas.

When increasing the number of divisions into which the display area 100 is divided, for example, by pressing the button switch 17, the number of divisions of the display area 100 can be returned to the default setting of four. When the button switch 17 is pressed, the screen display control unit 31 divides the display area 100 equally into four sub-display areas 110, 120, 130 and 4. The display area 140 is divided into four sub-display areas.

Application execution unit 32 executes application program 42 to display a screen in each of first sub-display area 110 to fourth sub-display area 140 . The application execution unit 32 includes a navigation unit 321 , an audio/visual unit 322 , a tool unit 323 and an application unit 324 .

Navigation unit 321 is a functional unit that operates when CPU 30 executes a navigation app. The navigation unit 321 displays the navigation screen 111 shown in FIG. 2 or 3 in the first sub-display area 110. FIG. Also, the navigation unit 321 displays map data 521 including the road on which the vehicle 5 is traveling on the navigation screen 111 based on the detection signals of the gyro sensor 53 and the GPS receiver 54 and the map data 521 . Also, the navigation unit 321 displays road traffic information on the navigation screen 111 based on the information received by the FM multiplex receiver 55, the beacon receiver 56, and the vehicle communication unit 57. FIG. Also, the navigation unit 321 outputs voice guidance for notifying road traffic information from the speaker 51 .

Audio/visual unit 322 is a functional unit that operates when CPU 30 executes a reproduction application. The audio/visual unit 322 displays the audio/visual screen 121 shown in FIG. 2 or 3 on the second sub-display area 120 . The audio/visual unit 322 reproduces the content data 523 stored in the storage device 52 and displays the reproduction screen on the audio/visual screen 121 . The audio/visual unit 322 also has functions such as source selection and sound setting.

The tool unit 323 is a functional unit that operates when the CPU 30 executes the control program 41 and the phone application. The tool section 323 displays the tool screen 131 shown in FIG. 2 or 3 in the third sub-display area 130. FIG. The tool unit 323 displays the time on the tool screen 131 and displays on the tool screen 131 a child screen for making calls and making various settings.

Application unit 324 is a functional unit that operates when CPU 30 executes applications 42 such as a weather forecast and a web browser. The application unit 324 displays the application screen 141 shown in FIG. 2 or 3 in the fourth sub-display area 140. FIG. The application unit 324 executes the application selected by the user to display the application screen 141 .

The screens (navigation screen 111, audio/visual screen 121, tool screen 131 and application screen 141) displayed in each of the sub-display areas 110 to 140 can be changed. The screen display control unit 31 receives, for example, a touch operation or an operation of the button switch 17, and changes the screen displayed in each of the sub-display areas 110-140.

4 and 5 are explanatory diagrams for explaining the principle of detecting a hover operation.
Next, the operation when the operation position detection unit 15 detects a hover operation will be described. The touch panel 11 is a panel that detects an operation by a capacitive method, and includes a plurality of transmission electrodes 15a and reception electrodes 15b. Each of the transmission electrodes 15a and the reception electrodes 15b is arranged in a line at equal intervals on the lower portion of the touch panel 11 . The transmitting electrodes 15a and the receiving electrodes 15b are arranged so as to intersect each other in a grid pattern. 4 and 5 show portions of the transmitting electrode 15a and the receiving electrode 15b.

The operation position detection unit 15 is a detection unit that detects an operation position using the "mutual capacitance method". The operating position detector 15 generates an electric field using the transmitting electrode 15a and the receiving electrode 15b, and detects the operating position of the touch panel 11 by detecting changes in the electric field generated between the transmitting electrode 15a and the receiving electrode 15b.

A drive pulse is applied to the transmission electrode 15a. An electric field is generated between the transmission electrode 15a and the reception electrode 15b by applying the drive pulse to the transmission electrode 15a. When a conductive finger or the like is inserted into the generated electric field, part of the electric field moves to the fingertip side as shown in FIG. . The operation position detection unit 15 detects the approach of the fingertip by detecting this decrease in capacitance. Specifically, the operation position detection unit 15 detects the three-dimensional coordinates (x, y, z) as coordinate information. When detecting a hover operation, the operation position detection unit 15 detects not only the x-coordinate value and the y-coordinate value indicating the position of the touch panel 11, but also the coordinate value in the z-axis direction, which is the normal direction of the panel surface of the touch panel 11. . Based on the z-coordinate value output by the operation position detection unit 15, the hover operation detection unit 33 can determine whether the operator has moved closer to the touch panel 11 or moved away from it.

Note that when detecting a hover operation, the detection range of the operation position detection unit 15 in the direction parallel to the panel surface of the touch panel 11 is adjusted to be the same range as the display area 100 of the touch panel 11 . That is, adjustment is made so that the range outside the display area 100 is not detected. Further, the operation position detection unit 15 detects a hover operation, for example, using a range of 1 cm to 10 cm from the touch panel 11 as a detection range in the z-axis direction.

The hover operation detection section 33 detects the first hover operation and the second hover operation based on the coordinate information input from the operation position detection section 15 . A first hover operation is an operation of selecting one of the screens displayed in the display area 100 . In the following description, as shown in FIGS. 2 and 3, the display area 100 is divided into four parts, the navigation screen 111 in the first sub-display area 110, and the audio/visual screen 121 in the second sub-display area 120. , a case where a tool screen 131 is displayed in the third sub-display area 130 and an application screen 141 is displayed in the fourth sub-display area 140 will be described as an example.

When performing the first hover operation, the user first moves the operator over the display area 100 from outside to inside the display area 100 . At this time, the user moves the manipulator from the outside to the inside of the display area 100 so as to pass over the screen to be selected.

FIG. 6 is an explanatory diagram for explaining the first hover operation.
For example, when selecting the navigation screen 111, as shown in FIG. The manipulator is moved from the outside of the display area 100 to the inside.

When the hover operation detection unit 33 detects the coordinates of the edge of the touch panel 11 as the starting position of the hover operation, it is displayed in one of the plurality of sub-display regions based on the detected coordinates. select one of the screens. The hover operation detection unit 33 selects the first sub-display area 110, that is, the navigation screen 111, when coordinates included in either the upper side 113 or the left side 115 are detected as the base point position of the hover operation. The origin position is the position (coordinates) of the touch panel 11 detected by the operation position detection unit 15 as the initial coordinates of the hover operation.

Similarly, when selecting the audio/visual screen 121, the operator is moved over at least one of the upper side 123 and the right side 125, which are two sides of the audio/visual screen 121 that are not in contact with other screens. is moved from the outside of the display area 100 to the inside.
Further, when selecting the tool screen 131, the operator is moved in the display area 100 so as to pass over at least one of the lower side 133 and the left side 135, which are two sides of the tool screen 131 that are not in contact with other screens. Move from outside to inside.
Further, when selecting the application screen 141, the operator is moved in the display area 100 so as to pass over at least one of the lower side 143 and the right side 145, which are two sides of the application screen 141 that are not in contact with other screens. Move from outside to inside.

When the user moves the operator from the outside to the inside of the display area 100 , the operator further moves the operator and moves the operator above the confirmation area 180 .
The confirmation area 180 is a setting area preset for confirming the first hover operation. When the operation position detection unit 15 detects the coordinates within the confirmation area 180, the hover operation detection unit 33 confirms the first hover operation, and shifts to a state of accepting the second hover operation. Further, when the coordinates in the confirmation area 180 are not detected by the operation position detection unit 15, the hover operation detection unit 33 does not confirm the first hover operation and does not shift to the state of accepting the second hover operation.

The position and size of the defined area 180 can be set arbitrarily. FIG. 6 shows a case where the definite area 180 is set in the center of the display area 100, but as shown in FIG. Also, the size of the definite area 180 can be changed. However, when the size of the confirmation area 180 is set small, it may become difficult to perform an operation to confirm the first hover operation. In particular, since the driver cannot continue to visually recognize the touch panel 11 while driving, it is preferable to set the confirmation area 180 as wide as possible for operation during driving.

Further, when the first hover operation is confirmed, the hover operation detection unit 33 notifies the user of the determined screen selected by the first hover operation.
The hover operation detection unit 33 operates the touch panel 11 as a notification unit, and lights or blinks the edge of the screen determined to be selected. Also, the hover operation detection unit 33 may light up in different colors for each screen. For example, when determining that the navigation screen 111 has been selected, the hover operation detection unit 33 lights or blinks the edge of the navigation screen 111 in green. When determining that the audio/visual screen 121 has been selected, the hover operation detection unit 33 lights or blinks the edge of the audio/visual screen 121 in red. When determining that the tool screen 131 has been selected, the hover operation detection unit 33 lights or blinks the edge of the tool screen 131 in blue. When determining that the application screen 141 has been selected, the hover operation detection unit 33 lights or blinks the edge of the application screen 141 in white.

Further, the hover operation detection unit 33 may operate the speaker 51 as a notification unit and output sound from the speaker 51 to notify the user of the screen selected by the first hover operation. For example, when the navigation screen 111 is selected by the first hover operation, the speaker 51 outputs a message such as "You have selected the navigation screen 111."

When the user moves the manipulator above the confirmation area 180, the second hover operation is performed next. A second hover operation is an operation of selecting a function to be executed by the function unit. The functional units are the navigation unit 321, the audio/visual unit 322, the tool unit 323, and the application unit 324 shown in FIG.

The second hover operation is an operation of moving the operator in any one of the up, down, left, and right directions of the display area 100 with the confirmation area 180 as a starting point. Further, it is an operation of further moving the manipulator that has been moved in any of the up, down, left, and right directions of the display area 100 to move the manipulator to the outside of the display area 100 .

The hover operation detection section 33 determines the moving direction of the operator based on the operation signal input from the operation position detection section 15 . Further, when the coordinates of the manipulator last detected by the manipulation position detector 15 are the coordinates of the end of the movement direction in which the manipulator has moved, the hover operation detection unit 33 detects that the manipulator moves outside the display area 100 . It determines that it has moved, and confirms the second hover operation.

In addition, since the second hover operation is not confirmed until the manipulator is moved outside the display area 100, the user returns the manipulator that has been moved from the decision area 180 to the decision area 180 again, and moves it in another direction. You can move it to In this case, the hover operation detection unit 33, the coordinates of the operation element detected by the operation position detection unit 15, once, after moving out of the confirmation area 180, by returning to the confirmation area 180 again, selection reset once.

FIG. 8 is an explanatory diagram for explaining the second hover operation.
The direction in which the manipulator is moved by the second hover operation differs for each screen selected by the first hover operation. When the navigation screen 111 is selected by the first hover operation, an operation of moving the operator in the direction of the upper side 151 and the lower side 152 of the display area 100 as shown in FIG. 8 is set as the second hover operation. ing.
The hover operation detection section 33 determines the moving direction of the operator based on the operation signal input from the operation position detection section 15 . When the movement direction of the operator is the direction of the upper side 151 of the display area 100, the hover operation detection unit 33 causes the navigation unit 321 to change the display of the map from detailed display to wide-area display. Further, when the moving direction of the operator is the direction of the lower side 152 of the display area 100, the hover operation detection unit 33 causes the navigation unit 321 to change the display of the map from the wide area display to the detailed display.

Further, when the audio/visual screen 121 is selected by the first hover operation, the operation of moving the operator in all directions of the upper side 151, the lower side 152, the left side 153, and the right side 154 of the display area 100 is the second hover operation. is set as
The hover operation detection unit 33 instructs the audio/visual unit 322 to increase the volume of the sound output from the speaker 51 when the moving direction of the operator is the direction of the upper side 151 of the display area 100 . Further, the hover operation detection unit 33 instructs the audio/visual unit 322 to decrease the volume of the sound output from the speaker 51 when the moving direction of the operator is the direction of the lower side 152 of the display area 100 . Further, when the moving direction of the operator is the direction of the left side 153 of the display area 100, the hover operation detection unit 33 instructs the audio/visual unit 322 to reproduce the music immediately preceding the music being reproduced. In addition, when the moving direction of the operator is the direction of the right side 154 of the display area 100, the hover operation detection unit 33 instructs the audio/visual unit 322 to reproduce the music following the music being reproduced.

Further, when the tool screen 131 is selected by the first hover operation, an operation of moving the operator in the direction of the upper side 151 and the direction of the lower side 152 of the display area 100 is set as the second hover operation.
When the movement direction of the manipulator is the direction of the upper side 151 of the display area 100, the hover operation detection unit 33 instructs the tool unit 323 to change the display mode. When the display mode of the touch panel 11 is the daytime display mode, the tool unit 323 changes the display mode to the nighttime display mode. Moreover, when the display mode of the touch panel 11 is the nighttime display mode, the tool unit 323 changes the display mode to the daytime display mode.

Further, when the application screen 141 is selected by the first hover operation, an operation of moving the operator in the direction of the left side 153 and the direction of the right side 154 of the display area 100 is set as the second hover operation.
The hover operation detection unit 33 instructs the application unit 324 to change the application to be executed when the moving direction of the operator is the direction of the left side 153 or the right side 154 of the display area 100 . For example, the order is set in advance for the applications 42 stored in the memory 40 , and the application unit 324 puts the order 1 before the application 42 being executed when the moving direction of the operator is the direction of the left side 153 of the display area 100 . Run the previous application 42 . Further, when the movement direction of the operator is the direction of the right side 154 of the display area 100, the application unit 324 executes the application 42 that is one after the application 42 being executed.

FIGS. 6 to 8 show cases where the display area 100 is divided into four, but the hover operation can be similarly performed when the display area 100 is divided into two or when the display area 100 is not divided.
FIG. 9 shows a case where the display area 100 is divided into two, the navigation screen 111 is displayed in the first sub-display area 110 and the audio/visual screen 121 is displayed in the second sub-display area 120 . The user performs the first hover operation in the same way as when the display area 100 is divided into four. For example, when selecting the navigation screen 111 displayed on the left side as seen from the user side, the user passes over any one of the upper side 151, the lower side 152, and the left side 153 of the display area 100 and moves the operator to the display area 100. move from outside to inside. After that, the user moves the manipulator to the confirmation area 180 and performs the second hover operation set for each screen, as in the case of the four divisions. In the case of the navigation screen 111, by moving the operator in the direction of the upper side 151 of the display area 100, the map display is changed to the wide-area display, and by moving the operator in the direction of the lower side 152 of the display area 100, The map display is changed to detailed display.

FIG. 10 shows a case where the screen display control unit 31 displays only the navigation screen 111 on one screen in the display area 100 without performing multiple screen display control.
When the screen displayed in the display area 100 is one screen, there is no need to perform the first hover operation, which is the operation of selecting the screen. However, in order to prevent erroneous recognition of other operations, it is necessary to move the manipulator from outside to inside the display area 100 and further move the manipulator into the decision area 180 . The reason why the manipulator is moved into the confirmation area 180 is to shift the hover operation detection unit 33 to a state of accepting the second hover operation. Other operations include, for example, an operation of selecting software keys displayed on the navigation screen 111 . When the user selects a software key displayed on the screen, the user brings the operator closer to the display area 100 in the z-axis direction, that is, in the direction normal to the panel surface of the touch panel 11, and selects the software key displayed on the navigation screen 111. to select.

Note that it is also possible to cancel the selection of the screen and cancel the operation during the first hover operation and the second hover operation.
For example, the operation can be canceled by moving the operator outside the display area 100 without moving the operator into the confirmation area 180 during execution of the first hover operation. In addition, during execution of the second hover operation, the operation can be canceled by moving the operator in a direction not specified as the movement direction of the second hover operation. For example, the navigation screen 111 defines an operation of moving the operator in the direction of the upper side 151 or the direction of the lower side 152 as the second hover operation. In this case, the operation can be canceled by moving the operator in the direction of the left side 153 or the right side 154 of the display area 100 . Also, the operation can be canceled by moving the operator located above the confirmation area 180 in the z-axis direction, that is, in the normal direction of the touch panel 11 .

FIG. 11 is a flow chart showing the operation of the information processing apparatus 1. As shown in FIG.
First, the control unit 20 divides the display area 100 into a plurality of sub-display areas, and displays a screen in each of the plurality of divided sub-display areas (step S1). Step S1 corresponds to a "display step". In this flowchart, as shown in FIGS. 6 to 8, the display area 100 is also divided into four, and the navigation screen 111, the audio/visual screen 121, the navigation screen 111, the audio/visual screen 121, Description will be made assuming that the tool screen 131 and the application screen 141 are displayed.

Next, the control section 20 determines whether or not an operation signal is input from the operation position detection section 15 (step S2). If no operation signal is input (step S2/NO), the control unit 20 waits until an operation signal is input. Step S2 corresponds to an "operation position detection step".

Further, when an operation signal is input from the operation position detection unit 15 (step S2/YES), the control unit 20 determines whether the coordinate indicated by the coordinate information included in the input operation signal is any one of the top, bottom, left, and right of the display area 100. It is determined whether or not the coordinates are those of the end (step S3). If the input coordinates are not the coordinates of the end of the display area 100 (step S3/NO), the control unit 20 executes processing corresponding to the input coordinates and returns to step S2.

If the input coordinates are the coordinates of the end of the display area 100 (step S3/YES), the control unit 20 selects one of the screens based on these coordinates (step S4). The control unit 20 selects a screen in which the input coordinates are included in the coordinates of the edge of the screen.

Next, the control unit 20 determines whether or not the coordinates of the definite area 180 are detected by the operation position detection unit 15 (step S5). Steps S3 and S5 correspond to a "hover operation detection step". The control unit 20 determines whether or not the coordinate information included in the operation signal input from the operation position detection unit 15 has the coordinates of the definite area 180 . Control part 20 judges whether there is an input of an operation signal from operation position primary detecting element 15, when the coordinates of decision field 180 are not detected (Step S5/NO) (Step S6).

If no operation signal is input (step S6/NO), the control unit 20 cancels the selection of the screen (step S7) and returns to step S2. For example, when the user moves the manipulator in the z-axis direction, specifically when the manipulator is removed from the touch panel 11, the operating position detection unit 15 cannot detect the operating position of the touch panel 11. In this case, the control unit 20 cancels the screen selection and restarts the process from the beginning. In addition, when canceling the selection of the screen, the control unit 20 preferably outputs a voice indicating that the selection of the screen is canceled from the speaker 51 to perform a notification operation. Although not described in this flowchart, even when the operation position detection unit 15 detects a touch operation in which an operator touches the touch panel 11, the control unit 20 cancels the selection of the screen and proceeds to the determination in step S2. return. Also, if there is an input of the operation signal (step S6/YES), the control unit 20 returns to the determination of step S5 and continues the processing according to the flowchart.

Further, when the coordinates of the confirmation area 180 are detected (step S5/YES), the control unit 20 confirms the first hover operation and shifts to a state of accepting the second hover operation. Furthermore, the control unit 20 lights or blinks the edge of the screen selected in step S4 in a preset color (step S8), and outputs a sound indicating that the selected screen has been selected from the speaker 51 ( step S9).

Next, the control unit 20 determines whether or not movement of the operator in the direction preset as the second hover operation has been detected on the selected screen based on the operation signal input from the operation position detection unit 15. (step S10). If movement in the set direction is not detected (step S10/NO), the control unit 20 determines whether or not an operation signal is input from the operation position detection unit 15 (step S11).

If no operation signal is input (step S11/NO), the control unit 20 cancels the screen selection (step S12) and returns to step S2. For example, when an operation of moving the operator in the direction of the left side 153 or the right side 154 of the display area 100 is specified as the second hover operation, the operation signal input from the operation position detection unit 15 detects the It is assumed that the operation to move the manipulator in the direction of the upper side 151 or the direction of the lower side 152 is detected. In this case, the manipulator moves outside the display area 100 and the input of the manipulation signal from the manipulation position detector 15 disappears. Therefore, the control unit 20 determines that the selection of the screen has been canceled, and cancels the selection of the screen. At this time, when canceling the selection of the screen, the control unit 20 preferably performs a notification operation by outputting a voice indicating that the selection of the screen is canceled from the speaker 51 . Also, if there is an input of the operation signal (step S11/YES), the control unit 20 returns to the determination of step S10 and continues the processing according to the flowchart.

Further, when the control unit 20 detects movement of the operator in the direction preset as the direction of the second hover operation on the selected screen (step S10/YES), the operation position detection unit 15 outputs an operation signal. It is determined whether or not the input has stopped (step S13). By determining that the operator has moved outside the display area 100, the control unit 20 determines whether or not the input of the operation signal from the operation position detection unit 15 has stopped in order to confirm the second hover operation. (step S13). Steps S10 and S13 correspond to a "hover operation detection step". If the input of the operation signal from the operation position detection unit 15 has not stopped (step S13/NO), the control unit 20 waits until the input of the operation signal stops. Further, when the input of the operation signal is stopped (step S13/YES), the control unit 20 executes the process associated with the movement direction detected in step S10 (step S14).

As described above, the information processing apparatus 1 of this embodiment includes the touch panel 11 , the screen display control section 31 , the operation position detection section 15 and the hover operation detection section 33 .
The screen display control unit 31 divides the display area 100 of the touch panel 11 into a plurality of sub-display areas 110-140, and controls the screen display of each of the sub-display areas 110-140.
The operation position detection unit 15 detects the operation position of the operation performed on the touch panel 11 by the operator in the hover state.
The hover operation detection unit 33 detects a hover operation based on the operation position detected by the operation position detection unit 15, and executes processing corresponding to the detected hover operation. In addition, the hover operation detection unit 33 detects the movement of the operator from the end of the touch panel 11 to the predetermined confirmation area 180 of the touch panel 11 as the first hover operation, and detects the touch panel that is the starting point of the first hover operation. One of the plurality of sub-display areas 110 to 140 is selected based on the position of the edge of 11 .
Therefore, by moving the manipulator from the end of the touch panel 11 to the predetermined confirmation area 180 of the touch panel 11, one of the plurality of sub-display areas can be selected. Therefore, it is possible to improve the operability of the touch panel 11 on which a plurality of screens are displayed.

In addition, the hover operation detection unit 33 selects a selectable process on the screen displayed in the selected sub-display area when the position within the confirmation area 180 is detected as the end point of the first hover operation. 2 It is good also as a structure which shifts to the state which can accept hover operation.
Therefore, by moving the manipulator into the confirmation area 180 as the end point of the first hover manipulation, the information processing apparatus can be shifted to a state in which the second hover manipulation can be accepted.

Further, the hover operation detection unit 33 detects movement of the operator in a preset direction from the confirmation area 180 as a second hover operation, identifies the moving direction of the operator in the second hover operation, and identifies The process associated with the moving direction is executed.
Therefore, by moving the manipulator from the defined area 180 in a preset direction, the process associated with this direction can be executed.

Further, when an operator that moves in a preset direction moves outside the touch panel 11, the hover operation detection unit 33 confirms the second hover operation, and executes processing associated with the identified movement direction. Let
Therefore, by moving the operator to the outside of the touch panel 11, the second hover operation can be confirmed.

The information processing device 1 also includes a touch panel 11 and a speaker 51 that operate as a notification unit. The hover operation detection unit 33 executes a notification operation corresponding to the selected sub-display areas 110 to 140 when detecting the first hover operation.
Therefore, the selected sub-display areas 110 to 140 can be notified to the user, and the user can judge whether or not the operation is erroneous.

Further, when the hover operation detection unit 33 detects the first hover operation, the hover operation detection unit 33 causes the selected sub-display area of the touch panel 11 to display a preset display color as a notification operation.
Therefore, the selected sub-display areas 110 to 140 can be notified to the user, and the user can judge whether or not the operation is erroneous.

Further, when the hover operation detection unit 33 detects the first hover operation, the hover operation detection unit 33 causes the speaker 51 to output a sound notifying of the screen displayed in the selected sub-display area as a notification operation.
Therefore, the selected sub-display areas 110 to 140 can be notified to the user, and the user can judge whether or not the operation is erroneous.

Further, the hover operation detection unit 33 detects the end of the touch panel 11 as the operation position by the operation position detection unit 15, but if the position within the confirmation area 180 cannot be detected as the operation position, the hover operation is changed to the first hover operation. not detected as
Therefore, if an erroneous operation is performed, the first hover operation can be canceled halfway.

Further, the hover operation detection unit 33 cancels the selection of the sub-display areas 110 to 140 when the operation position detection unit 15 cannot detect the operation position of the operator after detecting the first hover operation.
Therefore, when an erroneous operation is performed, the first hover operation can be canceled halfway.

Further, the hover operation detection unit 33 cancels the selection of the sub-display area when the moving direction of the operator detected after the detection of the first hover operation is not the moving direction set as the second hover operation.
Therefore, if an erroneous operation is performed, the second hover operation can be canceled halfway.

Further, when canceling the selection of the sub-display area, the hover operation detection unit 33 causes the speaker to output a sound notifying the cancellation of the selection.
Therefore, it is possible to notify the user that the second hover operation has been cancelled.

The embodiments described above are preferred embodiments of the present invention. However, without being limited to the above-described embodiment, various modifications can be made without departing from the gist of the present invention. For example, in the above-described embodiment, starting from the confirmation area 180, the operation of moving the operator in any direction up, down, left, or right of the touch panel 11 was described as the second hover operation, but other movements of the operator Can be set as a secondary hover action. At this time, when the vehicle 5 is running, it is preferable that an operation that restricts the operation cannot be set as the second hover operation. Also, it is preferable not to assign a function whose execution is restricted while the vehicle is running to the second hover operation.

Further, FIG. 1 is a schematic diagram showing the functional configuration of an information processing device 1 classified according to main processing contents for easy understanding of the present invention. Depending on the content, it can also be classified into more components. Also, one component can be grouped to perform more processing. Also, the processing of each component may be executed by one piece of hardware, or may be executed by a plurality of pieces of hardware. Also, the processing of each component may be implemented by one program or may be implemented by a plurality of programs.

In the control unit 20 shown in FIG. 1, a program executed by the CPU 30 is downloaded from an external server via a communication network, for example, loaded onto a memory 40 such as a RAM, and executed by the CPU. can be Alternatively, the program may be directly loaded from an external server into the memory 40 such as a RAM and executed by the CPU 30 via a communication network. Alternatively, it may be loaded onto the memory 40 such as RAM from a storage medium connected to the control unit 20 .

In addition, the processing unit of the flowchart shown in FIG. 11 is divided according to the main processing contents in order to facilitate understanding of the processing by the control unit 20 . The present invention is not limited by the division method or name of the processing unit. The processing of the control unit 20 can also be divided into more processing units according to the content of the processing. Also, one processing unit can be divided to include more processing. Further, the order of processing in each flowchart is not limited to the illustrated example, as long as similar processing results can be obtained.

Reference Signs List 1 information processing device 5 vehicle 11 touch panel 13 display device 15 operation position detection unit 15a transmission electrode 15b reception electrode 17 button switch 20 control unit 30 CPU
31 screen display control unit 32 application execution unit 33 hover operation detection unit 40 memory 41 control program 42 application 42 application program 51 speaker 52 storage device 53 gyro sensor 54 GPS receiver 55 FM multiplex receiver 56 beacon receiver 57 vehicle communication unit 110 first sub-display area 110 sub-display area 111 navigation screen 113 upper side 115 left side 120 second sub-display area 121 audio/visual screen 130 third sub-display area 131 tool screen 140 fourth sub-display area 141 application screen 170 cross point 180 Fixed area 321 navigation unit 322 audio/visual unit 323 tool unit 324 application unit 521 map data 523 content data

Claims (20)

a touch panel;
a screen display control unit that divides the display area of the touch panel into a plurality of sub-display areas and controls screen display of each sub-display area;
an operation position detection unit that detects an operation position of an operation performed on the touch panel by an operator in a hover state;
a hover operation detection unit that detects a hover operation based on the operation position detected by the operation position detection unit and executes processing corresponding to the detected hover operation,
The hover operation detection unit detects movement of the operator from an end of the touch panel to a preset setting area of the touch panel as a first hover operation, and detects the touch panel as a starting point of the first hover operation. selecting one of the plurality of sub-display areas based on the position of the end of the
The information processing apparatus , wherein the selection of the sub-display area is canceled when the operation position detection unit cannot detect the operation position of the operator after the detection of the first hover operation . The hover operation detection unit selects a selectable process on the screen displayed in the selected sub-display area when a position within the setting area is detected as the end point of the first hover operation. 2. The information processing apparatus according to claim 1, wherein the apparatus shifts to a state in which a hover operation can be accepted. The hover operation detection unit detects movement of the operator in a preset direction from the set area as the second hover operation, and specifies a moving direction of the operator in the second hover operation. 3. The information processing apparatus according to claim 2, wherein the processing associated with the identified moving direction is executed. The hover operation detection unit confirms the second hover operation when the operator moving in the preset direction moves outside the touch panel, and performs processing associated with the identified movement direction. 4. The information processing apparatus according to claim 3, wherein Equipped with a notification unit,
5. The hover operation detection unit, when detecting the first hover operation, causes the notification unit to perform a notification operation corresponding to the selected sub-display area. The information processing device according to item 1. 6. The method according to claim 5, wherein, when the first hover operation is detected, the hover operation detection unit causes the selected sub-display area to display a preset display color as the notification operation. information processing equipment. The hover operation detection unit, when detecting the first hover operation, causes the speaker to output a sound notifying of the screen displayed in the selected sub-display area as the notification operation. Item 6. The information processing apparatus according to item 5. The hover operation detection unit changes the hover operation to the first hover operation when the operation position detection unit detects an end portion of the touch panel as an operation position but cannot detect a position within the setting area as an operation position. 8. The information processing apparatus according to any one of claims 1 to 7, wherein the detection is not performed as The hover operation detection unit cancels the selection of the sub-display area when the moving direction of the operator detected after the detection of the first hover operation is not the moving direction set as the second hover operation. 5. The information processing apparatus according to any one of claims 2 to 4, characterized by: 10. The information processing apparatus according to claim 1 , wherein, when canceling the selection of the sub-display area, the hover operation detection unit causes a speaker to output a sound notifying the cancellation of the selection. a display step of displaying a screen in each display area of the touch panel divided into a plurality of sub-display areas;
an operation position detection step of detecting an operation position of an operation performed on the touch panel by an operator in a hover state;
a hover operation detection step of detecting a hover operation based on the operation position detected by the operation position detection step and executing a process corresponding to the detected hover operation;
The hover operation detection step detects movement of the operator from an end portion of the touch panel to a preset setting area of the touch panel as a first hover operation, and detects the touch panel as a starting point of the first hover operation. selecting one of the plurality of sub-display areas based on the position of the end of the
The information processing method , wherein the selection of the sub-display area is canceled when the operation position of the manipulator cannot be detected by the operation position detection step after the detection of the first hover operation . The hover operation detecting step selects a selectable process on the screen displayed in the selected sub-display area when a position within the setting area is detected as the end point of the first hover operation. 12. The information processing method according to claim 11 , further comprising shifting to a state in which a hover operation can be received. The hover operation detection step detects movement of the operator in a preset direction from the set area as the second hover operation, and specifies a movement direction of the operator in the second hover operation. 13. The information processing method according to claim 12 , further comprising executing a process associated with the identified movement direction. In the hover operation detection step, when the operator moving in the preset direction moves outside the touch panel, the second hover operation is confirmed, and processing associated with the specified movement direction. 14. The information processing method according to claim 13 , wherein 15. The method according to any one of claims 11 to 14 , wherein the hover operation detecting step causes a notification unit to perform a notification operation corresponding to the selected sub-display area when the first hover operation is detected. The information processing method according to the item. 16. The method according to claim 15 , wherein the hover operation detecting step displays a preset display color in the selected sub-display area as the notification operation when the first hover operation is detected. information processing method. The hover operation detection step causes a speaker to output, as the notification operation, a sound notifying a screen displayed in the selected sub-display area when the first hover operation is detected. Item 16. The information processing method according to item 15 . The hover operation detection step detects the end of the touch panel as the operation position by the operation position detection step, but determines the hover operation as the first hover operation when a position within the setting area cannot be detected as the operation position. 18. The information processing method according to any one of claims 11 to 17 , wherein detection is not performed. The hover operation detecting step cancels selection of the sub-display area when the moving direction of the operator detected after the detection of the first hover operation is not the moving direction set as the second hover operation. 15. The information processing method according to any one of claims 12 to 14 , characterized in that: 20. The information processing method according to claim 11 , wherein, when canceling the selection of the sub-display area, the hover operation detecting step causes a speaker to output a voice notifying the cancellation of the selection.

Images