JP7439699B2 - Vehicle display device - Google Patents

Description

The present invention relates to a display device for a vehicle.

As a conventional display device for a vehicle, Patent Document 1 describes one that includes a display section that displays an image, a touch panel provided in front of the display section, and a vibration section that vibrates the panel.

Further, as a technique for vibrating a panel, Patent Document 2 describes a technology that vibrates the panel in response to a touch operation performed by the user on the touch panel, thereby providing feedback that can be perceived by the user's senses (hereinafter referred to as sensory feedback). ) has been described that applies haptics.

JP2018-72930A Patent No. 6032657

In the structure of the vehicle display device described in Patent Document 1, there is a panel device in front of the display section, so when viewing a predetermined position of the display section, if the user's line of sight is in a direction tilted from the front of the display section, , parallax occurs with respect to the predetermined position. In particular, in a vehicle in which the device is used, the above-mentioned parallax is likely to occur depending on the position and type of user (eg, type of driver, passenger, etc.). When haptics is applied to this type of structure, due to the above-mentioned parallax, the position where the control system accepts the touch operation and provides sensory feedback in the form of vibrations and the position where the user performs the touch operation may be misaligned, resulting in an appropriate There is a risk that sensory feedback may not be possible.

The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide a display device for a vehicle that can appropriately perform sensory feedback in response to a touch operation.

In order to achieve the above object, a vehicle display device according to the present invention includes:
a display section that displays images on a screen;
an operation detection unit that detects a touch operation performed by a user on an effective area set on the screen;
a vibration control unit capable of applying vibration to a specific position included in the effective area in response to the operation detection unit detecting the touch operation performed on the effective area;
a user estimation unit that estimates a user position that is a position of the user with respect to the display unit;
The vibration control unit is capable of correcting the specific position according to the user position estimated by the user estimation unit, and when the specific position is corrected, the vibration control unit applies vibration to the corrected position that is the corrected position. give.

According to the present invention, sensory feedback for touch operations can be appropriately performed.

1 is a block diagram of a vehicle display system including a vehicle display device according to an embodiment of the present invention. FIG. 2 is a schematic diagram showing the interior of a vehicle in which the vehicle display system according to the embodiment is mounted. FIG. 3 is a schematic cross-sectional view of the display unit according to the embodiment. FIG. 3 is a diagram showing an example of a display image according to the embodiment same as the above, and is a diagram for explaining a vibration position. FIG. 3 is a diagram for explaining the configuration of the seat condition monitoring device according to the embodiment. (a) to (c) are diagrams for explaining an example of a user position estimation method according to the embodiment. A schematic diagram for explaining parallax. The flowchart which shows an example of the sensory feedback process based on embodiment same as the above. A flowchart showing an example of vibration position correction processing according to the embodiment same as above. (a) and (b) are figures for explaining a modification of the embodiment same as the above.

An embodiment of the present invention will be described with reference to the drawings.

The vehicle display device 10 according to this embodiment constitutes a part of the vehicle display system S, as shown in FIG. The vehicle display system S is mounted on the vehicle 1 and includes a vehicle display device 10, a line of sight detection device 20, a seat condition monitoring device 30, and a mirror condition monitoring device 40. The vehicle display system S displays various information on the vehicle display device 10 by communicating with each other.

The vehicle display device 10 integrally displays to the user U not only information regarding the vehicle 1 (hereinafter referred to as vehicle information), but also information other than vehicle information. Further, the vehicle display device 10 can be operated by a touch operation using the user's U's finger F (see FIG. 2). As shown in FIG. 2, the touch operation can be performed by both the driver U1 seated in the driver's seat 2 of the vehicle 1 and the fellow passenger U2 seated in the passenger seat 3. In this embodiment, it is assumed that the vehicle 1 is an RHD (Right Hand Drive).

The vehicle display device 10 includes a display unit 100 and a control device 200, as shown in FIG.

The display unit 100 is, for example, a CID (Center Information Display), and as shown in FIG. 2, it is provided in the interior of the vehicle 1 at a position that is visible to both the driver U1 and the passenger U2. The display unit 10 is provided, for example, on the dashboard 4 (instrument panel).

The display unit 100 includes a display section 110, a touch sensor 120, and a vibration generation section 130, as shown in FIGS. 1 and 3. The display unit 100 also includes a case 140, a holder 150, a cover glass 160, and an elastic support 170, as shown in FIG.

The display unit 110 includes an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), etc., and displays an image on the front surface 110a under the control of the control device 200. Considering the entire display unit 100, an image displayed on the front surface 110a of the display section 110 is displayed on the screen 100a of the display unit 100 after passing through a touch sensor 120 and a cover glass 160, which will be described later. That is, the display unit 110 displays an image on the screen 100a. In this embodiment, the screen 100a corresponds to the surface of a cover glass 160, which will be described later. The display unit 110 has, for example, a rectangular shape when viewed from the front.

The touch sensor 120 is, for example, a capacitive sensor sheet, and sends touch information to the control device 200 indicating that the finger F of the user U has contacted the screen 100a (more precisely, the surface of the cover glass 160, which will be described later). supply The touch information also includes a touch position indicating a position touched by the finger F on the screen 100a. The touch sensor 120 has translucency, is located in front of the display unit 110, and is provided over a range corresponding to the screen 100a.

The vibration generator 130 applies vibration to any position on the screen 100a under the control of the control device 200. As shown in FIG. 3, the vibration generator 130 is composed of a plurality of vibrators 131 installed on the outer bottom surface of a holder 150, which will be described later. The vibrator 131 is composed of a known vibration actuator such as a linear resonance actuator type, an eccentric rotating mass type, or a piezo actuator type. Each vibrator 131 is selectively driven under the control of the control device 200, and as shown in FIG. ing. In this embodiment, the vibrating positions P are set in a matrix. Note that the number of vibrators 131 and the locations at which they are installed are arbitrary as long as vibration can be applied to a desired vibrating position P, and known techniques can be adopted as appropriate. For example, the vibrator 131 may be installed at the end of the cover glass 160. Furthermore, the vibrator 131 may be installed at a position on the cover glass 160 overlapping the display section 110 as long as the visibility of the image displayed by the display section 110 is not hindered.

The case 140 is made of resin and has an open box shape. Case 140 is fixed to dashboard 4.

The holder 150 holds the display section 110, is made of metal or resin, and has a box shape that opens in the same direction as the case 140. Holder 150 is housed within case 140.

The cover glass 160 is a plate-shaped member made of a translucent resin such as polymethyl methacrylate resin (PMMA), for example. The cover glass 160 is installed in the holder 150 in such a manner that it closes the opening of the holder 150. The touch sensor 120 is stacked on the back surface of the cover glass 160. That is, the touch sensor 120 is located between the cover glass 160 and the display section 110. For example, the touch sensor 120 faces the display unit 110 with a slight distance therebetween.

The elastic support body 170 supports the holder 150 with respect to the case 140, and is located, for example, between the outer circumferential side of the holder 150 and the inner circumferential side of the case 140. Thereby, the holder 150 is supported in a floating state within the case 140. The elastic support body 170 is made of an elastic material such as rubber, elastomer, or spring. When the vibration generating section 130 vibrates, the holder 150, the display section 110, the touch sensor 120, and the cover glass 160 vibrate as an integrated body. In other words, the vibration of the vibration generator 130 causes the cover glass 160 forming the screen 100a to vibrate. The elastic support body 170 allows the vibration of this integrated body and suppresses the vibration from being transmitted to the case 140.

Returning to FIG. 1, the control device 200 is composed of a microcomputer that controls the overall operation of the vehicle display device 10, and includes a control section 210 composed of a CPU (Central Processing Unit) and the like, a ROM (Read Only Memory), The storage unit 220 includes a RAM (Random Access Memory) and the like. The ROM of the storage unit 220 stores various data such as a program PG for executing sensory feedback processing to be described later, correction amount calculation data D1, vibration pattern data D2, and the like. Further, the ROM of the storage unit 220 stores image parts data for generating a display image on the display unit 110. The control device 200 also includes a drive circuit for driving each of the display section 110, the touch sensor 120, and the vibration generation section 130, and an input/output circuit for communicating with the outside of the vehicle display device 10, as components not shown. Equipped with etc. Note that the configuration and arrangement of the control device 200 may be arbitrary as long as it satisfies the functions described below. For example, control device 200 may be implemented by multiple computers that communicate with each other.

The line-of-sight detection device 20 has a known configuration for detecting the line-of-sight direction of the user U, and includes an imaging unit including an infrared camera, a stereo camera, a TOF (Time of Flight) camera, etc. and a line-of-sight analysis unit that analyzes the data). The imaging range of the imaging unit is set to a range in which both the driver U1 and the passenger U2 can be imaged. The line-of-sight analysis unit identifies the line-of-sight direction of the user U and the viewpoint position of the user U by analyzing the image data using a known method such as a pattern matching method, and transmits line-of-sight information indicating these to the control device 200. . Note that the viewpoint position may be a representative position of both eyes of the user U (for example, the center of gravity of both eyes), or may be a position of each of the left and right eyes.

As shown in FIG. 5, the seat condition monitoring device 30 is a device that monitors the condition of the seat 5, and includes a first pressure sensor 31, a second pressure sensor 32, and a seat position sensor 33. The first pressure sensor 31 detects the pressure applied to the backrest of the seat 5 (hereinafter referred to as seatback pressure). The second pressure sensor 32 detects the pressure (hereinafter referred to as cushion pressure) applied to the cushion portion of the seat 5 (the position on which the user U's buttocks rest). The seat position sensor 33 detects the position of the seat 5 in the longitudinal direction (hereinafter referred to as the seat position). The seat condition monitoring device 30 transmits seat information indicating seat back pressure, cushion pressure, and seat position to the control device 200. Note that the seat condition monitoring device 30 can transmit seat information for each of the driver's seat 2 and the passenger seat 3 to the control device 200.

The mirror condition monitoring device 40 is a device that monitors the condition of a rear view mirror provided in the vehicle 1. For example, the mirror state monitoring device 40 transmits to the control device 200 mirror state information indicating the respective postures of the room mirror 6 (indoor rear view mirror) and the door mirror 7 (outdoor rear view mirror) shown in FIG. The attitude is, for example, the tilt of each mirror that can be adjusted by the user U. For example, the mirror condition monitoring device 40 includes a gyro sensor provided on each mirror. Note that when the rear view mirror is a digital mirror that displays a rearward image of the vehicle 1 using a camera (not shown), the mirror state information may indicate the angle of the camera.

The line of sight detection device 20, the seat condition monitoring device 30, and the mirror condition monitoring device 40 directly transmit the various types of information (hereinafter also referred to as monitoring information) or communicate with an ECU (Electronic Control Unit) that controls each part of the vehicle 1. The information is transmitted to the control device 200 via the host computer.

As shown in FIG. 1, the control unit 210 includes a display control unit 211, an operation detection unit 212, a vibration control unit 213, and a user estimation unit 214 as main functions.

The display control unit 211 controls the operation of the display unit 110 and displays an image on the screen 100a. Image G shown in FIG. 4 shows an example of an image displayed on the screen 100a. The image G includes operation icon images G1 and G2 that indicate objects that can be operated by the user U through a touch operation. Note that the display control unit 211 can switch the display content of the image G according to instructions from the operation detection unit 212.

The operation detection unit 212 detects a touch operation based on touch information from the touch sensor 120. Note that the touch operation refers to an operation performed on a predetermined device (including the display unit 110) by the user's U's finger F touching or coming close to the screen 100a. The operation detection unit 212 determines whether the detected touch operation is performed on the valid area set on the screen 100a. In the following, in order to facilitate understanding of the explanation, it is assumed that the touch position that can be detected by the touch sensor 120 corresponds to the vibration possible position P shown in FIG. 4 . In reality, the settings of the resolution of the touch sensor 120 and the vibrating positions P are arbitrary, and the coordinates indicating the touch positions set on the touch sensor 120 are finer than the vibrating positions P shown in FIG. Of course, this is a good thing.
In the example shown in FIG. 4, the effective area A1 for the touch operation by the user U on the operation icon image G1 is the position (2, 2) in the second row and second column, the position (2, 3) in the second row and third column, It is set in an area consisting of three squares at the position (2, 4) of the 2nd row and 4th column. If the operation detection unit 212 determines that a touch operation has been performed on the effective area A1, it assumes that an operation has been performed on the operation icon image G1 and instructs the display control unit 211 to switch the display content, A signal indicating the operation content is output to the operation target. The operation icon image G1 is an image indicating that a music player (not shown) can be operated. Therefore, when an operation is performed on the operation icon image G1, the operation detection unit 212 instructs the display control unit 211 to switch to a screen showing detailed display regarding the music player, or sends a signal to the music player instructing the music player to play music. or output.
In addition, the effective areas A2 for the touch operation by the user U on the operation icon image G2 are the position (4, 2) of the 4th row and 2nd column, the position (4, 3) of the 4th row and 3rd column, and the position (4, 3) of the 4th row and 4th column. It is set in an area consisting of three squares at position (4, 4). When the operation detection unit 212 determines that a touch operation has been performed on the effective area A2, it assumes that an operation has been performed on the operation icon image G2, and instructs the display control unit 211 to switch the display content, A signal indicating the operation content is output to the operation target. The operation icon image G2 is an image indicating that the car navigation device (not shown) can be operated. Therefore, when an operation is performed on the operation icon image G2, the operation detection unit 212 instructs the display control unit 211 to switch to a screen that displays details regarding the car navigation device, or performs various setting operations regarding the car navigation device. output a signal indicating the

The vibration control unit 213 selectively drives the vibrator 131 that constitutes the vibration generation unit 130 in response to the operation detection unit 212 detecting a touch operation performed on the effective area, and Gives vibration to specific locations included. Thereby, the user U who performed the touch operation can intuitively understand that the touch operation performed by the user U has been accepted by the vibration generated at a specific position on the screen 100a and transmitted to the finger F. For example, when a touch operation is performed on the effective area A1 shown in FIG. 4, the vibration control unit 213 applies vibration to a specific position Pv1 included in the effective area A1. The specific position Pv1 is set to the position (2, 3) in the second row and third column. Furthermore, when a touch operation is performed on the effective area A2 shown in FIG. 4, the vibration control unit 213 applies vibration to a specific position Pv2 included in the effective area A2. The specific position Pv2 is set to the position (4, 3) in the 4th row and 3rd column.

Here, depending on the position of the user U, the parallax described in the above problem occurs. For example, if a related image related to the target of the touch operation (such as the operation icon image G1 described above) is displayed at the display position Pd of the display unit 110 shown in FIG. If the related image is located in a direction shifted from the front of the screen 100a, the user U will visually recognize the related image at a position shifted in that direction from the display position Pd due to parallax. In this case, when the vibration control unit 213 applies vibration to a specific position Pv (such as the above-mentioned specific position Pv1), there is a possibility that the finger F of the user U is touching a position that is shifted from the specific position Pv on the screen 100a. There is a possibility that the vibration as sensory feedback cannot be appropriately transmitted to the user F. Note that a normal line N shown in FIG. 7 indicates a normal line to the screen 100a.
To explain more specifically, for example, when the user U is the driver U1, even though the vibration control unit 213 applies vibration to the specific position Pv1 (2, 3) shown in FIG. There is a possibility that the finger F1 of U1 (see FIG. 2) is touching the position (2, 4) shown in FIG. Further, when the user U is the passenger U2, as sensory feedback, even though the vibration control unit 213 has applied vibration to the specific position Pv1 (2, 3) shown in FIG. 2) may be touching the position (2, 2) shown in FIG. That is, the positional shift phenomenon of sensory feedback due to parallax occurs depending on the user position Pu. Note that the user position Pu can be estimated by a user estimation unit 214, which will be described later.

Based on the above phenomenon, the vibration control unit 213 can correct the specific position Pv at which vibration is applied according to the user position Pu, and when the specific position Pv is corrected, as shown in FIG. Vibration is applied to a certain correction position Pa. As an example, the vibration control unit 213 obtains the correction position Pa using the method described below.

First, the vibration control unit 213 calculates the coordinates of the user position Pu estimated by the user estimation unit 214 and the related images (the above-mentioned operation icon image G1, etc.) in a three-dimensional coordinate system set in advance in the interior of the vehicle 1. A straight line L connecting the coordinates of the display position Pd is determined. The straight line L corresponds to the user's U line of sight. Then, the vibration control unit 213 calculates the intersection of the screen 100a and the straight line L, and sets the position corresponding to the calculated intersection as the correction position Pa. Specifically, the vibration control unit 213 sets the position including the calculated intersection among the plurality of vibration possible positions P shown in FIG. 4 as the corrected position Pa. That is, the specific position Pv is corrected by the correction amount ΔP from the specific position Pv to the correction position Pa. The correction amount ΔP is a vector amount in the in-plane direction of the screen 100a.
To explain using the example shown in FIG. 4, when the corrected position Pa after correction of the specific position Pv1 (2, 3) is (2, 4), the correction amount ΔP is changed from the position (2, 3) to the position ( 2,4). When the corrected position Pa after correction of the specific position Pv1 (2, 3) is (1, 4), the correction amount ΔP is the amount shifted from the position (2, 3) to the position (1, 4). . That is, the vibration control unit 213 sets a position obtained by shifting the specific position Pv toward the user position Pu as the corrected position Pa in the in-plane direction of the screen 100a.
As described above, the mathematical data for calculating the correction position Pa and the correction amount ΔP is stored in advance in the ROM of the storage unit 220 as the correction amount calculation data D1. Note that the correction amount calculation data D1 may be table data in which a combination of coordinates of the user position Pu and the display position Pd is associated with the correction position Pa.

Further, the vibration control unit 213 changes the pattern of vibration applied to the specific position Pv or the correction position Pa according to the type of the user U estimated by the user estimation unit 214 described below. For example, if the prime mover of the vehicle 1 consisting of an engine or a motor is located in front of the driver's seat 2 of the vehicle 1, some types of vibration may interfere with the vibrations of the prime mover, making it difficult for the vibrations to be transmitted as sensory feedback to the user U. There is a possibility that this will happen. Therefore, when the estimated type of user U is the driver U1, a different pattern of vibration is applied to the specific position Pv or the correction position Pa than when the user U is the fellow passenger U2. If the vibration pattern applied when driver U1 is the first pattern, and the vibration pattern applied when passenger U2 is the second pattern, then the first pattern vibration has the same amplitude and frequency as the second pattern vibration. At least one of them is different. For example, the first pattern of vibrations may be set in advance to have a larger amplitude than the second pattern of vibrations and a frequency that does not interfere with vibrations caused by the prime mover. Data indicating the vibration conditions of the first pattern and the second pattern and data for controlling the vibration generator 130 to realize the vibration conditions are stored in advance in the ROM of the storage unit 220 as vibration pattern data D2.

The user estimation unit 214 estimates a user position Pu, which is the position of the user U with respect to the display unit 110, based on information from at least one of the line of sight detection device 20, the seat condition monitoring device 30, and the mirror condition monitoring device 40. Since various methods can be applied to this estimation, each case will be explained below.

(When based on information from line of sight detection device 20)
The user estimation unit 214 estimates the viewpoint position of the user U included in the line-of-sight information acquired from the line-of-sight detection device 20 as the user position Pu.

(When based on information from the sheet condition monitoring device 30)
The user estimation unit 214 identifies the seating posture of the user U shown in FIGS. 6(a) to 6(c) based on the seat information from the seat condition monitoring device 30, and estimates the user position Pu according to the identified seating posture. do.
In the normal sitting posture shown in FIG. 6(a), there is a seat back pressure from the first pressure sensor 31, and the cushion portion of the seat 5 is adjusted based on the distribution of the cushion pressure from the second pressure sensor 32. Identified when the load is concentrated at the rear. In the posture shown in FIG. 6A, it is assumed that the head of the user U is above the seat position indicated by the seat position sensor 33. Therefore, the user estimation unit 214 sets the seat position acquired from the seat position sensor 33 as the position of the user position Pu in the front-rear direction, and also sets preset head height information (for example, the height of the head of the user U with a standard body type). The estimated user position Pu is calculated by considering the height). As described above, the user position Pu indicates coordinates in a three-dimensional coordinate system set in advance in the interior of the vehicle 1.
In the seated posture shown in FIG. 6(b) without using the backrest, there is no seat back pressure from the first pressure sensor 31, and the seat 5 is adjusted based on the distribution of cushion pressure from the second pressure sensor 32. This is identified when the load is concentrated at the rear of the cushion section. In the posture shown in FIG. 6(b), it is assumed that the head of the user U is located in front of the seat position indicated by the seat position sensor 33. Therefore, the user estimation unit 214 sets the seat position obtained from the seat position sensor 33 to a position that is moved forward by a first amount as the position of the user position Pu in the front-rear direction, and also sets a preset height of the head. The estimated user position Pu is calculated by taking the information into account.
In the leaning posture shown in FIG. 6(c), there is no seat back pressure from the first pressure sensor 31, and the seat 5 is adjusted based on the distribution of cushion pressure from the second pressure sensor 32. It is identified when the load is concentrated in front of the cushion part. In the posture shown in FIG. 6(c), it is assumed that the head of the user U is in front of the seat position indicated by the seat position sensor 33 and further forward than in the posture shown in FIG. 6(b). For this reason, the user estimation unit 214 moves the seat position acquired from the seat position sensor 33 forward by a second amount (larger amount than the first amount) to a position in the front-rear direction of the user position Pu. In addition to the position, an estimated user position Pu is calculated by taking into account preset head height information.

(When based on information from mirror status monitoring device 40)
The user estimation unit 214 calculates the head or viewpoint position of the user U based on mirror state information indicating the attitude of the rear view mirror (room mirror 6, door mirror 7) from the mirror state monitoring device 40. Since the user U who adjusts the rear view mirror is usually the driver U1, the user position Pu that can be estimated based on the mirror state information is only the position of the driver U1. Therefore, the method for estimating the user position Pu based on mirror state information is preferably used in combination with the other estimation methods described above.

The user estimation unit 214 estimates the user position Pu using at least one of the plurality of methods described above. Note that when using a combination of multiple methods, for example, a weighting calculation is performed on the user position Pu calculated by each method so that the calculation result by the method with high estimation accuracy of the user position Pu becomes dominant. be able to.

Further, the user estimation unit 214 estimates the type of the user U from a plurality of predetermined types (driver U1, passenger U2) based on the line of sight information acquired from the line of sight detection device 20. The user estimation unit 214 identifies whether the user U viewing the display unit 110 (display unit 100) is the driver U1 or the passenger U2 based on the user U's line of sight direction and viewpoint position indicated by the line of sight information. do. Note that when the driver U1 and the passenger U2 are viewing the display unit 110 at the same time, the user estimating unit 214 may identify the person who has been gazing at the display unit 110 for a longer time as the user U, for example. However, the process of estimating the type of user U may wait until only one of the driver U1 and fellow passenger U2 is specified.

(Sensory feedback processing)
Next, the sensory feedback process executed by the control unit 210 according to the program PG will be described with reference to FIGS. 8 and 9. The sensory feedback process is continuously executed, for example, while the various parts constituting the vehicle display system S are in operation.

When starting the sensory feedback process shown in FIG. 8, the control unit 210 determines whether a touch operation is detected (step S101). If no touch operation is detected, the control unit 210 waits (step S101; No), whereas if a touch operation is detected (step S101; Yes), the control unit 210 determines whether the touch operation is valid (that is, in the valid area). (step S102). If the touch operation is not valid (step S102; No), the control unit 210 returns the process to step S101.

If the touch operation is valid (step S102; Yes), the control unit 210 determines a specific position Pv to which vibration should be applied (step S103). A specific example will be described with reference to FIG. 4. When a touch operation determined to be valid is performed in the valid area A1, the control unit 210 determines the position (2, 3) to be the specific position Pv1.

Subsequently, the control unit 210 executes vibration position correction processing (step S200) according to the flow shown in FIG. 9, and first acquires line-of-sight information from the line-of-sight detection device 20 (step S201). Next, the control unit 210 estimates the type of user U (driver U1 or fellow passenger U2) based on the acquired line of sight information (step S202).

Subsequently, the control unit 210 determines whether the estimated type of user U is the driver U1 (step S203). When the user U is the driver U1 (step S203; Yes), the control unit 210 determines the first pattern of vibration to be applied (step S204). When the user U is not the driver U1, that is, the fellow passenger U2 (step S203; No), the control unit 210 determines the second pattern of vibration to be applied (step S205).

Following the processing in step S204 or S205, the control unit 210 acquires necessary monitoring information from the line of sight detection device 20, seat condition monitoring device 30, and mirror condition monitoring device 40 (step S206), and uses the above-described method to The position Pu is estimated (step S207). Then, the control unit 210 calculates the correction amount ΔP according to the user position Pu estimated as described above (step S208), and ends the vibration position correction process.

Returning to FIG. 8, following the vibration position correction process (step S200), the control unit 210 determines whether or not the vibration position has been corrected (step S104). Specifically, when the correction amount ΔP calculated in step S208 is 0 (zero), the control unit 210 determines that there is no correction (step S104; No), and controls the vibration generating unit 130 to perform the step Vibration is generated for a certain period of time (for example, several seconds) at the specific position Pv determined in S103 (Step S105). On the other hand, if the correction amount ΔP calculated in step S208 is not 0 (zero), the control unit 210 determines that correction is required (step S104; Yes), controls the vibration generation unit 130, and controls the vibration generation unit 130 to make the correction determined in step S103. Vibration is generated for a certain period of time (for example, several seconds) at a correction position Pa, which is the correction amount ΔP added to the specific position Pv (step S106). Specifically, the correction position Pa is a position obtained by shifting the specific position Pv in the magnitude and direction indicated by the correction amount ΔP, which is a vector amount.

After executing step S105 or S106, the control unit 210 returns to step S101 and executes the process. The above is sensory feedback processing.

(Modified example)
In the above embodiment, as shown in FIG. 3, an example was shown in which the distance between the display unit 110 and the flat cover glass 160 was constant. However, as schematically shown in FIG. 10A, a curved cover glass 160 (for example, a cover glass 160 having a free-form surface shape) can also be applied to the display unit 100. In the case of the cover glass 160 curved in this way, the distance from the display unit 110 differs depending on the area within the screen 100a, so the manner in which parallax occurs as described with reference to FIG. 7 differs depending on the area within the screen 100a. This phenomenon occurs. If this phenomenon is conceptually explained with reference to FIG. 10(a), it is a phenomenon in which a larger parallax occurs in area B1 than in area B2. In order to perform sensory feedback processing in consideration of this phenomenon, the vibration control unit 213 of the control unit 210 virtually divides the screen 100a as shown in FIG. 10(b) when correcting the specific position Pv. It may also be possible to control the correction amount ΔP from the specific position Pv to the correction position Pa for each of the plurality of control areas C1 to Cn obtained by doing so. When the control areas C1 to Cn are set in this way, for example, the control unit 210 (vibration control unit 213) determines which of the control areas C1 to Cn the specific position Pv determined in step S103 shown in FIG. 8 belongs to. Just specify it. Then, in step 208 shown in FIG. 9, the control unit 210 may calculate the correction amount ΔP by executing an operation suitable for the specified control area among the control areas C1 to Cn. Note that a calculation suitable for the control area is a calculation that takes into consideration the distance between the display unit 110 and the cover glass 160 in the area, and the thickness and curvature of the cover glass 160, and the concept is based on the correction amount explained with reference to FIG. This is the same as the method for calculating ΔP.
By setting the control areas C1 to Cn in this way, it is possible to calculate the correction amount ΔP according to the area, so even in the vehicle display device 10 of various shapes, sensory feedback that takes into account the parallax that occurs can be achieved. Position correction can be performed appropriately. Note that by setting the control areas C1 to Cn in this manner, the sensory feedback process can be appropriately executed regardless of whether the cover glass 160 has a convex surface or a concave surface. Further, although FIG. 10(b) shows an example of control areas obtained by dividing the screen 100a in the horizontal direction, the control areas may be arranged in a matrix on the screen 100a, or in the vertical direction. may be arranged in Further, the number of control areas on the screen 100a is also arbitrary.

Note that the present invention is not limited to the above embodiments, modifications, and drawings. It is possible to make changes (including deletion of constituent elements) as appropriate without changing the gist of the present invention.

Although an example has been described above in which the operation icon images G1 and G2 indicating the operation target are displayed on the screen 100a as related images related to the touch operation target (operation target), the present invention is not limited to this example. The related image does not have to be an image showing the operation target itself, but may be an image that is at least related to the operation target.

Although an example has been shown above in which the user position Pu is calculated as three-dimensional coordinates, the user position Pu may be two-dimensional coordinates. For example, even if the user position Pu is a two-dimensional coordinate excluding the height direction of the vehicle 1, the control unit 210 can perform the sensory feedback process in consideration of parallax in the left and right direction.

The order and changes of each process constituting the sensory feedback process are arbitrary depending on the purpose. For example, if the slope of the straight line L that the vibration control unit 213 calculates when determining the corrected position Pa continues to deviate from the slope of the line of sight direction indicated by the line of sight information from the line of sight detection device 20 by a predetermined amount. If so, it can be assumed that the user U is not viewing the display unit 110, so the control unit 210 may skip the process of step S208. Furthermore, even if the touch operation is a multi-touch operation in which multiple fingers F touch the screen 100a at the same time, it is possible to obtain the correction amount ΔP for each finger F and perform sensory feedback processing using the same method as described above. .

The part of the user U who touches the screen 100a during a touch operation may be any part of the palm other than the fingers F, the back of the hand, or a predetermined part when the user U is wearing gloves. It's okay.

Although the program PG for executing the sensory feedback process described above is stored in advance in the storage unit 220, it may be distributed/provided by a removable recording medium. Further, the program PG may be downloaded from another device connected to the vehicle display device 10. Further, the vehicle display device 10 may execute various processes according to the program PG by exchanging various data with other devices via a telecommunications network or the like.

(1) The vehicle display device 10 described above has a display unit 110 that displays an image on the screen 100a, and a user who performs a An operation detection unit 212 detects a touch operation by U, and a vibration can be applied to a specific position Pv included in the effective area in response to the operation detection unit 212 detecting a touch operation performed on the effective area. and a user estimation unit 214 that estimates a user position Pu, which is the position of the user U with respect to the display unit 110. The vibration control unit 213 can correct the specific position Pv according to the user position Pu estimated by the user estimation unit 214, and when the specific position Pv is corrected, vibration is applied to the corrected position Pa, which is the position after the correction. give.
According to this configuration, sensory feedback for touch operations can be appropriately performed. In addition, in a control that simply returns vibration as sensory feedback to the position where a touch operation has been performed, it is assumed that the vibration is returned even though the touch operation has not been accepted. According to this, such a situation can be avoided.

(2) Further, the user estimating unit 214 can estimate the type of the user U from a plurality of predetermined types, and the vibration control unit 213 may The pattern of vibration given to the specific position Pv or correction position Pa is changed.
According to this configuration, it is possible to avoid difficulty in transmitting vibrations as sensory feedback to the user U.

(3) Furthermore, as described in the modification, when correcting the specific position Pv, the vibration control unit 213 controls the specific position Pv for each of the plurality of control areas C1 to Cn obtained by virtually dividing the screen 100a. It may be possible to control the correction amount ΔP from Pv to the correction position Pa.
According to this configuration, it is possible to calculate the correction amount ΔP according to the control areas C1 to Cn, so that even in the vehicle display device 10 of various shapes, the position of the sensory feedback can be appropriately corrected in consideration of the parallax that occurs. can be executed.

(4) Moreover, the information used when the user estimation unit 214 estimates the user position Pu may include the user's U line of sight information.
According to this configuration, the estimation accuracy of the user position Pu is good.

(5) Specifically, the vibration control unit 213 sets a position shifted from the specific position Pv toward the user position Pu (specifically, a position shifted in the in-plane direction of the screen 100a) as the corrected position Pa.

(6) Specifically, the display unit 110 displays related images (for example, operation icon images G1 and G2) related to the target of the touch operation in a range including the specific position Pv on the screen 100a.

In the above description, descriptions of known technical matters have been omitted as appropriate in order to facilitate understanding of the present invention.

S... Vehicle display system 10... Vehicle display device 100... Display unit, 100a... Screen 110... Display portion, 110a... Front surface 120... Touch sensor, 130... Vibration generator, 131... Vibrator 140... Case, 150... Holder , 160... cover glass, 170... elastic support 200... control device 210... control section 211... display control section, 212... operation detection section, 213... vibration control section, 214... user estimation section 220... storage section, PG... program , D1... Correction amount calculation data, D2... Vibration pattern data 20... Line of sight detection device 30... Seat condition monitoring device 31... First pressure sensitive sensor, 32... Second pressure sensitive sensor, 33... Seat position sensor 40... Mirror condition monitoring Device 1...Vehicle, 2...Driver's seat, 3...Passenger seat, 4...Dashboard, 5...Seat 6...Room mirror, 7...Door mirror A1, A2...Effective area C1-Cn...Control area F, F1, F2...Finger G... Image, G1, G2... Operation icon image (an example of a related image), L... Straight line P... Vibration possible position Pv, Pv1, Pv2... Specific position Pa... Correction position, ΔP... Correction amount Pd... Display position, Pu ...User position U...User, U1...Driver, U2...Passenger

Claims (6)

a display section that displays images on a screen;
an operation detection unit that detects a touch operation performed by a user on an effective area set on the screen;
a vibration control unit capable of applying vibration to a specific position included in the effective area in response to the operation detection unit detecting the touch operation performed on the effective area;
a user estimation unit that estimates a user position that is a position of the user with respect to the display unit;
The vibration control unit is capable of correcting the specific position according to the user position estimated by the user estimation unit, and when the specific position is corrected, the vibration control unit applies vibration to the corrected position that is the corrected position. give,
Vehicle display device. The user estimation unit is capable of estimating the type of the user from a plurality of predetermined types,
The vibration control unit changes a pattern of vibration applied to the specific position or the correction position according to the type of the user estimated by the user estimation unit.
The vehicle display device according to claim 1. The vibration control unit is capable of controlling a correction amount from the specific position to the correction position for each of a plurality of control areas obtained by virtually dividing the screen when correcting the specific position.
The vehicle display device according to claim 1 or 2. The information used by the user estimator to estimate the user position includes line-of-sight information of the user;
The vehicle display device according to any one of claims 1 to 3. The vibration control unit sets a position shifted from the specific position toward the user position as the correction position.
The vehicle display device according to any one of claims 1 to 4. The display unit displays a related image related to the target of the touch operation in a range including the specific position on the screen.
The vehicle display device according to any one of claims 1 to 5.

Images