KR102206743B1 - Apparatus for inputting driver`s operating signal using laser scanning - Google Patents

Abstract

A laser that outputs image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and acquires scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. Projector module; And a control unit that generates image information including a manipulation function image, and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture action on the displayed manipulation function image from the acquired scan information. A driver manipulation signal input device using laser scanning is provided.

Description

Driver operation signal input device using laser scanning {APPARATUS FOR INPUTTING DRIVER`S OPERATING SIGNAL USING LASER SCANNING}

The present invention relates to a driver manipulation signal input device using laser scanning, and in detail, an operation function that can be operated by a driver for a convenience function of the vehicle on the surface of the driver's steering wheel using laser scanning of a laser projector module installed in the vehicle. The present invention relates to a driver manipulation signal input device using laser scanning that displays an image and receives a preset manipulation signal by detecting a driver's touch or gesture.

In general, in addition to essential functions for driving, automobiles are equipped with various convenience devices in the vehicle to provide passengers' convenience, such as audio and navigation.

Accordingly, a function selection device for selecting or manipulating convenient functions of the vehicle is installed in a position within the vehicle that can be reached by the driver.

Since a function selection device of a vehicle for operating these convenient functions must be located within a distance that can be operated by a driver, for example, it is generally located in the center of a dashboard of a vehicle.

On the other hand, as shown in Fig. 1, the function selection device of the vehicle makes it easier to operate the function selection unit 1 and the function selection unit 1 installed on the dashboard (not shown), while the driver is driving. Consisting of an operation button part 6 and a control part 10 installed on one side of the spokes 8a of the steering handle 8 so that the function selection part 1 can be operated without removing a hand from the steering handle 8 do.

In addition, the function selection unit 1 is a generally button-type function operation device, and is located under the screen display unit 4 showing the selected function and the screen display unit 4 to provide a plurality of buttons 2b and dials 2a. It may be made of a control unit (2) made of.

Accordingly, the driver operates the corresponding functions of the button 2b and the dial 2a of the function selection unit 1, or selects a desired function from the operation button 6 installed on the steering handle 8, Controls the operation of the function unit 12 performing the convenience device, and checks the function operated by the user with information displayed on the screen display unit 4.

However, when a driver wants to control the function unit 12 through the operation button unit 6 while driving, the conventional vehicle function selection device has a limitation in operating the complex functions of the function unit 12 by means of a button. In addition, even when a user wants to perform a corresponding convenient function by manipulating the button 2b or the dial 2a of the function selection unit 1, the convenience function of the function unit 12 is gradually diversified and the function is complicated. Accordingly, there are many limitations in operating complex and various functions with only the button 2b or the dial 2a.

In addition, recently, multimedia electronic devices that provide information to users have been actively developed and released. The multimedia electronic device may include various functions such as calling, listening to music, viewing videos, sending and receiving messages, managing schedules, and surfing the Internet.

Meanwhile, attempts to apply such multimedia electronic devices to vehicles are being studied. Various buttons are installed on the exterior of the multimedia electronic device to receive input commands for performing various functions of the multimedia electronic device, and a user can operate various buttons to perform the corresponding function.

The problem to be solved by the present invention is to display an image of an operation function that the driver can manipulate for the convenience function of the vehicle on the surface of the driver's steering wheel by using laser scanning of a laser projector module installed in the vehicle, It is to provide a driver manipulation signal input device using laser scanning that senses and receives a preset manipulation signal.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned can be clearly understood by those of ordinary skill in the art to which the embodiments proposed from the following description belong. will be.

According to one aspect of the present invention, image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and a manipulation function image displayed in the area set by an optical signal received from the set area A laser projector module that acquires scan information for; And a control unit that generates image information including a manipulation function image, and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture action on the displayed manipulation function image from the acquired scan information. A driver manipulation signal input device using laser scanning is provided.

The laser projector module includes: an optical system including one or more R, G, B laser diodes and one or more infrared laser diodes; And according to the image information including the manipulation function image, the light output from the R, G, B laser diodes and infrared laser diodes is adjusted and displayed in a preset area of the steering wheel, and the scan information is received from the preset area. It may include a MEMS scanner that performs laser scanning for acquisition.

Vehicle convenience functions may include direction keys, emergency lights, lighting selection, channel change, mode selection, volume control, and multimedia device manipulation.

The control unit displays a plurality of manipulation function images corresponding to different manipulation functions in the border area of the steering wheel, and determines a driver's touch or gesture action on the plurality of manipulation function images, and executes a preset vehicle convenience function. The input can be recognized.

The controller may determine the position of the driver's finger from the scan information and generate image information for displaying a manipulation function image in an area close to the finger position.

The control unit can recognize the step-up or step-down input by tracking the position of the driver's finger within the border area of the steering wheel, and determining the operation when the finger is attached and released from the scan information for the displayed manipulation function image. .

The control unit may track the position of the driver's finger within the border region of the steering wheel, and recognize a step-up or step-down input according to the elapsed time in a state where the finger is attached from the scan information on the displayed manipulation function image.

The control unit displays one manipulation function image selected from a plurality of manipulation function images corresponding to different manipulation functions in the border area of the steering wheel, but whenever a driver's touch or gesture motion is detected in a preset area of the steering wheel. Or, it is possible to select a manipulation function image to be displayed according to the number of detections.

The control unit displays an image of a manipulation function selected from among a plurality of manipulation function images corresponding to different manipulation functions on the border area of the steering wheel, and detects and detects the position of a new finger of the driver in a preset area of the steering wheel. Whenever a touch or gesture motion by a new finger is detected, or according to the number of detections, a manipulation function image to be displayed may be selected.

The control unit may display one manipulation function image selected from among a plurality of manipulation function images corresponding to different manipulation functions on an edge area of the steering wheel, and may select a manipulation function image to be displayed through voice recognition of the driver.

According to the present invention, by using laser scanning of a laser projector module installed in a vehicle to display an image of an operation function that the driver can manipulate on the driver's steering wheel, the driver simply operates the operation function displayed around the finger while holding the steering wheel. User convenience may be improved by performing various manipulation functions for executing various convenient functions in the vehicle by touching an image or performing a gesture operation.

1 is a diagram illustrating a conventional vehicle function selection device.
2 is a view for explaining a driver manipulation signal input device using laser scanning according to an embodiment of the present invention.
3 is a view for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to an embodiment of the present invention.
4 is a view for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.
5 is a diagram for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.
6 is a view for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.
7 is a diagram illustrating a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.
8 is a diagram for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail together with the drawings. However, it cannot be said that the spirit of the present invention is limited to the presented embodiments, and other inventions that are regressive by addition, change, deletion, etc. of other constituents, or other embodiments included within the scope of the present invention are easily I can suggest.

As for the terms used in the present invention, general terms that are currently widely used are selected, but in certain cases, there are terms arbitrarily selected by the applicant. It should be noted that the present invention should be understood as the meaning of the term that is not.

That is, in the following description, the word'comprising' does not exclude the presence of elements or steps other than those listed.

2 is a block diagram illustrating a configuration of a driver manipulation signal input device using laser scanning according to an embodiment of the present invention, and FIG. 3 is a diagram illustrating a driver manipulation signal input device and a steering wheel using laser scanning according to an embodiment of the present invention. It is a drawing for explanation.

2 and 3, a driver manipulation signal input device using laser scanning according to an embodiment of the present invention may include a laser projector module 100 and a control unit 200.

The laser projector module 100 outputs image information for displaying an image of an arbitrary manipulation function in a preset area of the steering handle 300 through laser scanning, and manipulation displayed in the set area by an optical signal received from the set area. It is possible to obtain scan information for a functional image.

The controller 200 generates image information including a manipulation function image, and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture action on the displayed manipulation function image from the acquired scan information. can do. Here, the vehicle convenience functions may include, for example, direction keys, emergency lights, lighting selection, channel change, mode selection, volume control, and multimedia device manipulation.

The laser projector module 100 may include an optical system 110 and a Micro Electro Mechanical Systems (MEMS) scanner 120.

The optical system 110 may include one or more R, G, B laser diodes (R, G, B LD) 111 and one or more infrared laser diodes (IR LD) 112.

Since the light output from the laser diode 111 in the optical system 110 has strong linearity, it can be well displayed on a curve when the function manipulation image is displayed on the edge area 310 of the steering handle 300.

In the case of generating black in the optical system 110, power consumption is small because power supplied to the laser diode 111 can be cut off.

The light irradiated by the infrared laser diode 112 provided in the optical system 110 is reflected from the edge area 310 of the steering handle 300 and used to recognize the distance. Accordingly, the MEMS scanner 120 can operate by recognizing the distance to the function manipulation image 320 displayed on the edge area 310 of the steering handle 300 through the change of infrared light. If the driver's hand 400 or an obstacle is inserted while the function manipulation image 320 is displayed on the edge area 310 of the steering wheel 300, the edge area of the steering wheel 300 ( It can be recognized that a change has occurred in the distance to the function manipulation image 320 displayed in 310).

Accordingly, the driver's touch and gesture may be determined and recognized by the distance recognition function. That is, in a state where the function manipulation image 320 is displayed on the edge area 310 of the steering handle 300 by the laser scanning operation of the MEMS scanner 120, the predetermined area 330 including the corresponding function manipulation image 320 When the driver touches a finger or a gesture operation of the driver occurs in a predetermined area 330 including the corresponding function manipulation image 320, a change in distance may be sensed through characteristics of the received reflected light.

The laser projector module 100 may be used by employing a front projection method or a rear projection method. The front projection method is a method of projecting laser light by installing a laser projector module 100 above the driver, as shown in FIG. 3A. In the front projection method, light projected from the laser projector module 100 may be displayed on the front of the steering handle 300.

The rear projection method is a method in which the laser projector module 100 projects laser light from the rear side of the steering handle 300. In the rear projection method, light projected from the laser projector module 100 passes through the steering handle 300 made of a light-transmitting or light-semitransmissive material and is displayed on the surface of the steering handle 300.

The MEMS scanner 120 adjusts the light output from the laser diode 111 and the infrared laser diode 112 according to image information including a manipulation function image and displays it in a predetermined area 330 of the steering handle 300. , Laser scanning for acquiring scan information from a predetermined area 330 may be performed.

The MEMS scanner 120 constructs one screen by reciprocating and scanning image information to be generated using laser light for each horizontal line in a predetermined area 330 of the steering handle 300, and constructs one screen. When the scan of) is completed, a scanning method is used to return to the position of the first line and display the next screen.

The MEMS scanner 120 may display image information by scanning an optical signal by rotating a micro-mirror using a micro actuator manufactured by microelectronic device technology to change a traveling direction of light, and obtain the displayed image information.

The MEMS scanner 120 may include a micro-mirror, a spring structure supporting the micro-mirror, and a micro actuator that generates a force to drive the micro-mirror.

It is important that the micro-mirror has a high surface quality for efficient reflection of the optical signal, and it must have sufficient rigidity to withstand the distortion of the mirror itself that may occur during high-frequency operation.

The spring structure serves to support the micro-mirror so that it can be operated at a certain distance from the substrate.

4 is a view for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Referring to FIG. 4, in the driver manipulation signal input device using laser scanning according to another embodiment of the present invention, a laser projector module 100 is installed to be implemented when the steering wheel 300 is held by using the right hand 400. Perform the action.

5 is a diagram for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Referring to FIG. 5, the controller 200 controls the laser projector module 100 to display a plurality of manipulation function images 320a and 320b corresponding to different manipulation functions on the border area 310 of the steering handle 300. A key input for executing a preset vehicle convenience function may be recognized by selectively displaying and determining a driver's touch or gesture operation on the displayed manipulation function images 320a and 320b.

In a state in which a plurality of manipulation function images 320a and 320b are selectively displayed in the border area of the steering wheel 300, the controller 200 receives a driver's touch or gesture input for the area where each manipulation function image is displayed. I can.

At this time, the control unit 200 selects the corresponding manipulation function images 320a and 320b according to the function selection command while displaying the arbitrary manipulation function images 320a and 320b on the border area 310 of the steering handle 300 Can be controlled to be displayed. Accordingly, whenever a function selection command is input, the corresponding manipulation function images 320a and 320b may be displayed in a location area close to the finger. Here, the function selection command may be, for example, a driver's voice signal using voice recognition.

Alternatively, when a predetermined point of the steering wheel 300 is touched with a free hand (unused hand) on the steering wheel 300 without using voice recognition for function selection, a preset operation function image 320a, 320b) can be displayed one by one.

Alternatively, without using voice recognition for function selection, by knocking the steering wheel 300 with an unused hand free from the steering wheel 300, the manipulation function images 320a and 320b set in advance according to the number of tapping. Can be displayed one by one.

6 is a view for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Referring to FIG. 6, the controller 200 controls the laser projector module 100 to display a plurality of manipulation function images 340 corresponding to different manipulation functions on the border area 310 of the steering handle 300, and , It is possible to recognize a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the plurality of manipulation function images 340.

The controller 200 may receive a driver's touch or gesture input for an area in which each manipulation function image is displayed while displaying a plurality of manipulation function images 340 spaced apart from each other within the border area of the steering handle 300. have.

7 is a diagram illustrating a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Referring to FIG. 7, the control unit 200 displays a plurality of manipulation function images 350 on the border area 310 of the steering handle 300 and displays the corresponding manipulation function image 350 according to the function selection command. It is possible to control the display of the manipulation function image by applying a UI that rotates and moves to the area where the finger of is located and is displayed. Accordingly, whenever a function selection command is input, a corresponding manipulation function image 350 may be displayed in a location area close to the finger 400. Here, the function selection command may be, for example, a driver's voice signal using voice recognition.

In another way, without using voice recognition for function selection, the corresponding manipulation function image 350 is displayed whenever a predetermined point of the steering wheel 300 is touched with a free hand (unused hand) on the steering wheel 300. It may be rotated and moved to be displayed in a location area close to the finger 400.

Alternatively, the operation function image 350 is rotated according to the number of tapping by knocking the steering wheel 300 with an unused hand free from the steering wheel 300 without using voice recognition for function selection. It may be moved and displayed in a location area close to the finger 400.

8 is a diagram for explaining a driver manipulation signal input device and a steering wheel using laser scanning according to another embodiment of the present invention.

Referring to FIG. 8, the controller 200 controls the laser projector module 100 to correspond to the left hand and the right hand to the edge area 310 of the steering handle 300, respectively, corresponding to a plurality of different manipulation functions. A key input for executing a preset vehicle convenience function may be recognized by displaying the manipulation function images 360a and 360b and determining a driver's touch or gesture action on the plurality of manipulation function images 360a and 360b.

The control unit 200 displays a plurality of manipulation function images 360a and 360b separated from each other in correspondence with the positions of both hands in the border area 310 of the steering handle 300, and the area where each manipulation function image is displayed. It is possible to receive a driver's touch or gesture input for.

Statistically, the positions at which the drivers hold the steering wheel 300 may be different depending on the driver.

Accordingly, the controller 200 determines the driver's finger position from the scan information acquired by the laser projector module 100 to recognize the driver's finger, and an image for displaying a manipulation function image in an area close to the finger position. Can generate information. The manipulation function image may be an icon, for example. The size of the icon can be adjusted according to the size of the driver's finger. For example, the size of a driver's fingers differs according to a female driver, a male driver, a foreigner, or wearing gloves.

The controller 200 tracks the position of the driver's finger within the border area of the steering wheel 300 from the scan information acquired by the laser projector module 100, and retrieves the driver's finger from the scan information for the displayed manipulation function image. It is possible to recognize a step-up or step-down input by judging the action when it is attached and removed.

The control unit 200 tracks the position of the driver's finger within the border area of the steering wheel 300 from the scan information obtained by the laser projector module 100, and attaches the finger from the scan information for the displayed manipulation function image. Step-up or step-down input can be recognized depending on the elapsed time at.

In this case, the control unit 200 may quickly set a reaction speed according to recognition of a finger to speed up a step-up operation or a step-down operation, or set the reaction speed to be slow so that the step operation is performed with a time delay.

Whenever a touch or gesture motion by a driver's finger holding the steering wheel 300 in a preset area of the steering wheel from the scan information acquired by the laser projector module 100 is detected, or You can select the manipulation function image to be displayed according to the number of detections. The control unit 200 may display one manipulation function image selected from a plurality of manipulation function images corresponding to different manipulation functions within the border area of the steering wheel.

The controller 200 detects the position of a new finger of the driver who is not holding the steering wheel 300 in a preset area of the steering wheel from the scan information obtained by the laser projector module 100, and A manipulation function image to be displayed may be selected whenever a touch or gesture motion is detected or according to the number of detections. The control unit 200 may display one manipulation function image selected from among a plurality of manipulation function images corresponding to different manipulation functions on an edge area of the steering handle.

The control unit 200 displays one manipulation function image selected from among a plurality of manipulation function images corresponding to different manipulation functions on the border area 310 of the steering wheel 300, but the manipulation to be displayed through the driver's voice recognition You can select a function image.

The control unit 200 displays image information for providing an alarm on the display area of the steering handle 300 when the touch of a finger disappears from the scan information acquired by the laser projector module 100 and an emergency light Can be turned on.

In addition, when a problem occurs in the vehicle or an emergency situation occurs, the control unit 200 may display alarm information on a display area provided on the steering handle 300 and turn on the emergency light.

For example, the control unit 200 detects that a finger of a hand other than the hand holding the steering handle 200 is applied to the selection area while driving from the scan information obtained by the laser projector module 100. If it is recognized, it is recognized as a dangerous situation, alarm information can be displayed, and emergency lights can be turned on.

The controller 200 may control the initial startup for an operation of displaying a manipulation function image by the laser projector module 100 through voice recognition or gesture recognition. In this case, for voice recognition, the controller 200 may mount a voice recognition module or use a separate voice recognition module.

Meanwhile, the controller 200 may control the initial startup for an operation of displaying a manipulation function image through gesture recognition by the laser projector module 100 without using voice recognition.

The control unit 200 may visually distinguish and stand out to the driver's eyes by displaying different colors of the UI of the manipulation function image displayed on the steering wheel 300 according to each manipulation function.

The control unit 200 may display different colors on the rim area 310 of the steering handle 300 or may display different colors on the central area of the steering handle 300 to display a manipulation function image. .

Although the specific embodiments according to the present invention have been described so far, various modifications can be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be defined by being limited to the described embodiments, and should be defined by the claims to be described later, as well as those equivalent to the claims.

Claims (10)

Output image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. A laser projector module to obtain; And
A control unit that generates image information including the manipulation function image and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the displayed manipulation function image from the obtained scan information Including,
The control unit,
Determining the position of the driver's finger from the scan information, and generating the image information for displaying the manipulation function image in an area close to the finger position,
Laser for recognizing a step-up or step-down input by tracking the position of the driver's finger within the border area of the steering wheel, and determining the operation when the finger is attached and released from the scan information on the displayed manipulation function image Driver control signal input device using scanning. The method of claim 1, wherein the laser projector module,
An optical system including one or more R, G, B laser diodes and one or more infrared laser diodes; And
Laser scanning for adjusting the light output from the laser diode and the infrared laser diode according to image information including the manipulation function image and displaying it on a preset area of the steering handle, and obtaining scan information from the preset area Driver operation signal input device using laser scanning including a MEMS scanner to perform.
The method of claim 1, wherein the vehicle convenience function,
Driver control signal input device using laser scanning including direction keys, emergency lights, lighting selection, channel change, mode selection, volume control, and multimedia device operation. The method of claim 1, wherein the control unit,
Display a plurality of operation function images corresponding to different operation functions on the rim of the steering handle,
A driver manipulation signal input device using laser scanning for recognizing a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture action on the plurality of manipulation function images. delete delete Output image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. A laser projector module to obtain; And
A control unit that generates image information including the manipulation function image and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the displayed manipulation function image from the obtained scan information Including,
The control unit,
Determining the position of the driver's finger from the scan information, and generating the image information for displaying the manipulation function image in an area close to the finger position,
Laser scanning that tracks the position of the driver's finger within the border area of the steering wheel, and recognizes a step-up or step-down input according to the elapsed time in the state where the finger is attached from the scan information on the displayed manipulation function image. Driver operation signal input device using. Output image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. A laser projector module to obtain; And
A control unit that generates image information including the manipulation function image and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the displayed manipulation function image from the obtained scan information Including,
The control unit,
Determining the position of the driver's finger from the scan information, and generating the image information for displaying the manipulation function image in an area close to the finger position,
Displaying one manipulation function image selected from a plurality of manipulation function images corresponding to different manipulation functions in the border area of the steering handle,
A driver manipulation signal input device using laser scanning for selecting a manipulation function image to be displayed whenever a driver's touch or gesture motion is detected in a preset area of the steering wheel or according to the number of detections. Output image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. A laser projector module to obtain; And
A control unit that generates image information including the manipulation function image and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the displayed manipulation function image from the obtained scan information Including,
The control unit,
Determining the position of the driver's finger from the scan information, generating the image information for displaying the manipulation function image in an area close to the finger position,
Displaying one manipulation function image selected from among a plurality of manipulation function images corresponding to different manipulation functions in the border area of the steering wheel,
Laser scanning is performed by detecting the position of a new finger of the driver in a preset area of the steering wheel, and selecting a manipulation function image to be displayed whenever a touch or gesture motion by the detected new finger is detected Driver operation signal input device using. Output image information for displaying an arbitrary manipulation function image in a preset area of the steering wheel through laser scanning, and scan information for the manipulation function image displayed in the set area by an optical signal received from the set area. A laser projector module to obtain; And
A control unit that generates image information including the manipulation function image and recognizes a key input for executing a preset vehicle convenience function by determining a driver's touch or gesture operation on the displayed manipulation function image from the obtained scan information Including,
The control unit,
Determining the position of the driver's finger from the scan information, and generating the image information for displaying the manipulation function image in an area close to the finger position,
Displaying one manipulation function image selected from among a plurality of manipulation function images corresponding to different manipulation functions in the border area of the steering handle,
A driver manipulation signal input device using laser scanning for selecting a manipulation function image to be displayed through the driver's voice recognition.

Images