WO2023045696A1

WO2023045696A1 - Vehicle-mounted projection input system and vehicle

Info

Publication number: WO2023045696A1
Application number: PCT/CN2022/115001
Authority: WO
Inventors: 朱晓光; 徐佩明
Original assignee: 极氪汽车(宁波杭州湾新区)有限公司; 浙江吉利控股集团有限公司
Priority date: 2021-09-22
Filing date: 2022-08-26
Publication date: 2023-03-30
Also published as: CN215494986U

Abstract

The present application discloses a vehicle-mounted projection input system and a vehicle, wherein the vehicle-mounted projection input system comprises: an instrument panel for installing a central control display; and a projection assembly connected to the instrument panel and electrically connected to the central control display. The projection assembly comprises: a projection laser for projecting a virtual keyboard on the surface of an object; and a camera module for capturing an image of a region in which the virtual keyboard is located, so as to obtain a input signal corresponding to an operation of a user on the virtual keyboard. The technical solution of the present application may improve the comfort of users working or entertaining in the vehicle.

Description

Vehicle projection input system and vehicle

This application claims priority to a Chinese patent application with application number 202122301084.0 filed on September 22, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the technical field of vehicles, in particular to a vehicle-mounted projection input system and a vehicle.

Background technique

At present, more and more vehicles on the market have central control display configurations, especially in the field of passenger cars. The central control display has a design trend of increasing size and richer functions. The central control display screen is also becoming more and more common. As the central control display is limited by its layout position and angle, users in the front seat need to keep their body leaning forward when using the central control display, which makes the central control display unsuitable for long-term use. Time for office or play.

technical problem

The main purpose of this application is to provide a vehicle-mounted projection input system, which aims to improve the comfort of users in the vehicle for work or entertainment.

technical solution

In order to achieve the above purpose, the vehicle projection input system proposed by this application includes:

instrument panel for mounting the central control display; and

The projection assembly is connected to the instrument panel and is electrically connected to the central control display screen, and the projection assembly includes:

A projection laser for projecting a virtual keyboard on the surface of an object;

The camera module is configured to take images of the area where the virtual keyboard is located, so as to obtain input signals corresponding to operations performed by the user on the virtual keyboard.

In one embodiment, the projection assembly further includes an infrared laser located below the projection laser, the infrared laser is used to emit planar infrared rays, and the planar infrared rays intersect with the optical path of the virtual keyboard. .

In one embodiment, the camera module, the projection laser and the infrared laser are arranged sequentially from top to bottom and are located on the same straight line.

In one embodiment, the camera module includes a wide-angle camera and a control processor electrically connected to the wide-angle camera, and the control processor is used to analyze and process the image to obtain the user's text input signal or instruction input signal .

In one embodiment, the camera module further includes an infrared filter disposed on the front side of the wide-angle camera, and the infrared filter is used for filtering light entering the wide-angle camera.

In one embodiment, the projection assembly is located above the auxiliary instrument panel of the vehicle, the projection assembly is rotatably connected to the instrument panel, and can be rotated between the main driver's side and the passenger's side.

In one embodiment, the projection assembly further includes a mounting shell rotatably connected to the instrument panel, and an escape hole is provided on the underside of the instrument panel corresponding to the mounting shell; the camera module, the projection laser and The infrared lasers are arranged on the same side of the installation shell, and both are exposed in the escape hole.

In one embodiment, the projection assembly further includes a printed circuit board connected to the mounting case, and the camera module, the projection laser and the infrared laser are integrated on the printed circuit board.

In one embodiment, the projection assembly is slidably connected to the instrument panel, and the height from the ground can be adjusted in an up and down direction.

The present application also proposes a vehicle, including the aforementioned vehicle-mounted projection input system.

Beneficial effect

In the technical solution of the present application, the projection component installed on the instrument panel can facilitate the user to input text or control commands using the virtual keyboard, allowing the user to perform office or entertainment in the car with a more comfortable posture, such as long text input, document Manage, and play games, thereby improving user experience. Specifically, the user only needs to use an object with a flat surface, such as a plane object, and place the plane object on the thigh or the sub-dashboard, and then activate the projection component so that the projection laser projects a virtual keyboard on the plane object, and then Operations such as plain text input or control command input are performed on the virtual keyboard, and the camera module will capture both the virtual keyboard and the user's operations on the virtual keyboard, thereby identifying the input corresponding to the user's operation from the captured image information Signals, for example, the user taps the letter a to indicate the input text a, or taps the "up arrow" to indicate that the target moves up by one unit. The user's office documents can be displayed on the central control display or on other displays. In this embodiment, the central control display is used to directly display the content of the document and the input signal corresponding to the user's operation. The user can lean on the seat or turn sideways slightly, and perform relevant operations on the virtual keyboard with his hands, while his eyes stay on the central control display in front of the body to confirm whether the operation is correct, so that the user can use a more comfortable It can be used for office or entertainment, avoiding the discomfort and burnout caused by leaning forward for a long time to operate the central control display, thereby improving the user experience. It is understandable that when the user has urgent office affairs to deal with but does not have a laptop at hand, the projector component can well meet the user's temporary office needs, thereby significantly enriching the functions of the vehicle and improving the market competitiveness of the vehicle.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to the structures shown in these drawings without creative effort.

Fig. 1 is a structural schematic diagram of an embodiment of the vehicle-mounted projection input system of the present application;

Fig. 2 is a schematic diagram of the main structure of the projection assembly in Fig. 1;

FIG. 3 is a partial enlarged view at A of the vehicle-mounted projection input system in FIG. 1 .

Explanation of reference numbers:

标号 label	名称 name	标号 label	名称 name
11 11	主驾驶侧 driver's side	220 220	摄像模块 camera module
12 12	副驾驶侧 passenger side	230 230	红外激光器 infrared laser
100 100	仪表台 dashboard	240 240	印刷电路板 A printed circuit board
101 101	避让孔 avoidance hole	300 300	中控显示屏 Central control display
200 200	投影组件 projection component	400 400	平面物体 flat object
210 210	投影激光器 projection laser	500 500	副仪表台 Secondary instrument panel

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Embodiments of the present invention

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

It should be noted that if there are directional indications (such as up, down, left, right, front, back...) in the embodiment of the present application, the directional indications are only used to explain the position in a certain posture (as shown in the attached figure). If the specific posture changes, the directional indication will also change accordingly.

In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes, and cannot be interpreted as indications or hints Its relative importance or implicitly indicates the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In addition, the meaning of "and/or" appearing in the whole text includes three parallel schemes, taking "A and/or B" as an example, including scheme A, scheme B, or schemes that both A and B satisfy. In addition, the technical solutions of the various embodiments can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered that the combination of technical solutions does not exist , nor within the scope of protection required by the present application.

As the central control display is limited by its layout position and angle, users in the front seat need to keep their body leaning forward when using the central control display, which makes the central control display unsuitable for long-term use. Time for office or play.

In view of this, the application proposes a vehicle-mounted projection input system, referring to Figure 1 and Figure 2, in an embodiment of the application, the vehicle-mounted projection input system includes:

The instrument panel 100 is used to install the central control display screen 300; and

The projection assembly 200 is connected to the instrument panel 100 and is electrically connected to the central control display screen 300. The projection assembly 200 includes:

Projection laser 210, used to project a virtual keyboard on the object surface;

The camera module 220 is configured to take images of the area where the virtual keyboard is located, so as to obtain input signals corresponding to the user's operations on the virtual keyboard.

In the technical solution of the present application, the projection assembly 200 installed on the instrument panel 100 can facilitate the user to input text or control commands using a virtual keyboard, allowing the user to perform office or entertainment in the car in a more comfortable posture, such as long text input , document management, and playing games to improve user experience. Specifically, the user only needs to use an object with a flat surface, such as the plane object 400, place the plane object 400 on the thigh or the sub-dashboard 500, and then activate the projection assembly 200 to make the projection laser 210 project on the plane object 400 out of the virtual keyboard, and then perform operations such as plain text input or control command input on the virtual keyboard, and the camera module 220 will capture both the virtual keyboard and the user’s operations on the virtual keyboard, so as to identify them from the captured image information Output the input signal corresponding to the user operation, for example, the user taps the letter a to indicate the input text a, or taps the "up arrow" to indicate that the target moves up by one unit. The user's office documents can be displayed on the central control display 300 or on other displays. In this embodiment, the central control display 300 is used to directly display the content of the document and the input signal corresponding to the user's operation. The user can lean on the seat or turn sideways slightly, and perform relevant operations on the virtual keyboard with his hands, while his eyes stay on the central control display 300 in front of the body to confirm whether the operation is correct, so that the user can use a more comfortable It can be used for office work or entertainment, avoiding discomfort and burnout caused by leaning forward to operate the central control display 300 for a long time, thereby improving user experience. It can be understood that when the user has urgent office affairs to deal with but does not have a laptop at hand, the projector assembly 200 can well meet the user's temporary office needs, thereby significantly enriching the functions of the vehicle and improving the market competitiveness of the vehicle.

Referring to FIG. 2, in this embodiment, further, the projection assembly 200 further includes an infrared laser 230 located below the projection laser 210. The infrared laser 230 is used to emit planar infrared rays, and the planar infrared rays intersect with the optical path of the virtual keyboard. . Specifically, when the user uses the planar object 400 to image the virtual keyboard, the infrared rays emitted by the infrared laser 230 are parallel or nearly parallel to the virtual keyboard, and are located above the virtual keyboard; when the user places the finger on the virtual keyboard, Infrared rays will form a light spot on the back of the finger. The camera module 220 takes pictures of the virtual keyboard and the user's fingers on it, and processes the acquired images. The image processing method may be to correct the distorted or non-planar images into normal planar images, and then decolorize the planar images. Grayscale processing, and strengthen the effect of the center of the spot in the planar image, and weaken the peripheral brightness of the spot. Using the light spot on the planar image, calculate the included angle and the offset distance between the optical axis of the camera module 220 and the spot position, so as to obtain the offset position. Since the distance between the camera module 220 and the infrared rays emitted by the infrared laser 230 is already It is known that the coordinate values of x and y corresponding to the position of the light spot are calculated by using trigonometric functions. According to the coordinate values of x and y, compare and find the key position corresponding to the virtual keyboard, pack it into a common input event data packet of the system, and send it to the application layer (central control display 300) for its use, and the corresponding key position It is also displayed on the central control display screen 300, so that the user can quickly identify and confirm whether his input is correct. In this embodiment, infrared rays are used to form a light spot on the user's finger, and the camera module 220 uses the light spot as a medium to calculate and analyze the input signal corresponding to the position of the light spot, which not only has a high recognition rate, but also has low performance requirements for calculation and analysis. In turn, it is beneficial to control the production cost of the product. It should be noted that the planar infrared rays emitted by the infrared laser 230 must at least be able to cover the area where the virtual keyboard is located. However, the present design is not limited thereto. In other embodiments, the camera module can also have a motion capture function, that is, the camera module can directly capture the user's finger operation from the collected images, and combine the functions of each position on the virtual keyboard The input signal corresponding to the finger operation is determined by the coordinate value of the finger.

In this embodiment, in an embodiment, the infrared laser 230 is a cylindrical lens laser. Cylindrical lens laser technology is mature and stable, and can be purchased directly from the market, and the purchase cost is low. However, the design is not limited thereto, and in other embodiments, the infrared laser is a Powell prism laser.

In this embodiment, in an embodiment, the infrared laser 230 uses infrared rays with a wavelength of 850nm-1050nm. Since human eyes cannot see infrared rays with a wavelength of 850nm to 1064nm, and infrared rays in this wavelength range can be recognized by the camera module 220, using this feature allows the infrared laser 230 to use infrared rays with a wavelength of 850nm-1050nm, which can enable users to use When the virtual keyboard is functioning, no obvious light spots will be seen on the back of the finger, so as to avoid unnecessary light pollution and improve user experience.

Referring to FIG. 2 , in this embodiment, in one embodiment, the camera module 220 , the projection laser 210 and the infrared laser 230 are arranged sequentially from top to bottom and located on the same straight line. The camera module 220 is located at the top, which is beneficial to increase the maximum area that can be covered by image acquisition, thereby reducing performance requirements for the camera module 220 . Secondly, the camera module 220, the projection laser 210 and the infrared laser 230 are arranged on the same straight line, so that the central axis of the image collected by the camera module 220 tends to be consistent with the central axis of the virtual keyboard, thereby helping to reduce the workload of image processing , thereby improving the recognition efficiency of the input signal. However, the present design is not limited thereto, and in other embodiments, the camera module and the projection laser may also be located on the same horizontal plane.

In this embodiment, further, the camera module 220 includes a wide-angle camera and a control processor electrically connected to the wide-angle camera, and the control processor is used to analyze and process images to obtain user text input signals or instruction input signals. The control processor is responsible for image processing and calculation and analysis of the input signal corresponding to the spot position. The entire virtual keyboard input function can be completed by inputting data packets from the control display screen 300 for its use and display, thereby improving the application flexibility of the projection assembly 200 and being adaptable to different vehicles and different usage scenarios. However, the design is not limited thereto. In other embodiments, the camera module may also include a wide-angle camera, the wide-angle camera is electrically connected to the central control host of the vehicle, and the central control host is used to receive and analyze images collected by the wide-angle camera to obtain user information. text input signal or command input signal.

In this embodiment, further, the camera module 220 further includes an infrared filter disposed on the front side of the wide-angle camera, and the infrared filter is used for filtering light entering the wide-angle camera. The infrared filter can filter out stray light to filter some environmental interference factors, thereby improving the efficiency of image processing.

In this embodiment, in one embodiment, the operating wavelength of the infrared filter is 950nm to 1000nm, and this wavelength range falls within the operating wavelength range of the infrared laser 230, thereby ensuring that the light spot formed by infrared rays on the back of the finger can be accurately Captured by a wide-angle camera.

1 and 3, in this embodiment, furthermore, the projection assembly 200 is located above the auxiliary instrument panel 500 of the vehicle, and the projection assembly 200 is rotatably connected to the instrument panel 100, so that it can move toward the main driver side 11 and toward the passenger side. Rotate between sides 12. Firstly, by adjusting the working angle of the projection assembly 200, the passengers on the driver's side 11 or the passenger's side 12 can use the virtual keyboard function, thereby improving the flexibility of the vehicle projection input system and improving user experience. Secondly, the projection assembly 200 is arranged above the auxiliary instrument panel 500, so that the user's body is not easy to collide with the projection assembly 200 when a traffic accident occurs, so that the user can be protected from the impact damage of the projection assembly 200, which is conducive to improving vehicle driving. safety. However, the design is not limited thereto. In other embodiments, the projection assembly may also be located in front of the passenger seat, or on the steering column shield of the instrument panel.

Referring to FIG. 3 , in this embodiment, further, the projection assembly 200 further includes a mounting shell that is rotatably connected to the instrument panel 100, and the lower side of the instrument panel 100 is provided with an avoidance hole 101 corresponding to the mounting shell; the camera module 220, the projection laser 210 and The infrared lasers 230 are disposed on the same side of the installation shell, and both are exposed in the escape hole 101 . First, only the camera module 220, the projection laser 210 and the infrared laser 230 are exposed in the avoidance hole 101, and other components are hidden behind the avoidance hole 101, so that the projection assembly 200 can function as much as possible while ensuring normal function. Give users a compact and beautiful experience. Secondly, the lower area of the instrument panel 100 belongs to the non-mainly visible area of the front row passengers, and the projection assembly 200 installed in this area can improve the cleanliness and aesthetics of the car interior.

The installation shell is provided with a rotating shaft, and the instrument panel 100 is provided with a shaft hole corresponding to the rotating shaft, and the rotating shaft is inserted and rotatably connected to the shaft hole, so as to realize the rotation of the projection assembly 200 between facing the main driving side 11 and facing the passenger side 12 . The adjustment of the working angle of the projection assembly 200 is realized by the rotation between the rotation shaft and the shaft hole. This function realizes a simple and mature structure, which is beneficial to reduce the production cost of the vehicle-mounted projection input system. However, the present design is not limited thereto. In other embodiments, a motor may also be connected to the instrument panel, and the installation shell may be driven and connected to the motor so as to be able to rotate relative to the instrument panel.

In this embodiment, further, the projection assembly 200 is slidably connected to the instrument panel 100 so that the height from the ground can be adjusted in the up and down direction. By adjusting the height of the projection assembly 200 from the ground, the projection assembly 200 can be applied to different users or usage scenarios. For example, most users are used to placing the flat object 400 for projecting a virtual keyboard on their laps. The planar object 400 used by different users will be different, and the physical characteristics of different users will be different, resulting in differences in the height of the planar object 400 in use. If the height is high, it can ensure that the infrared laser 230 is above the planar object 400, and the infrared laser can form a light spot on the back of the finger if it is in a suitable height range. However, the present design is not limited thereto. In other embodiments, the instrument panel may also be provided with a motor and a gear connected to the motor for driving, and the installation shell is connected with a rack that fits and meshes with the gear, and the rack extends in the vertical direction.

In this embodiment, in order to simplify the sliding structure between the projection assembly 200 and the instrument panel 100 , in one embodiment, the rotating shaft on the installation shell can be slidably connected to the shaft hole along its own axis direction. However, the present design is not limited thereto. In other embodiments, slide grooves can also be provided on both sides of the installation shell, and guide rails are provided corresponding to the slide grooves on the instrument panel, and the guide rails are slidably connected in the slide grooves.

Referring to FIG. 2 , in this embodiment, in order to simplify the structure of the projection assembly 200 and further reduce the manufacturing cost of the projection assembly 200, further, the projection assembly 200 also includes a printed circuit board connected to the mounting case, a camera module 220, a projection laser 210 And the infrared laser 230 is integrated on the printed circuit board. However, the present design is not limited thereto, and in other embodiments, the camera module, the projection laser and the infrared laser may also be connected to the installation shell respectively.

The present application also proposes a vehicle, including the aforementioned vehicle-mounted projection input system. For the specific structure of the vehicle-mounted projection input system, refer to the above-mentioned embodiments. Since this vehicle adopts all the technical solutions of all the above-mentioned embodiments, it has at least the features of the above-mentioned embodiments. All beneficial effects brought by the technical solution will not be repeated here.

The above are only optional embodiments of the present application, and are not intended to limit the patent scope of the present application. Under the inventive concept of the present application, the equivalent structural transformations made by using the description of the application and the contents of the accompanying drawings, or direct/indirect Applications in other relevant technical fields are included in the patent protection scope of the present application.

Claims

A vehicle projection input system, including:

instrument panel for mounting the central control display; and

The projection assembly is connected to the instrument panel and is electrically connected to the central control display screen, and the projection assembly includes:

A projection laser for projecting a virtual keyboard on the surface of an object;

The camera module is configured to take images of the area where the virtual keyboard is located, so as to obtain input signals corresponding to operations performed by the user on the virtual keyboard.
The vehicle-mounted projection input system according to claim 1, wherein the projection assembly further comprises an infrared laser located below the projection laser, the infrared laser is used to emit planar infrared rays, and the planar infrared rays are compatible with the The light paths of the virtual keyboard are intersecting.
The vehicle-mounted projection input system according to claim 2, wherein the camera module, the projection laser and the infrared laser are arranged sequentially from top to bottom and are located on the same straight line.
The vehicle projection input system according to claim 2, wherein the camera module includes a wide-angle camera and a control processor electrically connected to the wide-angle camera, and the control processor is used to analyze and process the image to obtain user text input signal or command input signal.
The vehicle-mounted projection input system according to claim 4, wherein the camera module further comprises an infrared filter disposed on the front side of the wide-angle camera, and the infrared filter is used to screen the light entering the wide-angle camera The light is filtered.
The vehicle-mounted projection input system according to any one of claims 2 to 5, wherein the projection assembly is located above the sub-dashboard of the vehicle, and the projection assembly is rotatably connected to the dashboard, and can be turned towards the main driver side and the side toward the passenger.
The vehicle-mounted projection input system according to claim 6, wherein the projection assembly further includes a mounting shell rotatably connected to the instrument panel, and an avoidance hole is provided on the underside of the instrument panel corresponding to the mounting shell; The camera module, the projection laser and the infrared laser are arranged on the same side of the installation shell, and are all exposed in the escape hole.
The vehicle-mounted projection input system according to claim 7, wherein the projection assembly further includes a printed circuit board connected to the mounting shell, and the camera module, the projection laser and the infrared laser are integrated on the printed circuit board. circuit board.
The vehicle-mounted projection input system according to claim 1, wherein the projection assembly is slidably connected to the instrument panel, and the height from the ground can be adjusted up and down.
A vehicle, comprising the vehicle projection input system according to any one of claims 1 to 9.