CN113335185A - In-vehicle multifunctional information display device based on aerial imaging and control method - Google Patents
In-vehicle multifunctional information display device based on aerial imaging and control method Download PDFInfo
- Publication number
- CN113335185A CN113335185A CN202110898855.0A CN202110898855A CN113335185A CN 113335185 A CN113335185 A CN 113335185A CN 202110898855 A CN202110898855 A CN 202110898855A CN 113335185 A CN113335185 A CN 113335185A
- Authority
- CN
- China
- Prior art keywords
- unit
- imaging
- passenger
- display device
- information display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
- B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R2011/0042—Arrangements for holding or mounting articles, not otherwise provided for characterised by mounting means
- B60R2011/008—Adjustable or movable supports
- B60R2011/0092—Adjustable or movable supports with motorization
Abstract
The invention relates to an in-vehicle multifunctional information display device based on aerial imaging and a control method, and the device comprises: a control unit; a lifting unit; an integration unit; and an imaging zone; the lifting unit and the integrated unit are arranged in a front-row armrest box between the main driver and the assistant driver, the lifting unit controls the integrated unit to lift or lower according to an input instruction from the control unit, and when the integrated unit is lifted along with the lifting unit from the front-row armrest box, the integrated unit can form images in the imaging area. From this, can be used for accomodating of the integrated unit of mutual aerial formation of image through simple structure realization, have higher stability and convenience when guaranteeing the car interior appearance, aerial imaging technique need not the entity screen and enables the screen size great, improves the security of back row member and can guarantee to take simultaneously and experience, can also carry out health detection etc. outside the broadcast audio-visual, improves the practicality under satisfying recreational condition.
Description
Technical Field
The invention relates to an in-vehicle multifunctional information display device based on aerial imaging and a control method.
Background
With the rapid development of economy, automobiles play an increasingly important role in human life, and the demand of people for automobiles is increased. In the era of intelligent automobiles, automobiles are changed from traveling tools to moving traveling spaces, and the spaces are intelligent cabins to a certain extent. With the comprehensive arrival of the era of intelligent cabins, the competition of related enterprises and products is becoming more and more popular.
On the one hand, because of the great improvement of the intelligent and networking technologies in automobiles, the integrated vision of 'car-person-life' is gradually realized on the automobiles, the intelligent cockpit is a non-negligible important component, and the passenger health detection function is not embodied in the intelligent cockpit at the current stage. On the other hand, in order to allow the passengers in the back row to directly participate in the operation of the central control screen, an embedded or externally-hung touch screen is usually additionally arranged at the back of the front seat, the screen of the front seat is generally small, the experience feeling is poor, and the screen size of the back seat is ensured, but the back seat occupies the cabin space. In other words, most vehicles cannot provide the rear passengers with information display devices comparable to those of the front passengers in order to balance the safety and the entertainment of the rear passengers.
Disclosure of Invention
The problems to be solved by the invention are as follows:
in view of the above problems, an object of the present invention is to provide an in-vehicle multifunctional information display device and a control method based on aerial imaging, so as to achieve rear passenger services that take into account cabin space and experience, including health detection, audio-visual entertainment, mode control, etc.
The technical means for solving the problems are as follows:
the invention provides an in-vehicle multifunctional information display device based on aerial imaging, which comprises:
a control unit for receiving information and outputting instructions;
a lifting unit connected with the control unit in a manner that the lifting is controlled by the control unit;
an integration unit connected with the lifting unit and the control unit in a manner of lifting with the lifting unit; and
the imaging area faces to the passengers in the back row and is used for displaying human-vehicle interaction information;
the lifting unit and the integrated unit are arranged in a front-row armrest box between a main driver and a secondary driver, the lifting unit controls the integrated unit to lift or lower according to an input instruction from the control unit, and when the integrated unit rises from the front-row armrest box along with the lifting unit, an image can be formed in the imaging area in the air.
It is also possible, in the present invention,
the integrated unit is completely accommodated in the front armrest box along with the descending of the lifting unit.
It is also possible, in the present invention,
and a depth camera module used for identifying gestures of passengers and an imaging source module used for imaging in the air of the imaging area are installed on one end side of the integrated unit facing to the passengers in the back row.
It is also possible, in the present invention,
the content displayed in the imaging area by the imaging source module comprises health detection, audio-video entertainment and mode control.
It is also possible, in the present invention,
in the interaction process, the depth camera module identifies the gestures of the passengers and the regions where the gestures are located, corresponding to the regions of the imaging region, in real time and outputs the gestures to the control unit, and the control unit judges the gestures and realizes corresponding functions in a mode of meeting the operation intentions represented by the gestures.
It is also possible, in the present invention,
an active light emitting module and an active light receiving module are also mounted on an end side of the integrated unit facing a rear passenger.
It is also possible, in the present invention,
the active light emitting module actively emits light with the wavelength within the range of 510-1000 nm to the hand area of a passenger according to the health detection instruction;
the active light receiving module actively receives light with the wavelength of 510-1000 nm, for example, scattered back from the hand area of the passenger according to the health detection instruction.
It is also possible, in the present invention,
the integrated unit is formed into a structure hinged with the front-row armrest box, when the lifting unit is lifted, the integrated unit is pushed upwards, and the integrated unit rotates around the shaft and protrudes out of the front-row armrest box.
It is also possible, in the present invention,
the integrated unit is formed into a structure which is not connected with the front row armrest box, when the lifting unit is lifted and pushed upwards, the integrated unit is integrally lifted and protrudes out of the front row armrest box.
It is also possible, in the present invention,
and an integrated unit switch button for controlling the on and off of the multifunctional information display device in the vehicle is also arranged on the front armrest box.
The invention provides a control method of an in-vehicle multifunctional information display device based on aerial imaging, which is based on the control method of the in-vehicle multifunctional information display device based on aerial imaging and comprises the following steps: starting the multifunctional information display device in the vehicle and lifting the integrated unit; the imaging source module carries out aerial imaging; the depth camera module detects passenger gestures; the control unit judges the gestures of the passengers and executes corresponding functions; and closing the multifunctional information display device in the vehicle and descending the integrated unit.
It is also possible, in the present invention,
and the control unit receives command signals of the switch buttons of the integrated unit and/or voice input signals from the human-computer interaction device in real time.
It is also possible, in the present invention,
if the switch button of the integrated unit is in an open state or a passenger inputs an instruction for opening the multifunctional information display device in the vehicle by voice, the control unit controls the lifting unit to lift the integrated unit from the front-row armrest box, otherwise, the multifunctional information display device in the vehicle is closed.
It is also possible, in the present invention,
the depth camera module detects the gesture position and gesture action of a passenger in real time, and inputs a detection result to the control unit, and if in T1 time, the passenger sets the switch button of the integrated unit to be in a closed state, or the passenger inputs an instruction for closing the multifunctional information display device through voice, the multifunctional information display device in the vehicle is closed.
It is also possible, in the present invention,
if the depth camera module detects that the passenger gesture occurs outside the recognizable area of the imaging area within the time T1, the control unit judges that the passenger gesture is invalid, and the imaging area displays prompt content and lasts for the time T2 or carries out voice prompt through a voice assistant.
It is also possible, in the present invention,
if the depth camera module detects that the passenger gesture occurs in the recognizable area of the imaging area within the time of T1, the control unit judges that the passenger gesture is effective and controls the imaging source module to display corresponding content or start a corresponding function in the imaging area according to the meaning of the passenger gesture action.
It is also possible, in the present invention,
and if the control unit judges that the meaning of the gesture action of the passenger is to start the health detection function, displaying the shape of the hand in the imaging area, and giving correct operation prompt contents asking the passenger to place the hand in the area by voice or characters.
It is also possible, in the present invention,
the active light emitting module emits light with the wavelength within the range of 510-1000 nm to the hand area of a passenger, the active light receiving module receives light with the wavelength within the range of 510-1000 nm scattered back from the hand area of the passenger, the control unit calculates the heart rate and the blood oxygen saturation of the passenger according to the attenuation degree of the light, and the information is displayed in the imaging area in a dynamic health portrait mode.
It is also possible, in the present invention,
and prompting passengers to complete personal information in the imaging area, calculating more detailed health parameters of the passengers by the control unit according to the personal information, sending the results to a passenger mailbox in a report form, and displaying the health parameters in the imaging area.
It is also possible, in the present invention,
when the multifunctional information display device in the vehicle is closed, the imaging source module, the active light emitting module, the active light receiving module and the depth camera module are closed in sequence, if a certain module is not opened or does not exist, the integrated unit is skipped, if the integrated unit is in a rising state, the integrated unit is dropped, and if the integrated unit is in a falling state, the integrated unit is skipped.
The invention has the following effects:
the invention can provide an in-vehicle multifunctional information display device based on aerial imaging and a control method, realizes the storage of an integrated unit for interactive aerial imaging through a simple structure, ensures the appearance in the vehicle and has higher stability and convenience, the aerial imaging technology does not need a solid screen and can ensure larger screen size, the safety of rear members is improved, the riding experience can be ensured, health detection can be carried out besides audio and video playing, and the practicability is improved under the condition of meeting entertainment.
Drawings
FIG. 1 is a schematic view of the structure of a multifunctional information display device in a vehicle;
fig. 2 is a flowchart according to a control method of the in-vehicle multifunction information display apparatus;
description of the symbols:
1-a control unit; 2-a lifting unit; 3-an integration unit; 4-a depth camera module; 5-imaging source module; 6-an active light emitting module; 7-an active light receiving module; 8-front row armrest box; 9-integrated unit switch button; 10-imaging zone.
Detailed Description
The present invention is further described below in conjunction with the following embodiments, which are to be understood as merely illustrative, and not restrictive, of the invention. The same or corresponding reference numerals denote the same components in the respective drawings, and redundant description is omitted. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Disclosed herein is an in-vehicle multifunctional information display device (hereinafter, simply referred to as a display device) based on aerial imaging, which is installed in a front-row armrest box, i.e., an armrest box between a main driver and a passenger driver, and fig. 1 is a schematic structural view of the in-vehicle multifunctional information display device, and as shown in fig. 1, includes: a control unit 1, a lifting unit 2 connected to the control unit 1 in such a manner that lifting is controlled by the control unit 1, an integration unit 3 connected to the lifting unit 2 and the control unit 1 in such a manner that lifting is controlled by the lifting unit 2, and an image forming area 10 facing a rear passenger. The control unit 1 is connected with the lifting unit 2 and used for inputting information such as opening and closing of the integrated unit, passenger clicking functional application and the like in real time and outputting corresponding control instructions according to control logic so as to realize human-vehicle interactive inward display. The lifting unit 2 controls the integrated unit 3 to be lifted or lowered according to an input command from the control unit 1, and when the integrated unit 3 is lifted with the lifting unit from the front armrest box 8, the imaging area 10 can be projected to the rear row.
Specifically, the front armrest box 8 is a hollow structure, is a mounting carrier for the lifting unit 2 and the integrated unit 3, and is internally provided with an in-vehicle multifunctional information display device, and when the lifting unit 2 is completely lowered, the lifting unit is completely accommodated in the front armrest box 8, and is integrally observed from the outside, and the surface of the front armrest box is not provided with a protrusion. So can guarantee the clean and tidy and pleasing to the eye of car internal assembly, can also guarantee display device's safety simultaneously, especially if install on it if expose for a long time and receive the damage outside easily like precision devices such as camera, nevertheless drive integrated unit 3 through the control unit 1 control lifting unit 2 and hold in front-seat handrail case 8, just can avoid unnecessary to touch well.
In the present invention, the control unit 1 may be installed in the front armrest box 8 or may be installed in another reasonable position, and is not particularly limited. In the present invention, the lifting unit 2 is electrically connected to the control unit 1, and has one end fixed inside the front armrest box 8 and the other end connected to the bottom surface of the integrated unit 3 by using a sleeve-type lifting mechanism, and the integrated unit 3 is pushed out of or retracted into the front armrest box 8 as it is lifted, but the lifting unit 2 is not limited to the above, and may have a scissor-type, retractable, articulated arm, slider crank, screw-type, or other structure, as long as the lifting function is realized.
In the present invention, the integrated unit 3 is a functional module for inputting and outputting human-vehicle interaction information, and mainly includes a depth camera module 4 and an imaging source module 5. Wherein, degree of depth camera module 4 is used for discerning the passenger gesture, specifically includes gesture position and gesture action. And the imaging source module 5 outputs and displays the interactive content according to the interactive logic instruction. In the interaction process, the depth camera module 4 senses the passenger gesture in real time and the area where the gesture is located corresponds to the area of the imaging area 10, detects the passenger gesture and outputs the passenger gesture to the control unit 1, and the control unit 1 judges the gesture and realizes corresponding functions in a mode of meeting the operation intention represented by the gesture, for example, controls the imaging content of the imaging source module 5 and the like.
In addition, in the present invention, the integrated unit 3 may further include an active light emitting module 6 and an active light receiving module 7. Wherein, the active light emitting module 6 actively emits light with a wavelength ranging from 510 to 1000nm to the hand region of the passenger according to the health detection instruction. The active light receiving module 7 actively receives light with a wavelength of 510-1000 nm, for example, scattered from the hand region of the passenger according to the health detection instruction.
As shown in fig. 1, the integration unit 3 is configured such that one end side (one side) near the front in the vehicle longitudinal direction is hinged to the front armrest box 8, the depth camera module 4, the imaging source module 5, the active light emitting module 6, and the active light receiving module 7 are mounted on the end surface of the opposite end side (one end side near the rear in the vehicle longitudinal direction), and the connection position of the lifting unit 2 and the integration unit 3 is the side of the bottom of the integration unit 3 relatively distant from the hinged side. When the lifting unit 2 is lifted, the lifting unit is pushed upwards, and the integrated unit 3 rotates around a shaft (around a hinged side) to expose the depth camera module 4, the imaging source module 5, the active light emitting module 6 and the active light receiving module 7 which are arranged at the other end, so that the required operation is realized. However, the integrated unit 3 may be integrally raised from the front armrest box 8, the connection position of the lifting unit 2 and the integrated unit 3 may be the bottom of the integrated unit 3, and the vicinity of the center may be preferable in the case of the telescopic lifting structure to ensure stability.
In addition, in the invention, an integrated unit switch button 9 can be additionally arranged on the front armrest box 8, and the multifunctional information display device in the vehicle can be directly controlled to be turned on and off through the integrated unit switch button. Compared with an electronic interactive switch, the mechanical switch has the advantages of being more visual and convenient.
In the invention, after the integrated unit 3 is lifted from the front armrest box 8 through the lifting unit 2, the imaging source module 5 forms the imaging area 10 according to the interactive logic instruction and by the interactive aerial imaging technology without imaging backwards through any bearing medium. After the multifunctional information display device in the vehicle is turned on, various information can be projected and imaged in the imaging area 10, and human-vehicle interaction also occurs in the area. Specifically, the interactive aerial imaging technology is an aerial imaging method based on optical waveguide by applying a light field reconstruction principle, a novel material negative refraction flat lens with a negative refraction function is arranged in front of a projection lens, and light rays emitted by the lens are converged again in the air by utilizing the light field reconstruction principle, so that a real image without medium bearing is formed, and direct interaction of content presented by people and the aerial real image can be realized by combining the interactive technology based on the aerial real image. That is to say, the invention realizes the aerial medium-free imaging through the imaging source module 5, and simultaneously realizes the direct interaction of the human and the aerial real image through the depth camera module 4. The number, model, installation mode, and the like of the depth camera modules 4 are not limited as long as the passenger motion can be sensed and information such as distance can be acquired.
In addition, in the present invention, the position of the imaging source module 5 in the integrated unit 3 can be adjusted, for example, the imaging source module 5 is relatively extended forward by two centimeters or retracted back by two centimeters through a structure such as a slide rail, so as to achieve adjustment within a specified range of the imaging area 10, thereby further improving the driving experience of the passengers in the back row and making the operation of the passengers in the sensing area of the imaging area 10 more comfortable.
Hereinafter, a control method of an in-vehicle multifunctional information display apparatus according to the present invention will be described with reference to the flowchart of fig. 2, including the steps of: turning on the display device to raise the integrated unit 3; the imaging source module 5 performs aerial imaging; the depth camera module 4 detects the gesture of the passenger; the control unit 1 judges the gesture of the passenger and executes the corresponding function; turning off the display device lowers the integration unit 3. The details are as follows.
Step 1: the control unit 1 receives command signals such as the switch button 9 of the integrated unit and/or voice input signals from the man-machine interaction device in real time, and then enters step 2.
Step 2: if the integrated unit switch button 9 is in the on state or the passenger has inputted an instruction to turn on the multifunction information display device by voice, the process proceeds to step 3, otherwise, the process proceeds directly to step 14 described later.
And step 3: the control unit 1 controls the lifting unit 2 to lift the integrated unit 3 from the front armrest box 8, and then proceeds to step 4.
And 4, step 4: the imaging source module 5 displays default menu items including but not limited to health check, video entertainment, mode control, etc. in the imaging area 10, and then proceeds to step 5.
And 5: the depth camera module 4 detects the gesture position and gesture action of the passenger in real time, inputs the detection result to the control unit 1, and then enters step 6.
Step 6: if the passenger sets the integrated unit switch button 9 to the off state within the time T1 or the passenger has voice-input an instruction to turn off the multi-function information display device, the process proceeds directly to step 14, otherwise to step 7.
And 7: if the depth camera module 4 detects that the passenger gesture occurs in a certain range before and after the imaging area within the time period of T1, that is, in the recognizable area, the control unit 1 determines that the passenger gesture is valid, and then the process goes to step 9; if the depth camera module 4 detects that the passenger gesture occurs outside the recognizable region within the time T1, the control unit 1 determines that the passenger gesture is invalid, and proceeds to step 8.
And 8: the imaging area 10 displays the content of the prompt on how to operate correctly for time T2, or is voice prompted by a voice assistant, and step 5 is entered.
And step 9: if the control unit 1 determines that the meaning of the gesture action of the passenger is to switch on the health detection function, step 11 is entered, if not step 10 is entered.
Step 10: the control unit 1 controls the imaging source module 5 to display corresponding content or start a corresponding function in the imaging area 10 according to the requirement of the passenger gesture action, i.e. the meaning of the passenger gesture action, and then the step 5 is performed.
Step 11: the shape of the hand is displayed in the imaging area 10 and a prompt is given in voice or text for the correct operation asking the passenger to place the hand in the area, and then the process proceeds to step 12.
Step 12: the active light emitting module 6 emits light with a wavelength within a range of 510-1000 nm to a hand region of a passenger, and the active light receiving module 7 receives light with a wavelength within a range of 510-1000 nm scattered back from the hand region of the passenger, and then the step 13 is performed. In the invention, the active light emitting module 6 can emit light rays with different wavelengths within the range of 510-1000 nm, the absorption degrees of human biological tissues are different, only one wavelength of light ray can be used during detection, and light rays with multiple wavelengths can be mixed to enhance the anti-interference performance and the accuracy of detection, and the specific wavelength depends on the scene of target application, for example, the commonly used wavelengths are 542nm, 570nm, 660nm, 805nm, 810nm, 850nm and 940 nm.
Step 13: the control unit 1 calculates the heart rate and the blood oxygen saturation of the passenger according to the attenuation degree of the light, displays the information in the imaging area 10 in a dynamic health portrait mode, and simultaneously displays whether the personal information is complete in the imaging area 10, such as prompts including information of height, weight, mailbox and the like, if the passenger is complete in the information, the control unit 1 calculates more detailed health parameters of the passenger according to the information, sends the results to the passenger mailbox in a report mode, displays the health parameters in the imaging area 10 in a richer mode, and then enters step 5. The invention discloses a PPG (photoplethysmography) method which is used for detecting heart rate and blood oxygen saturation, and adopts the technical principle of photoplethysmography. Specifically, with each heartbeat, the geometry (due to the change of volume) and the property (due to the change of blood components) of the blood vessel are changed, the absorption and attenuation degrees of light are changed, the signal quantity monitored by the detection device is also changed, and the real-time heart rate and the average heart rate in a period of time can be calculated by confirming the time interval of the occurrence of two heartbeats through an algorithm; the oxyhemoglobin and the reduced hemoglobin of the human body have different effects on the absorption of light rays with different wavelengths, so that the light rays with two or more different wavelengths are adopted to irradiate human tissues, then the detection device respectively monitors the signal quantity change conditions of the light rays, and the blood oxygen saturation can be calculated through an algorithm.
Step 14: the method comprises the steps of sequentially turning off an imaging source module 5 (if so, not turning over), turning off an active light emitting module 6 (if so, not turning over), turning off an active light receiving module 7 (if so, not turning over), turning off a depth camera module 4 (if so, not turning over), if a certain module does not exist, turning over, lowering an integrated unit 3 (if so, lowering, not turning over), and ending the in-vehicle multifunctional information display function.
Therefore, based on the multifunctional information display device in the vehicle, the integration unit 3 can be completely accommodated in the front armrest box 8 through the lifting unit 2 capable of freely lifting when not in use, the appearance and the practicability of the intelligent cabin are not influenced, meanwhile, the precision instrument can be protected from dust and daily collision, and the service life of the device is prolonged. And based on the interactive aerial imaging technology, the passengers in the back row can enjoy a larger screen while protecting safety, perform audio-visual entertainment or mode control and the like, improve the driving experience of all users as much as possible and enrich the intelligent driving function. And, additionally set up initiative emission of light module 6 and initiative optical receiver module 7, can carry out health detection to the passenger through simple mode to show abundantly in formation of image district 10, increase the practicality of intelligent passenger cabin when satisfying recreational, avoid the back row passenger boring and tasteless to take and experience.
The above embodiments are intended to illustrate and not to limit the scope of the invention, which is defined by the claims, but rather by the claims, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims (20)
1. An in-vehicle multifunctional information display device based on aerial imaging is characterized by comprising:
a control unit for receiving information and outputting instructions;
a lifting unit connected with the control unit in a manner that the lifting is controlled by the control unit;
an integration unit connected with the lifting unit and the control unit in a manner of lifting with the lifting unit; and
the imaging area faces to the passengers in the back row and is used for displaying human-vehicle interaction information;
the lifting unit and the integrated unit are arranged in a front-row armrest box between a main driver and a secondary driver, the lifting unit controls the integrated unit to lift or lower according to an input instruction from the control unit, and when the integrated unit rises from the front-row armrest box along with the lifting unit, an image can be formed in the imaging area in the air.
2. The in-vehicle multifunctional information display device based on aerial imaging according to claim 1,
the integrated unit is completely accommodated in the front armrest box along with the descending of the lifting unit.
3. The in-vehicle multifunctional information display device based on aerial imaging according to claim 1,
and a depth camera module used for identifying gestures of passengers and an imaging source module used for imaging in the air of the imaging area are installed on one end side of the integrated unit facing to the passengers in the back row.
4. The in-vehicle multifunctional information display device based on aerial imaging according to claim 3,
the content displayed in the imaging area by the imaging source module comprises health detection, audio-video entertainment and mode control.
5. The in-vehicle multifunctional information display device based on aerial imaging according to claim 3,
in the interaction process, the depth camera module identifies the gestures of the passengers and the regions where the gestures are located, corresponding to the regions of the imaging region, in real time and outputs the gestures to the control unit, and the control unit judges the gestures and realizes corresponding functions in a mode of meeting the operation intentions represented by the gestures.
6. The in-vehicle multifunctional information display device based on aerial imaging according to claim 3,
an active light emitting module and an active light receiving module are also mounted on an end side of the integrated unit facing a rear passenger.
7. The in-vehicle multifunctional information display device based on aerial imaging according to claim 6,
the active light emitting module actively emits light with the wavelength within the range of 510-1000 nm to the hand area of a passenger according to the health detection instruction;
the active light receiving module actively receives light with the wavelength of 510-1000 nm, for example, scattered back from the hand area of the passenger according to the health detection instruction.
8. The in-vehicle multifunctional information display device based on aerial imaging according to claim 1,
the integrated unit is formed into a structure hinged with the front-row armrest box, when the lifting unit is lifted, the integrated unit is pushed upwards, and the integrated unit rotates around the shaft and protrudes out of the front-row armrest box.
9. The in-vehicle multifunctional information display device based on aerial imaging according to claim 1,
the integrated unit is formed into a structure which is not connected with the front row armrest box, when the lifting unit is lifted and pushed upwards, the integrated unit is integrally lifted and protrudes out of the front row armrest box.
10. The in-vehicle multifunctional information display device based on aerial imaging according to claim 1,
and an integrated unit switch button for controlling the on and off of the multifunctional information display device in the vehicle is also arranged on the front armrest box.
11. A control method of an in-vehicle multifunctional information display device based on aerial imaging, which is based on the control method of the in-vehicle multifunctional information display device based on aerial imaging according to any one of claims 1 to 10, and comprises the following steps: starting the multifunctional information display device in the vehicle and lifting the integrated unit; the imaging source module carries out aerial imaging; the depth camera module detects passenger gestures; the control unit judges the gestures of the passengers and executes corresponding functions; and closing the multifunctional information display device in the vehicle and descending the integrated unit.
12. The control method according to claim 11,
and the control unit receives command signals of the switch buttons of the integrated unit and/or voice input signals from the human-computer interaction device in real time.
13. The control method according to claim 12,
if the switch button of the integrated unit is in an open state or a passenger inputs an instruction for opening the multifunctional information display device in the vehicle by voice, the control unit controls the lifting unit to lift the integrated unit from the front-row armrest box, otherwise, the multifunctional information display device in the vehicle is closed.
14. The control method according to claim 10,
the depth camera module detects the gesture position and gesture action of a passenger in real time, and inputs a detection result to the control unit, and if in T1 time, the passenger sets the switch button of the integrated unit to be in a closed state, or the passenger inputs an instruction for closing the multifunctional information display device through voice, the multifunctional information display device in the vehicle is closed.
15. The control method according to claim 14,
if the depth camera module detects that the passenger gesture occurs outside the recognizable area of the imaging area within the time T1, the control unit judges that the passenger gesture is invalid, and the imaging area displays prompt content and lasts for the time T2 or carries out voice prompt through a voice assistant.
16. The control method according to claim 14,
if the depth camera module detects that the passenger gesture occurs in the recognizable area of the imaging area within the time of T1, the control unit judges that the passenger gesture is effective and controls the imaging source module to display corresponding content or start a corresponding function in the imaging area according to the meaning of the passenger gesture action.
17. The control method according to claim 16,
and if the control unit judges that the meaning of the gesture action of the passenger is to start the health detection function, displaying the shape of the hand in the imaging area, and giving correct operation prompt contents asking the passenger to place the hand in the area by voice or characters.
18. The control method according to claim 17,
the active light emitting module emits light with the wavelength within the range of 510-1000 nm to the hand area of a passenger, the active light receiving module receives light with the wavelength within the range of 510-1000 nm scattered back from the hand area of the passenger, the control unit calculates the heart rate and the blood oxygen saturation of the passenger according to the attenuation degree of the light, and the information is displayed in the imaging area in a dynamic health portrait mode.
19. The control method according to claim 18,
and prompting passengers to complete personal information in the imaging area, calculating more detailed health parameters of the passengers by the control unit according to the personal information, sending the results to a passenger mailbox in a report form, and displaying the health parameters in the imaging area.
20. The control method according to claim 11,
when the multifunctional information display device in the vehicle is closed, the imaging source module, the active light emitting module, the active light receiving module and the depth camera module are closed in sequence, if a certain module is not opened or does not exist, the integrated unit is skipped, if the integrated unit is in a rising state, the integrated unit is dropped, and if the integrated unit is in a falling state, the integrated unit is skipped.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110898855.0A CN113335185B (en) | 2021-08-06 | 2021-08-06 | In-vehicle multifunctional information display device based on aerial imaging and control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110898855.0A CN113335185B (en) | 2021-08-06 | 2021-08-06 | In-vehicle multifunctional information display device based on aerial imaging and control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113335185A true CN113335185A (en) | 2021-09-03 |
| CN113335185B CN113335185B (en) | 2021-11-09 |
Family
ID=77480979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110898855.0A Active CN113335185B (en) | 2021-08-06 | 2021-08-06 | In-vehicle multifunctional information display device based on aerial imaging and control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113335185B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114030355A (en) * | 2021-11-15 | 2022-02-11 | 智己汽车科技有限公司 | Vehicle control method and device, vehicle and medium |
| CN116215341A (en) * | 2023-01-06 | 2023-06-06 | 安徽省东超科技有限公司 | Armrest box assembly for vehicle and vehicle |
| CN116627260A (en) * | 2023-07-24 | 2023-08-22 | 成都赛力斯科技有限公司 | Method and device for idle operation, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150379362A1 (en) * | 2013-02-21 | 2015-12-31 | Iee International Electronics & Engineering S.A. | Imaging device based occupant monitoring system supporting multiple functions |
| CN108919959A (en) * | 2018-07-23 | 2018-11-30 | 奇瑞汽车股份有限公司 | Vehicle man machine's exchange method and system |
| CN208615813U (en) * | 2017-07-10 | 2019-03-19 | 现代摩比斯株式会社 | Side view imaging device for vehicle |
| CN109823287A (en) * | 2019-01-31 | 2019-05-31 | 重庆长安汽车股份有限公司 | A kind of holography occupant's working entertainment system and automobile |
| CN112860056A (en) * | 2019-11-12 | 2021-05-28 | 现代自动车株式会社 | Back seat entertainment system, back seat entertainment remote controller and method thereof |
| CN113085723A (en) * | 2021-06-09 | 2021-07-09 | 智己汽车科技有限公司 | Device and method for displaying information outside vehicle |
-
2021
- 2021-08-06 CN CN202110898855.0A patent/CN113335185B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150379362A1 (en) * | 2013-02-21 | 2015-12-31 | Iee International Electronics & Engineering S.A. | Imaging device based occupant monitoring system supporting multiple functions |
| CN208615813U (en) * | 2017-07-10 | 2019-03-19 | 现代摩比斯株式会社 | Side view imaging device for vehicle |
| CN108919959A (en) * | 2018-07-23 | 2018-11-30 | 奇瑞汽车股份有限公司 | Vehicle man machine's exchange method and system |
| CN109823287A (en) * | 2019-01-31 | 2019-05-31 | 重庆长安汽车股份有限公司 | A kind of holography occupant's working entertainment system and automobile |
| CN112860056A (en) * | 2019-11-12 | 2021-05-28 | 现代自动车株式会社 | Back seat entertainment system, back seat entertainment remote controller and method thereof |
| CN113085723A (en) * | 2021-06-09 | 2021-07-09 | 智己汽车科技有限公司 | Device and method for displaying information outside vehicle |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114030355A (en) * | 2021-11-15 | 2022-02-11 | 智己汽车科技有限公司 | Vehicle control method and device, vehicle and medium |
| CN116215341A (en) * | 2023-01-06 | 2023-06-06 | 安徽省东超科技有限公司 | Armrest box assembly for vehicle and vehicle |
| CN116627260A (en) * | 2023-07-24 | 2023-08-22 | 成都赛力斯科技有限公司 | Method and device for idle operation, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113335185B (en) | 2021-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113335185B (en) | In-vehicle multifunctional information display device based on aerial imaging and control method | |
| JP6650032B2 (en) | Vehicle control system based on human face recognition | |
| US20200331486A1 (en) | Autonomous vehicles and methods of using same | |
| JP3632607B2 (en) | Vehicle expression operation control system, vehicle communication system, and vehicle for expression operation | |
| WO2018208776A1 (en) | Integration of occupant monitoring systems with vehicle control systems | |
| US20030060937A1 (en) | Vehicle information processing device, vehicle, and vehicle information processing method | |
| JP7302005B2 (en) | Vehicle interaction method and device, electronic device, storage medium, and vehicle | |
| KR102135379B1 (en) | Robot for vehicle and control method of the robot | |
| JP2016137871A (en) | Vehicular occupant feeling correspondence control device | |
| JP2016137204A (en) | Control device for coping with feeling of passenger for vehicle | |
| CN113401015A (en) | Multifunctional in-vehicle entertainment and office system, method and electronic equipment | |
| RU2753010C1 (en) | Vehicle interior lighting system, method for activating vehicle interior lighting system and data carrier | |
| CN112455462B (en) | Passenger cabin system | |
| CN113459975A (en) | Intelligent cabin system | |
| JP2016137202A (en) | Control device for coping with feeling of passenger for vehicle | |
| CN218675975U (en) | Vehicle and air interaction system thereof | |
| Sawabe et al. | Xr mobility platform: Multi-modal xr system mounted on autonomous vehicle for passenger’s comfort improvement | |
| CN112297842A (en) | Autonomous vehicle with multiple display modes | |
| EP3862225B1 (en) | Vehicle cabin lighting system | |
| WO2021043559A1 (en) | Communication system in a vehicle and method for operating a communication system in a vehicle | |
| KR20210090764A (en) | Smart Car seat and Smart Car seat System having the same | |
| CN217885496U (en) | Intelligent game chair with emotion recognition and lamplight interaction functions | |
| WO2022196810A1 (en) | Attachment structure for functional component and interior member | |
| CN220904867U (en) | Vehicle with a wheel | |
| JP2022065778A (en) | Movable body and input device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |