CN113492756A - Method, device, equipment and storage medium for displaying vehicle external information - Google Patents
Method, device, equipment and storage medium for displaying vehicle external information Download PDFInfo
- Publication number
- CN113492756A CN113492756A CN202110745046.6A CN202110745046A CN113492756A CN 113492756 A CN113492756 A CN 113492756A CN 202110745046 A CN202110745046 A CN 202110745046A CN 113492756 A CN113492756 A CN 113492756A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- information
- outside
- object outside
- passenger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 230000006870 function Effects 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 11
- 230000008921 facial expression Effects 0.000 claims description 4
- 230000009467 reduction Effects 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 4
- 210000001747 pupil Anatomy 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method, a device, equipment and a storage medium for displaying vehicle-exterior information, wherein the method comprises the steps of collecting passenger sight line information in real time under the state that a vehicle-exterior information interaction function is started; determining an object outside the vehicle, which is observed by the passenger, according to the passenger sight line information; acquiring image information of the target object outside the vehicle; acquiring vehicle position information; acquiring basic information of the object outside the vehicle based on the image information and the vehicle position information of the object outside the vehicle; the basic information comprises one or more combinations of vehicle-exterior scene information, position information, names and appearances corresponding to the vehicle-exterior target objects; and displaying the basic information of the object outside the vehicle on the vehicle window display module. According to the invention, when a passenger has a demand for knowing the information outside the vehicle, the information outside the vehicle can be displayed on the vehicle window in real time, so that the passenger can quickly acquire the information outside the vehicle, and obtain rich entertainment information and interesting riding experience.
Description
Technical Field
The invention relates to the technical field of vehicles, in particular to a method, a device, equipment and a storage medium for displaying vehicle exterior information.
Background
With the gradual development of the automobile industry, the functions of vehicles are increasingly enriched, and the vehicle-mounted intelligent cabin system is widely applied. In the driving process of a vehicle, the vehicle-mounted intelligent cabin system can provide intelligent and comfortable driving experience for a user, however, passengers sometimes want to know real-time changing vehicle-mounted information such as mountains, buildings, rivers and the like, the current intelligent cabin system focuses on a vehicle-mounted entertainment system, the information source of the entertainment system is limited to a vehicle-mounted built-in information source, and the requirement that the passengers know the vehicle-mounted information cannot be met.
In order to improve the riding experience, people gradually integrate some hardware, such as a transparent display screen, a camera, a positioning device and the like, on the vehicle/window to increase the function of the window, so as to provide better interaction experience for passengers when the passengers want to know information outside the vehicle. However, in the prior art, the vehicle external information acquired through the camera, the positioning device and the like is generally limited to a specific landmark building on a specific line, and the experience is monotonous; in practical application, the driving route of the automobile has great flexibility, and simultaneously, the information outside the automobile, which the passengers want to know, has uncertainty and diversity, such as mountains, buildings, rivers and the like. Accordingly, there is a need for improvements in the prior art to better meet the needs of passengers for information outside of a vehicle.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides a vehicle exterior information display method in a first aspect, which comprises the following steps:
acquiring passenger sight line information in real time when the information interaction function outside the vehicle is in an open state;
determining an object outside the vehicle, which is observed by the passenger, according to the passenger sight line information;
acquiring image information of the target object outside the vehicle;
acquiring vehicle position information;
acquiring basic information of the object outside the vehicle based on the image information of the object outside the vehicle and the vehicle position information; wherein the basic information comprises a combination of one or more of the vehicle-exterior scene information, the position information, the name and the appearance corresponding to the vehicle-exterior target object;
and displaying the basic information of the object outside the vehicle on a vehicle window display module.
The second aspect of the present invention provides an external information display device, comprising:
the in-vehicle image acquisition module is used for acquiring passenger sight line information in real time when the out-vehicle information interaction function is in an open state;
the image processing module is used for determining an object outside the vehicle, which is observed by a passenger, according to the passenger sight line information;
the vehicle exterior image acquisition module is used for acquiring image information of the vehicle exterior target object;
the vehicle positioning module is used for acquiring vehicle position information;
the basic information acquisition module is used for acquiring basic information of the object outside the vehicle based on the image information of the object outside the vehicle and the vehicle position information; wherein the basic information comprises a combination of one or more of the vehicle-exterior scene information, the position information, the name and the appearance corresponding to the vehicle-exterior target object;
and the basic information display module is used for displaying the basic information of the target object outside the vehicle on the vehicle window display module.
A third aspect of the present invention provides an electronic device, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or a set of instructions, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the vehicle exterior information display method according to the first aspect of the present invention.
A fourth aspect of the present invention provides a computer-readable storage medium, wherein at least one instruction, at least one program, a code set, or a set of instructions is stored in the storage medium, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the vehicle exterior information display method according to the first aspect of the present invention.
Aiming at the problem that the existing vehicle-mounted intelligent cabin system has single information source input and cannot intelligently display the information outside the vehicle according to the real-time information change outside the vehicle, the invention adds the functions of acquiring and analyzing the information outside the vehicle on the basis of the current vehicle-mounted intelligent cabin system, quickly analyzes the intention of a passenger, judges whether the passenger has the requirement of knowing the information outside the vehicle, and displays the corresponding information outside the vehicle on the vehicle window in real time according to the analysis result, so that the passenger can quickly acquire the information outside the vehicle, and obtain rich entertainment information and interesting riding experience.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a method for displaying information outside a vehicle according to an embodiment of the present invention;
FIG. 2 is a flowchart of step S104 provided by the embodiment of the present invention;
FIG. 3 is a flow chart of another method for displaying information outside a vehicle according to an embodiment of the present invention;
FIG. 4 is a flow chart of yet another method for displaying information outside a vehicle according to an embodiment of the present invention;
fig. 5 is a block diagram of a vehicle exterior information display device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention. It should be noted that although the embodiments of the present invention provide the method operation steps as described in the embodiments or flowcharts, more or less operation steps may be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In practice, the system or server product may be implemented in a sequential or parallel manner (e.g., parallel processor or multi-threaded environment) according to the embodiments or methods shown in the figures.
And that the described embodiments are a subset of the embodiments of the invention, rather than a whole embodiment. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. Examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout.
Examples
In the running process of a vehicle, passengers sometimes want to know information outside the vehicle, such as mountains, buildings, rivers and the like, the information source input of the existing vehicle-mounted intelligent cabin system is single, for example, the information source of an entertainment system is limited to a vehicle-mounted built-in information source, the information outside the vehicle cannot be rapidly and effectively acquired, and the updating and interaction of real-time data outside the vehicle are lacked.
The vehicle-mounted information provided by other applications is single in display form and cannot be reasonably displayed fully according to the intention of a passenger, for example, the current partial map software is integrated with a GPS-based scenic spot information broadcasting function, the form is limited to voice broadcasting, the broadcasting content is single, and the vehicle-mounted information cannot be displayed in a targeted manner according to the intention of the passenger.
In order to solve the problems, the embodiment of the invention adds the functions of acquiring and analyzing the information outside the vehicle on the basis of the current vehicle-mounted intelligent cabin system to quickly analyze the intention of the passenger and display the information outside the vehicle on the vehicle window in real time, so that the passenger can quickly acquire the information outside the vehicle and obtain rich entertainment information and interesting riding experience. Fig. 1 is a flowchart of an off-vehicle information display method provided in an embodiment of the present invention, specifically as shown in fig. 1, the method may include the following steps:
s101: acquiring passenger sight line information in real time when the information interaction function outside the vehicle is in an open state;
for example, the step of collecting the passenger sight line information may be that a built-in vehicle-mounted image collecting device is used for collecting a face image of a user, and the passenger sight line information is extracted from the face image; the built-in vehicle-mounted image acquisition equipment can be a camera arranged in the vehicle;
the sight line information of the passenger can be geometric feature information of the face and the eyes of the passenger, such as pupil position information and iris position information.
S102: determining an object outside the vehicle, which is observed by a passenger, according to the sight line information of the passenger;
for example, an image preprocessing and pupil positioning algorithm can be adopted to calculate the stop position of the passenger sight line on the vehicle exterior image according to the mapping relation between the passenger pupil position and the vehicle exterior image which is established in advance, identify the target object corresponding to the stop position, and take the target object corresponding to the stop position as the vehicle exterior target object observed by the passenger.
It should be noted that the above method for determining the vehicle-exterior object being observed by the passenger is only used for illustrating the embodiment of the present invention, and other calculation methods may be applied herein according to actual needs.
The vehicle exterior object may be a building, a mountain, a river, a forest, a town, a park, etc., and the above examples regarding the vehicle exterior object are only for illustrating the vehicle exterior object and should not be construed as limiting the vehicle exterior object, and other vehicle exterior objects may also be applied herein.
S103: acquiring image information of a target object outside the vehicle;
the image information of the object outside the vehicle may be acquired by a vehicle-mounted image capturing device, which may be disposed outside the vehicle.
S104: acquiring vehicle position information;
the vehicle position information may be acquired through a GPS positioning system, a beidou satellite navigation system, an inertial navigation system, and the like, which is not limited in this embodiment.
S105: acquiring basic information of the object outside the vehicle based on the image information and the vehicle position information of the object outside the vehicle;
the basic information of the object outside the vehicle includes, but is not limited to, scene information outside the vehicle, position information, name, appearance, etc. where the object outside the vehicle is located.
S106: and displaying the basic information of the object outside the vehicle on the vehicle window display module.
For example, the basic information of the object outside the vehicle is displayed on the vehicle window display module on the corresponding side in real time in the forms of characters, images, videos and the like.
In one embodiment, the window display module is only arranged on a passenger side window so as to meet the requirement of passengers on knowing information outside the vehicle; in one embodiment, the window display module can be arranged on the passenger side window and the driver front windshield, considering that the driver also needs to know information in front of the vehicle under some occasions. The position of the window display module on the front windshield is within the sight range of the driver, and normal driving operation is not affected when the sight of the driver is projected to the window display module.
The vehicle window display module can be an interactive touch screen with a touch sensor, and can also be a projection display.
Fig. 2 is a flowchart of step S105 provided in an embodiment of the present invention, and specifically as shown in fig. 2, in an implementation manner, step S105 includes the following steps:
s1051: identifying image information of the target object outside the vehicle to obtain attribute information of the target object outside the vehicle;
s1052: acquiring position information corresponding to the object outside the vehicle according to the attribute information of the object outside the vehicle and the vehicle position information; the position information includes image information and attribute information;
s1053: matching image information of objects with the same attribute information in the image information and the position information of the target object outside the vehicle;
s1054: and displaying the basic information of the object matched with the image information of the target object outside the vehicle as the information of the target object outside the vehicle.
Fig. 3 is a flowchart of another vehicle exterior information display method according to an embodiment of the present invention, specifically as shown in fig. 3, after step S106, the method further includes:
s107: detecting the facial expression of the user, and judging whether the user is interested in the current display information according to the facial expression recognition result of the user; if yes, go to step S108;
s108: and displaying the detailed information of the object outside the vehicle on the vehicle window display module.
In one embodiment, step S106 is followed by:
acquiring detailed information of a target object outside the vehicle in response to the acquired user control instruction; and displaying the detailed information of the object outside the vehicle on the vehicle window display module. The user control instruction can be a control signal input by a user through a voice input or touch module, so that the user can control and switch the required display information through a voice input or touch function.
In one embodiment, step S106 is followed by: carrying out noise reduction processing on the collected user control instruction to obtain a noise-reduced user control instruction; and displaying the detailed information of the target object outside the vehicle in response to the user control instruction after the noise reduction. The control instruction input by the user comprises at least one of a voice signal and a touch signal, so that the user can realize real-time control of the vehicle-mounted information display system based on the voice and touch functions. For example, when a passenger uses voice input, noise reduction processing is performed on collected voice information, thereby making recognition of the voice information more accurate.
Fig. 4 is a flowchart of another vehicle exterior information displaying method according to an embodiment of the present invention, and specifically as shown in fig. 4, in an implementation manner, the method includes the following steps:
s201: acquiring passenger sight line information in real time when the information interaction function outside the vehicle is in an open state;
s202: judging whether the passenger is in a state of looking outside the vehicle according to the passenger sight line information; if yes, go to step S203; if not, go to step S205;
s203: judging whether the duration of the state of the passenger looking outside the vehicle exceeds a first preset duration or not; when the first preset time length is exceeded, turning to step S204; if the first preset time length is not exceeded, the process goes to step S205; that is, when the time that the passenger looks outside the window reaches a first preset time length, the window display module can be automatically switched to the information display mode outside the vehicle.
S204: determining an object outside the vehicle, which is observed by a passenger, according to the sight line information of the passenger;
s205: the basic information of the target object outside the automobile is not displayed on the automobile window display module;
in one embodiment, step S205 includes the steps of:
acquiring a current display mode of the vehicle window display module;
judging whether the current display mode of the vehicle window display module is the vehicle external information display mode or not;
if so, switching the display mode of the vehicle window display module to a preset display mode; the preset display mode is other display modes which do not comprise an outside information display mode, for example, the preset display mode can be an inside entertainment system information display mode; the preset display mode may be a state of a pure black frame appearing in 0 gray scale.
If not, the current display mode of the vehicle window display module is kept unchanged.
S206: acquiring image information of a target object outside the vehicle;
s207: acquiring vehicle position information;
s208: acquiring basic information of the object outside the vehicle based on the image information and the vehicle position information of the object outside the vehicle; the basic information comprises one or more combinations of vehicle-exterior scene information, position information, names and appearances corresponding to the vehicle-exterior target objects;
s209: and displaying the basic information of the object outside the vehicle on the vehicle window display module.
Therefore, the passenger behaviors are detected and analyzed, the automatic switching between the in-vehicle entertainment system information and the out-vehicle real-time information is realized, and the passenger riding experience is enriched.
In one embodiment, step S106 or step S209 is followed by:
judging whether the passenger is in a state of looking outside the vehicle according to the passenger sight line information;
if not, judging whether the state duration time when the passengers do not look outside the vehicle exceeds a second preset time length or not;
and when the second preset time length is exceeded, the basic information of the target object outside the automobile is not displayed on the automobile window display module. For example, when the time when the passenger stops looking outside the vehicle reaches a second preset time period, the information display system outside the vehicle is closed.
It should be noted that the present invention is not limited by the described order of acts, as some steps may occur in other orders or concurrently with other steps, depending on the embodiment of the invention. For example, the step of determining whether the user still has a need to know the vehicle-exterior information based on the passenger sight line analysis acquired in real time may occur after step S106 or step S209, may also occur after any step from step S102 to step S105, or after any step from step S204 to step S208, and the embodiment is not limited thereto. Thus, when the requirement that the user does not know the information outside the vehicle any more is monitored, the relevant operation of displaying the information outside the vehicle on the vehicle window display module is not executed any more.
Fig. 5 is a block diagram of a vehicle exterior information display device according to an embodiment of the present invention, and specifically, as shown in fig. 5, the device may include the following modules:
the in-vehicle image acquisition module 301 is used for acquiring passenger sight line information in real time when the out-vehicle information interaction function is in an open state;
the in-vehicle image acquisition module 301 may be a camera arranged in the vehicle, and the number of the cameras may be one or more;
the in-vehicle image acquisition module 301 may be connected to the vehicle control unit to acquire state information of the out-vehicle information interaction function, where the state information of the out-vehicle information interaction function includes but is not limited to on and off; the in-vehicle image acquisition module 301 is connected to the image processing module 302 to transmit the acquired passenger sight line information, which may be a passenger face image and/or a passenger eye image capable of determining the passenger sight line, to the image processing module 302.
The image processing module 302 is used for determining an object outside the vehicle, which is observed by a passenger, according to the passenger sight line information; the image processing module 302 is connected with the vehicle exterior image acquisition module 303, and the vehicle exterior image acquisition module can adjust the vehicle exterior image acquisition device to an appropriate state required for acquiring image information of a vehicle exterior target object according to a processing result of the image processing module 302, such as adjusting an angle, a focal length and the like of a vehicle external camera, so that the acquired image information of the vehicle exterior target object is complete, pixels meet image comparison requirements, and main characteristics of the vehicle exterior target object can be reflected;
the vehicle exterior image acquisition module 303 is used for acquiring image information of a vehicle exterior target object; the vehicle exterior image acquisition module can be a camera arranged outside the vehicle or a laser radar;
a vehicle positioning module 304 for obtaining vehicle position information;
a basic information acquisition module 305 for acquiring basic information of the object outside the vehicle based on the image information of the object outside the vehicle and the vehicle position information; the basic information comprises one or more combinations of vehicle-exterior scene information, position information, names and appearances corresponding to the vehicle-exterior target objects; the position information can be presented in combination in one or more forms of maps, position coordinates, characters, voice and the like.
And the basic information display module 306 is used for displaying the basic information of the object outside the vehicle on the vehicle window display module.
It is noted that the vehicle of the present invention may be a car, truck, sport utility vehicle, van, caravan, or any other type of vehicle without departing from the scope of the present disclosure.
The embodiment of the invention also provides electronic equipment, which comprises a processor and a memory, wherein the memory is stored with at least one instruction, at least one program, code set or instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to realize the vehicle exterior information display method provided by the embodiment of the method.
The embodiment of the invention also provides a computer-readable storage medium, wherein at least one instruction, at least one program, code set or instruction set is stored in the storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to realize the vehicle exterior information display method provided by the method embodiment.
Alternatively, in this embodiment, the storage medium may be located in at least one network server of a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
According to the embodiment of the method, the device, the electronic equipment or the storage medium for displaying the information outside the vehicle, the problem that the existing vehicle-mounted intelligent cabin system is single in information source input and cannot intelligently display the information outside the vehicle according to real-time information change outside the vehicle is solved.
It should be noted that: the precedence order of the above embodiments of the present invention is only for description, and does not represent the merits of the embodiments. And specific embodiments thereof have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device and server embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. A method for displaying information outside a vehicle is characterized by comprising the following steps:
acquiring passenger sight line information in real time when the information interaction function outside the vehicle is in an open state;
determining an object outside the vehicle, which is observed by the passenger, according to the passenger sight line information;
acquiring image information of the target object outside the vehicle;
acquiring vehicle position information;
acquiring basic information of the object outside the vehicle based on the image information of the object outside the vehicle and the vehicle position information; wherein the basic information comprises a combination of one or more of the vehicle-exterior scene information, the position information, the name and the appearance corresponding to the vehicle-exterior target object;
and displaying the basic information of the object outside the vehicle on a vehicle window display module.
2. The method of claim 1, wherein after the window display module displays the basic information of the object outside the vehicle, further comprising:
detecting the facial expression of the user, and judging whether the user is interested in the current display information according to the facial expression recognition result of the user;
if yes, displaying the detailed information of the target object outside the vehicle on a vehicle window display module.
3. The method of claim 1, wherein said obtaining basic information of the object external to the vehicle based on the image information of the object external to the vehicle and the vehicle position information comprises:
identifying the image information of the object outside the vehicle to obtain the attribute information of the object outside the vehicle;
acquiring position information corresponding to the object outside the vehicle according to the attribute information of the object outside the vehicle and the vehicle position information; the position information comprises image information and attribute information;
matching the image information of the target object outside the vehicle with the image information of the object with the same attribute information in the position information;
and displaying the basic information of the object matched with the image information of the target object outside the vehicle as the information of the target object outside the vehicle.
4. The method according to claim 1, wherein after the step of collecting the passenger sight line information in real time in the state that the vehicle-exterior information interaction function is turned on, the method further comprises the following steps:
judging whether the passenger is in a state of looking outside the vehicle according to the passenger sight line information;
if so, judging whether the duration of the state of the passenger looking outside the vehicle exceeds a first preset duration;
when the first preset time length is exceeded, turning to the step of determining the vehicle external target object observed by the passenger according to the passenger sight line information;
and when the first preset time length is not exceeded, the basic information of the target object outside the automobile is not displayed on the automobile window display module.
5. The method of claim 1, wherein after the window display module displays the basic information of the object outside the vehicle, further comprising:
judging whether the passenger is in a state of looking outside the vehicle according to the passenger sight line information;
if not, judging whether the state duration time when the passengers do not look outside the vehicle exceeds a second preset time length or not;
and when the second preset time length is exceeded, not displaying the basic information of the target object outside the vehicle on a vehicle window display module.
6. The method of claim 1, wherein after the window display module displays the basic information of the object outside the vehicle, further comprising:
acquiring detailed information of the target object outside the vehicle in response to the acquired user control instruction;
and displaying the detailed information of the object outside the vehicle on a vehicle window display module.
7. The method of claim 6, wherein the user-entered control command comprises at least one of a voice signal and a touch signal; after the vehicle window display module displays the information of the target object outside the vehicle, the method further comprises the following steps:
denoising the collected user control instruction to obtain a denoised user control instruction;
and responding to the user control instruction after the noise reduction to display the detailed information of the target object outside the vehicle.
8. An information display device outside a vehicle, comprising:
the in-vehicle image acquisition module is used for acquiring passenger sight line information in real time when the out-vehicle information interaction function is in an open state;
the image processing module is used for determining an object outside the vehicle, which is observed by a passenger, according to the passenger sight line information;
the vehicle exterior image acquisition module is used for acquiring image information of the vehicle exterior target object;
the vehicle positioning module is used for acquiring vehicle position information;
the basic information acquisition module is used for acquiring basic information of the object outside the vehicle based on the image information of the object outside the vehicle and the vehicle position information; wherein the basic information comprises a combination of one or more of the vehicle-exterior scene information, the position information, the name and the appearance corresponding to the vehicle-exterior target object;
and the basic information display module is used for displaying the basic information of the target object outside the vehicle on the vehicle window display module.
9. An electronic device comprising a processor and a memory, the memory having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement the off-board information presentation method according to any one of claims 1-7.
10. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions that is loaded and executed by a processor to implement a method of off-board information presentation according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110745046.6A CN113492756A (en) | 2021-07-01 | 2021-07-01 | Method, device, equipment and storage medium for displaying vehicle external information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110745046.6A CN113492756A (en) | 2021-07-01 | 2021-07-01 | Method, device, equipment and storage medium for displaying vehicle external information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113492756A true CN113492756A (en) | 2021-10-12 |
Family
ID=77998019
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110745046.6A Pending CN113492756A (en) | 2021-07-01 | 2021-07-01 | Method, device, equipment and storage medium for displaying vehicle external information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113492756A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114115656A (en) * | 2021-11-22 | 2022-03-01 | 上汽大众汽车有限公司 | Vehicle-mounted augmented reality vehicle window entertainment system and operation method thereof |
| WO2024001573A1 (en) * | 2022-06-30 | 2024-01-04 | 中国第一汽车股份有限公司 | Data display method and system, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005012465A (en) * | 2003-06-18 | 2005-01-13 | Denso Corp | Peripheral displaying device for vehicle |
| KR20120025261A (en) * | 2010-09-07 | 2012-03-15 | 삼성전자주식회사 | Image processing apparatus and method using eye tracking of user |
| CN106951093A (en) * | 2017-03-31 | 2017-07-14 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN107380064A (en) * | 2017-07-04 | 2017-11-24 | 上海青研科技有限公司 | A kind of vehicle-mounted Eye-controlling focus device based on augmented reality |
| CN108501809A (en) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | Vehicular display control device, display system based on Eye-controlling focus and display methods |
| CN110856107A (en) * | 2018-08-21 | 2020-02-28 | 上海擎感智能科技有限公司 | Intelligent tour guide method, system, server and vehicle |
| CN111452616A (en) * | 2020-03-30 | 2020-07-28 | 广州小鹏汽车科技有限公司 | Information display control method and device and vehicle |
-
2021
- 2021-07-01 CN CN202110745046.6A patent/CN113492756A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005012465A (en) * | 2003-06-18 | 2005-01-13 | Denso Corp | Peripheral displaying device for vehicle |
| KR20120025261A (en) * | 2010-09-07 | 2012-03-15 | 삼성전자주식회사 | Image processing apparatus and method using eye tracking of user |
| CN106951093A (en) * | 2017-03-31 | 2017-07-14 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN107380064A (en) * | 2017-07-04 | 2017-11-24 | 上海青研科技有限公司 | A kind of vehicle-mounted Eye-controlling focus device based on augmented reality |
| CN108501809A (en) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | Vehicular display control device, display system based on Eye-controlling focus and display methods |
| CN110856107A (en) * | 2018-08-21 | 2020-02-28 | 上海擎感智能科技有限公司 | Intelligent tour guide method, system, server and vehicle |
| CN111452616A (en) * | 2020-03-30 | 2020-07-28 | 广州小鹏汽车科技有限公司 | Information display control method and device and vehicle |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114115656A (en) * | 2021-11-22 | 2022-03-01 | 上汽大众汽车有限公司 | Vehicle-mounted augmented reality vehicle window entertainment system and operation method thereof |
| WO2024001573A1 (en) * | 2022-06-30 | 2024-01-04 | 中国第一汽车股份有限公司 | Data display method and system, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7332726B2 (en) | Detecting Driver Attention Using Heatmaps | |
| US20220207309A1 (en) | System and method for contextualized vehicle operation determination | |
| DE112018004847B4 (en) | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, PROGRAM AND MOBILE OBJECT | |
| US9881221B2 (en) | Method and system for estimating gaze direction of vehicle drivers | |
| EP2660104B1 (en) | Apparatus and method for displaying a blind spot | |
| US9771083B2 (en) | Cognitive displays | |
| CA2598165C (en) | Method of operating a night-view system in a vehicle and corresponding night-view system | |
| CN111931579A (en) | Automatic driving assistance system and method using eye tracking and gesture recognition technology | |
| CN107766872B (en) | Method and device for identifying illumination driving scene | |
| CN111009039B (en) | AR display system based on transparent OLED window and landscape acquisition and display method | |
| CN113492756A (en) | Method, device, equipment and storage medium for displaying vehicle external information | |
| KR20200043391A (en) | Image processing, image processing method and program for image blur correction | |
| CN106515583A (en) | Driver information method | |
| DE112018004953T5 (en) | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS, PROGRAM AND MOVING BODY | |
| CN111351474B (en) | Vehicle moving target detection method, device and system | |
| DE112018004904T5 (en) | INFORMATION PROCESSING DEVICE, SELF-POSITION ESTIMATE AND PROGRAM | |
| CN112092809A (en) | Auxiliary reversing method, device and system and vehicle | |
| WO2018042976A1 (en) | Image generation device, image generation method, recording medium, and image display system | |
| CN111797755A (en) | Automobile passenger emotion recognition method and electronic equipment | |
| JP7058800B2 (en) | Display control device, display control method, and display control program | |
| CN113815627A (en) | Method and system for determining a command of a vehicle occupant | |
| CN113505674B (en) | Face image processing method and device, electronic equipment and storage medium | |
| EP4113988A1 (en) | Image processing device, image processing method, program, and image presentation system | |
| JP2022041245A (en) | Vehicle display control device, method, program, and vehicle display system | |
| WO2020008876A1 (en) | Information processing device, information processing method, program, and mobile body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211012 |