CN113269906A - Wireless driving record navigation device and method combining image identification and reality expansion - Google Patents
Wireless driving record navigation device and method combining image identification and reality expansion Download PDFInfo
- Publication number
- CN113269906A CN113269906A CN202010092519.2A CN202010092519A CN113269906A CN 113269906 A CN113269906 A CN 113269906A CN 202010092519 A CN202010092519 A CN 202010092519A CN 113269906 A CN113269906 A CN 113269906A
- Authority
- CN
- China
- Prior art keywords
- driving
- augmented reality
- image
- navigation
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
- G01C21/30—Map- or contour-matching
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07B—TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- G07B15/00—Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
- G07B15/06—Arrangements for road pricing or congestion charging of vehicles or vehicle users, e.g. automatic toll systems
- G07B15/063—Arrangements for road pricing or congestion charging of vehicles or vehicle users, e.g. automatic toll systems using wireless information transmission between the vehicle and a fixed station
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Multimedia (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides a wireless driving record navigation device and method combining image identification and reality expansion. The vehicle multimedia module comprises a display screen and an input unit. The body comprises a shell, a front camera and a control module. The control module comprises a processing unit, a storage unit, an image recognition unit, a voice recognition unit and a communication unit. The front camera records the video in front of the vehicle to generate a first driving image. The image identification unit identifies object information and the direction of the object information in the first driving image. The voice recognition unit recognizes control information of the voice information. The processing unit finds the augmented reality object according to the object information and the orientation thereof. The processing unit integrates the augmented reality object, the first driving image and the navigation map into an augmented reality driving navigation image and displays the augmented reality driving navigation image on the display screen.
Description
Technical Field
The present invention relates to a navigation device and method for driving record, and more particularly, to a navigation device and method for wireless driving record combining image recognition and reality expansion.
Background
The driving recorder is a camera mounted on the vehicle and is used for recording surrounding images during driving, mainly images in front of the vehicle. The vehicle navigation system can cooperate with the satellite navigation system to display the driving route and turn the corner, etc. to guide the vehicle to the destination, reduce the probability of getting lost, avoid the detour and shorten the time to the destination.
However, the existing driving recorder and the existing vehicle navigation system cannot identify the road condition, and the user can only visually observe and analyze the road condition according to the driving experience, and once an emergency occurs on the road, the user often has serious consequences if not found in time. For example, if there is any moving vehicle or animal in a certain position in front of the vehicle driven by the user, the user may miss the vehicle driven by the user and bump into the moving vehicle or animal. For example, there may be road closures, potholes, boulders, earth and rock flow, road barriers, trees falling on the road, animals lying on the road, or other stationary obstacles in a direction in front of the vehicle driven by the user, which the user may miss or run over if not noticed.
In addition, the conventional driving recorder and the conventional vehicle navigation system cannot be wirelessly connected with portable electronic devices such as a smart phone, a tablet computer, a notebook computer and the like, and a user cannot download driving records and navigation records to the portable electronic devices.
In addition, the existing driving recorder and the existing vehicle navigation system can not control the vehicle electronic device and the intelligent furniture.
In addition, the conventional drive recorder and the conventional car navigation system cannot record the internal state of the vehicle and the state of the surrounding environment behind the vehicle.
In addition, when the vehicle passes through the toll gate frame on the expressway, the existing driving recorder and the vehicle navigation system cannot provide the function of wireless toll collection.
Disclosure of Invention
The invention mainly aims to provide a wireless driving record navigation device and method combining image identification and reality expansion, which can provide functions of driving record, navigation, real-time road condition judgment and the like and can inform a user of an emergency situation in time.
Another objective of the present invention is to provide a wireless driving record navigation device and method combining image recognition and reality expansion, which can provide a portable electronic device to download driving records, navigation records and real-time road conditions.
The invention further provides a wireless driving recording navigation device and method combining image identification and reality expansion, which can remotely control the operation of intelligent furniture by using voice information.
Still another objective of the present invention is to provide a wireless driving recording navigation device and method combining image recognition and reality expansion, which can control the operation of the electronic device for vehicle by using voice information.
The present invention also provides a wireless driving recording navigation device and method combining image recognition and augmented reality, which can record the internal condition of the vehicle and the surrounding environment behind the vehicle.
Another objective of the present invention is to provide a wireless driving recording navigation device and method combining image recognition and reality expansion, which can provide wireless charging function.
In order to achieve the above object, the present invention provides a wireless driving recording navigation device combined with image recognition and reality expansion, which is installed on a vehicle and comprises a vehicle multimedia module and a body.
The vehicle multimedia module comprises a display screen and an input unit, wherein the input unit is used for receiving voice information from a user.
The body comprises a shell, a front camera and a control module.
The shell is provided with a front surface and a back surface.
The front camera is arranged on a front surface of the shell and used for recording the surrounding environment in front of the vehicle so as to generate a first driving image.
The control module is arranged in the shell and comprises a processing unit, a storage unit, an image identification unit, a voice identification unit and a communication unit.
The processing unit is electrically connected with the vehicle multimedia module and the front camera.
The storage unit is electrically connected with the processing unit and comprises an augmented reality object database, a navigation map database and an augmented reality driving navigation image database, wherein the augmented reality object database stores a plurality of augmented reality objects, and the navigation map database stores a plurality of navigation maps.
The image identification unit is electrically connected with the processing unit and is used for identifying at least one object information and the direction thereof in the first driving image.
The voice recognition unit is electrically connected with the processing unit and is used for recognizing control information of the voice information.
The communication unit is electrically connected with the processing unit and is used for wirelessly connecting a portable electronic device.
The processing unit finds at least one augmented reality object from the augmented reality object database according to the at least one object information and the orientation thereof.
The processing unit integrates the searched at least one augmented reality object, the first driving image and one of the navigation maps into an augmented reality driving navigation image, the processing unit simultaneously stores the augmented reality driving navigation image in an augmented reality driving navigation image database and displays the augmented reality driving navigation image on a display screen, and the communication unit transmits the augmented reality driving navigation image to the portable electronic device.
Preferably, the communication unit is used for wirelessly connecting a voice server, the voice server stores a plurality of voice voiceprint information, the voice recognition unit compares the voice information with the voice voiceprint information in the voice server through the communication unit to find out one of the voice voiceprint information corresponding to the voice information from the voice server, and the found one of the voice voiceprint information is the control information.
Preferably, the communication unit is used for wirelessly connecting an intelligent home server, the intelligent home server stores a plurality of intelligent furniture control instructions and wirelessly connects a plurality of intelligent furniture, the processing unit is connected to the intelligent home server through the communication unit and compares the control information with the intelligent furniture control instructions to find out one of the intelligent furniture control instructions corresponding to the control information from the intelligent home server, the intelligent home server transmits the found one of the intelligent furniture control instructions to the corresponding intelligent furniture, and the corresponding intelligent furniture operates according to the intelligent furniture control instructions.
Preferably, the control module is electrically connected with one vehicle electronic device in a wired manner through a CAN bus or an LIN bus, the vehicle computer is electrically connected with at least one vehicle electronic device in a wired manner through the CAN bus or the LIN bus, and the processing unit controls the at least one vehicle electronic device to operate through the vehicle computer according to the control information.
Preferably, the body further comprises a rear camera which is arranged on the back surface of the shell, is electrically connected with the processing unit and is used for recording the video of the interior of the vehicle and the surrounding environment behind the vehicle so as to generate a second driving image;
the body still includes an ETC card, and a card slot is seted up to the casing, card slot electric connection processing unit, and the ETC card is inserted and is located in the card slot.
In order to achieve the above object, the present invention provides a wireless driving record navigation method combining image recognition and augmented reality, comprising the following steps:
recording the surrounding environment in front of a vehicle to generate a first driving image;
identifying at least one object information and the direction thereof in the first driving image;
finding out at least one augmented reality object according to the at least one object information and the orientation thereof;
integrating the searched at least one augmented reality object, the first driving image and a navigation map into an augmented reality driving navigation image;
displaying the augmented reality driving navigation image;
receiving a voice message from a user and identifying a control message of the voice message;
and transmitting the augmented reality driving navigation image to a portable electronic device.
Preferably, the step of receiving a voice message from a user and recognizing a control message of the voice message comprises:
and comparing the voice information with the multiple voice voiceprint information to find out one of the voice voiceprint information corresponding to the voice information, wherein the found one of the voice voiceprint information is the control information.
Preferably, the method further comprises: and comparing the control information with the plurality of intelligent furniture control instructions to find one intelligent furniture control instruction corresponding to the control information, transmitting the found one intelligent furniture control instruction to the corresponding intelligent furniture, and operating the corresponding intelligent furniture according to the intelligent furniture control instruction.
Preferably, the method further comprises: and controlling the operation of at least one vehicular electronic device according to the control information.
Preferably, the method further comprises: recording the surrounding environment inside and behind the vehicle to generate a second driving image; the ETC card is inserted into a card slot.
The wireless driving record navigation device and the method thereof have the advantages that the wireless driving record navigation device and the method thereof not only can provide functions of driving record, navigation and the like, but also can judge real-time road conditions by combining functions of image identification, reality augmentation and the like, and can inform users of emergency situations in time, enable the users to react as early as possible, and effectively reduce the accident occurrence probability.
Moreover, the wireless driving record navigation device and the method can provide users with the capability of downloading the augmented reality driving navigation image by utilizing the portable electronic device at any time.
In addition, the wireless driving record navigation device and the method can provide the remote control of the intelligent furniture operation by using voice information when the user drives the vehicle.
In addition, the wireless driving record navigation device and the method can provide the voice information for controlling the operation of the vehicle electronic device when the user drives the vehicle.
In addition, the wireless driving record navigation device and method of the invention can record the internal condition of the vehicle and the condition of the surrounding environment behind the vehicle by utilizing the second driving image.
It is worth mentioning that when the vehicle passes through the toll gate frame on the expressway, the wireless driving record navigation device and the method can deduct money through the ETC card, so that the purpose of wireless toll collection is achieved.
Drawings
Fig. 1 is a schematic diagram of a wireless driving record navigation device installed on a vehicle.
Fig. 2 is a schematic view of another view angle of the wireless driving recording navigation device of the present invention installed on a vehicle.
Fig. 3 is a schematic diagram of the vehicle multimedia module of the wireless driving recording navigation device of the invention.
Fig. 4 is a perspective view of the body of the wireless driving recording navigation device of the present invention.
Fig. 5 is a perspective view of another perspective view of the body of the wireless car navigation device according to the present invention.
Fig. 6 is a schematic structural diagram of the wireless driving record navigation device of the present invention.
Fig. 7 is a schematic diagram of the wireless driving recording navigation device of the present invention combining the functions of image recognition and augmented reality.
Fig. 8 is a schematic diagram of the display screen displaying the augmented reality driving navigation image according to the present invention.
Fig. 9 is a schematic diagram of the present invention combining image recognition and augmented reality to determine real-time road conditions and notify the user of the attention of the right-side coming vehicle.
Fig. 10 is a schematic diagram of the present invention combining image recognition and augmented reality functions to determine real-time road conditions and notify users of road closure ahead.
FIG. 11 is a schematic diagram of the voice recognition function of the wireless driving recording navigation device according to the present invention.
Fig. 12 is a flowchart of a wireless driving record navigation method of the present invention.
Description of reference numerals:
1-body, 10-shell, 11-front, 12-back, 20-front camera, 21-first driving image, 30-back camera, 31-second driving image, 40-ETC card, 50-control module, 51-processing unit, 52-storage unit, 521-augmented reality object database, 5211-augmented reality object, 5212-emergency prompt character string, 5213-pattern, 522-navigation map database, 5221-navigation map, 523-augmented reality driving navigation image database, 5231-augmented reality driving navigation image, 5232-driving image picture, 5233-navigation map picture, 5234-navigation information, 5235-floating frame line, 53-image identification unit, 531-object information, 54-voice recognition unit, 55-communication unit, 60-adsorption device, 2-vehicle multimedia module, 201-display screen, 202-input unit, 100-portable electronic device, 110-voice information, 20-voice server, 121-voice voiceprint information, 130-intelligent home server, 131-intelligent furniture control instruction, 140-intelligent furniture, 141-lamp, 142-cool air, 143-computer, 150-vehicle computer, 160-vehicle electronic device, 161-driving seat, 162-vehicle lamp, 163-cool air.
Detailed Description
The embodiments of the present invention will be described in more detail below with reference to the drawings and the accompanying numerical descriptions, so that those skilled in the art can implement the embodiments of the present invention after reading the present specification.
Please refer to fig. 1 and fig. 2, which are a schematic view of the wireless driving record navigation device of the present invention installed on a vehicle 200 and a schematic view from another perspective, respectively. The invention provides a wireless driving recording navigation device combining image identification and reality expansion, which is used for being arranged on a vehicle 200 and comprises a vehicle multimedia module 2 and a body 1.
Referring to fig. 3, fig. 3 is a schematic diagram of a vehicle multimedia module 2 of the wireless driving recording navigation device according to the present invention. The vehicular multimedia module 2 includes a display screen 201 and an input unit 202, and the input unit 202 is a microphone.
Please refer to fig. 4, fig. 5 and fig. 6, which are a perspective view of the body 1 of the wireless car navigation device, a perspective view of another angle of the body 1 and a schematic structural diagram, respectively. The main body 1 includes a housing 10, a front camera 20 and a control module 50.
The housing 10 has a front surface 11 and a back surface 12, and the front camera 20 is disposed on the front surface 11 of the housing 10.
The control module 50 is disposed inside the housing 10 and includes a processing unit 51, a storage unit 52, an image recognition unit 53, a voice recognition unit 54, and a communication unit 55. The processing unit 51 is electrically connected to the vehicle multimedia module 2, the front camera 20, the storage unit 52, the image recognition unit 53, the voice recognition unit 54 and the communication unit 55. The storage unit 52 includes an augmented reality object database 521, a navigation map database 522 and an augmented reality driving navigation image database 523. The augmented reality object database 521 stores a plurality of augmented reality objects 5211. The navigation map database 522 stores a plurality of navigation maps 5221. The communication unit 55 is used for wirelessly connecting a portable electronic device 100.
In the present embodiment, the communication unit 55 wirelessly connects the portable electronic device 100 via the internet. In other embodiments, the communication unit 55 wirelessly connects the portable electronic device 100 through one of WIFI, nfc, bluetooth, ZigBee, and the like.
Referring to fig. 7, fig. 7 is a schematic view of the wireless driving record navigation device of the present invention combining the functions of image recognition and augmented reality. After the vehicle is started, the wireless tachograph navigation device of the present invention is started, the user inputs the destination, the processing unit 51 searches one of the navigation maps 5221 from the navigation map database 522 according to the input destination, and calculates the planned route from the location where the vehicle is located to the destination. Then, the communication unit 55 is connected to a satellite navigation system (not shown), so that the wireless navigation device can display the planned route on a navigation map 5221 (see fig. 8) in cooperation with the satellite navigation system. The front camera 20 is used for recording the surrounding environment in front of the vehicle to generate a first driving image 21. The image recognition unit 53 is used for recognizing at least one object information 531 and its position in the first driving image 21. The processing unit 51 finds at least one augmented reality object 5211 from the augmented reality object database 521 according to the at least one object information 531 and the orientation thereof. The processing unit 51 integrates the at least one searched augmented reality object 5211, the first driving image 21 and one of the navigation maps 5221 into an augmented reality driving navigation image 5231, and the processing unit 51 simultaneously stores the augmented reality driving navigation image 5231 in the augmented reality driving navigation image database 523 and displays the augmented reality driving navigation image on the display screen 201.
Referring to fig. 8, fig. 8 is a schematic diagram of the display screen 201 displaying the augmented reality driving navigation image 5231 according to the present invention. The augmented reality driving navigation image 5231 includes a driving image screen 5232, a navigation map screen 5233, navigation information 5234 and a plurality of floating frame lines 5235. The driving image frame 5232 displays a first driving image 21, and the first driving image 21 includes all the object information 531 (for example, transportation, animals, plants, buildings, traffic signs and signs, holes, boulders, earth and stone flows, and road barriers) on the road. The navigation map frame 5233 is located at the lower right corner of the driving image frame 5232 to display the navigation map 5221; the navigation map 5221 is a two-dimensional map clearly indicating a planned route from a vehicle driven by the user to a destination, so as to guide the user to travel along the planned route. A predicted remaining travel time and a remaining mileage are displayed below the navigation map 5221. The navigation information 5234 is displayed on the upper center of the driving image screen 5232, and includes characters and patterns (for example, "enter unknown road after 25 m" and a turning arrow shown in fig. 8). The floating frame lines 5235 show the object information 531 in the first driving image 21 captured by the image recognition unit 53, so as to recognize the object information 531 and the position thereof in the first driving image 21.
In the preferred embodiment of the present invention, each augmented reality object 5211 includes an emergency alert string 5212 and a pattern 5213 (see fig. 9 and 10 for details). Preferably, the emergency alert string 5212 includes words with a strong meaning (e.g., attention, caution, danger, etc.), orientation (e.g., right, left, front, etc.), and object information (e.g., car, pedestrian, road closure, etc.), and the number of words in the emergency alert string 5212 is not more than ten words. The strong-tone adjectives can allow the user to immediately notice the augmented reality object 5211, the directions can allow the user to know where the emergency situation is near the vehicle where the user is driving, the object information can allow the user to know what the emergency situation is caused by, and the short number of words can allow the user to quickly read and immediately make a correct judgment. The pattern 5213 comprises any shape of pictorial text box that surrounds the emergency alert string 5212, assisting the user in focusing on the emergency alert string 5212.
In other embodiments, the augmented reality objects 5211 may only contain the emergency alert strings 5212 and not contain the patterns 5213, and still achieve the same effect.
In other embodiments, the augmented reality objects 5211 may only contain the pattern 5213 and not the emergency alert string 5212. The pattern 5213 of the augmented reality object 5211 of this embodiment is a flickering object information pattern, and is overlapped with the object information 531 in the augmented reality driving navigation image 5231, thereby achieving the same effect.
The emergency condition is any moving vehicle or animal in a certain position in front of the vehicle driven by the user, and road closure, potholes, boulders, earth and rock flow, roadblocks, trees falling on the road, animals lying on the road, or other immovable obstacles in a certain position in front of the vehicle driven by the user.
Two cases will be listed below to illustrate how the wireless driving record navigation device of the present invention combines the functions of image recognition and augmented reality to determine real-time traffic and notify users of emergency situations.
Referring to fig. 9, fig. 9 is a schematic diagram of the present invention combining image recognition and augmented reality to determine real-time road conditions and notify the user of the coming vehicle in the right direction. The image recognition unit 53 recognizes that the object information 531 in the first driving image 21 is "another vehicle switching lane is inserted into the lane where the vehicle driven by the user runs" and the direction thereof is "right", and the processing unit 51 finds the emergency prompt character string 5212 "notice coming right" of the augmented reality object 5211 and the pattern 5213 "cloud-shaped graphic text box" of the augmented reality object 5211 from the augmented reality object database 521 according to the object information 531 "another vehicle switching lane is inserted into the lane where the vehicle driven by the user" in the augmented reality object database 521. The processing unit 51 integrates the emergency prompt string 5212 of the augmented reality object 5211 "pay attention to the right coming car" and the pattern 5213 of the augmented reality object 5211 "cloud-shaped graphic language text box" together with the first driving image 21 and the navigation map 5221 into the augmented reality driving navigation image 5231. The processing unit 51 stores the augmented reality driving navigation image 5231 in the augmented reality driving navigation image database 531 and displays the augmented reality driving navigation image on the display screen 201. The user can clearly see the emergency prompt character string 5212 "pay attention to the right coming car" of the augmented reality object 5211 and the pattern 5213 "cloud-shaped graphic text box" of the augmented reality object 5211 from the augmented reality driving navigation image 5231 on the display screen 201, and be alert that there is an emergency, and know that there is another vehicle switching lane inserted into the lane where the vehicle driven by the user runs suddenly on the right side from the emergency prompt character string 5212 in cooperation with the driving image screen 5232. At this time, the user can step on the brake in time to avoid the vehicle driven by the user from colliding with another vehicle.
Referring to fig. 10, fig. 10 is a schematic view of determining a real-time road condition and informing a user of a closed road in front of the vehicle by combining functions of image recognition and augmented reality according to the present invention. When a road closure suddenly occurs on a road in front of a vehicle driven by a user, the image recognition unit 53 recognizes that the object information 531 in the first driving image 21 is "road closure" and the direction thereof is "front", and the processing unit 51 finds the emergency prompt character string 5212 "careful front road closure" of the augmented reality object 5211 and the pattern 5213 "rounded rectangle image language character frame" of the augmented reality object 5211 from the augmented reality object database 521 according to the object information 531 "road closure" and the direction thereof "front", and integrates the first driving image 21 and the navigation map 5221 into the augmented reality driving navigation image 5231. The processing unit 51 stores the augmented reality driving navigation image 5231 in the augmented reality driving navigation image database 531 and displays the augmented reality driving navigation image on the display screen 201. The user can clearly see the emergency prompt character string 5212 "cautious front road closure" of the augmented reality object 5211 and the pattern 5213 "rounded rectangle image language text box" of the augmented reality object 5211 from the augmented reality driving navigation image 5231 on the display screen 201, and be alerted to the existence of the emergency situation, and know that the front road is closed from the emergency prompt character string 5212 in cooperation with the driving image screen 5232. At this time, the user can decelerate the vehicle he or she is driving as early as possible and bypass the road closure.
Therefore, the wireless driving record navigation device can provide the functions of driving record, navigation and the like, can also combine the functions of image identification, augmented reality and the like to judge real-time road conditions, and can inform a user of the occurrence of an emergency in time, so that the user can respond as early as possible, and the accident occurrence probability is effectively reduced.
As shown in fig. 7, in the preferred embodiment of the invention, the communication unit 55 transmits the augmented reality driving navigation image 5231 to the portable electronic device 100. The portable electronic device 100 may be a smart phone, a tablet computer, a notebook computer, etc. Therefore, the user can download the augmented reality driving navigation image 5231 by using the portable electronic device 100 at any time.
Referring to fig. 11, fig. 11 is a schematic view illustrating a voice recognition function of the wireless driving recording navigation device according to the present invention. The input unit 202 is used for receiving a voice message 110 from a user, and the voice recognition unit 54 is used for recognizing a control message of the voice message 110. The communication unit 55 is used for wirelessly connecting a voice server 120, the voice server 120 stores a plurality of voice voiceprint information 121, the voice recognition unit 54 uses the voice information 110 to compare with the voice voiceprint information 121 in the voice server 120 through the communication unit 55, so as to find out one of the voice voiceprint information 121 corresponding to the voice information 110 from the voice server 120, and the found one of the voice voiceprint information 121 is the control information.
The communication unit 55 is used for wirelessly connecting an intelligent home server 130, the intelligent home server 130 stores a plurality of intelligent furniture control instructions 131 and wirelessly connects a plurality of intelligent furniture 140, the processing unit 51 is connected to the intelligent home server 130 through the communication unit 55 and compares the control information with the intelligent furniture control instructions 131 to find out one of the intelligent furniture control instructions 131 corresponding to the control information from the intelligent home server 130, the intelligent home server 130 transmits the found one of the intelligent furniture control instructions 131 to the corresponding intelligent furniture 140, and the corresponding intelligent furniture 140 operates according to the intelligent furniture control instructions 131. Therefore, the wireless driving record navigation device of the invention can provide the user with the function of remotely controlling the intelligent furniture 140 by using the voice message 110 when driving.
The intelligent furniture 140 shown in fig. 11 includes a lamp 141, a cool air 142 and a computer 143, but not limited thereto, and the operation of other intelligent furniture 140 can also be remotely controlled by the wireless driving record navigation device of the present invention.
As shown in fig. 11, the control module 50 is electrically connected to a vehicle computer 150 through a CAN BUS (Controller Area Network) or a LIN BUS (Local Interconnect Network) in a wired manner, the vehicle computer 150 is electrically connected to at least one vehicle electronic device 160 through the CAN BUS or the LIN BUS in a wired manner, and the processing unit 51 controls the at least one vehicle electronic device 160 to operate through the vehicle computer 150 according to the control information. Therefore, the wireless driving record navigation device of the present invention can provide the user with the voice message 110 to control the operation of the electronic device 160 for vehicle when driving.
The electronic device 160 for vehicle shown in fig. 11 includes a driving seat 161, a lamp 162 and a cooling air 163, but not limited thereto, and other electronic devices 160 for vehicle may also be controlled by the wireless driving record navigation device of the present invention.
It should be noted that the voice recognition unit 54 has a function of recognizing the prompt sentence and the command sentence in the control information of the voice message 110. The prompt sentence is, for example: room air conditioning, lights in the living room, my computer, car headlights, in-car air conditioning, driver's seats, etc. The command sentence is, for example: turning on the lamp of the living room, turning off the headlight, adjusting the room air to several degrees, turning on a certain file of the computer, driving the chair back of the chair to incline backwards by several degrees, etc.
As shown in fig. 2 and 5, the main body 1 further includes a rear camera 30, the rear camera 30 is disposed on the back 12 of the casing 10, electrically connected to the processing unit 51, and used for recording the surroundings inside the vehicle 200 and behind the vehicle 200 to generate a second driving image 31. The second driving image 31 mainly records the internal state of the vehicle 200 and the state of the surrounding environment behind the vehicle 200.
As shown in fig. 4 and 5, the body 1 further includes an ETC card 40, the housing 10 defines a card slot 13, the card slot 13 is electrically connected to the processing unit 41, and the ETC card 40 is inserted into the card slot 13. ETC is short for Electronic Toll Collection, and is named as an Electronic road Toll Collection system in Chinese. The ETC card 40 may store value. When the vehicle 200 passes through a toll gate (not shown) on the highway, the ETC card 40 can deduct money, thereby achieving the purpose of wireless toll collection.
As shown in fig. 4 and 5, the adsorption device 60 is disposed on the top of the housing 10. As shown in fig. 1 and 2, the suction device 60 is configured to be sucked into a front windshield of a vehicle 200.
Referring to fig. 12, fig. 12 is a flowchart of a wireless driving record navigation method according to the present invention. The invention provides a wireless driving record navigation method combining image identification and reality expansion, which comprises the following steps:
step S1: the surrounding environment in front of a vehicle is recorded to generate a first driving image 21.
Step S2: at least one object information 531 and its orientation in the first driving image 21 are identified.
Step S3: finding at least one augmented reality object 5211 according to the at least one object information 531 and the orientation thereof.
Step S4: the searched at least one augmented reality object 5211, the first driving image 21 and the navigation map 5221 are integrated into an augmented reality driving navigation image 5231. Preferably, each augmented reality object 5211 includes an emergency alert string 5212 and/or a pattern 5213.
Step S5: the augmented reality driving navigation image 5231 is displayed.
Step S6: a voice message 110 from a user is received, and a control message of the voice message 110 is recognized. Specifically, the voice message 110 is compared with the plurality of voice voiceprint messages 121 to find one of the voice voiceprint messages 121 corresponding to the voice message 110, and the found one of the voice voiceprint messages 121 is the control message. The control information is compared with the plurality of intelligent furniture control instructions 131 to find one of the intelligent furniture control instructions 131 corresponding to the control information. The found one of the intelligent furniture control commands 131 is transmitted to the corresponding intelligent furniture 140, and the corresponding intelligent furniture 140 operates according to the intelligent furniture control command 131. Controlling at least one in-vehicle electronic device 160 to operate according to the control information.
Step S7: the augmented reality driving navigation image 5231 is transmitted to a portable electronic device 100.
Step S8: the surroundings inside the vehicle 200 and behind the vehicle 200 are recorded to generate a second driving image 31.
Step S9: an ETC card 40 is inserted into a card slot 13.
Therefore, the wireless driving record navigation method can provide the functions of driving record, navigation and the like, can also combine the functions of image identification, augmented reality and the like to judge real-time road conditions, can inform a user of the occurrence of an emergency in time, enables the user to react as early as possible, and effectively reduces the occurrence probability of accidents.
Furthermore, the wireless driving record navigation method of the present invention can provide the user with the portable electronic device 100 to download the augmented reality driving navigation image 5231 at any time.
In addition, the wireless driving record navigation method of the invention can provide the user with the voice information 110 to remotely control the intelligent furniture 140 to operate when driving.
In addition, the wireless driving record navigation method of the present invention can provide the user with the function of controlling the vehicle electronic device 160 by using the voice message 110 during driving.
In addition, the wireless driving record navigation method of the present invention can record the internal condition of the vehicle 200 and the condition of the surrounding environment behind the vehicle 200 by using the second driving image 31.
It should be noted that, when the vehicle 200 passes through a toll gate on the expressway, the wireless driving record navigation method of the present invention can deduct money through the ETC card 40, thereby achieving the purpose of wireless toll collection.
The foregoing is illustrative of the preferred embodiment of the present invention and is not to be construed as limiting thereof, since any modification and variation of the present invention disclosed herein may be made within the spirit and scope of the invention.
Claims (10)
1. A wireless driving recording navigation device combined with image identification and reality expansion is used for being installed on a vehicle, and is characterized by comprising:
the vehicle multimedia module comprises a display screen and an input unit, wherein the input unit is used for receiving voice information from a user;
a body, comprising:
a housing having a front surface and a back surface;
the front camera is arranged on the front surface of the shell and used for recording the surrounding environment in front of the vehicle so as to generate a first driving image; and
a control module disposed inside the housing and comprising:
the processing unit is electrically connected with the vehicle multimedia module and the front camera;
the storage unit is electrically connected with the processing unit and comprises an augmented reality object database, a navigation map database and an augmented reality driving navigation image database, wherein the augmented reality object database stores a plurality of augmented reality objects, and the navigation map database stores a plurality of navigation maps;
the image identification unit is electrically connected with the processing unit and used for identifying at least one object information and the direction thereof in the first driving image;
the voice recognition unit is electrically connected with the processing unit and is used for recognizing control information of the voice information; and
the communication unit is electrically connected with the processing unit and is used for wirelessly connecting a portable electronic device;
the processing unit searches at least one augmented reality object from the augmented reality object database according to the at least one object information and the orientation thereof;
the processing unit integrates the searched at least one augmented reality object, the first driving image and one of the navigation maps into an augmented reality driving navigation image, the processing unit stores the augmented reality driving navigation image in the augmented reality driving navigation image database and displays the augmented reality driving navigation image on the display screen, and the communication unit transmits the augmented reality driving navigation image to the portable electronic device.
2. The wireless car driving record navigation device according to claim 1, wherein the communication unit is configured to wirelessly connect to a voice server, the voice server stores a plurality of voice voiceprint information, the voice recognition unit uses the voice information to compare with the voice voiceprint information in the voice server through the communication unit to find one of the voice voiceprint information corresponding to the voice information from the voice server, and the found one of the voice voiceprint information is the control information.
3. The wireless driving record navigation device according to claim 1 or 2, wherein the communication unit is configured to wirelessly connect to an intelligent home server, the intelligent home server stores a plurality of intelligent furniture control commands and wirelessly connects to a plurality of pieces of intelligent furniture, the processing unit is connected to the intelligent home server through the communication unit and compares the control information with the intelligent furniture control commands to find one of the intelligent furniture control commands corresponding to the control information from the intelligent home server, the intelligent home server transmits the found one of the intelligent furniture control commands to the corresponding intelligent furniture, and the corresponding intelligent furniture operates according to the intelligent furniture control commands.
4. The wireless driving record navigation device according to claim 1 or 2, wherein the control module is electrically connected to a vehicle electronic device through a CAN bus or a LIN bus in a wired manner, the vehicle computer is electrically connected to at least one vehicle electronic device through a CAN bus or a LIN bus in a wired manner, and the processing unit controls the at least one vehicle electronic device to operate through the vehicle computer according to the control information.
5. The wireless driving record navigation device according to claim 1, wherein the body further comprises a rear camera disposed on a back surface of the housing, electrically connected to the processing unit, and configured to record an ambient environment inside the vehicle and behind the vehicle to generate a second driving image;
the body still includes an ETC card, a card slot is seted up to the casing, card slot electric connection the processing unit, the ETC card is inserted and is located in the card slot.
6. A wireless driving record navigation method combining image identification and augmented reality is characterized by comprising the following steps:
recording the surrounding environment in front of a vehicle to generate a first driving image;
identifying at least one object information and the direction thereof in the first driving image;
finding out at least one augmented reality object according to the at least one object information and the orientation thereof;
integrating the at least one searched augmented reality object, the first driving image and a navigation map into an augmented reality driving navigation image;
displaying the augmented reality driving navigation image;
receiving a voice message from a user and identifying a control message of the voice message;
and transmitting the augmented reality driving navigation image to a portable electronic device.
7. The method of claim 6, wherein the step of receiving a voice message from a user and recognizing a control message of the voice message comprises:
and comparing the voice information with a plurality of voice voiceprint information to find out one of the voice voiceprint information corresponding to the voice information, wherein the found one of the voice voiceprint information is the control information.
8. The wireless tachograph navigation method according to claim 6 or 7, characterized in that the method further comprises:
and comparing the control information with a plurality of intelligent furniture control instructions to find one intelligent furniture control instruction corresponding to the control information, and transmitting the found one intelligent furniture control instruction to the corresponding intelligent furniture, wherein the corresponding intelligent furniture operates according to the intelligent furniture control instruction.
9. The wireless tachograph navigation method according to claim 6 or 7, characterized in that the method further comprises:
and controlling at least one vehicle electronic device to operate according to the control information.
10. The wireless driving record navigation method according to claim 6, further comprising: recording the surrounding environment inside the vehicle and behind the vehicle to generate a second driving image; the ETC card is inserted into a card slot.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092519.2A CN113269906A (en) | 2020-02-14 | 2020-02-14 | Wireless driving record navigation device and method combining image identification and reality expansion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092519.2A CN113269906A (en) | 2020-02-14 | 2020-02-14 | Wireless driving record navigation device and method combining image identification and reality expansion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113269906A true CN113269906A (en) | 2021-08-17 |
Family
ID=77227245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010092519.2A Pending CN113269906A (en) | 2020-02-14 | 2020-02-14 | Wireless driving record navigation device and method combining image identification and reality expansion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113269906A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114183445A (en) * | 2021-11-11 | 2022-03-15 | 重庆长安汽车股份有限公司 | Mounting fixture of ETC card |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102519475A (en) * | 2011-12-12 | 2012-06-27 | 杨志远 | Intelligent navigation method and equipment based on augmented reality technology |
| CN102759360A (en) * | 2011-04-28 | 2012-10-31 | 昆达电脑科技(昆山)有限公司 | Navigation device combining driving video record and navigation information |
| CN105785938A (en) * | 2014-12-26 | 2016-07-20 | 北京奇虎科技有限公司 | Onboard control system capable of controlling intelligent household environment |
| CN106314290A (en) * | 2015-06-24 | 2017-01-11 | 戴万谋 | Vehicle-mounted intelligent rear viewing mirror device |
| CN106952363A (en) * | 2017-05-12 | 2017-07-14 | 北京聚利科技股份有限公司 | Drive recorder |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN109830235A (en) * | 2019-03-19 | 2019-05-31 | 东软睿驰汽车技术（沈阳）有限公司 | Sound control method, device, onboard control device and vehicle |
-
2020
- 2020-02-14 CN CN202010092519.2A patent/CN113269906A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102759360A (en) * | 2011-04-28 | 2012-10-31 | 昆达电脑科技(昆山)有限公司 | Navigation device combining driving video record and navigation information |
| CN102519475A (en) * | 2011-12-12 | 2012-06-27 | 杨志远 | Intelligent navigation method and equipment based on augmented reality technology |
| CN105785938A (en) * | 2014-12-26 | 2016-07-20 | 北京奇虎科技有限公司 | Onboard control system capable of controlling intelligent household environment |
| CN106314290A (en) * | 2015-06-24 | 2017-01-11 | 戴万谋 | Vehicle-mounted intelligent rear viewing mirror device |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN106952363A (en) * | 2017-05-12 | 2017-07-14 | 北京聚利科技股份有限公司 | Drive recorder |
| CN109830235A (en) * | 2019-03-19 | 2019-05-31 | 东软睿驰汽车技术（沈阳）有限公司 | Sound control method, device, onboard control device and vehicle |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114183445A (en) * | 2021-11-11 | 2022-03-15 | 重庆长安汽车股份有限公司 | Mounting fixture of ETC card |
| CN114183445B (en) * | 2021-11-11 | 2024-01-12 | 重庆长安汽车股份有限公司 | Mounting fixture of ETC card |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230311749A1 (en) | Communication between autonomous vehicle and external observers | |
| KR102309316B1 (en) | Display apparatus for vhhicle and vehicle including the same | |
| CN113196357B (en) | Method and system for controlling autonomous vehicles in response to detecting and analyzing strange traffic signs | |
| CN109712432B (en) | System and method for projecting a trajectory of an autonomous vehicle onto a road surface | |
| KR102489401B1 (en) | Traffic signs recognition apparatus and method for providing limiting speed of the same | |
| JP4771365B2 (en) | Route guidance system, route guidance method and program | |
| JP4729905B2 (en) | Vehicle notification device and program | |
| US9809165B1 (en) | System and method for minimizing driver distraction of a head-up display (HUD) in a vehicle | |
| CN112313137B (en) | Travel information processing device and processing method | |
| JP2007178358A (en) | System and method for route guidance | |
| CN113808418B (en) | Road condition information display system, method, vehicle, computer device and storage medium | |
| US11840173B2 (en) | External facing communications for autonomous vehicles | |
| JP2006038558A (en) | Car navigation system | |
| JP4586606B2 (en) | Route guidance system and route guidance method | |
| CN112985433A (en) | Vehicle navigation apparatus and vehicle navigation method | |
| US11866068B2 (en) | Detecting and responding to malfunctioning traffic signals for autonomous vehicles | |
| KR20190067366A (en) | Vehicle and control method thereof | |
| CN113269906A (en) | Wireless driving record navigation device and method combining image identification and reality expansion | |
| CN115131749A (en) | Image processing apparatus, image processing method, and computer-readable storage medium | |
| JP4523541B2 (en) | Specific vehicle priority traveling apparatus and method | |
| KR102585945B1 (en) | Drive video record system and method thereof | |
| CN111696375A (en) | Server apparatus and information processing method | |
| CN113928335B (en) | Method and system for controlling a vehicle having an autonomous driving mode | |
| CN113401071B (en) | Display control device, display control method, and computer-readable storage medium | |
| JP5056902B2 (en) | Route guidance system and route guidance method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210817 |