CN113163156A - Vehicle-end information acquisition and remote display system for remote driving - Google Patents
Vehicle-end information acquisition and remote display system for remote driving Download PDFInfo
- Publication number
- CN113163156A CN113163156A CN202010009529.5A CN202010009529A CN113163156A CN 113163156 A CN113163156 A CN 113163156A CN 202010009529 A CN202010009529 A CN 202010009529A CN 113163156 A CN113163156 A CN 113163156A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- angle camera
- video data
- narrow
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 9
- 238000006243 chemical reaction Methods 0.000 claims description 17
- 230000008447 perception Effects 0.000 claims description 15
- 238000013144 data compression Methods 0.000 claims description 3
- 239000000446 fuel Substances 0.000 claims 1
- 230000000007 visual effect Effects 0.000 abstract description 5
- 238000000034 method Methods 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/44—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides a vehicle-end information acquisition and remote display system for remote driving, which comprises a vehicle-end information sensing system, an information remote transmission system and a remote display system, wherein the vehicle-end information sensing system comprises an environment sensing system and a vehicle information acquisition system, the environment sensing system and the vehicle information acquisition system are respectively used for acquiring the traffic environment around a vehicle and the pose, behavior and state information of the vehicle, the information remote transmission system is used for transmitting the traffic environment around the vehicle and the pose, behavior and state information of the vehicle to the remote display system, the remote system comprises a plurality of displays, and the plurality of displays are used for displaying the traffic environment around the vehicle and the pose, behavior and state information of the vehicle in a split screen mode. By the method and the device, the problem that the display interface layout of the cockpit does not conform to the visual angle of the driver and the incomplete information of the vehicle position, posture and state is solved, and the driving difficulty and the driving fatigue of a remote driver are reduced.
Description
Technical Field
The invention relates to the technical field of automobiles, in particular to a vehicle-end information acquisition and remote display system for remote driving.
Background
At the present stage, a part of remote driving systems display traffic environment information around the vehicle by adopting a virtual reality technology, and driving fatigue of remote drivers is easily caused due to the difference between a virtual environment and a real environment; in addition, the existing remote driving system does not fully consider the requirement of remote driving on vehicle state information, so the designed display system lacks the vehicle state information. Such as vehicle behavior state: whether the vehicle is currently in a remote driving state; vehicle gear information: the current gear of the vehicle (including forward and reverse). Meanwhile, the interface layout displayed by the cockpit does not conform to the visual angle of the driver, and the driver is not facilitated to acquire the surrounding environment information and the state information of the vehicle.
Disclosure of Invention
The invention aims to solve the technical problem of providing a vehicle-end information acquisition and remote display system for remote driving, which is used for solving the problems that the installation position of a camera is unreasonable, the display interface layout of a cockpit does not conform to the visual angle of a driver and the pose, behavior and state information of the vehicle are incomplete, and the acquisition of the surrounding environment information and the state information of the vehicle by the driver is not facilitated.
The invention provides a vehicle end information acquisition and remote display system for remote driving, which comprises a vehicle end information sensing system, an information remote transmission system and a remote display system, wherein:
the vehicle-end information sensing system comprises an environment sensing system and a vehicle information acquisition system, wherein the environment sensing system comprises a close-range sensing module, a long-range sensing module and a video signal conversion module, and the vehicle information acquisition system comprises an automatic driving unit and a remote driving controller;
the information remote transmission system comprises a vehicle-end network access device, a 5G network and a server-end network access device which are arranged on the vehicle;
the remote display system comprises a server host and 3 displays;
the close-range sensing module comprises 4 all-around fisheye cameras and all-around electronic control units, wherein the all-around fisheye cameras are arranged around a vehicle body and used for acquiring traffic environments in a first preset range around the vehicle, and the all-around electronic control units are used for carrying out video splicing on the traffic environments in the first preset range around the vehicle acquired by the all-around fisheye cameras and sending the spliced traffic environments in the first preset range around the vehicle to the video signal conversion module;
the remote sensing module comprises a forward narrow-angle camera, a left narrow-angle camera, a right narrow-angle camera and a rear wide-angle camera which are arranged around a vehicle body, the forward narrow-angle camera, the left narrow-angle camera, the right narrow-angle camera and the rear wide-angle camera are respectively connected with the video signal conversion module and are used for transmitting a traffic environment in a second preset range around the vehicle to the video signal conversion module, and the traffic environment in the second preset range around the vehicle comprises live-action video data of the forward narrow-angle camera, live-action video data of the left narrow-angle camera, live-action video data of the right narrow-angle camera and live-action video data of the rear wide-angle camera;
the video signal conversion module is used for compressing video data of a traffic environment in a first preset range around the vehicle and a traffic environment in a second preset range around the vehicle, converting the video data into a preset format and transmitting the preset format to the vehicle end network access device;
the remote driving controller is used for acquiring the pose, behavior and state information of the vehicle from the automatic driving unit and transmitting the pose, behavior and state information of the vehicle to the vehicle-end network access device;
the vehicle-end network access device is connected with the server-end network access device through the 5G network and is used for transmitting the traffic environment in a first preset range around the vehicle, the traffic environment in a second preset range around the vehicle and the pose, behavior and state information of the vehicle to the server-end network access device;
the server host is connected with the server-side network access device and used for acquiring and analyzing the traffic environment in a first preset range around the vehicle, the traffic environment in a second preset range around the vehicle and the pose, behavior and state information of the vehicle from the server-side network access device;
the plurality of displays are used for displaying live-action video data of the left narrow-angle camera and live-action video data of the right narrow-angle camera in a split screen mode, traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, current vehicle speed, current oil quantity or electric quantity, current gear, current vehicle door state, current vehicle performance state, remote driving vehicle end information connection state, control flow information connection state, current driving behavior state and live-action video data of a forward narrow-angle camera when the vehicle is located in a forward gear or live-action video data of a rear wide-angle camera when the vehicle is located in a backward gear.
Further, close range perception module includes four look around fisheye cameras, four look around fisheye cameras set up respectively in air inlet grille top, on the left-hand rear-view mirror, on the right-hand rear-view mirror and rear license plate top.
Further, the close distance sensing module is used for sensing the traffic environment within 3m around the vehicle.
Further, to the narrow angle camera set up in preceding windscreen rear, the left side narrow angle camera sets up on the left side rear-view mirror, the right side narrow angle camera sets up on the right side rear-view mirror, rear side wide angle camera sets up in rear license plate top.
Furthermore, the remote sensing module is used for sensing traffic environments in the range of 2-80m in front, 2-80m in left and right sides and 2-20m in right back.
Further, the video signal conversion module is specifically configured to perform video data compression on a traffic environment in a first preset range around the vehicle and a traffic environment in a second preset range around the vehicle according to an H265 format, convert the video data into a real-time streaming protocol, and transmit the real-time streaming protocol to the vehicle-end network access device.
Further, the plurality of displays includes a left display, a middle display, and a right display, wherein:
the left display is used for displaying real-time video data of the left narrow-angle camera in real time, the right display is used for displaying real-time video data of the right narrow-angle camera in real time, the middle display is used for displaying a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil quantity or electric quantity, a current gear, a current vehicle door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state and real-time video data of a forward narrow-angle camera when the vehicle is in a forward gear or real-time video data of a rear wide-angle camera when the vehicle is in a backward gear.
Furthermore, the middle display is used for displaying the traffic environment in a first preset range around the vehicle at the upper left corner, displaying a global navigation map of a remote driving task at the upper right corner, displaying a remote driving vehicle end information connection state, a control flow information connection state and a current driving behavior state at the lower left side, displaying a current vehicle speed, a current oil quantity or electric quantity, a current gear, a current vehicle door state and a current vehicle performance state at the lower right side, and displaying live-action video data of a forward narrow-angle camera when the vehicle is in a forward gear or live-action video data of a rear wide-angle camera when the vehicle is in a reverse gear on a main picture.
The implementation of the invention has the following beneficial effects:
according to the invention, the surrounding environment of the vehicle is sensed in a mode of combining close-range live-action videos and long-range live-action videos, so that remote driving is suitable for different speeds and different road environments; in the switching process of the forward gear and the reverse gear, the forward-looking camera and the rear-looking camera are adopted for video switching, so that the influence of split-screen display on the operation of a remote driver is avoided; the actual driving is simulated, the display is divided into three screens, the existing driving control system is matched, and the operation experience of a driver is met; the problems that the existing camera is unreasonable in installation position, the display interface layout of the cockpit is not accordant with the visual angle of a driver, the pose and the behavior of the vehicle, and the driver is not facilitated to acquire the surrounding environment information and the vehicle state information are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a structural diagram of a vehicle-end information collection and remote display system for remote driving according to an embodiment of the present invention.
Fig. 2 is a connection relationship diagram of a vehicle-side information collection and remote display system for remote driving according to an embodiment of the present invention.
Fig. 3 is a schematic view of a display effect of the remote driving display system according to the embodiment of the present invention.
Detailed Description
In the patent, the surrounding environment of the vehicle is acquired by adopting a near-far combination mode, the remote transmission is carried out through a 5G network, and the related information is displayed in a split screen mode.
As shown in fig. 1, an embodiment of the present invention provides a vehicle-end information acquisition and remote display system for remote driving, where the system includes a vehicle-end information sensing system 1, an information remote transmission system 2, and a remote display system 3, where:
the vehicle-end information perception system 1 comprises an environment perception system 11 and a vehicle information acquisition system 12, wherein the environment perception system 11 comprises a close distance perception module 111, a long distance perception module 112 and a video signal conversion module 113, and the vehicle information acquisition system 12 comprises an automatic driving unit 121 and a remote driving controller 122;
the information remote transmission system 2 comprises a vehicle-end network access device 21, a 5G network 22 and a server-end network access device 23 which are arranged on a vehicle;
the remote display system 3 includes a server host 31 and a plurality of displays.
In this embodiment, the short-distance sensing module 111 includes four all-round-looking fisheye cameras 1111 and an all-round-looking electronic control unit 1112, which are disposed around a vehicle body, where the four all-round-looking fisheye cameras 1111 are configured to acquire a traffic environment around a vehicle within a first preset range, and the all-round-looking electronic control unit 1112 is configured to perform video splicing on the traffic environment around the vehicle within the first preset range acquired by the four all-round-looking fisheye cameras 1111, and send the spliced traffic environment around the vehicle within the first preset range to the video signal conversion module 113;
in this embodiment, the close-range sensing module 111 is configured to sense a traffic environment within a range of 3m around the vehicle, that is, the first preset range is a range of 3m around the vehicle, that is, a close-range video.
In this embodiment, the remote sensing module 112 includes a forward narrow-angle camera 1121, a left narrow-angle camera 1122, a right narrow-angle camera 1123, and a rear wide-angle camera 1124 disposed around the vehicle body, where the forward narrow-angle camera 1121, the left narrow-angle camera 1122, the right narrow-angle camera 1123, and the rear wide-angle camera 1124 are respectively connected to the video signal conversion module 113, and are configured to transmit a traffic environment in a second preset range around the vehicle to the video signal conversion module 113, where the traffic environment in the second preset range around the vehicle includes live-view video data of the forward narrow-angle camera 1121, live-view video data of the left narrow-angle camera 1122, live-view video data of the right narrow-angle camera 1123, and live-view video data of the rear wide-angle camera 1124;
it should be noted that the remote sensing module 112 is used for sensing traffic environments in the range of 2-80m in front, left and right sides and 2-20m in front and back, that is, distant view videos.
The close-range sensing module 111 and the long-range sensing module 112 are matched with each other, so that the remote driving can adapt to different vehicle speeds and different road environments, the capability of the remote driving system adapting to different environments is effectively improved, and the remote driving safety is obviously improved.
The video signal conversion module 113 is specifically configured to perform video data compression on the traffic environment in the first preset range around the vehicle and the traffic environment in the second preset range around the vehicle according to an H265 format, convert the video data into a real-time streaming protocol, and transmit the real-time streaming protocol to the vehicle-side network access device 21.
The autopilot unit 121 is configured to read pose, behavior and state information of a vehicle, and the remote driving controller 122 is configured to acquire the pose, behavior and state information of the vehicle from the autopilot unit 121 and transmit the pose, behavior and state information of the vehicle to the vehicle-end network access 21;
the vehicle-end network access device 21 is connected with the server-end network access device 23 through the 5G network 22, and is configured to transmit the traffic environment in the first preset range around the vehicle, the traffic environment in the second preset range around the vehicle, and the pose, behavior, and state information of the vehicle to the server-end network access device 23;
the server host 31 is connected to the server-side network access device 23, and is configured to acquire and analyze a traffic environment in a first preset range around the vehicle, a traffic environment in a second preset range around the vehicle, and pose, behavior, and state information of the vehicle from the server-side network access device 23;
the multiple displays are used for displaying live-action video data of the left narrow-angle camera 1122, live-action video data of the right narrow-angle camera 1123, a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil amount or electric quantity, a current gear, a current vehicle door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state, and live-action video data of the forward narrow-angle camera 1121 when the vehicle is located in a forward gear or live-action video data of the rear wide-angle camera 1124 when the vehicle is located in a reverse gear in a split screen manner.
As shown in fig. 2, an embodiment of the present invention provides a connection relationship between a vehicle-end information collection and a remote display system for remote driving, in this embodiment, the short-distance sensing module 111 includes four all-round fisheye cameras 1111, and the four all-round fisheye cameras 1111 are respectively disposed above an air intake grille, on a left rearview mirror, on a right rearview mirror, and above a rear license plate. Set up four all-round looking fisheye cameras 1111, can reach and gather all the surrounding environment, guarantee again that later stage concatenation data volume is minimum as far as possible, efficiency is optimal.
The front narrow-angle camera 1121 is arranged behind front windshield glass, the left narrow-angle camera 1122 is arranged on a left rearview mirror, the right narrow-angle camera 1123 is arranged on a right rearview mirror, and the rear wide-angle camera 1124 is arranged above a rear license plate.
As shown in fig. 3, an embodiment of the present invention provides a remote display system display effect, the plurality of displays includes a left display 32, a middle display 33, and a right display 34, wherein:
the left display 32 is configured to display real-time video data of the left narrow-angle camera 1122 in real time, the right display 34 is configured to display real-time video data of the right narrow-angle camera 1123 in real time, and the middle display 33 is configured to display a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil quantity or electric quantity, a current gear, a current vehicle door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state, and real-time video data of the forward narrow-angle camera 1121 when located at a forward gear or real-time video data of the rear wide-angle camera 1124 when located at a reverse gear.
Three displays, a left display 32 and a right display 34, are provided for displaying live-action video data of the left narrow-angle camera 1122 and live-action video data of the right narrow-angle camera 1123, respectively, similar to two rear-view mirrors of an automobile in appearance; the intermediate display 33 is configured to display a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil amount or electric quantity, a current gear, a current door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state, and live-action video data of the forward narrow-angle camera 1121 when located in a forward gear or live-action video data of the rear wide-angle camera 1124 when located in a reverse gear, which are similar to an automobile dashboard and live-action video data in front when moving forward or live-action video data in rear when moving backward in appearance; therefore, the setting mode of the three displays is quite accordant with the driving habit of driving the automobile by the user, and the driving comfort and the driving safety are facilitated.
Further, the middle display 33 is configured to display a traffic environment in a first preset range around the vehicle at an upper left corner, display a global navigation map of a remote driving task at an upper right corner, display a remote driving vehicle end information connection state, a control flow information connection state, and a current driving behavior state at a lower left corner, display a current vehicle speed, a current oil amount or electric quantity, a current gear, a current vehicle door state, and a current vehicle performance state directly below, and display live-action video data of the forward narrow-angle camera 1121 at a forward gear or live-action video data of the rear wide-angle camera 1124 at a reverse gear on a main screen.
Also, the display content of the arrangement of the intermediate display 33 is similar to the content layout observed during driving in reality, which is beneficial to the comfort and adaptability of remote driving control.
The implementation of the invention has the following beneficial effects:
according to the invention, the surrounding environment of the vehicle is sensed in a mode of combining close-range live-action videos and long-range live-action videos, so that remote driving is suitable for different speeds and different road environments; in the switching process of the forward gear and the backward gear, the forward-looking camera and the backward camera are adopted to realize video switching, so that the influence of split-screen display on the operation of a remote driver is avoided; the actual driving is simulated, the display is divided into three screens, the existing driving control system is matched, and the operation experience of a driver is met; the problem of the interface layout that current cockpit shows not conform to driver's visual angle and be unfavorable for the driver to acquire surrounding environment information and vehicle state information is solved.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (8)
1. The utility model provides a car end information acquisition and remote display system of remote driving, its characterized in that, the system includes car end information perception system (1), information teletransmission system (2) and remote display system (3), wherein:
the vehicle-end information perception system (1) comprises an environment perception system (11) and a vehicle information acquisition system (12), wherein the environment perception system (11) comprises a short-distance perception module (111), a long-distance perception module (112) and a video signal conversion module (113), and the vehicle information acquisition system (12) comprises an automatic driving unit (121) and a remote driving controller (122);
the information remote transmission system (2) comprises a vehicle-end network access device (21), a 5G network (22) and a server-end network access device (23) which are arranged on the vehicle;
the remote display system (3) comprises a server host (31) and a plurality of displays;
the close-range perception module (111) comprises a plurality of all-around fisheye cameras (1111) and an all-around electronic control unit (1112), the all-around fisheye cameras (1111) are arranged around a vehicle body and used for acquiring traffic environments in a first preset range around the vehicle, the all-around electronic control unit (1112) is used for carrying out video splicing on the traffic environments in the first preset range around the vehicle acquired by the all-around fisheye cameras (1111), and sending the spliced traffic environments in the first preset range around the vehicle to the video signal conversion module (113);
the remote sensing module (112) comprises a forward narrow-angle camera (1121), a left narrow-angle camera (1122), a right narrow-angle camera (1123) and a rear wide-angle camera (1124) which are arranged around the vehicle body, the forward narrow-angle camera (1121), the left narrow-angle camera (1122), the right narrow-angle camera (1123) and the rear wide-angle camera (1124) are respectively connected to the video signal conversion module (113), for transmitting the traffic environment within a second predetermined range around the vehicle to the video signal conversion module (113), the traffic environment in a second preset range around the vehicle comprises live-action video data of a forward narrow-angle camera (1121), live-action video data of a left narrow-angle camera (1122), live-action video data of a right narrow-angle camera (1123) and live-action video data of a rear wide-angle camera (1124);
the video signal conversion module (113) is used for compressing video data of a traffic environment in a first preset range around the vehicle and a traffic environment in a second preset range around the vehicle, converting the video data into a preset format and transmitting the preset format to the vehicle-end network access device (21);
the automatic driving unit (121) is used for reading the pose, behavior and state information of a vehicle, and the remote driving controller (122) is used for acquiring the pose, behavior and state information of the vehicle from the automatic driving unit (121) and transmitting the pose, behavior and state information of the vehicle to the vehicle-end network access device (21);
the vehicle-end network access device (21) is connected with the server-end network access device (23) through the 5G network (22) and is used for transmitting the traffic environment in a first preset range around the vehicle, the traffic environment in a second preset range around the vehicle and the pose, behavior and state information of the vehicle to the server-end network access device (23);
the server host (31) is connected with the server-side network access device (23) and is used for acquiring and analyzing a traffic environment in a first preset range around the vehicle, a traffic environment in a second preset range around the vehicle and the pose, behavior and state information of the vehicle from the server-side network access device (23);
the multiple displays are used for displaying live-action video data of the left narrow-angle camera (1122), live-action video data of the right narrow-angle camera (1123), a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil quantity or electric quantity, a current gear, a current vehicle door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state and live-action video data of a forward narrow-angle camera (1121) when the vehicle is located at a forward gear or live-action video data of a rear wide-angle camera (1124) when the vehicle is located at a reverse gear in a split screen mode.
2. The system of claim 1, wherein the close-range perception module (111) comprises four all-round fisheye cameras (1111) disposed above the intake grille, on the left rear view mirror, on the right rear view mirror, and above the rear license plate, respectively.
3. The system according to claim 2, characterized in that the close range perception module (111) is adapted to perceive the traffic environment within a range of 3m around the vehicle.
4. The system of claim 1, wherein the forward narrow angle camera (1121) is disposed behind a front windshield, the left narrow angle camera (1122) is disposed on a left side rearview mirror, the right narrow angle camera (1123) is disposed on a right side rearview mirror, and the rear wide angle camera (1124) is disposed above a rear license plate.
5. The system according to claim 1, wherein the distance sensing module (112) is used for sensing traffic environment within a range of 2-80m in front, left and right sides and 2-20m in right back.
6. The system according to claim 1, wherein the video signal conversion module (113) is specifically configured to perform video data compression according to an H265 format on the traffic environment within a first predetermined range around the vehicle and the traffic environment within a second predetermined range around the vehicle, and convert the video data into a real-time streaming protocol for transmission to the vehicle-side network access device (21).
7. The system of claim 1, wherein the plurality of displays comprises a left display (32), a middle display (33), and a right display (34), wherein:
the left display (32) is used for displaying live-action video data of the left narrow-angle camera (1122) in real time, the right display (34) is used for displaying live-action video data of the right narrow-angle camera (1123) in real time, and the middle display (33) is used for displaying a traffic environment in a first preset range around the vehicle, a global navigation map of a remote driving task, a current vehicle speed, a current oil quantity or electric quantity, a current gear, a current vehicle door state, a current vehicle performance state, a remote driving vehicle end information connection state, a control flow information connection state, a current driving behavior state, and live-action video data of the forward narrow-angle camera (1121) when the forward gear is located or live-action video data of the rear wide-angle camera (1124) when the reverse gear is located.
8. The system as claimed in claim 7, wherein the intermediate display (33) is configured to display a traffic environment in a first preset range around the vehicle in an upper left corner, a global navigation map for a remote driving task in an upper right corner, a remote driving vehicle-side information connection state, a control flow information connection state, and a current driving behavior state in a lower left corner, a current vehicle speed, a current fuel or electric quantity, a current gear position, a current door state, and a current vehicle performance state in a lower left corner, and real-scene video data of the forward narrow-angle camera (1121) at a forward gear position or real-scene video data of the rear wide-angle camera (1124) at a reverse gear position on a main screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010009529.5A CN113163156A (en) | 2020-01-06 | 2020-01-06 | Vehicle-end information acquisition and remote display system for remote driving |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010009529.5A CN113163156A (en) | 2020-01-06 | 2020-01-06 | Vehicle-end information acquisition and remote display system for remote driving |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113163156A true CN113163156A (en) | 2021-07-23 |
Family
ID=76881317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010009529.5A Pending CN113163156A (en) | 2020-01-06 | 2020-01-06 | Vehicle-end information acquisition and remote display system for remote driving |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113163156A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113448276A (en) * | 2021-08-18 | 2021-09-28 | 东风悦享科技有限公司 | Vehicle-end parallel driving controller with function of rack-end signal acquisition instrument and remote parallel driving control system and device |
| CN115297276A (en) * | 2022-10-09 | 2022-11-04 | 东风悦享科技有限公司 | Remote driving image processing system and method with vision field self-adaptive switching |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103661107A (en) * | 2013-11-29 | 2014-03-26 | 北京理工大学 | Non-line-of-sight driving system with controllable circumferential view field |
| CN105172701A (en) * | 2015-09-16 | 2015-12-23 | 浙江吉利汽车研究院有限公司 | Control method of vehicle panorama image system |
| CN107776489A (en) * | 2016-08-26 | 2018-03-09 | 比亚迪股份有限公司 | The display methods and display system of vehicle and its full-view image |
| US20180074490A1 (en) * | 2016-09-12 | 2018-03-15 | Iplab Inc. | Apparatus and method for vehicle remote controlling and remote driving system |
| CN109017757A (en) * | 2018-08-22 | 2018-12-18 | 吉林大学 | In vehicle remote generation, drives method and system |
| CN208291083U (en) * | 2018-05-11 | 2018-12-28 | 宝沃汽车（中国）有限公司 | In-vehicle display system and vehicle |
| CN110377000A (en) * | 2018-04-13 | 2019-10-25 | 北京智行者科技有限公司 | A kind of long-range dispensing control system of automatic driving vehicle and method |
-
2020
- 2020-01-06 CN CN202010009529.5A patent/CN113163156A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103661107A (en) * | 2013-11-29 | 2014-03-26 | 北京理工大学 | Non-line-of-sight driving system with controllable circumferential view field |
| CN105172701A (en) * | 2015-09-16 | 2015-12-23 | 浙江吉利汽车研究院有限公司 | Control method of vehicle panorama image system |
| CN107776489A (en) * | 2016-08-26 | 2018-03-09 | 比亚迪股份有限公司 | The display methods and display system of vehicle and its full-view image |
| US20180074490A1 (en) * | 2016-09-12 | 2018-03-15 | Iplab Inc. | Apparatus and method for vehicle remote controlling and remote driving system |
| CN110377000A (en) * | 2018-04-13 | 2019-10-25 | 北京智行者科技有限公司 | A kind of long-range dispensing control system of automatic driving vehicle and method |
| CN208291083U (en) * | 2018-05-11 | 2018-12-28 | 宝沃汽车（中国）有限公司 | In-vehicle display system and vehicle |
| CN109017757A (en) * | 2018-08-22 | 2018-12-18 | 吉林大学 | In vehicle remote generation, drives method and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113448276A (en) * | 2021-08-18 | 2021-09-28 | 东风悦享科技有限公司 | Vehicle-end parallel driving controller with function of rack-end signal acquisition instrument and remote parallel driving control system and device |
| CN113448276B (en) * | 2021-08-18 | 2023-12-05 | 东风悦享科技有限公司 | Parallel driving control circuit and system with signal acquisition instrument function |
| CN115297276A (en) * | 2022-10-09 | 2022-11-04 | 东风悦享科技有限公司 | Remote driving image processing system and method with vision field self-adaptive switching |
| CN115297276B (en) * | 2022-10-09 | 2023-01-17 | 东风悦享科技有限公司 | Remote driving image processing system and method with vision field self-adaptive switching |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN212353623U (en) | Display system based on automobile intelligent cabin | |
| CN105374221A (en) | Reminder system and reminder method of states of traffic lights | |
| CN113163156A (en) | Vehicle-end information acquisition and remote display system for remote driving | |
| CN212305474U (en) | Large vehicle panoramic image splicing system and automobile | |
| CN113525234A (en) | Auxiliary driving system device | |
| CN105365674A (en) | Multifunctional vehicle meter panel and realization method thereof | |
| CN114281074A (en) | Beyond-the-horizon unmanned vehicle remote control system and unmanned vehicle | |
| CN212220070U (en) | Vehicle real-time positioning system based on visual semantic segmentation technology | |
| CN111907410A (en) | System and method for realizing panoramic driving record by utilizing panoramic parking function | |
| CN216268984U (en) | Original vehicle is installed 360 degrees panorama parking systems additional | |
| CN215599528U (en) | Remote control driving system for automatic driving automobile | |
| CN212447343U (en) | Multi-screen interconnected vehicle-mounted entertainment system | |
| CN214689258U (en) | Intelligent electronic display system of automobile | |
| CN105172679A (en) | Wide area driving image system | |
| CN218228833U (en) | Vehicle-mounted display device and vehicle | |
| CN210168141U (en) | Vehicle-mounted projection system | |
| CN106809138A (en) | A kind of in-vehicle display system of the transport information interaction based on DSRC technology | |
| CN111083439A (en) | Automobile high-resolution panoramic fusion system | |
| US20150116320A1 (en) | Device for Operating One or More Optical Display Devices of a Vehicle | |
| CN208360056U (en) | 360 based on Vehicular intelligent cockpit look around device, Vehicular intelligent cockpit and vehicle | |
| CN105451000A (en) | Vehicle-mounted panoramic all-around looking system and method based on monocular rear-view camera | |
| CN112389326A (en) | Electronic exterior rearview mirror control system and method for realizing split-screen display and automobile | |
| CN214475513U (en) | Unmanned mine card remote control system based on 5G | |
| CN112078486A (en) | Steering auxiliary device and method based on HUD display | |
| CN221067783U (en) | AR-HUD-based integrated display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210723 |