CN113316027A - Double-screen interaction system based on video stream in vehicle-machine interaction - Google Patents
Double-screen interaction system based on video stream in vehicle-machine interaction Download PDFInfo
- Publication number
- CN113316027A CN113316027A CN202110576047.2A CN202110576047A CN113316027A CN 113316027 A CN113316027 A CN 113316027A CN 202110576047 A CN202110576047 A CN 202110576047A CN 113316027 A CN113316027 A CN 113316027A
- Authority
- CN
- China
- Prior art keywords
- socket
- central control
- screen
- display module
- navigation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 29
- 230000005540 biological transmission Effects 0.000 claims abstract description 24
- 238000004891 communication Methods 0.000 claims abstract description 4
- 230000002452 interceptive effect Effects 0.000 claims description 9
- 239000004973 liquid crystal related substance Substances 0.000 abstract description 5
- 238000000034 method Methods 0.000 abstract description 3
- 230000008569 process Effects 0.000 abstract description 3
- 238000013461 design Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- B60K35/10—
-
- B60K35/28—
-
- B60K35/85—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- B60K2360/166—
-
- B60K2360/589—
Abstract
The invention relates to a video stream-based dual-screen interaction system in vehicle-machine interaction, which comprises a central control navigation display module, a Socket client, a Socket server and an instrument display navigation module, wherein the output end of the central control navigation display module is connected with the Socket client and used for intercepting video data in real time, the central control navigation display module compresses and encodes videos and transmits screen projection signals to the Socket client, the Socket client is connected with the Socket server through an Ethernet and used for carrying out video transmission through Socket communication, and the input end of the instrument display navigation module is connected with the Socket server and used for decoding the videos. By adopting the video stream-based double-screen interaction system in the vehicle-machine interaction, the instrument panel comprises the liquid crystal display, when the central control displays navigation, a navigation interface is displayed in the screen of the instrument, and a driver does not need to turn the sight to the central control screen to check information in the driving process, so that the driving safety is improved.
Description
Technical Field
The invention relates to the field of vehicle-machine double-screen interaction, in particular to the field of double-screen video stream transmission, network data transmission and data conversion formats, and particularly relates to a double-screen interaction system based on video streams in vehicle-machine interaction.
Background
In the early period, the control is mainly based on the entity key, the entertainment function is only a radio, a tape player is developed slowly, then in the later CD player, in 1986, a first touch control central control screen, namely a 3 x 4 inch touch control screen based on a GCC system, is carried on Nieke Rivirera, and therefore the air conditioner temperature and the radio can be adjusted, and vehicle fault diagnosis, residual oil quantity and history information can be displayed.
After 2000 years, the vehicle-mounted system is built into the on-screen era, and in 2001, BMW carries an initial i-Drive system in a new 7 th system, and integrates more than 700 functions through a main key and a plurality of shortcut keys which can be controlled in four directions, so that the entity key of central control is simplified. The combination of physical keys and screen then occupies the primary position of the center console.
In 2012, the chip of Cortex A8 series is released to frees up in the air to the cartridge, has carried on tall and erect 2.1 system, and tall and erect car machine of ann is horizontal to be appeared, and the car machine gets into intelligent era, and on-vehicle ecology begins to enrich.
With the development of electronic information technology, the central control system of the automobile increasingly uses digital technology, and each family enterprise develops an intelligent cabin with great force. Compare traditional passenger cabin, intelligence passenger cabin is more intelligent, more comfortable, more can press close to user's demand, and intelligence passenger cabin is constantly changing along with intelligent new technology, new material etc. constantly develop.
The intelligent cockpit display changes towards 3D, multi-screen, large-screen and diversified layout trends. In the era of scene interaction, the cabin layout is not uniform, for example, besides the traditional center control instrument design, the center control console screen-connected design is applied by a plurality of host factories, the dual-screen and triple-screen design is achieved, and even the quintuplet screen design is achieved, and in addition, novel display screens such as a center control screen, a copilot entertainment screen, a rear row display screen and a transparent A column appear on a vehicle.
The automobile instrument is continuously improved along with the high-speed development of the automobile industry, the technology is developed from a mechanical instrument panel to the existing liquid crystal instrument panel, the liquid crystal instrument panel is not only a simple element for providing the rotating speed and the vehicle speed, and more important automobile information can be displayed.
At present, most of vehicle machines are combined by a digital instrument and a central control screen, wherein the central control screen comprises functions of navigation, vehicle-mounted control, photocopying entertainment and the like, and the instrument displays vehicle information and the like. The instrument screen directly faces the driver, the central control screen does not directly face the driver, when the driver views navigation, entertainment and other functions, the sight line can move to the central control screen, and when the sight line leaves the road, certain danger exists.
If the content displayed by the central control screen is projected to the instrument screen and the content is selected and displayed through the button of the steering wheel, a driver does not need to move the sight to the central control screen, so that the driving safety is improved, and the user experience is also improved.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a video stream-based double-screen interaction system in vehicle-mounted interaction, which has the advantages of simple structure, good safety and good user experience.
In order to achieve the above object, the video stream-based dual-screen interactive system in the car-machine interaction of the present invention is as follows:
the double-screen interactive system based on the video stream in the vehicle-mounted interaction is mainly characterized by comprising a central control navigation display module, a Socket client, a Socket server and an instrument display navigation module, wherein the output end of the central control navigation display module is connected with the Socket client and used for intercepting video data in real time, the central control navigation display module compresses and encodes videos and transmits screen projection signals to the Socket client, the Socket client is connected with the Socket server through the Ethernet and used for carrying out video transmission through Socket communication, and the input end of the instrument display navigation module is connected with the Socket server and used for decoding the videos.
Preferably, the central control navigation display module, the Socket client, the Socket server and the instrument display navigation module are all connected in an internal local area network, and real-time video transmission is realized through the network.
Preferably, the central navigation display module compresses the video data into an H264 encoding format, and transmits the compressed video data to the Socket client.
Preferably, the Socket server opens a long-standing Socket service, and creates a Socket client when the central control navigation display module transmits the screen projection signal, and the Socket client sends data to the Socket server.
Preferably, the Socket server converts the data into playable video data through a decoder.
Preferably, the central control navigation display module and the Socket client further perform data transmission in an LVDS manner.
By adopting the double-screen interaction system based on the video stream in the vehicle-mounted interaction, the instrument panel comprises the liquid crystal display screen, when the central control displays navigation, the instrument panel can be used for sending a screen-throwing instruction in a mode of key pressing of a steering wheel or multi-finger sliding of the central control, and the like, a navigation interface is displayed in the screen of the instrument panel, and contents such as music, radio and the like can also be displayed, so that a driver does not need to turn the sight to the central control screen to view information in the driving process, and the driving safety is improved.
Drawings
Fig. 1 is a block diagram of a video stream-based dual-screen interactive system in vehicle-mounted interaction according to the present invention.
Fig. 2 is a schematic diagram of a data transmission mode of a video stream-based dual-screen interactive system in vehicle-machine interaction according to the present invention.
Fig. 3 is a schematic view of an LVDS interface of a video stream-based dual-screen interactive system in vehicle-machine interaction according to the present invention.
Detailed Description
In order to more clearly describe the technical contents of the present invention, the following further description is given in conjunction with specific embodiments.
The double-screen interaction system based on the video stream in the vehicle-mounted interaction comprises a central control navigation display module, a Socket client, a Socket server and an instrument display navigation module, wherein the output end of the central control navigation display module is connected with the Socket client and used for intercepting video data in real time, the central control navigation display module compresses and encodes videos and transmits screen projection signals to the Socket client, the Socket client is connected with the Socket server through the Ethernet and used for carrying out video transmission through Socket communication, and the input end of the instrument display navigation module is connected with the Socket server and used for decoding the videos.
As a preferred embodiment of the present invention, the central control navigation display module, the Socket client, the Socket server, and the instrument display navigation module are all connected in an internal local area network, and real-time video transmission is realized through the network.
As a preferred embodiment of the present invention, the central control navigation display module compresses the video data into an H264 encoding format, and transmits the compressed video data to the Socket client.
As a preferred embodiment of the present invention, the Socket server opens a long-lived Socket service, creates a Socket client when the central control navigation display module transmits a screen projection signal, and sends data to the Socket server.
As a preferred embodiment of the present invention, the Socket server converts data into playable video data through a decoder.
As a preferred embodiment of the present invention, the central control navigation display module and the Socket client further perform data transmission in an LVDS manner.
In the specific implementation mode of the invention, the scene interaction between the android central control and the instrument system is solved, and partial functions of instrument display central control are realized.
The invention realizes the display of the central control content on the instrument screen by using the Ethernet in the vehicle and transmitting the video data by using the network.
The data transmission mode uses an internal ethernet to realize network transmission, connects an internal local area network through a singlechip network interface and a central control chip, and uses the network to realize real-time video transmission, as shown in fig. 2.
1. Acquiring a real-time video:
and the central control intercepts each frame of video data in real time through Android Camera preview setting.
2. Data compression and encoding:
video data acquired by Android through Camera is in YUV420SP format, and in order to support more terminals, the video needs to be converted into I420 format; the video is composed of a frame of picture, because of the special physiological structure of human eyes, in order to prevent the video from having a pause phenomenon, the frame rate of the picture is higher than 16 frames/second, the high definition is generally 60 frames, if the video resolution is 1280 × 720, plus the 24 bits true color of the picture, the picture of one second: 1280 × 720 × 60 ≈ 162M if the video without encoding is unfavorable for transmission.
And for convenient transmission, one frame cannot be transmitted, the content of one frame is too large, and needs to be subdivided for more convenient transmission, if the time of a counterpart and the like is long in the past of transmitting a complete frame, a smaller transmission unit is needed to ensure better compressibility, fault tolerance and real-time viewability, the smaller unit is a NALU unit, so that an H264 original code stream (also called a naked stream) is composed of NALUs one by one, and the composition of NALUs does not need to be known, and the known data is in NALUs units. Therefore, the video is converted into an H264 coding format, and transmission is facilitated.
3. Video transmission:
the transmission mode adopts a Socket mode, the instrument end starts a Socket service, the service is long-standing, the service exists all the time during the running period of the instrument, a Socket client is established during the screen projection of the central control, and the client sends data to the server end.
4. And (3) decoding:
after receiving the data, the server end decodes the data into video data which can be played by using a decoder. And the instrument acquires the video and then displays the video at the corresponding position on the screen.
Remarking:
the data transmission of the meter and the central control unit can also be transmitted in an LVDS manner instead of using a network, the meter chip and the central control chip are connected through a pin of the LVDS, and an LVDS interface is shown in fig. 3.
By adopting the double-screen interaction system based on the video stream in the vehicle-mounted interaction, the instrument panel comprises the liquid crystal display screen, when the central control displays navigation, the instrument panel can be used for sending a screen-throwing instruction in a mode of key pressing of a steering wheel or multi-finger sliding of the central control, and the like, a navigation interface is displayed in the screen of the instrument panel, and contents such as music, radio and the like can also be displayed, so that a driver does not need to turn the sight to the central control screen to view information in the driving process, and the driving safety is improved.
In this specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (6)
1. The double-screen interactive system is characterized by comprising a central control navigation display module, a Socket client, a Socket server and an instrument display navigation module, wherein the output end of the central control navigation display module is connected with the Socket client and used for intercepting video data in real time, the central control navigation display module compresses and encodes videos and transmits screen projection signals to the Socket client, the Socket client is connected with the Socket server through an Ethernet and used for carrying out video transmission through Socket communication, and the input end of the instrument display navigation module is connected with the Socket server and used for decoding the videos.
2. The dual-screen interactive system based on video streams in vehicle-mounted interaction according to claim 1, wherein the central control navigation display module, the Socket client, the Socket server and the instrument display navigation module are all connected in an internal local area network, and real-time video transmission is achieved through the network.
3. The system of claim 1, wherein the central navigation display module compresses video data into an H264 coding format and transmits the compressed video data to a Socket client.
4. The dual-screen interactive system based on video streams in vehicle-mounted interaction according to claim 1, wherein the Socket server side starts a long-standing Socket service, a Socket client is created when the central control navigation display module transmits a screen projection signal, and the Socket client sends data to the Socket server side.
5. The system of claim 1, wherein the Socket server converts data into playable video data through a decoder.
6. The dual-screen interactive system based on video streams in vehicle-machine interaction according to claim 1, wherein the central control navigation display module and the Socket client further perform data transmission in an LVDS manner.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110576047.2A CN113316027A (en) | 2021-05-26 | 2021-05-26 | Double-screen interaction system based on video stream in vehicle-machine interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110576047.2A CN113316027A (en) | 2021-05-26 | 2021-05-26 | Double-screen interaction system based on video stream in vehicle-machine interaction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113316027A true CN113316027A (en) | 2021-08-27 |
Family
ID=77374901
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110576047.2A Pending CN113316027A (en) | 2021-05-26 | 2021-05-26 | Double-screen interaction system based on video stream in vehicle-machine interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113316027A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114047896A (en) * | 2021-11-16 | 2022-02-15 | 湖北亿咖通科技有限公司 | Screen projection method and electronic equipment |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN115174537A (en) * | 2022-06-30 | 2022-10-11 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-machine interaction |
| CN115220842A (en) * | 2022-07-21 | 2022-10-21 | 亿咖通(湖北)技术有限公司 | Vehicle navigation method, system, vehicle and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140289627A1 (en) * | 2013-03-15 | 2014-09-25 | Activevideo Networks, Inc. | Multiple-Mode System and Method for Providing User Selectable Video Content |
| CN205951848U (en) * | 2016-08-11 | 2017-02-15 | 扬州航盛科技有限公司 | On -vehicle high definition double screen interaction entertainment system |
| CN111182078A (en) * | 2020-01-03 | 2020-05-19 | 清华大学深圳国际研究生院 | Multi-screen interaction method based on intelligent cabin |
| CN111954069A (en) * | 2020-07-07 | 2020-11-17 | 东风电驱动系统有限公司 | Double-screen interactive display method and system for automobile console video |
-
2021
- 2021-05-26 CN CN202110576047.2A patent/CN113316027A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140289627A1 (en) * | 2013-03-15 | 2014-09-25 | Activevideo Networks, Inc. | Multiple-Mode System and Method for Providing User Selectable Video Content |
| CN205951848U (en) * | 2016-08-11 | 2017-02-15 | 扬州航盛科技有限公司 | On -vehicle high definition double screen interaction entertainment system |
| CN111182078A (en) * | 2020-01-03 | 2020-05-19 | 清华大学深圳国际研究生院 | Multi-screen interaction method based on intelligent cabin |
| CN111954069A (en) * | 2020-07-07 | 2020-11-17 | 东风电驱动系统有限公司 | Double-screen interactive display method and system for automobile console video |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114047896A (en) * | 2021-11-16 | 2022-02-15 | 湖北亿咖通科技有限公司 | Screen projection method and electronic equipment |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN114756321B (en) * | 2022-04-28 | 2024-02-06 | 重庆长安汽车股份有限公司 | System and method for realizing instrument interaction interface and displaying based on vehicle-mounted device |
| CN115174537A (en) * | 2022-06-30 | 2022-10-11 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-machine interaction |
| CN115174537B (en) * | 2022-06-30 | 2023-07-21 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-computer interaction |
| CN115220842A (en) * | 2022-07-21 | 2022-10-21 | 亿咖通(湖北)技术有限公司 | Vehicle navigation method, system, vehicle and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113316027A (en) | Double-screen interaction system based on video stream in vehicle-machine interaction | |
| EP2628042B1 (en) | Variable transparency heads up displays | |
| US10937120B2 (en) | Video processing system and processing chip | |
| CN101431690B (en) | Image processing apparatus, image processing method | |
| JP2005107780A (en) | Image blending method and blended image data generation device | |
| CN201887901U (en) | Three-dimensional video playing system | |
| US20110148938A1 (en) | Displayed contents securing system and method, and displayed contents viewing device | |
| AU2003256012A1 (en) | A display system for displaying images within a vehicle | |
| CN101742167B (en) | Video processing circuit and related method for merging video output streams with graphical stream for transmission | |
| WO2005120068A2 (en) | System for delivering multimedia content to airline passengers | |
| GB2455456A (en) | System and method for displaying computer data in a multi-screen display system | |
| CN101409063A (en) | Display control device, display device, and display method | |
| US9369634B2 (en) | Display device and display method | |
| KR20130066168A (en) | Apparatas and method for dual display of television using for high definition multimedia interface in a portable terminal | |
| CN102547313A (en) | Three-dimensional video play system and method thereof | |
| JPS60180387A (en) | Display device | |
| CN102957875A (en) | Image processing method, device and system | |
| CN103129463A (en) | Vehicle-mounted real-time image transmission display communication system | |
| CN105139765B (en) | Information shows hybrid system | |
| CN103237243A (en) | Vehicle-mounted digital television receiving terminal capable of realizing EPG (Electronic Program Guide) display style multi-user management | |
| CN111432257A (en) | Method for starting screen protection of display equipment and display equipment | |
| CN109348157A (en) | Based on circuit, the method and device for controlling information iteration in video realization | |
| WO2002007138A3 (en) | Interactive advertising display | |
| CN201444232U (en) | Vehicle-mounted multimedia display terminal device | |
| CN111064982A (en) | Display control method, storage medium and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210827 |
|
| RJ01 | Rejection of invention patent application after publication |