CN111182078A - Multi-screen interaction method based on intelligent cabin - Google Patents
Multi-screen interaction method based on intelligent cabin Download PDFInfo
- Publication number
- CN111182078A CN111182078A CN202010005789.5A CN202010005789A CN111182078A CN 111182078 A CN111182078 A CN 111182078A CN 202010005789 A CN202010005789 A CN 202010005789A CN 111182078 A CN111182078 A CN 111182078A
- Authority
- CN
- China
- Prior art keywords
- android
- linux system
- data
- linux
- socket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/143—Termination or inactivation of sessions, e.g. event-controlled end of session
- H04L67/145—Termination or inactivation of sessions, e.g. event-controlled end of session avoiding end of session, e.g. keep-alive, heartbeats, resumption message or wake-up for inactive or interrupted session
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Telephone Function (AREA)
Abstract
The invention relates to the technical field of intelligent cabins, in particular to a multi-screen interaction method based on an intelligent cabin. The method comprises the following steps: establishing a server side of Socket communication in a Linux system, and establishing a client side of Socket communication in an Android system; compared with the Android system, the Linux system is started first, and a Socket server is established after the Linux system is started to wait for connection of a client; after the Android system is started, a Socket client is established and connected with a Socket server in the Linux system; after the connection is established, Android starts a heartbeat package mechanism; under the normal connection condition, the Android system sends navigation map data and other multi-screen interaction data to the Linux system, and the Linux system sends a control instruction to the Android system; and when the connection is required to be disconnected, the Linux system sends a disconnection instruction to the Android system to disconnect the Linux system from the Android system. According to the invention, the connection is established between the Linux system and the Android system, and the information sharing and interaction among a plurality of screens are realized by mutual transmission of data between the Linux system and the Android system.
Description
Technical Field
The invention relates to the technical field of intelligent cabins, in particular to a multi-screen interaction method based on an intelligent cabin.
Background
The current smart car generally adopts a CarPlay system and a Mirrorlink system, wherein the CarPlay system is a technology provided by apple Inc. and can be used by car manufacturers or car loader manufacturers, and enable users to access functions of iPhone such as telephone, short message, navigation, music, podcasts and the like through interaction means such as a touch screen or buttons (including steering wheel buttons, center console buttons/knobs) and the like of the car loader. Interaction between the vehicle-mounted entertainment system and the mobile phone enriches the functions of the vehicle-mounted central control entertainment system; the MirrorLink system is a 'car networking' standard which is jointly established by some international famous mobile phone manufacturers and car manufacturers, aims to standardize the effective connection between the smart phone and the car system, and forms good user experience. The mobile phone can be connected with the vehicle-mounted system through USB, Bluetooth or WIFI. And the mobile phone terminal transmits the operation interface to the vehicle-mounted screen through the APP software. A simple and clear menu interface is formed on the vehicle-mounted screen, and corresponding menu operation can be carried out through physical keys or voice commands on the vehicle. The two methods have the defects of different degrees, the CarPlay system is only limited to the apple cell phone, and the operation of the apple cell phone is carried to a central control display screen in a vehicle through CarPlay, and the development cycle of the whole project is long because the CarPlay authentication cycle is long and the auditing process is complex; the Mirrolink system is limited to multi-screen interaction and data transmission between the mobile phone and the central control, and transmits an operation interface to the vehicle-mounted screen through the APP software at the mobile phone end, so that when the Mirrolink system is connected with the mobile phone, the interaction between the central control and the instrument, and the interaction between the central control and the HUD can not be realized by the vehicle-mounted screen.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a multi-screen interaction method between a Liquid Crystal Display (LCD) and a head-up display (HUD) and a vehicle-mounted information entertainment system (IVI).
The purpose of the invention is realized by the following technical scheme:
a multi-screen interaction method based on an intelligent cabin comprises the following steps:
step 1) establishing a server side of Socket communication in a Linux system, and establishing a client side of Socket communication in an Android system;
step 2) starting the Linux system compared with the Android system, and establishing a Socket server after the Linux system is started to wait for connection of a client;
step 3) after the Android system is started, establishing a Socket client to connect a Socket server in the Linux system;
step 4), after the connection is established, Android starts a heartbeat package mechanism to confirm that Socket connection is normal;
step 5) under the normal connection condition, the Android system sends navigation map data and other multi-screen interaction data to the Linux system, and the Linux system sends a control instruction to the Android system;
and 6) when the connection is required to be disconnected, the Linux system sends a disconnection instruction to the Android system to disconnect the Linux system from the Android system.
Specifically, the vehicle-mounted infotainment system comprises music data, Bluetooth data, radio station data and navigation map data.
Specifically, the music data, the bluetooth data and the radio station data are transmitted based on a TCP communication mode.
Specifically, the navigation map data is transmitted based on a UDP communication mode.
Compared with the prior art, the invention has the following advantages and beneficial effects:
according to the multi-screen interaction method, the connection is established between the Linux system and the Android system, and the data between the Linux system and the Android system are mutually transmitted, so that the information sharing and interaction among a plurality of screens are realized, the interaction experience of a user is enriched, compared with a CarPlay system or a MirrorLink system, the multi-screen interaction method has better flexibility, and the independence and the safety among the systems are also ensured.
Drawings
Fig. 1 is a flowchart illustrating the overall steps of a multi-screen interaction method based on an intelligent cockpit according to the present invention.
Fig. 2 is a flowchart illustrating specific steps of a multi-screen interaction method based on an intelligent cockpit according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but the present invention is not limited thereto.
The specific implementation process of the invention is as follows: as shown in fig. 1 to 2, a multi-screen interaction method based on an intelligent cockpit includes the following steps:
the liquid crystal instrument and the HUD are operated in a Linux system, the vehicle-mounted information entertainment system IVI is operated in an Android system, the Linux system can enable the liquid crystal instrument and the HUD to be started quickly within 2s of starting of an automobile and guarantee the safety of the liquid crystal instrument and the HUD, the Android system brings richer functional experience to customers, the Linux system and the Android system are connected through Socket data of an Ethernet and carry out data transparent transmission through Socket communication, the Socket communication is a network-oriented communication mechanism, and the liquid crystal instrument and the vehicle-mounted information entertainment system IVI can transmit data in a Socket communication mode in the same network; a multi-screen interaction communication protocol between Linux and Android is defined in advance.
Step 1) establishing a server side of Socket communication in a Linux system, and establishing a client side of Socket communication in an Android system;
step 2) starting the Linux system compared with the Android system, and establishing a Socket server after the Linux system is started to wait for connection of a client; in the intelligent cockpit, the instrument is always started in preference to the central control entertainment system, so that a Linux system of an instrument end is started first, a QT development application program is used by the Linux side, and a Socket server end is established in QT application development to wait for connection of a client;
step 3) after the Android system is started, establishing a Socket client to connect a Socket server in the Linux system; specifically, the Android system is connected with a server end by binding an ip address and a port number of the server end; one Linux system can be connected with a plurality of Android systems, and in an intelligent cabin, the Android system loaded is mainly a mobile terminal, for example: a cell phone, tablet or other mobile electronic device.
Step 4), after the connection is established, Android starts a heartbeat package mechanism to confirm that Socket connection is normal; the heartbeat package mechanism is that the Android system periodically sends heartbeat package messages to the Linux system, if the Linux system receives the heartbeat package messages, the heartbeat package messages are responded, the operation is normal and is not processed, if the continuous N heartbeat packages are overtime and not responded, the connection with the Linux system is abnormal, and the Android system returns to the step 3) to restart the Socket client and is connected with the Socket server in the Linux system again;
step 5) under the normal connection condition, the Android system sends navigation map data and other multi-screen interaction data to the Linux system, and the Linux system sends a control instruction to the Android system; step 5) mainly performing multi-screen interactive data interaction, wherein after the receiving end receives the message of the sending end, the receiving end replies to the sending end to indicate that the receiving end receives the message; the front-row driver, the copilot and the back-row passengers can enjoy the interaction of one-key navigation, movies, radio stations, news information and the like, brand-new man-machine interaction experience is brought to users, the automobile becomes a moving living space by means of an intelligent cabin, a navigation map in the vehicle-mounted information entertainment system IVI sends real-time navigation map data to the liquid crystal instrument/head-up display HUD, the liquid crystal instrument/head-up display HUD directly displays the data information on the liquid crystal instrument/head-up display HUD after receiving the navigation map data, and the driver does not need to observe a navigation route in the vehicle-mounted information entertainment system IVI in the navigation process, so that the interference to the driver is reduced, the driver can concentrate on driving, and the same multimedia information such as music, on-line radio stations and the like can be easily passed through the mode, the information is transmitted to the liquid crystal instrument/head-up display HUD and displayed and interacted on the liquid crystal instrument/head-up display HUD, so that the entertainment of driving is enhanced.
And 6) when the connection is required to be disconnected, the Linux system sends a disconnection instruction to the Android system to disconnect the Linux system from the Android system.
In addition, the multi-screen interaction method can be expanded to four-screen or even five-screen interaction, and the interaction of the copilot vehicle-mounted information entertainment system IVI and the rear-row vehicle-mounted information entertainment system IVI can also be expanded.
Specifically, the vehicle-mounted infotainment system comprises music data, Bluetooth data, radio station data and navigation map data.
Specifically, the music data, the bluetooth data and the radio station data are transmitted based on a TCP communication mode, and the TCP communication is a stable and reliable network transmission protocol and can be used for transmitting related data such as music, bluetooth and radio stations in a data stream mode.
Specifically, the navigation map data is transmitted based on a UDP communication mode, and the UDP is a connection-free unreliable network transmission protocol, and may be used for data transmission of the navigation map.
Compared with a CarPlay system, the multi-screen interaction method based on the intelligent cabin can be used in an open-source Android system, and compared with a Mirrolink system, a mobile phone operation interface does not need to be transmitted to a vehicle-mounted screen, and a plurality of Android systems can be connected with a Linux system at the same time. The multi-screen interaction method also ensures the independence and safety among all systems, and automatically shares related information to related screens in the navigation, music or telephone processes according to the personalized settings of the user, thereby bringing intelligent driving experience to the user.
The above-mentioned embodiments only express the embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (4)
1. A multi-screen interaction method based on an intelligent cabin is characterized by comprising the following steps:
step 1) establishing a server side of Socket communication in a Linux system, and establishing a client side of Socket communication in an Android system;
step 2) starting the Linux system compared with the Android system, and establishing a Socket server after the Linux system is started to wait for connection of a client;
step 3) after the Android system is started, establishing a Socket client to connect a Socket server in the Linux system;
step 4), after the connection is established, Android starts a heartbeat package mechanism to confirm that Socket connection is normal;
step 5) under the normal connection condition, the Android system sends navigation map data and other multi-screen interaction data to the Linux system, and the Linux system sends a control instruction to the Android system;
and 6) when the connection is required to be disconnected, the Linux system sends a disconnection instruction to the Android system to disconnect the Linux system from the Android system.
2. A smart car-based multi-screen interaction method as claimed in claim 1, wherein the in-vehicle infotainment system includes music data, bluetooth data, radio data and navigation map data.
3. A multi-screen interaction method based on an intelligent cockpit as recited in claim 2 wherein the music data, bluetooth data, and radio station data are transmitted based on TCP communication.
4. A multi-screen interaction method based on an intelligent cockpit as recited in claim 2, wherein the navigation map data is transmitted based on a UDP communication manner.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010005789.5A CN111182078A (en) | 2020-01-03 | 2020-01-03 | Multi-screen interaction method based on intelligent cabin |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010005789.5A CN111182078A (en) | 2020-01-03 | 2020-01-03 | Multi-screen interaction method based on intelligent cabin |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111182078A true CN111182078A (en) | 2020-05-19 |
Family
ID=70649164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010005789.5A Pending CN111182078A (en) | 2020-01-03 | 2020-01-03 | Multi-screen interaction method based on intelligent cabin |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111182078A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112309154A (en) * | 2020-09-28 | 2021-02-02 | 惠州市德赛西威智能交通技术研究院有限公司 | Method, equipment and automobile for automatically parking and leaving garage through quick Ble starting |
| CN112929343A (en) * | 2021-01-22 | 2021-06-08 | 中汽创智科技有限公司 | Cross-domain communication method, system, equipment and storage medium for intelligent cockpit |
| CN112947235A (en) * | 2021-03-11 | 2021-06-11 | 深圳市阿丹能量信息技术有限公司 | Cabin domain controller system based on X9 platform and Xen technology and application method |
| CN113316027A (en) * | 2021-05-26 | 2021-08-27 | 东风电子科技股份有限公司 | Double-screen interaction system based on video stream in vehicle-machine interaction |
| CN113504870A (en) * | 2021-04-06 | 2021-10-15 | 惠州市德赛西威智能交通技术研究院有限公司 | Hypervisor intelligent cockpit input method sharing system and method |
| CN113891146A (en) * | 2021-09-23 | 2022-01-04 | 中汽创智科技有限公司 | Multi-screen interaction system, method, driving device and storage medium |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN114827220A (en) * | 2022-04-15 | 2022-07-29 | 武汉光庭信息技术股份有限公司 | Cabin domain application simulation platform |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103501453A (en) * | 2013-09-29 | 2014-01-08 | 中山大学 | Interaction system based on Android and Linux smart television |
| US20140277937A1 (en) * | 2013-03-15 | 2014-09-18 | Audi Ag | In-vehicle access of mobile device functions |
| CN104333844A (en) * | 2014-11-12 | 2015-02-04 | 沈阳美行科技有限公司 | Interconnection method of vehicle-mounted terminal and smart phone |
| CN108255677A (en) * | 2018-01-16 | 2018-07-06 | 中电福富信息科技有限公司 | The vehicle-mounted vehicle device of car networking and Android device communication means and its device |
| CN108391247A (en) * | 2018-02-02 | 2018-08-10 | 深圳市恒晨电器有限公司 | WIFI control systems and method based on P2P, vehicle-mounted Android system and mobile phone terminal |
| CN109889513A (en) * | 2019-02-02 | 2019-06-14 | 上海市共进通信技术有限公司 | Realize the method that communication control is carried out between fusion device internal gateway and the end OTT |
-
2020
- 2020-01-03 CN CN202010005789.5A patent/CN111182078A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140277937A1 (en) * | 2013-03-15 | 2014-09-18 | Audi Ag | In-vehicle access of mobile device functions |
| CN103501453A (en) * | 2013-09-29 | 2014-01-08 | 中山大学 | Interaction system based on Android and Linux smart television |
| CN104333844A (en) * | 2014-11-12 | 2015-02-04 | 沈阳美行科技有限公司 | Interconnection method of vehicle-mounted terminal and smart phone |
| CN108255677A (en) * | 2018-01-16 | 2018-07-06 | 中电福富信息科技有限公司 | The vehicle-mounted vehicle device of car networking and Android device communication means and its device |
| CN108391247A (en) * | 2018-02-02 | 2018-08-10 | 深圳市恒晨电器有限公司 | WIFI control systems and method based on P2P, vehicle-mounted Android system and mobile phone terminal |
| CN109889513A (en) * | 2019-02-02 | 2019-06-14 | 上海市共进通信技术有限公司 | Realize the method that communication control is carried out between fusion device internal gateway and the end OTT |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112309154A (en) * | 2020-09-28 | 2021-02-02 | 惠州市德赛西威智能交通技术研究院有限公司 | Method, equipment and automobile for automatically parking and leaving garage through quick Ble starting |
| CN112929343A (en) * | 2021-01-22 | 2021-06-08 | 中汽创智科技有限公司 | Cross-domain communication method, system, equipment and storage medium for intelligent cockpit |
| CN112947235A (en) * | 2021-03-11 | 2021-06-11 | 深圳市阿丹能量信息技术有限公司 | Cabin domain controller system based on X9 platform and Xen technology and application method |
| CN112947235B (en) * | 2021-03-11 | 2024-05-24 | 深圳市阿丹能量信息技术有限公司 | Application method of cabin domain controller based on Xen technology |
| CN113504870A (en) * | 2021-04-06 | 2021-10-15 | 惠州市德赛西威智能交通技术研究院有限公司 | Hypervisor intelligent cockpit input method sharing system and method |
| CN113316027A (en) * | 2021-05-26 | 2021-08-27 | 东风电子科技股份有限公司 | Double-screen interaction system based on video stream in vehicle-machine interaction |
| CN113891146A (en) * | 2021-09-23 | 2022-01-04 | 中汽创智科技有限公司 | Multi-screen interaction system, method, driving device and storage medium |
| CN113891146B (en) * | 2021-09-23 | 2023-08-22 | 中汽创智科技有限公司 | Multi-screen interaction system, method, driving equipment and storage medium |
| CN114827220A (en) * | 2022-04-15 | 2022-07-29 | 武汉光庭信息技术股份有限公司 | Cabin domain application simulation platform |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN114756321B (en) * | 2022-04-28 | 2024-02-06 | 重庆长安汽车股份有限公司 | System and method for realizing instrument interaction interface and displaying based on vehicle-mounted device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111182078A (en) | Multi-screen interaction method based on intelligent cabin | |
| WO2018082105A1 (en) | Method and device for switching on-vehicle service using external sim card | |
| US8731627B2 (en) | Method of using a smart phone as a telematics device interface | |
| CN105978927B (en) | The method for maintaining the mirror sessions between the vehicles and mobile device | |
| CN210536833U (en) | Screen projection interactive system of intelligent terminal and vehicle-mounted entertainment equipment | |
| JP5944689B2 (en) | In-vehicle device and display control system for in-vehicle device | |
| CN109491625B (en) | Terminal synchronous display method and device of vehicle-mounted system, storage medium and vehicle machine | |
| US20150363348A1 (en) | Automobile adaptor system, apparatus and methodology | |
| CN109429096B (en) | Sound main unit for vehicle, vehicle having the same, and vehicle control method | |
| US8839366B2 (en) | Vehicular communication system, mobile communication terminal, and vehicular apparatus | |
| CN105922872B (en) | Vehicle control system and vehicle | |
| WO2013184296A1 (en) | Holistic identification of an electronic device | |
| US9924011B2 (en) | Manual bluetooth hands free transfer mode | |
| CN112532783A (en) | Vehicle machine, intelligent mobile terminal and corresponding connection control method and system | |
| EP2647520B1 (en) | Method of acquiring vehicle contents, method of displaying vehicle contents, system for displaying vehicle contents, and automotive electronic device | |
| CN107835398A (en) | A kind of customization navigation information display methods based on throwing screen, device | |
| CN213322689U (en) | Vehicle-mounted display system and vehicle | |
| CN103559902A (en) | Method for interaction control over mobile terminal device and car audio and video system | |
| US20160065709A1 (en) | Manual bluetooth hands free transfer mode | |
| CN105946747B (en) | Control method and vehicle mainboard in vehicle | |
| CN114764319A (en) | Intelligent cabin multi-screen interaction system and method and readable storage medium | |
| WO2016032533A1 (en) | Manual bluetooth hands free transfer mode | |
| CN102546723B (en) | The remote demonstration method and system of car-mounted electronic device | |
| CN113543078A (en) | Vehicle machine, mobile terminal and method for controlling interaction between mobile terminal and vehicle machine | |
| US20130304280A1 (en) | Vehicle control and display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |
|
| RJ01 | Rejection of invention patent application after publication |