CN117119615A - Screen throwing method for intelligent mobile terminal to control large screen in vehicle - Google Patents
Screen throwing method for intelligent mobile terminal to control large screen in vehicle Download PDFInfo
- Publication number
- CN117119615A CN117119615A CN202311384764.0A CN202311384764A CN117119615A CN 117119615 A CN117119615 A CN 117119615A CN 202311384764 A CN202311384764 A CN 202311384764A CN 117119615 A CN117119615 A CN 117119615A
- Authority
- CN
- China
- Prior art keywords
- screen
- vehicle
- module
- mobile terminal
- data stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000009471 action Effects 0.000 claims abstract description 12
- 238000004891 communication Methods 0.000 claims description 54
- 230000005236 sound signal Effects 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 230000006870 function Effects 0.000 description 22
- 238000012546 transfer Methods 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000005266 casting Methods 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/724098—Interfacing with an on-board device of a vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/48—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Telephone Function (AREA)
Abstract
The invention relates to a screen throwing method for controlling a large screen in a vehicle by an intelligent mobile terminal. The invention relates to the technical field of vehicle screen throwing, which is characterized in that Bluetooth pairing connection is prepared to be established with a mobile terminal by starting Bluetooth through an equipment body, the equipment body sends point-to-point connection pairing information to an intelligent terminal through Bluetooth, the intelligent mobile terminal sends a screen display data stream to the equipment body through point-to-point wireless connection, and the equipment body converts the screen display data stream into USB data stream and transmits the USB data stream to a vehicle end screen display module through a USB channel; converting the data stream received through the USB port into signals such as video, audio and the like, and displaying and playing the signals through a screen and sound equipment; the vehicle end screen display software monitors a vehicle machine screen and a mic at the same time, and judges whether a user has touch screen action or voice input in real time; the device body converts the USB data stream into touch or voice signals and transmits the touch or voice signals to the intelligent mobile terminal through point-to-point wireless connection; and the intelligent mobile terminal executes corresponding operation according to the received signal.
Description
Technical Field
The invention relates to the technical field of vehicle screen projection, in particular to a screen projection method for controlling a large screen in a vehicle by an intelligent mobile terminal.
Background
At present, a central control large screen is equipped for a passenger car when the passenger car leaves a factory, and some application software is built in the central control large screen. However, at present, the life of consumers and the like is deeply bound with mobile intelligent terminals such as mobile phones and the like, and various demands such as life, entertainment, consumption and the like are all completed through the mobile intelligent terminals. The car machine provides a large screen, but the mobile intelligent terminal and the car machine cannot be synchronized in real time, and as a result, a user installs a mobile phone support on the car and uses the mobile phone to solve specific requirements, and only the car machine is used for playing audio. Meanwhile, because the mobile phone screen is smaller, the user experience is poor, the operation is inconvenient, and potential safety hazards exist in the driving process. Instead, the large screen of the vehicle is idle, so that serious waste is caused.
At present, the main stream intelligent mobile intelligent terminals have built-in screen throwing functions, such as carplay, hicar, but as many large screens of vehicles are not built-in with corresponding hardware, the mobile intelligent terminals cannot be used for realizing screen throwing on the large screens of the vehicles, and the built-in screen throwing functions of the mobile phones of users are also seriously wasted.
Disclosure of Invention
Aiming at the defects or improvement demands of the prior art and the problem that the mobile intelligent terminal cannot be used for realizing screen projection on a large screen of a vehicle because a plurality of large screens of the vehicle are not provided with corresponding built-in hardware chips and running software, the invention provides a screen projection method for controlling the large screen of the intelligent mobile terminal in the vehicle.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The invention provides a screen throwing method for controlling a large screen in a vehicle by an intelligent mobile terminal, which provides the following technical scheme:
a screen projection system for controlling a large screen of an intelligent mobile terminal in a vehicle, the system comprising: the intelligent mobile terminal, the Bluetooth and WiFi module, the equipment body, the mic, the vehicle central control large screen and the user side;
the intelligent mobile terminal comprises a mobile terminal communication module and a built-in screen throwing module, wherein the mobile terminal communication module is connected with the built-in screen throwing module, the equipment body comprises an equipment terminal communication module, an operation module, a storage module and an indicator lamp module, the mobile terminal communication module is connected with the equipment terminal communication module through a Bluetooth module and a WiFi module, the equipment terminal communication module is connected with the operation module, and the operation module is connected with the storage module and the indicator lamp module;
the vehicle center control large screen comprises a vehicle end communication module and a vehicle end screen display module, wherein the vehicle end communication module and the equipment end communication module are interacted through USB data flow, the vehicle end communication module is connected with the vehicle end screen display module, and the vehicle end screen display module outputs audio signals to be connected with a sound; the user side controls the car end screen display module through touch operation, and the user side inputs the mic output audio signals through voice and transmits the mic output audio signals to the car end screen display module.
Preferably, the smart mobile terminal comprises a smart phone, a tablet computer, a notebook computer or a removable device with data processing capability.
The screen projection method of the intelligent mobile terminal for controlling the large screen in the vehicle is based on a screen projection system of the intelligent mobile terminal for controlling the large screen in the vehicle, and comprises the following steps of:
step 1: device body starts bluetooth and prepares to establish bluetooth pairing connection with mobile terminal
Step 2: the equipment body sends point-to-point connection pairing information to the intelligent terminal through Bluetooth
Step 3: pairing-based point-to-point wireless connection between intelligent mobile terminal and equipment body
Step 4: the intelligent mobile terminal sends the screen display data stream to the equipment body through point-to-point wireless connection
Step 5: the equipment body converts the screen display data stream into a USB data stream and transmits the USB data stream to the vehicle-end screen display module through a USB channel;
step 6: the vehicle end screen display module converts the data stream received through the USB port into video and audio signals, and displays and plays the video and audio signals through a screen and sound equipment;
step 7: the vehicle end screen display module monitors a vehicle machine screen and a mic simultaneously and judges whether a user has touch screen action or voice input in real time;
step 8: the vehicle end screen display module converts touch screen actions or audio input into USB data streams and transmits the USB data streams to the equipment body through a USB interface;
step 9: the device body converts the USB data stream into touch or voice signals and transmits the touch or voice signals to the intelligent mobile terminal through point-to-point wireless connection;
step 10: and the intelligent mobile terminal executes corresponding operation according to the received signal.
Preferably, after receiving a screen throwing signal transmitted by the intelligent mobile terminal through WiFi, the equipment body converts the signal into a special USB data stream through a communication protocol and transmits the special USB data stream to the vehicle through a USB communication interface of the vehicle; the USB data stream is identified as storage data on the USB equipment at the vehicle-mounted terminal, the built-in screen projection module obtains the authority of reading and storing the data on the vehicle-mounted terminal, and the built-in screen projection module reads the USB data stream.
Preferably, after the built-in screen projection module reads the USB data stream, the USB data stream is converted into video and audio signals displayed and played by the vehicle end screen display module through a communication protocol, video information is displayed on a central control large screen, and audio information is played through vehicle sound equipment.
Preferably, when the user side performs touch control on the central control large screen and performs operation on the vehicle large screen through a vehicle mic input voice means, the vehicle end screen display module acquires corresponding information in real time and converts the information into USB data flow through a communication protocol.
Preferably, the special screen throwing software of the vehicle end is installed in the large central control screen of the vehicle, so that the screen throwing software is ensured to be started automatically when being started and is operated all the time and cannot be closed by the system periodically; meanwhile, the software needs to obtain the following rights: front end display, video rights, audio rights, touch rights, mic rights, and storage rights.
Preferably, after the Bluetooth connection is established between the equipment body and the intelligent mobile terminal, a section of WiFi handshake signal is sent to the equipment body, after the built-in screen-throwing module of the intelligent mobile terminal receives the signal and processes the signal, a WiFi communication handshake signal is automatically generated, and then WiFi communication connection is established between the equipment body and the equipment body through the WiFi handshake signal.
A computer readable storage medium having stored thereon a computer program for execution by a processor for implementing a method for controlling a large screen of an intelligent mobile terminal in a vehicle.
The computer equipment comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes a screen projection method of controlling a large screen of an intelligent mobile terminal in a vehicle when executing the computer program.
The invention has the following beneficial effects:
the invention can solve the problem that the intelligent terminal cannot be moved to realize screen throwing on the large vehicle screen because a plurality of large vehicle screens are not provided with corresponding built-in hardware chips and running software.
Aiming at the original vehicle without the screen-throwing function of carplay, hicar and the like, the invention realizes the screen-throwing function of carplay, hicar and the like through the external screen-throwing equipment, and has the advantages of low cost, high speed, high definition, wide and flexible application and the like.
According to the invention, the screen-throwing functions of carplay, hicar and the like are realized through the external screen-throwing equipment, so that the advantages of high speed, high definition, wide application, flexibility and the like can be obtained at lower cost, and more functions and convenience are added for the vehicle-mounted entertainment system.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of the structure of the present invention;
fig. 2 is a flow chart of the method of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made apparent and fully in view of the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
In addition, the technical features of the different embodiments of the present invention described below may be combined with each other as long as they do not collide with each other.
The present invention will be described in detail with reference to specific examples.
First embodiment:
according to the specific optimization technical scheme adopted by the invention for solving the technical problems, as shown in the figures 1 to 2, the technical scheme is as follows: the invention relates to a screen projection method for controlling a large screen in a vehicle by an intelligent mobile terminal.
The purpose of the invention is realized in the following way:
the invention provides a screen projection system of an intelligent mobile terminal for controlling a large screen in a vehicle, which comprises the following components: the intelligent mobile terminal, the Bluetooth and WiFi module, the equipment body, the mic, the vehicle central control large screen and the user side;
the intelligent mobile terminal comprises a mobile terminal communication module and a built-in screen throwing module, wherein the mobile terminal communication module is connected with the built-in screen throwing module, the equipment body comprises an equipment terminal communication module, an operation module, a storage module and an indicator lamp module, the mobile terminal communication module is connected with the equipment terminal communication module through a Bluetooth module and a WiFi module, the equipment terminal communication module is connected with the operation module, and the operation module is connected with the storage module and the indicator lamp module;
the vehicle center control large screen comprises a vehicle end communication module and a vehicle end screen display module, wherein the vehicle end communication module and the equipment end communication module are interacted through USB data flow, the vehicle end communication module is connected with the vehicle end screen display module, and the vehicle end screen display module outputs audio signals to be connected with a sound; the user side controls the car end screen display module through touch operation, and the user side inputs the mic output audio signals through voice and transmits the mic output audio signals to the car end screen display module.
The intelligent mobile terminal comprises a smart phone, a tablet computer, a notebook computer or mobile equipment with data processing capability.
The invention provides a screen projection method of an intelligent mobile terminal for controlling a large screen in a vehicle, which is based on a screen projection system of the intelligent mobile terminal for controlling the large screen in the vehicle, and comprises the following steps:
step 1: device body starts bluetooth and prepares to establish bluetooth pairing connection with mobile terminal
Step 2: the equipment body sends point-to-point connection pairing information to the intelligent terminal through Bluetooth
Step 3: pairing-based point-to-point wireless connection between intelligent mobile terminal and equipment body
Step 4: the intelligent mobile terminal sends the screen display data stream to the equipment body through point-to-point wireless connection
Step 5: the equipment body converts the screen display data stream into a USB data stream and transmits the USB data stream to the vehicle-end screen display module through a USB channel;
step 6: the vehicle end screen display module converts the data stream received through the USB port into video and audio signals, and displays and plays the video and audio signals through a screen and sound equipment;
step 7: the vehicle end screen display module monitors a vehicle machine screen and a mic simultaneously and judges whether a user has touch screen action or voice input in real time;
step 8: the vehicle end screen display module converts touch screen actions or audio input into USB data streams and transmits the USB data streams to the equipment body through a USB interface;
step 9: the device body converts the USB data stream into touch or voice signals and transmits the touch or voice signals to the intelligent mobile terminal through point-to-point wireless connection;
step 10: and the intelligent mobile terminal executes corresponding operation according to the received signal.
After receiving a screen throwing signal transmitted by the intelligent mobile terminal through WiFi, the equipment body converts the signal into a special USB data stream through a communication protocol, and transmits the special USB data stream to the vehicle through a USB communication interface of the vehicle; the USB data stream is identified as storage data on the USB equipment at the vehicle-mounted terminal, the built-in screen projection module obtains the authority of reading and storing the data on the vehicle-mounted terminal, and the built-in screen projection module reads the USB data stream.
After the built-in screen throwing module reads the USB data stream, the USB data stream is converted into video and audio signals displayed and played by the vehicle end screen display module through a communication protocol, video information is displayed on a central control large screen, and audio information is played through vehicle sound equipment.
When the user side performs touch control on the central control large screen and performs operation on the vehicle large screen through a vehicle mic input voice means, the vehicle end screen display module acquires corresponding information in real time and converts the information into USB data flow through a communication protocol.
Installing special screen throwing software at a vehicle end in a large central control screen of a vehicle, and ensuring that the screen throwing software is started automatically when the vehicle is started and always runs and cannot be closed by a system periodically; meanwhile, the software needs to obtain the following rights: front end display, video rights, audio rights, touch rights, mic rights, and storage rights.
After the Bluetooth connection is established between the equipment body and the intelligent mobile terminal, a section of WiFi handshake signal is sent to the equipment body, after the built-in screen-throwing module of the intelligent mobile terminal receives the signal and processes the signal, a WiFi communication handshake signal is automatically generated, and then WiFi communication connection is established between the equipment body and the equipment body through the WiFi handshake signal.
The invention provides a computer readable storage medium, on which a computer program is stored, the program being executed by a processor for implementing a screen projection method for controlling a large screen in a vehicle by an intelligent mobile terminal.
The invention provides computer equipment, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes a screen projection method of controlling a large screen of an intelligent mobile terminal in a vehicle when executing the computer program.
Specific embodiment II:
the embodiment of the invention provides a method for interconnecting a mobile intelligent terminal with a vehicle-mounted large screen through a device body, which is applied to a vehicle Unit (HU). Referring to fig. 2, a flowchart of a method for mobile intelligent terminal to screen-casting through interconnection of a device body and a vehicle is shown, which is applied to a vehicle-mounted large screen according to an embodiment of the present invention. The method comprises steps S101-S110.
In step S101, the device body establishes a bluetooth pairing connection with the mobile intelligent terminal.
In step S102, the device body sends point-to-point connection pairing information to the mobile intelligent terminal through bluetooth. As an example, the mobile smart terminal may be a mobile device with data processing capabilities, such as a smart phone, tablet, notebook, etc.
In step S103, the intelligent mobile intelligent terminal responds to the connection response information sent by the device body, and establishes a pairing-based point-to-point wireless connection with the device body.
In step S104, the intelligent mobile intelligent terminal sends the on-screen data stream to the device body through the point-to-point wireless connection.
In step S105, the device body receives, through the point-to-point wireless connection, the screen-casting data sent by the mobile intelligent terminal, and encapsulates the data processing result executed by the mobile intelligent terminal and the screen-casting video and audio information of the mobile intelligent terminal, where the data processing result is obtained by the mobile intelligent terminal according to the data processing request and related data and calling the background server through the mobile communication network. The device body converts the screen projection data into a USB data stream through a specific algorithm.
In step S106, the vehicle-end screen display software converts the data stream received through the USB port into signals such as video and audio through a specific algorithm, and displays and plays the signals on the screen of the vehicle through a screen and sound.
In step 107, the vehicle end screen display software monitors the vehicle-mounted screen and the mic simultaneously, and determines whether the user has touch screen action or voice input in real time.
In step 108, the vehicle end screen software converts the collected touch screen actions or audio input application specific algorithms into a USB data stream and transmits the USB data stream to the device body through the USB interface.
In step 109, the device body converts the USB data stream into a touch or voice signal and transmits the touch or voice signal to the smart mobile terminal through the point-to-point wireless connection.
In step 110, the intelligent mobile intelligent terminal performs a corresponding operation according to the received signal.
According to the method, the corresponding APP can be installed on the vehicle, the interconnection is established with the mobile intelligent terminal in a communication transfer mode through the equipment body installed on the USB port, the functions on the mobile intelligent terminal are projected to the screen of the vehicle for use, meanwhile, the application of multiple functions related to the real-time control of the mobile intelligent terminal can be realized through the touch control and voice operation of the vehicle, and the background server is required to participate in order to provide services.
As a specific example, multiple electronic maps APP can be integrated on the mobile intelligent terminal to provide real-time location and navigation services for the user.
As a specific example, a plurality of media resources can be integrated on the mobile intelligent terminal, including a music APP installed on a user mobile phone, a music resource local to the user mobile phone, a radio resource on a background server, and the like, so as to provide rich media resource playing services for the user.
The point-to-point wireless connection is a communication mode of Wi-Fi, which is different from the traditional AP connection, can realize quick connection, and the mobile intelligent terminal can communicate with the device body through the point-to-point wireless connection and simultaneously communicate with the outside through a mobile communication network (such as a general 4G network and a general 5G network), so that the use of the network flow of the mobile intelligent terminal is not affected. In the point-to-point wireless connection mode, the equipment body and the mobile intelligent terminal negotiate a secret key to carry out encrypted communication, and password setting and inputting are not needed. Through the utilization and development of the point-to-point, a user can quickly establish wireless connection, the influence of the traditional AP connection is avoided, and the mobile communication network of the mobile phone can be used for normally accessing the online function when the equipment body has no network. Through the optimization of the connection technology and the architecture of the vehicle terminal and the mobile intelligent terminal, the noninductive quick connection is realized.
The mobile intelligent terminal can display video content on a screen of the car machine and play audio content on a car sound by utilizing video and audio streams transmitted by the steering car machine in the equipment body.
The method for realizing the screen projection with the vehicle-mounted device interconnection through the device body transfer by using the mobile intelligent terminal provided by the embodiment of the invention can realize the screen projection function of various scenes. For example, by performing touch control and audio operation on the car machine, control of some functions of the mobile intelligent terminal is realized, and voice, navigation and other online services are involved.
As a specific example of a voice application scenario, the vehicle side may receive voice input by a user through a microphone, and transmit the voice data and the voice recognition request to the mobile intelligent terminal through a point-to-point wireless connection. The mobile intelligent terminal processes the voice data correspondingly, for example, extracts the characteristics of the audio stream, uploads the audio stream to the server, and the server performs voice recognition. Or the mobile intelligent terminal identifies the voice and communicates with the corresponding server according to the voice identification result. And then, the communication result and the screen throwing information of the mobile intelligent terminal are packaged in a data stream together, and are transmitted to the vehicle terminal through the equipment body in a transfer way, and are displayed on a screen of the vehicle terminal.
As a specific example of the navigation application scenario, a user may input a destination on a screen of a vehicle-mounted device, the vehicle-mounted device transmits a navigation request and destination data to the mobile intelligent terminal through a point-to-point wireless connection, the mobile intelligent terminal may invoke a server related to the navigation function to realize the navigation function, package a video stream in navigation and a video stream recorded by the mobile intelligent terminal into a data stream, and transmit the video stream to the vehicle-mounted device through the point-to-point wireless connection and the device body, thereby displaying a real-time video of navigation and screen throwing information of the mobile intelligent terminal on the screen of the vehicle-mounted device.
The input of the user at the vehicle machine end can comprise touch screen input, when the user touches the display, the vehicle machine can transfer coordinate values of the touched positions through the point-to-point wireless connection by the equipment body and then send the coordinate values to the mobile intelligent terminal, and the mobile intelligent terminal carries out corresponding data processing according to the coordinate value data.
As one embodiment of the present invention, the server with which the mobile intelligent terminal communicates may include one or more servers. For example, a service backend (Service Background) server and a Basic backend (Basic) server may be included.
As an example, the Service backend server may be connected to the mobile intelligent terminal APP through the internet, and is used to provide services such as Account (Account), life Service (Life Service), order Management (Order Management), and user Data (Data) Management to the user. Account provides Account service, which is used for user identification and authentication, and performs targeted personalized service recommendation for users. Life Service provides Life Service resource support, and according to different background configurations, rich Life services such as hotels, air tickets, takeouts, oiling and the like can be realized. The life service is deeply combined with the voice on the mobile phone, and the service background mainly provides corresponding resource data to process the user inquiry and the order request. Data stores usage Data and preference Data of each user, and provides customized services for each user in combination with an account number. In addition, the server is provided with a server gateway for forwarding and distributing service requests.
As an example, the underlying background server mainly provides the underlying capabilities of the voice system, the navigation system. Because the computing power and the storage space of the mobile terminal are difficult to support complete voice and navigation services, the services can be independently deployed on a background of a base, and high-performance operation and real-time updating are realized. Different from a service background, the basic service which needs to be responded quickly and the rich function is required to be realized is deployed independently, so that the interaction delay is lower and the realized function is richer. For the SDS (Speech Dialogue System, voice dialogue system) service which needs to be stable and accurate, the function of the online service can be called, and the SDS service module connected to the basic background can call the online SDS identification. The navigation service provides real-time map information and traffic information for the mobile intelligent terminal and provides quick and accurate online calculation service.
The embodiment deploys the special voice recognition server, can integrate various voice capabilities therein, realizes accurate and quick online voice recognition, is favorable for deep fusion of functions and voices, realizes comprehensive control of voices on all functions, promotes a software system based on voice control mode, and gets rid of the limitation based on touch in the prior art.
As an implementation mode of the invention, besides dividing two different background servers, a data channel can be established between the two servers, so that network delay is reduced, and functional response speed is improved. For example, a living service is accessed, and the mobile intelligent terminal is prevented from repeatedly communicating with the server through communication between the servers from the mobile terminal App- > basic background- > service background- > mobile intelligent terminal.
In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "examples," "particular embodiments," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "N" means at least two, for example, two, three, etc., unless specifically defined otherwise. Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more N executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention. Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or N wires, a portable computer cartridge (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. As with the other embodiments, if implemented in hardware, may be implemented with any one or combination of the following techniques, as known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, where the program, when executed, includes one or a combination of the steps of the method embodiments. In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented as software functional modules and sold or used as a stand-alone product.
The above is only a preferred implementation manner of the method for controlling the large screen of the intelligent mobile terminal in the vehicle, and the protection scope of the method for controlling the large screen of the intelligent mobile terminal in the vehicle is not limited to the above embodiments, and all technical solutions under the concept belong to the protection scope of the invention. It should be noted that modifications and variations can be made by those skilled in the art without departing from the principles of the present invention, which is also considered to be within the scope of the present invention.
Claims (10)
1. A screen throwing system of an intelligent mobile terminal for controlling a large screen in a vehicle is characterized in that: the system comprises: the intelligent mobile terminal, the Bluetooth and WiFi module, the equipment body, the mic, the vehicle central control large screen and the user side;
the intelligent mobile terminal comprises a mobile terminal communication module and a built-in screen throwing module, wherein the mobile terminal communication module is connected with the built-in screen throwing module, the equipment body comprises an equipment terminal communication module, an operation module, a storage module and an indicator lamp module, the mobile terminal communication module is connected with the equipment terminal communication module through a Bluetooth module and a WiFi module, the equipment terminal communication module is connected with the operation module, and the operation module is connected with the storage module and the indicator lamp module;
the vehicle center control large screen comprises a vehicle end communication module and a vehicle end screen display module, wherein the vehicle end communication module and the equipment end communication module are interacted through USB data flow, the vehicle end communication module is connected with the vehicle end screen display module, and the vehicle end screen display module outputs audio signals to be connected with a sound; the user side controls the car end screen display module through touch operation, and the user side inputs the mic output audio signals through voice and transmits the mic output audio signals to the car end screen display module.
2. The system according to claim 1, characterized in that:
the intelligent mobile terminal comprises a smart phone, a tablet computer, a notebook computer or mobile equipment with data processing capability.
3. A screen projection method of an intelligent mobile terminal for controlling a large screen in a vehicle, the method being based on the screen projection system as claimed in claim 1, characterized in that: the method comprises the following steps:
step 1: the equipment body starts Bluetooth to prepare to establish Bluetooth pairing connection with the mobile terminal;
step 2: the equipment body sends point-to-point connection pairing information to the intelligent terminal through Bluetooth;
step 3: the intelligent mobile terminal establishes a point-to-point wireless connection based on pairing with the equipment body;
step 4: the intelligent mobile terminal sends a screen display data stream to the equipment body through point-to-point wireless connection;
step 5: the equipment body converts the screen display data stream into a USB data stream and transmits the USB data stream to the vehicle-end screen display module through a USB channel;
step 6: the vehicle end screen display module converts the data stream received through the USB port into video and audio signals, and displays and plays the video and audio signals through a screen and sound equipment;
step 7: the vehicle end screen display module monitors a vehicle machine screen and a mic simultaneously and judges whether a user has touch screen action or voice input in real time;
step 8: the vehicle end screen display module converts touch screen actions or audio input into USB data streams and transmits the USB data streams to the equipment body through a USB interface;
step 9: the device body converts the USB data stream into touch or voice signals and transmits the touch or voice signals to the intelligent mobile terminal through point-to-point wireless connection;
step 10: and the intelligent mobile terminal executes corresponding operation according to the received signal.
4. A method according to claim 3, characterized in that:
after receiving a screen throwing signal transmitted by the intelligent mobile terminal through WiFi, the equipment body converts the signal into a special USB data stream through a communication protocol, and transmits the special USB data stream to the vehicle through a USB communication interface of the vehicle; the USB data stream is identified as storage data on the USB equipment at the vehicle-mounted terminal, the built-in screen projection module obtains the authority of reading and storing the data on the vehicle-mounted terminal, and the built-in screen projection module reads the USB data stream.
5. The method according to claim 4, characterized in that:
after the built-in screen throwing module reads the USB data stream, the USB data stream is converted into video and audio signals displayed and played by the vehicle end screen display module through a communication protocol, video information is displayed on a central control large screen, and audio information is played through vehicle sound equipment.
6. The method according to claim 5, characterized in that:
when the user side performs touch control on the central control large screen and performs operation on the vehicle large screen through a vehicle mic input voice means, the vehicle end screen display module acquires corresponding information in real time and converts the information into USB data flow through a communication protocol.
7. The method according to claim 6, characterized in that:
installing special screen throwing software at a vehicle end in a large central control screen of a vehicle, and ensuring that the screen throwing software is started automatically when the vehicle is started and always runs and cannot be closed by a system periodically; meanwhile, the software needs to obtain the following rights: front end display, video rights, audio rights, touch rights, mic rights, and storage rights.
8. The method according to claim 7, characterized in that:
after the Bluetooth connection is established between the equipment body and the intelligent mobile terminal, a section of WiFi handshake signal is sent to the equipment body, after the built-in screen-throwing module of the intelligent mobile terminal receives the signal and processes the signal, a WiFi communication handshake signal is automatically generated, and then WiFi communication connection is established between the equipment body and the equipment body through the WiFi handshake signal.
9. A computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by a processor for implementing the method according to any of claims 3-8.
10. A computer device comprising a memory and a processor, the memory storing a computer program, characterized by: the processor, when executing the computer program, implements the method of any of claims 3-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311384764.0A CN117119615A (en) | 2023-10-25 | 2023-10-25 | Screen throwing method for intelligent mobile terminal to control large screen in vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311384764.0A CN117119615A (en) | 2023-10-25 | 2023-10-25 | Screen throwing method for intelligent mobile terminal to control large screen in vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117119615A true CN117119615A (en) | 2023-11-24 |
Family
ID=88795218
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311384764.0A Pending CN117119615A (en) | 2023-10-25 | 2023-10-25 | Screen throwing method for intelligent mobile terminal to control large screen in vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117119615A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107168666A (en) * | 2017-04-21 | 2017-09-15 | 陈景雄 | The system and method for USB interface-based audio video transmission and multi-screen mapping |
| CN111131866A (en) * | 2019-11-25 | 2020-05-08 | 华为技术有限公司 | Screen-projecting audio and video playing method and electronic equipment |
| WO2022166618A1 (en) * | 2021-02-08 | 2022-08-11 | 华为技术有限公司 | Screen projection method and electronic device |
| CN114928897A (en) * | 2021-02-02 | 2022-08-19 | 博泰车联网(南京)有限公司 | Connection method, device, system and computer storage medium |
| CN115525366A (en) * | 2021-06-25 | 2022-12-27 | 华为技术有限公司 | Screen projection method and related device |
| CN115842829A (en) * | 2021-09-07 | 2023-03-24 | 一汽-大众汽车有限公司 | Method and device for screen projection of mobile terminal and vehicle machine in interconnection mode and storage medium |
| CN116112884A (en) * | 2023-01-09 | 2023-05-12 | 芜湖雄狮汽车科技有限公司 | Screen throwing method and device for automobile |
| CN116419018A (en) * | 2023-03-24 | 2023-07-11 | 重庆长安汽车股份有限公司 | Vehicle-mounted multi-screen simultaneous display method based on USB wired screen projection |
-
2023
- 2023-10-25 CN CN202311384764.0A patent/CN117119615A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107168666A (en) * | 2017-04-21 | 2017-09-15 | 陈景雄 | The system and method for USB interface-based audio video transmission and multi-screen mapping |
| CN111131866A (en) * | 2019-11-25 | 2020-05-08 | 华为技术有限公司 | Screen-projecting audio and video playing method and electronic equipment |
| CN114928897A (en) * | 2021-02-02 | 2022-08-19 | 博泰车联网(南京)有限公司 | Connection method, device, system and computer storage medium |
| WO2022166618A1 (en) * | 2021-02-08 | 2022-08-11 | 华为技术有限公司 | Screen projection method and electronic device |
| CN115525366A (en) * | 2021-06-25 | 2022-12-27 | 华为技术有限公司 | Screen projection method and related device |
| CN115842829A (en) * | 2021-09-07 | 2023-03-24 | 一汽-大众汽车有限公司 | Method and device for screen projection of mobile terminal and vehicle machine in interconnection mode and storage medium |
| CN116112884A (en) * | 2023-01-09 | 2023-05-12 | 芜湖雄狮汽车科技有限公司 | Screen throwing method and device for automobile |
| CN116419018A (en) * | 2023-03-24 | 2023-07-11 | 重庆长安汽车股份有限公司 | Vehicle-mounted multi-screen simultaneous display method based on USB wired screen projection |
Non-Patent Citations (3)
| Title |
|---|
| 刘英杰: "《车联网中数据传输安全的关键技术研究》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 钱润生: "《车载多功能前屏系统的研究与实现》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 韩屏: "《基于USB的车载信息系统》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8346310B2 (en) | Method and apparatus for communication between a vehicle based computing system and a remote application | |
| WO2018082105A1 (en) | Method and device for switching on-vehicle service using external sim card | |
| US8331987B2 (en) | Personal area network systems and devices and methods for use thereof | |
| US8364139B2 (en) | Personal area network systems and devices and methods for use thereof | |
| EP3043526B1 (en) | Auxiliary device and method to enhance native in-vehicle systems by adding interfaces and computational power | |
| CN104253636B (en) | Mobile electronic device coordination system, information providing apparatus, mobile electronic device, and control method for mobile electronic device | |
| US20100048133A1 (en) | Audio data flow input/output method and system | |
| CN110278461B (en) | Information recommendation interface display method and device, vehicle-mounted terminal and storage medium | |
| CN103685573A (en) | Interaction system used between automobile and intelligent terminal | |
| WO2018120492A1 (en) | Page processing method, mobile terminal, device and computer storage medium | |
| CN110113728B (en) | Audio data transmission method, vehicle-mounted platform, vehicle-mounted machine and readable storage medium | |
| WO2022262380A1 (en) | Screen projection method, screen projection apparatus, electronic device, head unit, and screen projection system | |
| CN102148888A (en) | Mobile phone integration into driver information systems | |
| CN103124963A (en) | Method and system for operating mobile applications in a vehicle | |
| CN105790802A (en) | Sound sources management method in dual-terminal interconnection mode | |
| CN103546422B (en) | Vehicular screen multiplexing system, application method thereof and multimedia interaction system | |
| JP2013021632A (en) | Vehicle communication system, mobile communication terminal and vehicle apparatus | |
| WO2019062538A1 (en) | In-vehicle intelligent wifi microphone and audio delay processing method therefor | |
| TW201309510A (en) | Telematics system and related mobile device and method | |
| CN102932516A (en) | Apparatus for communication between a vehicle based computing system and a remote application | |
| CN111199743A (en) | Audio coding format determining method and device, storage medium and electronic equipment | |
| CN204222776U (en) | Based on the Intelligent flat display terminal vehicle mounted multimedia matching system of cloud server | |
| CN103559902A (en) | Method for interaction control over mobile terminal device and car audio and video system | |
| CN113225716A (en) | Vehicle-mounted karaoke realization method, system, equipment and storage medium | |
| EP2733913A2 (en) | Method and apparatus for communication between a vehicle based computing system and a remote application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20231124 |