WO2021051989A1 - 一种视频通话的方法及电子设备 - Google Patents

一种视频通话的方法及电子设备 Download PDF

Info

Publication number
WO2021051989A1
WO2021051989A1 PCT/CN2020/102803 CN2020102803W WO2021051989A1 WO 2021051989 A1 WO2021051989 A1 WO 2021051989A1 CN 2020102803 W CN2020102803 W CN 2020102803W WO 2021051989 A1 WO2021051989 A1 WO 2021051989A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
terminal
user
mobile terminal
mounted terminal
Prior art date
Application number
PCT/CN2020/102803
Other languages
English (en)
French (fr)
Inventor
陶强
高光远
韩静
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021051989A1 publication Critical patent/WO2021051989A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/48Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/40Connection management for selective distribution or broadcast

Definitions

  • This application relates to the field of communication technology, and in particular to a method and electronic equipment for video calls.
  • the video call method and electronic equipment provided in the present application can realize free switching of video calls between mobile terminals and vehicle-mounted terminals, meet different needs of users in multiple scenarios, and can not only ensure user driving safety, but also improve users Experience.
  • a video call method is provided, which is applied to a mobile terminal and a vehicle-mounted terminal.
  • the vehicle-mounted terminal includes one or more display screens and one or more cameras.
  • the method includes: establishing a communication connection between the mobile terminal and the vehicle-mounted terminal;
  • the mobile terminal receives the first information sent by the vehicle-mounted terminal.
  • the first information is an instruction for the first user to initiate a video call with the second user on the vehicle-mounted terminal; in response to the first information, the mobile terminal establishes a video call connection with the second user’s terminal , Receiving the video data of the second user; the mobile terminal sends the video data of the second user to the vehicle-mounted terminal, and sends the video data of the first user collected by the camera of the vehicle-mounted terminal to the second user's terminal.
  • the mobile terminal can use the screen of the vehicle-mounted terminal for display by default, and use the camera of the vehicle-mounted terminal to collect video information. That is to say, when the video call application of the mobile terminal calls the display driver for display, it can call the virtual driver corresponding to the display of the vehicle terminal, so that the interface drawn by the mobile terminal can be transmitted to the vehicle terminal for display. In the same way, when the video call application of the mobile terminal calls the camera driver to collect video information, it can call the virtual driver corresponding to the camera of the vehicle terminal so that the vehicle terminal can send the video information collected by the camera of the vehicle terminal to the mobile terminal.
  • the video call running on the mobile terminal can call the screen of the vehicle terminal to display the second user's screen, or call the camera of the vehicle terminal to collect the second user's screen, releasing
  • the user's hands are convenient for the user to control the car and improve driving safety.
  • the vehicle terminal side since the entire video call runs on the mobile terminal side, the vehicle terminal side only needs to provide corresponding hardware capabilities, such as providing a display screen for display, providing a camera to capture images, providing a microphone to capture audio and play audio, and so on. Therefore, the method provided in the embodiments of the present application does not have high requirements on the capabilities of the vehicle-mounted terminal system.
  • a vehicle-mounted terminal may not have the ability to connect to a mobile communication network or the Internet.
  • the in-vehicle terminal may not be required to be able to run video call applications and the like.
  • the embodiments of the present application are applicable to most vehicle-mounted terminals.
  • the method further includes: after the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives the information sent by the vehicle-mounted terminal The video data of the first user collected by the camera of the vehicle-mounted terminal.
  • the method further includes: after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives the video data of the second user sent by the terminal of the second user; and the mobile terminal sends the video data of the second user to the vehicle-mounted terminal.
  • the video data of the second user is specifically: the mobile terminal draws the first interface according to the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; wherein, The first interface includes the video data of the first user and the video data of the second user collected by the camera of the vehicle-mounted terminal.
  • the method before the mobile terminal receives the first information sent by the vehicle-mounted terminal, the method further includes: the mobile terminal receives second information sent by the vehicle-mounted terminal, the second information includes the parameters of the display screen of the vehicle-mounted terminal, and Parameters of the camera of the vehicle terminal; the mobile terminal registers the display screen of the vehicle terminal and the camera of the vehicle terminal according to the second information.
  • the registration process can be understood as the mobile terminal creating a virtual drive for each hardware of the vehicle-mounted terminal. Later, when the application of the mobile terminal needs to call the hardware of the vehicle-mounted terminal, it can transmit data to the hardware of the vehicle-mounted terminal through the corresponding virtual driver. Thus, a method for the mobile terminal to call the hardware of the vehicle-mounted terminal is provided.
  • the vehicle-mounted terminal transmits the second information to the mobile terminal via Bluetooth low energy BLE.
  • the vehicle-mounted terminal after the vehicle-mounted terminal is turned on or the wireless connection function is turned on, it can send a BLE broadcast message through Bluetooth low energy so that the mobile terminal can scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal.
  • the BLE broadcast message can carry vehicle terminal identification and vehicle terminal capability information.
  • the vehicle-mounted terminal identifier may be, for example, a car model, used to identify the vehicle-mounted terminal.
  • the vehicle terminal capability information may include the hardware capability information of the vehicle terminal, such as camera information, display screen information, audio information, GPS information, sensor information, and so on.
  • the method further includes: after the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after a video call connection is established between the mobile terminal and the terminal of the second user, the mobile terminal determines whether it is registered The camera of the vehicle-mounted terminal; if it is determined that the camera of the vehicle-mounted terminal is registered, the mobile terminal sends an instruction to turn on the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.
  • the method further includes: the mobile terminal receives third information sent by the vehicle-mounted terminal, where the third information is an operation of the first user instructing to switch to the camera and display screen of the mobile terminal; or, the mobile terminal detects The mobile terminal is disconnected from the vehicle-mounted terminal; the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.
  • the method further includes: the mobile terminal receives fourth information sent by the vehicle-mounted terminal, where the fourth information indicates that the first user instructs to switch the current camera to another camera of the vehicle-mounted terminal; the mobile terminal instructs the vehicle-mounted terminal to turn off The current camera, and another camera of the vehicle-mounted terminal is turned on; the mobile terminal receives the video data of the first user collected by another camera of the vehicle-mounted terminal; the mobile terminal sends the video data of the second user to the vehicle-mounted terminal, and the other camera of the vehicle-mounted terminal The collected video data of the first user.
  • the method further includes: the mobile terminal receives fifth information sent by the vehicle-mounted terminal, where the fifth information is that the first user instructs to switch the current camera to the camera of the mobile terminal; the mobile terminal instructs the vehicle-mounted terminal to turn off the current camera , And turn on the camera of the mobile terminal; the video data of the first user collected by the camera of the mobile terminal; the mobile terminal sends the video data of the second user to the vehicle-mounted terminal, and the video data of the first user collected by the camera of the mobile terminal.
  • the user can switch from the camera of the vehicle terminal to the camera of the mobile terminal to meet different needs in different scenarios.
  • the method further includes: when the mobile terminal and the vehicle-mounted terminal disconnect the communication connection, the mobile terminal logs off the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal.
  • the mobile terminal When the mobile terminal is disconnected from the vehicle-mounted terminal, the mobile terminal will log off the registered hardware of the vehicle-mounted terminal, for example, delete the virtual driver corresponding to the hardware of the vehicle-mounted terminal, or set the virtual driver corresponding to the hardware of the vehicle-mounted terminal as unavailable .
  • a video call method is provided, which is applied to a mobile terminal and a vehicle-mounted terminal.
  • the vehicle-mounted terminal includes one or more display screens and one or more cameras.
  • the method includes: establishing a communication connection between the mobile terminal and the vehicle-mounted terminal;
  • the mobile terminal receives the video call request sent by the second user’s terminal;
  • the mobile terminal receives the second user’s video data sent by the server, and receives the first user’s video data collected by the on-board terminal’s camera;
  • the mobile terminal sends the second user’s video data to the on-board terminal
  • the video data of the user sends the video data of the first user collected by the camera of the vehicle-mounted terminal to the terminal of the second user.
  • the mobile terminal sends the video data of the second user to the vehicle-mounted terminal, specifically: the mobile terminal draws the first user based on the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal. And send the first interface to the vehicle-mounted terminal; where the first interface includes the video data of the first user and the video data of the second user collected by the camera of the vehicle-mounted terminal.
  • the method further includes: if the mobile terminal registers the camera of the vehicle-mounted terminal, sending an instruction to turn on the camera of the vehicle-mounted terminal to the vehicle-mounted terminal .
  • the method further includes: the mobile terminal receives first information sent by the vehicle-mounted terminal, and the first information includes information on the display screen of the vehicle-mounted terminal , And the information of the camera of the vehicle-mounted terminal; the mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the first information.
  • the vehicle-mounted terminal transmits the first information to the mobile terminal via Bluetooth low energy BLE.
  • the method further includes: the mobile terminal receives second information sent by the vehicle-mounted terminal, where the second information is an operation of the first user instructing to switch to the camera and display screen of the mobile terminal; or, the mobile terminal detects The mobile terminal is disconnected from the vehicle-mounted terminal; the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.
  • the method further includes: the mobile terminal receives three pieces of information, The third information is the operation of the first user instructing to switch to the camera and display screen of the on-board terminal, or the mobile terminal detects that the mobile terminal is connected to the on-board terminal; if the mobile terminal determines that the camera of the on-board terminal is registered, it will send a message to the on-board terminal to open The instruction of the camera of the vehicle-mounted terminal; the mobile terminal sends to the vehicle-mounted terminal the video data of the second user received from the server and the video data of the first user collected by the camera of the vehicle-mounted terminal.
  • a video call method is provided, which is applied to a mobile terminal and a vehicle-mounted terminal.
  • the vehicle-mounted terminal includes one or more display screens and one or more cameras.
  • the method includes: the vehicle-mounted terminal establishes a communication connection with the mobile terminal; The vehicle-mounted terminal receives the first operation of the first user, and the first operation is used to instruct to establish a video call with the terminal of the second user; the camera of the vehicle-mounted terminal collects the video data of the first user and sends the video data of the first user to the mobile The terminal and the vehicle-mounted terminal receive the video data of the second user sent by the mobile terminal, and display the video of the first user.
  • an electronic device including: a processor, a memory, and a touch screen, the memory, the touch screen are coupled to the processor, and the memory is used to store computer program code, the computer program code including a computer Instruction, when the processor reads the computer instruction from the memory, so that the electronic device executes the method described in the above aspect and any one of its possible implementation manners.
  • a device in a fifth aspect, is provided, the device is included in an electronic device, and the device has the function of realizing the behavior of the vehicle-mounted terminal in any of the foregoing aspects and possible implementation manners.
  • This function can be realized by hardware, or by hardware executing corresponding software.
  • the hardware or software includes at least one module or unit corresponding to the above-mentioned functions. For example, a receiving module or unit, a display module or unit, an acquisition module or unit, and a sending module or unit, etc.
  • a computer storage medium including computer instructions, which, when the computer instructions are executed on a mobile terminal, cause the mobile terminal to execute the method described in the above aspect and any one of its possible implementation manners.
  • a computer program product which when the computer program product runs on a computer, causes the computer to execute the method described in the foregoing aspects and any one of the possible implementation manners.
  • a chip system including a processor, and when the processor executes an instruction, the processor executes the method described in the foregoing aspects and any one of the possible implementation manners.
  • FIG. 1 is a schematic structural diagram of a communication system provided by an embodiment of this application.
  • FIG. 2A is a first structural diagram of a mobile terminal provided by an embodiment of this application.
  • 2B is a second structural diagram of a mobile terminal provided by an embodiment of this application.
  • FIG. 3A is a first structural diagram of a vehicle-mounted terminal provided by an embodiment of this application.
  • FIG. 3B is a second structural diagram of a vehicle-mounted terminal provided by an embodiment of this application.
  • FIG. 4 is a schematic flowchart of a video call method provided by an embodiment of this application.
  • FIG. 5 is a schematic diagram of user interfaces of some mobile terminals provided by embodiments of this application.
  • FIG. 6A is a schematic diagram of a user interface of some vehicle-mounted terminals provided by an embodiment of the application.
  • FIG. 6B is a schematic diagram of user interfaces of still other vehicle-mounted terminals provided by an embodiment of the application.
  • FIG. 7 is a schematic diagram of a method for transmitting data between a vehicle-mounted terminal and a mobile phone according to an embodiment of the application
  • FIG. 8 is a schematic flowchart of another video call method provided by an embodiment of this application.
  • FIG. 9 is a schematic flowchart of another video call method provided by an embodiment of this application.
  • FIG. 10 is a schematic flowchart of another video call method provided by an embodiment of this application.
  • FIG. 11 is a schematic structural diagram of a chip system provided by an embodiment of the application.
  • FIG. 12 is a schematic structural diagram of another chip system provided by an embodiment of the application.
  • A/B means or, for example, A/B can mean A or B; "and/or” in this document is only an association describing the associated object Relationship means that there can be three kinds of relationships.
  • a and/or B can mean that: A alone exists, A and B exist at the same time, and B exists alone.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
  • words such as “exemplary” or “for example” are used as examples, illustrations, or illustrations. Any embodiment or design solution described as “exemplary” or “for example” in the embodiments of the present application should not be construed as being more preferable or advantageous than other embodiments or design solutions. To be precise, words such as “exemplary” or “for example” are used to present related concepts in a specific manner.
  • video call applications can also be installed on some vehicle-mounted terminals. Therefore, when the user is in the car, the video call application on the in-vehicle terminal can be used.
  • users only use the video call application on the vehicle terminal or only use the video call application on the mobile phone to make a video call with a poor user experience.
  • the user is using a mobile phone to make a video call.
  • the user needs to hang up the video call on the mobile phone and re-use the video call application on the vehicle terminal to make the video call.
  • the user is using the vehicle-mounted terminal to make a video call, and when the user leaves the car, the user needs to hang up the video call on the vehicle-mounted terminal and re-use the video call application on the mobile phone to make the call.
  • the embodiments of the present application provide a video call method, which enables the video call application running on the mobile phone to call the hardware on the vehicle-mounted terminal connected to it, for example, call the display screen of the vehicle-mounted terminal to display the interface of the video call.
  • the camera of the vehicle terminal can be called to collect the user's picture.
  • the mobile phone can still call the screen of the mobile phone to display the video call interface, and use the camera of the mobile phone to capture the user's picture.
  • the method provided by the embodiments of the present application can realize that the video application on the mobile phone can freely call the camera of the mobile phone or the vehicle-mounted terminal to collect images, and freely call the display interface of the mobile phone or the vehicle-mounted terminal.
  • the ongoing video call can be freely switched between the mobile phone and the vehicle terminal, which can meet the different needs of users in different scenarios, and improve the user experience.
  • FIG. 1 it is a schematic structural diagram of a communication system provided by an embodiment of this application, and the video call method provided by the embodiment of this application can be applied to the communication system.
  • the communication system includes a mobile terminal 100 and a vehicle-mounted terminal 200.
  • the mobile terminal 100 and the vehicle-mounted terminal 200 may establish a communication connection in a wired or wireless manner.
  • a wired connection can be established with the mobile terminal 100 through a line through the USB interface on the vehicle-mounted terminal 200.
  • a wireless connection can be established via Bluetooth or WLAN.
  • the vehicle-mounted terminal 200 can be operated to control the application (for example: video call application) installed on the mobile terminal 100 to improve driving.
  • the application for example: video call application
  • the mobile terminal 100 may send the interface of the application program to the vehicle-mounted terminal 200, and the vehicle-mounted terminal 200 may display it.
  • the size, resolution and other parameters of the screen on the vehicle-mounted terminal 200 are different from those of the mobile terminal 100, and the mobile terminal 100 will draw a special interface for the vehicle-mounted terminal 200.
  • the mobile terminal 100 draws a specific interface for the vehicle-mounted terminal 200 according to the operating status of the application, and sends the drawn specific interface to the vehicle-mounted terminal 200 for display through the above-mentioned communication connection.
  • the user can also control the application program through the in-vehicle terminal 200.
  • the user can manipulate the application by touching controls on the touch screen of the vehicle terminal 200, pressing physical keys on the vehicle terminal (including the steering wheel), and inputting voice commands through the microphone of the vehicle terminal.
  • the vehicle-mounted terminal 200 can be understood as an external device of the mobile terminal 100.
  • the mobile terminal 100 can call the screen of the vehicle-mounted terminal 200 to display the interface of the application running on the mobile terminal 100; the mobile terminal 100 can also call the images collected by the camera on the vehicle-mounted terminal 200 (including the external camera on the vehicle-mounted terminal 200); The terminal 100 can also call the microphone on the vehicle-mounted terminal 200 to collect voices and play voices.
  • the mobile terminal 100 may also call sensors and the like connected to the vehicle-mounted terminal 200.
  • the specific implementation of the mobile terminal 100 calling the hardware and peripherals on the vehicle-mounted terminal 200 will be introduced below, and will not be described here.
  • the application program installed on the mobile terminal 100 may also correspond to one or more application servers 400. That is, the application program of the mobile terminal 100 communicates with the one or more application servers 400.
  • the application server may be a server of a video call application, and may provide a video call function for the mobile terminal 100.
  • the mobile terminal 100 may establish a connection with the application server 400 through one or more networks 300.
  • the network 300 may be a local area network (local area networks, LAN) or a wide area network (wide area networks, WAN), such as the Internet.
  • the network 300 can be implemented using any known network communication protocol.
  • the above-mentioned network communication protocol can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), Firewire (FIREWIRE), any Cellular network communication protocol (such as 3G/4G/5G/future communication technology), Bluetooth, wireless fidelity (Wi-Fi), NFC or any other suitable communication protocol.
  • the communication system may further include an electronic device 500.
  • the electronic device 500 may also establish a communication connection with the application server 400 through one or more networks 300.
  • the video call application may be, for example, an instant messaging application with a video call function (such as a WeChat application), facetime (a kind of video call software), and other applications with a video pass function.
  • a video call function such as a WeChat application
  • facetime a kind of video call software
  • other applications with a video pass function for example, the user A can make a video call with the user B (using the electronic device 500) through the video call application on the mobile terminal 100. That is, the mobile terminal 100 sends the video of the user A to the electronic device 500 via the application server 400 for the user B to watch.
  • the electronic device 500 can also send the video of the user B to the mobile terminal 100 via the application server 400 for the user A to watch.
  • the video call running on the mobile terminal 100 can call the screen of the vehicle-mounted terminal 200 to display the screen of user B, or call the camera of the vehicle-mounted terminal 200 to capture the screen of user A, freeing the user’s hands. It is convenient for users to control the car.
  • the video call running on the mobile terminal 100 can switch to use the display screen of the mobile terminal 100 to display the screen of the user B, and call the camera of the mobile terminal 100 to capture the screen of the user A. In other words, the user does not need to hang up the phone to switch the video call from the vehicle-mounted terminal to the mobile terminal.
  • the video call running on the mobile terminal 100 can switch to use the screen of the vehicle-mounted terminal 200 to display the screen of user B, or call the camera of the vehicle-mounted terminal 200 to collect the screen of user A.
  • the user does not need to hang up the phone to switch the video call from the mobile terminal to the vehicle-mounted terminal.
  • the aforementioned mobile terminal 100 may be, for example, a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (personal digital assistant, PDA), a smart watch, a netbook, a wearable electronic device, and augmented reality technology.
  • augmented reality (AR) equipment, virtual reality (VR) equipment, in-vehicle equipment, smart cars, smart speakers, robots, etc. this application does not impose special restrictions on the specific form of the mobile terminal 100.
  • the electronic device 500 and the mobile terminal 100 may be the same or different. For the structure of the electronic device 500, reference may be made to the mobile terminal 100, which will not be repeated.
  • FIG. 2A shows a schematic diagram of the hardware structure of the mobile terminal 100.
  • the mobile terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM Subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the mobile terminal 100.
  • the mobile terminal 100 may include more or less components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that the processor 110 has just used or used cyclically. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface can include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
  • the USB interface 130 can be used to connect a charger to charge the mobile terminal 100, and can also be used to transfer data between the mobile terminal 100 and peripheral devices. It can also be used to connect earphones and play audio through earphones. This interface can also be used to connect to other electronic devices, such as AR devices.
  • the mobile terminal 100 may be connected to the vehicle-mounted terminal 200 through the USB interface 130, so as to implement data communication between the mobile terminal 100 and the vehicle-mounted terminal 200.
  • the mobile terminal 100 may also be connected to the vehicle-mounted terminal 200 through other interfaces, or the mobile terminal 100 may be connected to the vehicle-mounted terminal 200 through a wireless connection.
  • the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely a schematic description, and does not constitute a structural limitation of the mobile terminal 100.
  • the mobile terminal 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive the wireless charging input through the wireless charging coil of the mobile terminal 100. While the charging management module 140 charges the battery 142, it can also supply power to the mobile terminal through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be provided in the processor 110.
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the mobile terminal 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the mobile terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the mobile terminal 100.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic wave radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the mobile terminal 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the mobile terminal 100 may establish a wireless connection with the vehicle-mounted terminal 200 through the wireless communication module 160 and the antenna 2 to implement data communication between the mobile terminal 100 and the vehicle-mounted terminal 200.
  • the antenna 1 of the mobile terminal 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the mobile terminal 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the mobile terminal 100 may establish a connection with the application server 400 through the mobile communication module 150 and the antenna 1, so as to implement data communication between the mobile terminal 100 and the application server 400.
  • the mobile terminal 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, connected to the display 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the mobile terminal 100 may include one or N display screens 194, and N is a positive integer greater than one.
  • the mobile terminal 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the mobile terminal 100 may include 1 or N cameras 193, and N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the mobile terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the mobile terminal 100 may support one or more video codecs. In this way, the mobile terminal 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • applications such as intelligent cognition of the mobile terminal 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the mobile terminal 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the mobile terminal 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the mobile terminal 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the mobile terminal 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.
  • the speaker 170A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the mobile terminal 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the mobile terminal 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 170C through the human mouth, and input the sound signal into the microphone 170C.
  • the mobile terminal 100 may be provided with at least one microphone 170C.
  • the mobile terminal 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals.
  • the mobile terminal 100 may also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the earphone interface 170D is used to connect wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the mobile terminal 100 may receive key input, and generate key signal input related to user settings and function control of the mobile terminal 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • touch operations that act on different applications can correspond to different vibration feedback effects.
  • Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminding, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the mobile terminal 100.
  • the mobile terminal 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards can be the same or different.
  • the SIM card interface 195 can also be compatible with different types of SIM cards.
  • the SIM card interface 195 may also be compatible with external memory cards.
  • the mobile terminal 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the mobile terminal 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the mobile terminal 100 and cannot be separated from the mobile terminal 100.
  • the software system of the mobile terminal 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture.
  • the embodiment of the present invention takes an Android system with a layered architecture as an example to illustrate the software structure of the mobile terminal 100 by way of example.
  • FIG. 2B is a block diagram of the software structure of the mobile terminal 100 according to an embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
  • the application layer can include a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
  • the application package also includes a video call application with a video call function, such as: WeChat application, QQ application, facetime, etc.
  • the video call application may be an application preset on the mobile terminal 100, or may be an application downloaded by a user through an application market or other methods. The embodiment of the present application does not limit the video call application.
  • the application package may also include the first application.
  • HiCar application a kind of software that connects mobile phones and in-vehicle terminals.
  • the first application may draw a related interface for connecting the mobile terminal 100 and the vehicle-mounted terminal 200, and convert the application interface drawn by an application program installed on the mobile terminal 100 into an interface displayed by the vehicle-mounted terminal 200, and so on.
  • the display desktop of the vehicle-mounted terminal 200 is drawn according to the application programs installed on the mobile terminal 100, and the display desktop includes cards corresponding to all or part of the application programs installed on the mobile terminal 100.
  • the first application converts the application program interface drawn by the video call application (such as a video request interface, a video call interface, etc.) into an interface displayed by the vehicle terminal 200.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the content provider is used to store and retrieve data and make these data accessible to applications.
  • the data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, and so on.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide the communication function of the mobile terminal 100.
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can disappear automatically after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, and so on.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, a prompt sound is emitted, the mobile terminal vibrates, and the indicator light flashes.
  • the application framework layer may also include a first module for communicating with other devices (for example, the vehicle-mounted terminal 200).
  • the first module can be specifically used to discover the vehicle terminal 200 and connect it to the vehicle terminal 200; perform data transmission with the vehicle terminal 200 (such as sending the vehicle terminal side graphical interface to the vehicle terminal 200, receiving the image data collected by the vehicle terminal 200 camera, and receiving the user’s Input on the vehicle-mounted terminal 200), and encoding and decoding of data during data transmission.
  • Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • the system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the kernel layer also includes a second module for managing external devices of the mobile terminal 100.
  • the second module may be specifically used to manage the hardware on the vehicle-mounted terminal 200 connected to the mobile terminal 100, such as the screen, camera, microphone, sensor and other devices of the vehicle-mounted terminal 200.
  • FIG. 3A shows a schematic diagram of the hardware structure of the vehicle-mounted terminal 200.
  • the vehicle-mounted terminal 200 may include a processor 210, a memory 220, a wireless communication module 230, a speaker 240, a microphone 250, a display screen 260, a camera 270, a USB interface 280, a sensor module 290, and so on.
  • the sensor module 290 may include a pressure sensor 290A, a magnetic sensor 290B, an acceleration sensor 290C, a temperature sensor 290D, a touch sensor 290E, an ambient light sensor 290F, a positioning system 290G, and so on.
  • the processor 210 may include one or more processing units.
  • the processor 210 may include an electronic control unit (ECU) and a telematics box (Telematics BOX).
  • ECU electronice control unit
  • Telematics BOX Telematics box
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in the processor 210 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 210. If the processor 210 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 210 is reduced, and the efficiency of the system is improved.
  • the memory 220 may be used to store computer executable program code, where the executable program code includes instructions.
  • the internal memory 220 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the storage data area can store data (such as audio data, video data, etc.) created during the use of the vehicle-mounted terminal 200.
  • the memory 220 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • the processor 210 executes various functional applications and data processing of the in-vehicle terminal 200 by running instructions stored in the memory 220 and/or instructions stored in a memory provided in the processor.
  • the wireless communication module 230 may provide a wireless communication solution including WLAN, such as Wi-Fi network, Bluetooth, NFC, IR, etc., which is applied to the vehicle-mounted terminal 200.
  • the wireless communication module 230 may be one or more devices integrating at least one communication processing module.
  • the vehicle-mounted terminal 200 may establish a wireless communication connection with the mobile terminal 100 through the wireless communication module 230.
  • the vehicle-mounted terminal 200 may also establish a wired communication connection with the mobile terminal 100 through the USB interface 280, which is not limited in the embodiment of the present application.
  • the functions of the components such as the speaker 240, the microphone 250, the display screen 260, and the camera 270 can be referred to the related description in the mobile terminal 100, which will not be repeated here.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the in-vehicle terminal 200.
  • the in-vehicle terminal 200 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • FIG. 3B shows a schematic diagram of the software structure of the vehicle-mounted terminal 200.
  • the software structure of the vehicle-mounted terminal 200 may include an application module, a control module, a human-machine interface module, a telematics module, an electronic control unit, and an operating system.
  • the application module is used for audio-visual entertainment in the car, and vehicle information display.
  • the control module can control the operation of the vehicle and its components, such as steering, throttle, braking, etc.
  • the man-machine interface also called the man-machine interface, is a medium for interaction and information exchange between the vehicle-mounted terminal 200 and the user. It realizes the conversion between the internal form of information and the form acceptable to humans.
  • the telematics module is mainly used to communicate with the background operating system/mobile phone APP to realize the vehicle information display and control of the mobile phone APP.
  • the electronic control unit is also called "travel computer", “vehicle computer”, etc., and it is a special-purpose microcomputer controller for automobiles.
  • the vehicle-mounted terminal 200 further includes a third module for communicating with other electronic devices (for example, the mobile terminal 100).
  • the third module may be an independent functional module, or may be a part of an existing module (for example, a telematics module), which is not limited in the embodiment of the present application.
  • the mobile terminal 100 is taken as an example of a mobile phone, and the technical solutions provided by the embodiments of the present application will be described in detail in combination with specific application scenarios.
  • Scenario 1 The mobile phone establishes a communication connection with the vehicle-mounted terminal.
  • User A initiates a video call with user B through the vehicle-mounted terminal.
  • the mobile phone uses the vehicle-mounted terminal's camera to collect images and uses the vehicle-mounted terminal's display interface.
  • FIG. 4 it is a schematic diagram of a flow of a video call provided by an embodiment of this application, and the flow specifically includes:
  • the vehicle-mounted terminal sends a BLE broadcast message, and the BLE broadcast message carries the vehicle-mounted terminal identifier and the vehicle-mounted terminal capability information.
  • the vehicle-mounted terminal after the vehicle-mounted terminal is turned on or the wireless connection function is turned on, it can send a BLE broadcast message through Bluetooth low energy so that the mobile phone can scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal.
  • the BLE broadcast message can carry vehicle terminal identification and vehicle terminal capability information.
  • the vehicle-mounted terminal identifier may be, for example, a car model, used to identify the vehicle-mounted terminal.
  • the vehicle terminal capability information may include the hardware capability information of the vehicle terminal, such as camera information, display screen information, audio information, GPS information, sensor information, and so on.
  • the BLE broadcast message may adopt a format pre-appointed with the mobile phone.
  • the pre-appointed format may be: information header+model:+model name+capacitytype+capacity type+capacityvalue+capacity parameter.
  • the capability type may refer to the hardware capabilities of the vehicle terminal's camera, audio, display, GPS and other hardware.
  • the vehicle-mounted terminal may have multiple hardware under the same capability type, for example, multiple cameras, including cameras inside the car and cameras outside the car. Then, multiple pieces of hardware under the capability type can be numbered separately to show distinction.
  • the in-vehicle terminal may also be connected to some hardware through the interface. Then, when the vehicle-mounted terminal broadcasts a message, it can also carry the capability information of the external hardware. For example, the vehicle-mounted terminal can connect an external camera through the USB interface. Then, the BLE broadcast message sent by the vehicle-mounted terminal in this step also carries the information of the camera connected to the vehicle-mounted terminal.
  • the capability parameters are specific parameters corresponding to each capability type.
  • Table 1 shows some examples of the parameters corresponding to each capability type.
  • the vehicle-mounted terminal may also carry the vehicle-mounted terminal capability information after establishing a communication connection with the mobile phone to inform the mobile phone of the capability of the vehicle-mounted terminal. That is, the BLE broadcast message sent by the vehicle terminal may carry the vehicle terminal identifier, but does not carry the vehicle terminal capability information.
  • the BLE broadcast message is usually encrypted, and the mobile phone can decrypt the BLE broadcast message when it receives the BLE broadcast message.
  • the third module in the vehicle terminal can be used to collect information about the hardware capabilities of the vehicle terminal. For example, after the vehicle-mounted terminal is turned on or after the wireless function is turned on, the third module may require each hardware of the vehicle-mounted terminal to report its own capability information. Or, each hardware of the vehicle-mounted terminal actively reports its own capability information to the third module. Then, the vehicle-mounted terminal carries the capability information acquired by the third module in the BLE broadcast message for broadcast. For another example, after the vehicle-mounted terminal establishes a communication connection with the mobile phone, the vehicle-mounted terminal collects the hardware capability information of the vehicle-mounted terminal and reports it to the mobile phone, so that the mobile phone can register the hardware capabilities of the vehicle-mounted terminal. The registration-related content will be explained in detail below.
  • the mobile phone performs a Bluetooth scan and displays a list of discovered devices.
  • the vehicle-mounted terminal identification in the BLE broadcast message is displayed in the list of discovered devices.
  • the mobile phone starts the first application.
  • the first application can display a prompt interface to prompt the user to manually turn on the Bluetooth and WIFI functions.
  • the mobile phone automatically turns on the Bluetooth and WIFI functions.
  • the phone starts to scan for Bluetooth. After scanning and sending the BLE broadcast message, the mobile phone parses the BLE broadcast message, obtains the vehicle terminal identification and the capability information of the vehicle terminal, and stores the vehicle terminal identification and the capability information of the vehicle terminal. Then, the mobile phone displays a list of discovered Bluetooth devices to prompt the user to choose which Bluetooth device to connect to. The list of Bluetooth devices displays the identification of the vehicle-mounted terminal carried in the BLE broadcast message.
  • the interface 501 as shown in (1) in FIG. 5 is an example of the list of discovered Bluetooth devices displayed by the mobile phone.
  • a list 502 of Bluetooth devices is displayed on the interface 501. It can be seen that the mobile phone scans two Bluetooth devices at this time, namely "SAIC-GM Buick Encore" and "SAIC-GM ATS-L".
  • the mobile phone can also register the hardware capabilities of the vehicle terminal according to the vehicle terminal capability information in the BLE broadcast message.
  • the registration process can be understood as the mobile phone creates a virtual drive for each hardware of the vehicle terminal. Later, when the mobile phone application needs to call the hardware of the vehicle terminal, it can transmit data to the hardware of the vehicle terminal through the corresponding virtual driver.
  • the first module of the mobile phone application framework layer finds the BLE broadcast message of the vehicle terminal, it can request the second module of the kernel layer to register the various hardware of the vehicle terminal, namely Create virtual drivers for the various hardware of the vehicle terminal.
  • the virtual camera driver corresponding to the camera of the vehicle terminal For example: the virtual camera driver corresponding to the camera of the vehicle terminal, the virtual audio driver corresponding to the microphone of the vehicle terminal, the virtual display driver corresponding to the display of the vehicle terminal, the sensor driver corresponding to the sensor of the vehicle terminal, etc.
  • the mobile phone when the mobile phone is disconnected from the vehicle terminal, the mobile phone will cancel the registered hardware of the vehicle terminal, for example, delete the virtual driver corresponding to the hardware of the vehicle terminal, or set the virtual driver corresponding to the hardware of the vehicle terminal Is not available.
  • the mobile phone can also register the hardware capabilities of the car terminal after the mobile phone establishes a connection with the car terminal, that is, after step S403. It can be seen that the mobile phone only needs to complete the registration before calling the hardware of the vehicle-mounted terminal, and the embodiment of the application does not specifically limit the registration timing.
  • S403 The mobile phone receives an instruction from the user to connect to the vehicle terminal (S403a), and the mobile phone establishes a WIFI connection with the vehicle terminal (S403b).
  • the mobile phone in response to the user selecting the operation of connecting "SAIC-GM Buick Envision" on the interface 501 as shown in Figure 5 (1), the mobile phone sends a connection to the on-board terminal corresponding to "SAIC-GM Buick Envision" command.
  • the mobile phone can use the generic attribute profile (GATT) of BLE to send commands.
  • the content of the command can be a command header (cmd command) + mobile phone identification (for example, the name of the mobile phone and/or the International Mobile Equipment Identity (IMEI)); the cmd command is to open the WIFI connection of the vehicle terminal.
  • the vehicle-mounted terminal authenticates the mobile phone. After the authentication is successful, the WIFI function is turned on, and a WIFI connection request is initiated to the mobile phone.
  • the mobile phone receives the WIFI connection request, the mobile phone establishes a WIFI connection with the vehicle terminal. Later, the mobile phone and the vehicle-mounted terminal can communicate data through the WIFI connection.
  • an interface 503 as shown in (2) in FIG. 5 is displayed. It can be seen that the mobile phone has established a connection with the on-board terminal corresponding to "SAIC-GM Buick Encore".
  • the interface 503 may also have a setting control 504 corresponding to "SAIC-GM Buick Encore".
  • the user can perform related settings through the setting control 504. For example, in response to the user clicking the setting control 504, the mobile phone displays a setting interface 505 as shown in (3) in FIG. 5.
  • the setting interface 505 contains multiple application icons, controls 506, controls 507, controls 508, and controls 509 displayed on the vehicle-mounted terminal.
  • the control 506 can be used to download a new HiCar application.
  • the HiCar application here refers to the application displayed on the in-vehicle terminal.
  • the applications displayed on the vehicle-mounted terminal are applications that have been installed on the mobile phone. This is because these applications are actually running on mobile phones, and the hardware that these applications need to use can be hardware that uses a vehicle-mounted terminal. For example, use the display interface of the vehicle-mounted terminal, use the camera of the vehicle-mounted terminal to collect images, and so on.
  • the vehicle-mounted terminal can also be used to receive user operation instructions, for example, by touching the controls of the display (usually a touch screen) of the vehicle-mounted terminal, or collecting the user’s voice commands through the microphone of the vehicle-mounted terminal, or through the vehicle-mounted terminal (including the steering wheel). (Above) the pressing action of the physical button, etc.
  • the control 507 can be used to turn on the function of the mobile phone wirelessly automatically connecting to the vehicle terminal.
  • the control 508 can be used to modify the vehicle name of the car.
  • the control 509 can be used to release the binding relationship between the mobile phone and the vehicle-mounted terminal.
  • the first module of the mobile phone when the first module of the mobile phone discovers the BLE broadcast message of the vehicle-mounted terminal, it will determine whether the mobile phone is connected to the vehicle-mounted terminal for the first time. If it is the first time to connect to the vehicle terminal, or although it is not the first time to connect to the vehicle terminal, but the user has not turned on the wireless automatic connection function of the machine and the vehicle terminal, it will wait for the user's connection instruction.
  • the mobile phone can report to the first application, and the first application draws prompt information to prompt the user whether to connect. If the user's connection instruction is received, the vehicle terminal is connected. Otherwise, the vehicle terminal is not connected. If it is not the first time that the vehicle terminal is connected, and the user turns on the wireless automatic connection function of the mobile phone and the vehicle terminal, the vehicle terminal is automatically connected.
  • the first module reports the successful connection message to the first application.
  • the mobile phone discovers the vehicle-mounted terminal through Bluetooth low energy consumption and establishes a WIFI connection with the vehicle-mounted terminal.
  • the mobile phone can also directly establish a connection with the vehicle terminal via a USB interface data cable, or the mobile phone can directly establish a connection with the vehicle terminal via WIFI, or the mobile phone and the vehicle terminal can be connected via classic Bluetooth.
  • the embodiment of the present application does not specifically limit the connection mode of the mobile phone and the vehicle-mounted terminal.
  • S404 The mobile phone draws the interface of the video call application of the vehicle terminal, and sends it to the vehicle terminal for display by the vehicle terminal.
  • the first application of the mobile phone can determine that the vehicle-mounted terminal has a display screen according to the capability information of the vehicle-mounted terminal.
  • the information on the display screen of the terminal draws the desktop of the vehicle-mounted terminal and sends it to the vehicle-mounted terminal for display by the vehicle-mounted terminal.
  • the interface 601 as shown in (1) in FIG. 6A is an example of a desktop of a vehicle-mounted terminal.
  • the interface 601 displays a shortcut menu bar 602, a status bar 603, and multiple application cards (for example, a video call card 604).
  • the shortcut menu bar 602 can be used to quickly enter the corresponding interface or application.
  • the status bar 603 displays time, power, signal, and voice input boxes, etc. Users can enter each application through the application card on the desktop.
  • the vehicle-mounted terminal sends the received user's operation of the application to the mobile phone, and the corresponding application on the mobile phone responds, draws the next interface of the vehicle-mounted terminal, and sends it to the vehicle-mounted terminal for display.
  • the user operates a video application on a mobile phone on a vehicle-mounted terminal as an example for description.
  • the vehicle-mounted terminal In response to the user clicking on the video call card 604 on the interface 601 shown in (1) of FIG. 6A, the vehicle-mounted terminal sends the user operation to the mobile phone.
  • the mobile phone starts the video call application, draws the next interface of the vehicle terminal, that is, the interface of the video call application, and sends it to the vehicle terminal.
  • the interface 605 as shown in (2) in FIG. 6A is an example of an interface of a video call application displayed by a vehicle-mounted terminal.
  • the vehicle-mounted terminal receives the user's operation of initiating a video call on the interface of the video call application (S405a), and sends the video call operation to the mobile phone (S405b).
  • the mobile phone sends a video call request to the server (S406a), and draws the video call interface of the vehicle-mounted terminal and sends it to the vehicle-mounted terminal for display (S406b).
  • the server may be an application server that provides a video call service for a mobile phone.
  • the user selects Andy on the interface 605 as shown in (2) of FIG. 6A, that is, initiates a video call instruction to Andy, and the vehicle-mounted terminal sends the instruction to the mobile phone.
  • the mobile phone draws the video call interface of the vehicle terminal; on the other hand, the video call application of the mobile phone sends a video call request to the server.
  • the video call request carries the identity of Andy.
  • the server sends a video call request to the terminal used by Andy according to Andy's identification. If Andy receives this video call request, the server returns a video call establishment event to the mobile phone, and then performs step S407. If Andy rejects this video call request, the server returns a video call failure event to the mobile phone.
  • the corresponding interface drawn by the mobile phone is displayed by the vehicle-mounted terminal to inform the user.
  • the interface 606 shown in (3) in FIG. 6B is an example of a video call interface displayed by the vehicle-mounted terminal.
  • the interface 606 displays a prompt box 607 and a preview box 608.
  • the prompt box 607 prompts "Calling Andy".
  • the preview frame 608 is used to display the picture collected by the vehicle-mounted terminal camera.
  • the interface 606 also displays a hang-up control 609 for hanging up the video call.
  • the mobile phone can use the screen of the car terminal to display by default, and use the camera of the car terminal to collect video information. That is to say, when the video call application of the mobile phone calls the display driver for display, it can call the virtual driver corresponding to the display of the vehicle terminal, so that the interface drawn by the mobile phone can be transmitted to the vehicle terminal for display. In the same way, when the mobile phone video call application calls the camera driver to collect video information, it can call the virtual driver corresponding to the vehicle terminal camera so that the vehicle terminal can send the video information collected by the vehicle terminal camera to the mobile phone.
  • the video call application after the video call application receives an instruction from the user to initiate a video call, it can also query from the second module whether the mobile phone is registered with the camera of the vehicle terminal. If it is determined that the vehicle-mounted terminal is registered to have a camera, the video call application sends an instruction to turn on the camera to the vehicle-mounted terminal through the second module and the first module. After receiving the instruction to turn on the camera, the vehicle-mounted terminal turns on the camera to capture images and returns to the video call application. In an example, after receiving an instruction from the vehicle-mounted terminal to initiate a video call, the mobile phone may instruct the vehicle-mounted terminal to send and turn on the camera to start capturing images.
  • the mobile phone can also instruct the vehicle-mounted terminal to turn on the camera after receiving the message that the video call connection is successful sent by the server, and start to capture images. If it is determined that the vehicle-mounted terminal does not have a camera, the video call application needs to call the camera of the mobile phone to capture images.
  • the mobile phone receives the video call establishment message sent by the server (S407a), draws the video call interface of the vehicle-mounted terminal, and sends it to the vehicle-mounted terminal for display by the vehicle-mounted terminal (S407b).
  • the video call interface of the vehicle-mounted terminal displays a video screen collected by the camera of the vehicle-mounted terminal.
  • the interface 610 shown in (4) in FIG. 6B is the interface of the video call displayed on the vehicle-mounted terminal after the video call is connected.
  • the video call service of the mobile phone is a module that provides services for the video call application in the framework layer and the system library of the mobile phone.
  • the device driver includes the driver of the mobile phone related hardware that the video call application needs to call.
  • the first module includes: a device discovery module, which is used to perform related functions of the mobile phone discovering the vehicle terminal.
  • the equipment management module is used to register with the second module according to the received hardware capability information of the vehicle terminal reported by the vehicle terminal.
  • the remote service module is used to send data to the vehicle-mounted terminal, receive data from the vehicle-mounted terminal, and perform encryption and decryption processing on the data.
  • the codec is used to decode the received data and encode the sent data.
  • the process of the vehicle-mounted terminal transmitting application data to the mobile phone is: the third module of the vehicle-mounted terminal encodes and encrypts the data that needs to be transmitted (the user's operation on the vehicle-mounted terminal, the picture collected by the vehicle-mounted terminal camera, the audio collected by the microphone, etc.), and The encoded and encrypted data is transmitted to the first module in the mobile phone through the connection link with the mobile phone.
  • the first module in the mobile phone decrypts and decodes the received data, and determines that the data is the data of the video call application. It is transmitted to the video call application through the second module, device driver and video call service, and processed by the video call application.
  • the process of the mobile phone transmitting application data to the vehicle terminal is: the video call application sends the data (the drawn application interface on the vehicle terminal side, the data received from the server, etc.) to the video call service, device driver, second module, and first module.
  • the first application converts the application interface on the mobile phone side into the application interface on the vehicle terminal side, and the first module performs encryption and decryption, etc., and sends the communication link between the mobile phone and the vehicle terminal to the vehicle terminal.
  • the third module of the vehicle-mounted terminal decrypts and decodes the received data for display.
  • the transmitted application data is the operation of the user to initiate a video call on the vehicle-mounted terminal. Then, after the vehicle-mounted terminal transmits the application data to the first module of the mobile phone, the first module of the mobile phone determines that the application data is an operation to start a video call, and then transmits the application data to the second module, the device driver, and the video call service.
  • Video call application sends a video call request to the server on the one hand, and draws the video call interface on the mobile phone on the other hand. The mobile phone sends the drawn video call interface on the mobile phone side to the first application via the video call service, device driver, second module, and first module.
  • the first application converts the video call interface on the mobile phone side into a video call interface on the car terminal side suitable for display on the car terminal, and sends it to the car terminal via the first module and the communication link between the mobile phone and the car terminal.
  • the display screen of the car terminal To display.
  • the above-mentioned video call interface on the mobile phone side refers to a video call interface usually drawn by a video call application, and this interface is generally displayed on the display screen of the mobile phone.
  • the video call application needs to have a display interface on the vehicle terminal. Therefore, in order to distinguish the interface displayed by the vehicle-mounted terminal, the interface displayed on the mobile phone is referred to as the display interface on the mobile phone side (for example, the video call interface on the mobile phone side, etc.).
  • the display interface on the mobile phone side for example, the video call interface on the mobile phone side, etc.
  • the video call application of the mobile phone can also use the screen projection method in the Bluetooth protocol to transmit interface data when using the display interface of the car terminal side display. , That is, the mobile phone can directly call the display screen of the vehicle terminal through the Bluetooth driver.
  • the audio transmission method in the Bluetooth protocol can also be used to transmit audio data, that is, the mobile phone can directly call the audio device of the vehicle terminal through the Bluetooth driver.
  • the mobile phone can call the camera of the vehicle-mounted terminal to collect images.
  • FIG 8 it is a schematic diagram of the connection process and the video call service process of the mobile phone and the vehicle-mounted terminal.
  • the schematic diagram shows the interaction between the various modules in the mobile phone and the vehicle-mounted terminal. The specific interaction process has been described in detail in the foregoing embodiment, and will not be repeated here.
  • the video call running on the mobile phone can call the screen of the vehicle terminal to display the screen of user B (the called party), or call the camera of the vehicle terminal to collect user A (the main The screen of the calling party frees the user's hands, which is convenient for the user to control the car and improve driving safety.
  • the vehicle terminal side since the entire video call runs on the mobile phone side, the vehicle terminal side only needs to provide corresponding hardware capabilities, such as providing a display screen for display, providing a camera to capture images, providing a microphone to capture audio and play audio, and so on. Therefore, the method provided in the embodiments of the present application does not have high requirements on the capabilities of the vehicle-mounted terminal system.
  • a vehicle-mounted terminal may not have the ability to connect to a mobile communication network or the Internet.
  • the in-vehicle terminal may not be required to be able to run video call applications and the like.
  • the embodiments of the present application are applicable to most vehicle-mounted terminals.
  • the first application, the first module, and the second module cooperate with the existing video call application to complete the call to the hardware of the vehicle-mounted terminal for the video call. That is, the method provided in the embodiment of the present application does not need to modify the code of the video call application, that is, it is possible to call the hardware of the vehicle-mounted terminal to perform the video call. In this way, the embodiments of the present application can be compatible with the video call application on the mobile phone.
  • the video call application running on the mobile phone can call the hardware (camera, display screen, etc.) of the vehicle terminal, the user can realize the video call on the vehicle terminal (watch video, and use the vehicle terminal camera to collect their own Screen).
  • the video call application running on the mobile phone can still call the hardware of the mobile phone, that is, the user can still implement video calls on the mobile phone.
  • the user can freely switch the video call on the mobile phone or on the vehicle terminal to meet different needs in different scenarios. The following respectively show the cases where the methods provided in the embodiments of the present application are applied in other scenarios.
  • Scenario 2 User A uses a vehicle-mounted terminal to make a video call with user B in the car. At this time, user A needs to leave the car, and then switches the video call to the mobile phone.
  • a switch control may be displayed on the interface displayed by the vehicle terminal, and the switch control may be used to indicate that the video call application on the mobile phone will call the display and camera of the vehicle terminal (which may also include a microphone and an external camera, etc.). Mode, switch to call the phone’s display and camera, etc.
  • the user can also switch through voice commands or physical buttons on the steering wheel. That is, the user can manually switch the video call from the vehicle-mounted terminal to the mobile phone.
  • the connection between the mobile phone and the car terminal is disconnected, and the mobile phone automatically calls the display screen and camera of the mobile phone to make a video call. That is, the mobile phone automatically switches the video call from the vehicle-mounted terminal to the mobile phone.
  • the user can set the mobile phone to switch manually or automatically.
  • Scenario 3 User A uses a mobile phone to make a video call with user B. At this time, the user enters the car and can switch the video call to the vehicle-mounted terminal.
  • the interface displayed by the mobile phone can display a switching control, and the user can manually switch the video call to the vehicle-mounted terminal. Or, after the mobile phone detects that it has established a connection with the vehicle-mounted terminal, it automatically switches the video call to the vehicle-mounted terminal.
  • the mobile phone can also intelligently determine whether to switch to the vehicle-mounted terminal. For example, when the camera of the vehicle-mounted terminal collects only one portrait of the person in the vehicle, the video call can be switched to the vehicle-mounted terminal. If it is detected that there are multiple portraits in the car, in order to ensure the privacy of the user, the video call may not be switched to the vehicle-mounted terminal or the user is asked whether to switch to the vehicle-mounted terminal.
  • the above scenario 2 and scenario 3 are to switch the video call application from using the display and camera on the mobile phone to the display and camera on the in-vehicle terminal at the same time when switching. Or vice versa.
  • Scenario 4 User A uses the on-board terminal to make a video call with user B in the car, and uses the camera in the car to collect images. If the car has an external camera, user A needs to use the camera outside the car to capture images outside the car.
  • FIG. 9 it is a schematic diagram of the process of switching cameras after the mobile phone and the vehicle-mounted terminal discover the connection process, and the vehicle-mounted terminal is connected to the external camera.
  • the discovery connection process of the mobile phone and the vehicle-mounted terminal is the same as that of FIG. 8, and will not be repeated.
  • the third module of the vehicle terminal will inform the mobile phone of the information of the external camera.
  • the first module of the mobile phone registers the external camera in the second module.
  • the vehicle terminal detects the user's instruction to switch the camera (touching the display related controls, inputting a voice command, pressing a physical button on the center control panel, etc.), the instruction to switch the camera will be sent to the video call application in the mobile phone.
  • the video call application sends an instruction to turn off the current camera and turn on the camera that needs to be switched to the vehicle-mounted terminal.
  • the instruction to switch cameras does not specify which camera to switch to, the video call application can switch cyclically according to the existing cameras. The embodiments of this application do not limit this.
  • the method of switching other hardware on the vehicle-mounted terminal is similar to switching the camera, and will not be repeated here.
  • the method of switching the hardware on the mobile phone is also similar to the method of switching the camera on the vehicle-mounted terminal, and will not be repeated here.
  • Scenario 5 User A uses the on-board terminal to make a video call with user B in the car.
  • the mobile phone can also obtain data from other hardware in the on-board terminal, such as sensor data. And perform corresponding operations based on the sensor data of the vehicle terminal.
  • FIG. 10 is an interaction diagram of another video call method provided by an embodiment of this application.
  • the sensors of the vehicle-mounted terminal can detect the driving state of the car in real time, such as the speed of the car, the driving section, and so on. If the sensor of the vehicle terminal detects that the speed of the car exceeds the threshold, the vehicle speed is reported to the video call application of the vehicle terminal.
  • the video call application may instruct the display screen of the vehicle terminal to close the screen of the opposite end, or the video call application directly ends the video call. In other examples, because the vehicle speed is too fast, the quality of the picture collected by the camera of the vehicle terminal may be reduced.
  • the mobile phone when the mobile phone is a video call application that receives a message that the vehicle speed is too fast, it can also issue instructions to increase the frame rate of the vehicle terminal to the camera of the vehicle terminal, so as to improve the image quality collected by the camera of the vehicle terminal.
  • this article takes the video call application running on the mobile phone to switch between using the hardware on the mobile phone and using the hardware on the vehicle terminal as an example. It is understandable that, according to the method provided in the embodiments of the present application, other applications running on the mobile phone can also realize any switch between using the hardware on the mobile phone and using the hardware on the vehicle terminal. The embodiments of this application will not be repeated one by one.
  • the chip system includes at least one processor 1101 and at least one interface circuit 1102.
  • the processor 1101 and the interface circuit 1102 may be interconnected by wires.
  • the interface circuit 1102 may be used to receive signals from other devices (such as the memory of the mobile terminal 100).
  • the interface circuit 1102 may be used to send signals to other devices (such as the processor 1101).
  • the interface circuit 1102 can read an instruction stored in the memory, and send the instruction to the processor 1101.
  • the electronic device can be made to execute the steps executed by the mobile terminal 100 (for example, a mobile phone) in the above-mentioned embodiment.
  • the chip system may also include other discrete devices, which are not specifically limited in the embodiment of the present application.
  • the chip system includes at least one processor 1201 and at least one interface circuit 1202.
  • the processor 1201 and the interface circuit 1202 may be interconnected by wires.
  • the interface circuit 1202 can be used to receive signals from other devices (such as the memory of the vehicle-mounted terminal 200).
  • the interface circuit 1202 may be used to send signals to other devices (such as the processor 1201).
  • the interface circuit 1202 can read instructions stored in the memory, and send the instructions to the processor 1201.
  • the electronic device can be made to execute the various steps executed by the vehicle-mounted terminal 200 in the foregoing embodiment.
  • the chip system may also include other discrete devices, which are not specifically limited in the embodiment of the present application.
  • the above-mentioned terminal and the like include hardware structures and/or software modules corresponding to each function.
  • the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the embodiments of the present invention.
  • the embodiment of the present application may divide the above-mentioned terminal and the like into functional modules according to the above-mentioned method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of modules in the embodiment of the present invention is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • the functional units in the various embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of software products, and the computer software products are stored in a storage
  • the medium includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

Abstract

一种视频通话的方法及电子设备,涉及通信技术领域,实现将视频通话在移动终端和车载终端上自由切换,满足用户多种场景下的不同需求,既能保证用户驾车安全,又能提升用户的使用体验,该方法包括:移动终端和车载终端建立通信连接;移动终端接收车载终端发送的第一信息,第一信息为第一用户在车载终端上发起与第二用户视频通话的指示;响应于第一信息,移动终端与第二用户的终端建立视频通话连接,接收第二用户的视频数据;移动终端向车载终端发送第二用户的视频数据,向第二用户的终端发送车载终端的摄像头采集的第一用户的视频数据。

Description

一种视频通话的方法及电子设备
本申请要求于2019年9月18日提交国家知识产权局、申请号为201910883084.0、申请名称为“一种视频通话的方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域,尤其涉及一种视频通话的方法及电子设备。
背景技术
目前,用户可以很方便地使用手机与其他用户进行视频通话等。但当用户位于汽车内,若用户仍然使用手机进行视频通话,会很不方便,甚至是不安全的。
发明内容
本申请提供的一种视频通话的方法及电子设备,能够实现将视频通话在移动终端和车载终端上自由切换,满足用户多种场景下的不同需求,既能保证用户驾车安全,又能提升用户的使用体验。
第一方面、提供一种视频通话的方法,应用于移动终端和车载终端,车载终端包括一个或多个显示屏,以及一个或多个摄像头,该方法包括:移动终端和车载终端建立通信连接;移动终端接收车载终端发送的第一信息,第一信息为第一用户在车载终端上发起与第二用户视频通话的指示;响应于第一信息,移动终端与第二用户的终端建立视频通话连接,接收第二用户的视频数据;移动终端向车载终端发送第二用户的视频数据,向第二用户的终端发送车载终端的摄像头采集的第一用户的视频数据。
由于第一用户是通过在车载终端上开启视频通话应用的,表明用户处于汽车内,则移动终端可以默认使用车载终端的屏幕进行显示,以及使用车载终端的摄像头采集视频信息。也就是说,移动终端的视频通话应用在调用显示驱动进行显示时,可以调用车载终端显示屏对应的虚拟驱动,以便使得移动终端绘制的界面可以传输到车载终端进行显示。同理,移动终端的视频通话应用在调用摄像头驱动采集视频信息时,可以调用车载终端摄像头对应的虚拟驱动,以便使得车载终端将车载终端摄像头采集的视频信息发送到移动终端。
由上可见,当第一用户位于汽车内时,移动终端上运行的视频通话可以调用车载终端的显示屏显示第二用户的画面,也可以调用车载终端的摄像头采集第二用户的画面,释放了用户的双手,便于用户操控汽车,提升驾车安全性。
再有,由于整个视频通话是运行在移动终端侧,而车载终端侧只需要提供相应的硬件能力,例如提供显示屏进行显示,提供摄像头采集画面,提供麦克风采集音频以及播放音频等。因此,本申请实施例提供的方法对车载终端系统能力要求不高。例如,车载终端可不具有连接到移动通信网、互联网等能力。车载终端也可以不要求能够运行视频通话应用等。换言之,本申请实施例可适用于大多数的车载终端。
一种可能的实现方式中,该方法还包括:在移动终端接收到车载终端发送的第一信息之后,或者,在移动终端与第二用户的终端建立视频通话之后,移动终端接收车 载终端发送的车载终端的摄像头采集的第一用户的视频数据。
一种可能的实现方式中,该方法还包括:在移动终端与第二用户的终端建立视频通话之后,移动终端接收第二用户的终端发送的第二用户的视频数据;移动终端向车载终端发送第二用户的视频数据,具体为:移动终端根据第二用户的视频数据,以及车载终端的摄像头采集的第一用户的视频数据绘制第一界面,并将第一界面发送给车载终端;其中,第一界面包括第一用户的视频数据,以及车载终端的摄像头采集的第二用户的视频数据。
一种可能的实现方式中,在移动终端接收车载终端发送的第一信息之前,该方法还包括:移动终端接收车载终端发送的第二信息,第二信息包括车载终端的显示屏的参数,以及车载终端的摄像头的参数;移动终端根据第二信息对车载终端的显示屏和车载终端的摄像头进行注册。
其中,该注册过程可理解为移动终端为车载终端的各个硬件创建一个虚拟驱动。后续,移动终端的应用在需要调用车载终端的硬件时,可以通过对应的虚拟驱动将数据传输给车载终端的硬件。由此,提供了一种移动终端调用车载终端的硬件的方法。
一种可能的实现方式中,车载终端通过蓝牙低功耗BLE传输第二信息给移动终端。
本申请的一些实施例中,车载终端在开机或者打开无线连接功能后,可以通过低功耗蓝牙发送BLE广播消息,以便移动终端能够扫描到该车载终端,并与车载终端建立通信连接。BLE广播消息中可以携带车载终端标识以及车载终端能力信息。其中,车载终端标识例如可以是汽车型号,用于标识该车载终端。车载终端能力信息可以包括车载终端的硬件能力信息,例如摄像头信息、显示屏信息、音频信息、GPS信息、传感器信息等。
一种可能的实现方式中,该方法还包括:在移动终端接收车载终端发送的第一信息之后,或者,在移动终端与第二用户的终端的建立视频通话连接之后,移动终端确定是否注册了车载终端的摄像头;若确定注册了车载终端的摄像头,则移动终端向车载终端发送打开车载终端的摄像头的指示。
一种可能的实现方式中,该方法还包括:移动终端接收车载终端发送的第三信息,第三信息为第一用户指示切换到移动终端的摄像头和显示屏的操作;或者,移动终端检测到移动终端与车载终端断开通信连接;移动终端的显示屏显示第二用户的视频数据,以及移动终端的摄像头采集到的第一用户的视频数据。
可见,用户在视频通话的过程中,可以将视频通话在移动终端上或车载终端上进行自由切换,满足不同场景下的不同需求。
一种可能的实现方式中,该方法还包括:移动终端接收车载终端发送的第四信息,第四信息为第一用户指示将当前摄像头切换到车载终端的另一个摄像头;移动终端指示车载终端关闭当前摄像头,以及打开车载终端的另一个摄像头;移动终端接收车载终端的另一个摄像头采集的第一用户的视频数据;移动终端向车载终端发送第二用户的视频数据,以及车载终端的另一个摄像头采集的第一用户的视频数据。
可见,用户在视频通话的过程中,可以将在车载终端的多个摄像头中进行切换,满足不同场景下的不同需求。
一种可能的实现方式中,该方法还包括:移动终端接收车载终端发送的第五信息, 第五信息为第一用户指示将当前摄像头切换到移动终端的摄像头;移动终端指示车载终端关闭当前摄像头,并打开移动终端的摄像头;移动终端的摄像头采集的第一用户的视频数据;移动终端向车载终端发送第二用户的视频数据,以及移动终端的摄像头采集的第一用户的视频数据。
可见,用户在视频通话的过程中,可以从车载终端的摄像头切换到移动终端的摄像头,满足不同场景下的不同需求。
一种可能的实现方式中,该方法还包括:在移动终端和车载终端断开通信连接时,移动终端对车载终端的显示屏和车载终端的摄像头进行注销。
当移动终端与车载终端断开连接后,移动终端会对已注册的车载终端的硬件进行注销,例如删除车载终端的硬件对应的虚拟驱动,或者将车载终端的硬件对应的虚拟驱动设置为不可用。
第二方面、提供一种视频通话的方法,应用于移动终端和车载终端,车载终端包括一个或多个显示屏,以及一个或多个摄像头,该方法包括:移动终端和车载终端建立通信连接;移动终端接收第二用户的终端发送的视频通话请求;移动终端接收服务器发送的第二用户的视频数据,以及接收车载终端的摄像头采集的第一用户的视频数据;移动终端向车载终端发送第二用户的视频数据,向第二用户的终端发送车载终端的摄像头采集的第一用户的视频数据。
一种可能的实现方式中,移动终端向车载终端发送第二用户的视频数据,具体为:移动终端根据第二用户的视频数据,以及车载终端的摄像头采集的第一用户的视频数据绘制第一界面,并将第一界面发送给车载终端;其中,第一界面包括第一用户的视频数据,以及车载终端的摄像头采集的第二用户的视频数据。
一种可能的实现方式中,在移动终端与第二用户的终端建立视频通话连接之后,该方法还包括:若移动终端注册了车载终端的摄像头,则向车载终端发送打开车载终端的摄像头的指示。
一种可能的实现方式中,在移动终端和第二用户的终端建立视频通话连接之前,该方法还包括:移动终端接收车载终端发送的第一信息,第一信息包括车载终端的显示屏的信息,以及车载终端的摄像头的信息;移动终端根据第一信息对车载终端的显示屏和车载终端的摄像头进行注册。
一种可能的实现方式中,车载终端通过蓝牙低功耗BLE传输第一信息给移动终端。
一种可能的实现方式中,该方法还包括:移动终端接收车载终端发送的第二信息,第二信息为第一用户指示切换到移动终端的摄像头和显示屏的操作;或者,移动终端检测到移动终端与车载终端断开通信连接;移动终端的显示屏显示第二用户的视频数据,以及移动终端的摄像头采集到的第一用户的视频数据。
一种可能的实现方式中,在移动终端的显示屏显示第二用户的视频数据,以及移动终端的摄像头采集到的第一用户的视频数据之后,该方法还包括:移动终端接收到三信息,第三信息为第一用户指示切换到车载终端的摄像头和显示屏的操作,或者,移动终端检测到移动终端连接到车载终端;若移动终端确定注册了车载终端的摄像头,则向车载终端发送打开车载终端的摄像头的指示;移动终端向车载终端发送从服务器处接收的第二用户的视频数据,以及车载终端的摄像头采集的第一用户的视频数据。
第三方面、提供一种视频通话的方法,应用于移动终端和车载终端,车载终端包括一个或多个显示屏,以及一个或多个摄像头,该方法包括:车载终端和移动终端建立通信连接;车载终端接收第一用户的第一操作,第一操作用于指示与第二用户的终端建立视频通话;车载终端的摄像头采集第一用户的视频数据,并将第一用户的视频数据发送给移动终端,以及车载终端接收移动终端发送的第二用户的视频数据,并显示所述第一用户的视频。
第四方面、提供一种电子设备,包括:处理器、存储器和触摸屏,所述存储器、所述触摸屏与所述处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述处理器从所述存储器中读取所述计算机指令,以使得所述电子设备执行如上述方面及其中任一种可能的实现方式中所述的方法。
第五方面、提供一种装置,该装置包含在电子设备中,该装置具有实现上述方面及可能的实现方式中任一方法中车载终端行为的功能。该功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。例如,接收模块或单元、显示模块或单元、采集模块或单元、以及发送模块或单元等。
第六方面、提供一种计算机存储介质,包括计算机指令,当计算机指令在移动终端上运行时,使得移动终端执行如上述方面及其中任一种可能的实现方式中所述的方法。
第七方面、提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如上述方面中及其中任一种可能的实现方式中所述的方法。
第八方面、提供一种芯片系统,包括处理器,当处理器执行指令时,处理器执行如上述方面中及其中任一种可能的实现方式中所述的方法。
附图说明
图1为本申请实施例提供的一种通信系统的结构示意图;
图2A为本申请实施例提供的一种移动终端的结构示意图一;
图2B为本申请实施例提供的一种移动终端的结构示意图二;
图3A为本申请实施例提供的一种车载终端的结构示意图一;
图3B为本申请实施例提供的一种车载终端的结构示意图二;
图4为本申请实施例提供的一种视频通话的方法流程示意图;
图5为本申请实施例提供的一些移动终端的用户界面示意图;
图6A为本申请实施例提供的一些车载终端的用户界面示意图;
图6B为本申请实施例提供的又一些车载终端的用户界面示意图;
图7为本申请实施例提供的一种车载终端和手机传输数据的方法示意图;
图8为本申请实施例提供的又一种视频通话的方法流程示意图;
图9为本申请实施例提供的又一种视频通话的方法流程示意图;
图10为本申请实施例提供的又一种视频通话的方法流程示意图;
图11为本申请实施例提供的一种芯片系统的结构示意图;
图12为本申请实施例提供的又一种芯片系统的结构示意图。
具体实施方式
在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
在本申请实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
目前,在一些车载终端上也可以安装有视频通话的应用。于是,当用户位于汽车内时,可以使用车载终端上的视频通话应用。然而,在一些具体的场景中,用户仅使用车载终端上的视频通话应用或仅使用手机上的视频通话应用进行视频通话的使用体验并不佳。例如:用户正在使用手机进行视频通话,当用户进入汽车时,用户需要挂断手机上的视频通话,重新使用车载终端上的视频通话应用进行视频通话。或者,用户正在使用车载终端进行视频通话,当用户离开汽车时,用户需要挂断车载终端上的视频通话,重新使用手机上的视频通话应用进行通话。
为此,本申请实施例提供一种视频通话的方法,可以使得手机上运行的视频通话应用可调用与之连接的车载终端上的硬件,例如调用车载终端的显示屏显示视频通话的界面,也可以调用车载终端的摄像头采集用户的画面。当然,手机仍然也可以调用手机的显示屏显示视频通话的界面,使用手机的摄像头采集用户的画面。换言之,本申请实施例提供的方法可实现手机上的视频应用自由调用手机或车载终端的摄像头采集画面,以及自由调用手机或车载终端的显示屏显示界面等。进而,实现正在进行的视频通话可以在手机和车载终端上自由切换,能够满足用户在不同场景下的不同需求,提升了用户的使用体验。
如图1所示,为本申请实施例提供的一种通信系统的结构示意图,本申请实施例提供的视频通话的方法可应用该通信系统。具体的,该通信系统包括移动终端100和车载终端200。
其中,移动终端100与车载终端200可以通过有线或无线的方式建立通信连接。例如:可以通过车载终端200上的USB接口与移动终端100通过线路建立有线连接。又例如:可以通过蓝牙或WLAN等建立无线连接。
本申请中,用户位于汽车内时(例如用户处于驾车状态,或驻车状态),可以通过操作车载终端200实现对移动终端100上安装的应用程序(例如:视频通话应用)的操控,提升驾车时的安全性以及驾车时使用应用的舒适度。在一些实施例中,移动终端100可以将应用程序的界面发送到车载终端200,由车载终端200进行显示。在一些示例中,车载终端200上屏幕的大小、分辨率等参数与移动终端100不同,移动终端100会为车载终端200绘制专门的界面。也就是说,移动终端100会根据应用程 序的运行状况为车载终端200绘制特定的界面,并将绘制好的特定界面通过上述通信连接发送给车载终端200进行显示。相应的,用户也可以通过车载终端200对该应用程序进行操控。例如用户可以是通过触摸车载终端200触摸屏上的控件、按压车载终端上(包括方向盘上)的物理按键、通过车载终端的麦克风输入语音命令等方式操控该应用程序。
本申请中,车载终端200可理解为移动终端100的外接设备。换言之,移动终端100可调用车载终端200的屏幕显示移动终端100上运行应用程序的界面;移动终端100也可以调用车载终端200上的摄像头(包括车载终端200上外接的摄像头)采集的图像;移动终端100还可以调用车载终端200上的麦克风采集语音以及播放语音等。当然,移动终端100也可以调用车载终端200连接的传感器等。其中,移动终端100调用车载终端200上的硬件以及外设等的具体实现将在下文介绍,这里先不做说明。
在一些实施例中,移动终端100上安装的应用程序还可以对应一个或多个应用服务器400。也就是说,移动终端100的应用程序与该一个或多个应用服务器400进行通信。例如:应用服务器可以是视频通话应用的服务器,可以为移动终端100提供视频通话功能等。
具体的,移动终端100可以通过一个或多个网络300与应用服务器400建立连接。其中,网络300可以是局域网(local area networks,LAN),也可以是广域网(wide area networks,WAN),例如互联网。网络300可使用任何已知的网络通信协议来实现,上述网络通信协议可以是各种有线或无线通信协议,诸如以太网、通用串行总线(universal serial bus,USB)、火线(FIREWIRE)、任何蜂窝网通信协议(如3G/4G/5G/未来通信技术)、蓝牙、无线保真(wireless fidelity,Wi-Fi)、NFC或任何其他合适的通信协议。
在一些实施例中,该通信系统还可以包括电子设备500。电子设备500也可以通过一个或多个网络300与应用服务器400建立通信连接。
例如:以视频通话应用为例进行说明。视频通话应用例如可以是具有视频通话功能的即时通信应用(如微信应用)、facetime(一种视频通话软件)、以及其他具有视频通过功能的应用。比如,用户A可以通过移动终端100上的视频通话应用,与用户B(使用电子设备500)进行视频通话。即,移动终端100将用户A的视频,经应用服务器400,发送给电子设备500,供用户B观看到。对应的,电子设备500也可以将用户B的视频,经应用服务器400发送给移动终端100,供用户A观看。
当用户A位于汽车内时,移动终端100上运行的视频通话可以调用车载终端200的显示屏显示用户B的画面,也可以调用车载终端200的摄像头采集用户A的画面,释放了用户的双手,便于用户操控汽车。当用户A离开汽车时,移动终端100上运行的视频通话可以切换使用移动终端100的显示屏显示用户B的画面,且调用移动终端100的摄像头采集用户A的画面。也就是说,用户不用挂断电话,即可实现视频通话从车载终端切换到移动终端。同理的,当用户A进入汽车时,移动终端100上运行的视频通话可以切换使用车载终端200的显示屏显示用户B的画面,也可以调用车载终端200的摄像头采集用户A的画面。也就是说,用户不用挂断电话,即可实现视频通话从移动终端切换到车载终端。可见,本申请实施例提供的视频方法能够满足用户在不同场景下的不同需求。
示例性的,上述的移动终端100例如可以为手机、平板电脑、个人计算机(personal computer,PC)、个人数字助理(personal digital assistant,PDA)、智能手表、上网本、可穿戴电子设备、增强现实技术(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、车载设备、智能汽车、智能音响、机器人等,本申请对移动终端100的具体形式不做特殊限制。电子设备500与移动终端100可以相同,也可以不同。电子设备500的结构可参考移动终端100,不再赘述。
图2A示出了移动终端100的硬件结构示意图。
移动终端100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对移动终端100的具体限定。在本申请另一些实施例中,移动终端100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
其中,USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为移动终端100充电,也可以用于移动终端100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
在本申请的一些实施例中,移动终端100可以通过USB接口130连接车载终端200,以实现移动终端100与车载终端200之间的数据通信。当然,移动终端100也可能通过其他接口连接车载终端200,或者移动终端100通过无线连接方式连接车载终端200。
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对移动终端100的结构限定。在本申请另一些实施例中,移动终端100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过移动终端100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为移动终端供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
移动终端100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。移动终端100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在移动终端100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处 理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在移动终端100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在本申请的一些实施例中,移动终端100可以通过无线通信模块160和天线2与车载终端200建立无线连接,以实现移动终端100和车载终端200的数据通信。
在一些实施例中,移动终端100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得移动终端100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
在本申请的一些实施例中,移动终端100可以通过移动通信模块150和天线1与应用服务器400建立连接,以实现移动终端100和应用服务器400之间的数据通信。
移动终端100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,移动终端100可以包括1个或N个显示屏194,N为大于1的正整数。
移动终端100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,移动终端100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当移动终端100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。移动终端100可以支持一种或多种视频编解码器。这样,移动终端100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现移动终端100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展移动终端100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储移动终端100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行移动终端100的各种功能应用以及数据处理。
移动终端100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。移动终端100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当移动终端100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。移动终端100可以设置至少一个麦克风170C。在另一些实施例中,移动终端100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,移动终端100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动终端平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。移动终端100可以接收按键输入,产生与移动终端100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和移动终端100的接触和分离。移动终端100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。移动终端100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,移动终端100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在移动终端100中,不能和移动终端100分离。
移动终端100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的Android系统为例,示例性说明移动终端100的软件结构。
图2B是本发明实施例的移动终端100的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图2B所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
在本申请的一些实施例中,应用程序包还包括具有视频通话功能的视频通话应用,例如:微信应用、QQ应用、facetime等。视频通话应用可以是移动终端100上预置的应用程序,也可以是用户通过应用市场或其他方式下载的应用程序,本申请实施例对视频通话应用不做限定。
可选的,应用程序包还可以包括第一应用。例如,HiCar应用(一种手机和车载终端连接的软件)。具体的,第一应用可以绘制移动终端100和车载终端200进行连接的相关界面,以及将移动终端100上安装的应用程序绘制的应用界面转换为车载终端200显示的界面等。比如,根据移动终端100上安装的应用程序绘制车载终端200的显示桌面,显示桌面上包括对应于移动终端100上安装的全部或部分应用程序的卡片。又比如,当移动终端100上运行有视频通话应用时,第一应用将视频通话应用绘制的应用程序界面(如视频请求界面、视频通话界面等)转换为车载终端200显示的界面等。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2B所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。电话管理器用于提供移动终端100的通信功能。例如通话状态的管理(包括接通,挂断等)。资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,移动终端振动,指示灯闪烁等。
在本申请的一些实施例中,应用程序框架层还可以包括用于与其他设备(例如车载终端200)进行通信的第一模块。第一模块具体可用于发现车载终端200,连接车载终端200;与车载终端200进行数据传输(如向车载终端200发送车载终端侧的图形界面、接收车载终端200摄像头采集的图像数据、接收用户在车载终端200上的输入),以及在数据传输时对数据进行编码和解码等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的 核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
在本申请中,内核层还包括用于管理移动终端100外接设备的第二模块。第二模块具体可用于管理与移动终端100连接的车载终端200上的硬件,例如:车载终端200的屏幕、摄像头、麦克风以及传感器等其他装置。
图3A示出了车载终端200的硬件结构示意图。
车载终端200可以包括处理器210,存储器220,无线通信模块230,扬声器240,麦克风250,显示屏260,摄像头270,USB接口280,以及传感器模块290等。其中传感器模块290可以包括压力传感器290A,磁传感器290B,加速度传感器290C,温度传感器290D,触摸传感器290E,环境光传感器290F,定位系统290G等。
处理器210可以包括一个或多个处理单元,例如:处理器210可以包括电子控制单元(Electronic Control Unit,ECU)和远程信息处理器(TelematicsBOX)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器210中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器210的等待时间,因而提高了系统的效率。
存储器220可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器220可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储车载终端200使用过程中所创建的数据(比如音频数据,视频数据等)等。此外,存储器220可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器210通过运行存储在存储器220的指令,和/或存储在设置于处理器中的存储器的指令,执行车载终端200的各种功能应用以及数据处理。
无线通信模块230可以提供应用在车载终端200上的包括WLAN,如Wi-Fi网络,蓝牙,NFC,IR等无线通信的解决方案。无线通信模块230可以是集成至少一个通信处理模块的一个或多个器件。
在本申请的一些实施例中,车载终端200可以通过无线通信模块230,与移动终 端100建立无线通信连接。或者,车载终端200也可以通过USB接口280,与移动终端100建立有线通信连接,本申请实施例对此不做限定。
扬声器240、麦克风250、显示屏260和摄像头270等部件的作用可参考移动终端100中相关的描述,这里不做赘述。
可以理解的是,本发明实施例示意的结构并不构成对车载终端200的具体限定。在本申请另一些实施例中,车载终端200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
图3B示出了车载终端200的软件结构示意图。
示例性的,车载终端200的软件结构可以包括应用模块、控制模块、人机接口模块、远程信息处理模块、电子控制单元和操作系统。
其中,应用模块用于车内的影音娱乐,以及车辆信息显示等。控制模块,可控制车辆及其组件的操作,例如控制转向、油门、制动等。人机接口,也叫人机界面,是车载终端200和用户之间进行交互和信息交换的媒介,它实现信息的内部形式与人类可以接受形式之间的转换。远程信息处理模块主要用于和后台操作系统/手机APP通信,实现手机APP的车辆信息显示与控制。电子控制单元又称“行车电脑”、“车载电脑”等,从用途上讲则是汽车专用微机控制器。
本申请的一些实施例中,车载终端200还包括用于与其他电子设备(例如移动终端100)进行通信的第三模块。可以理解的是,第三模块可以是独立的一个功能模块,也可以是已有模块(例如远程信息处理模块)中的一部分,本申请实施例对此不做限定。
下文以移动终端100为手机举例,并结合具体的应用场景对本申请实施例提供的技术方案进行详细说明。
场景一、手机与车载终端建立通信连接,用户A通过车载终端发起与用户B的视频通话,手机使用车载终端的摄像头采集图像,以及使用车载终端的显示屏显示界面。
如图4所示,为本申请实施例提供的一种视频通话的流程示意图,该流程具体包括:
S401、车载终端发送BLE广播消息,BLE广播消息中携带车载终端标识以及车载终端能力信息。
本申请的一些实施例中,车载终端在开机或者打开无线连接功能后,可以通过低功耗蓝牙发送BLE广播消息,以便手机能够扫描到该车载终端,并与车载终端建立通信连接。BLE广播消息中可以携带车载终端标识以及车载终端能力信息。其中,车载终端标识例如可以是汽车型号,用于标识该车载终端。车载终端能力信息可以包括车载终端的硬件能力信息,例如摄像头信息、显示屏信息、音频信息、GPS信息、传感器信息等。
其中,BLE广播消息可以采用与手机预先约定的格式。例如,预先约定的格式可以是:信息头+model:+车型名称+capacitytype+能力类型+capacityvalue+能力参数。其中,能力类型可以指车载终端的摄像头、音频、显示屏、GPS等硬件能力。
示例性的,给出一个能力类型数值的举例,如下:
Figure PCTCN2020102803-appb-000001
意思是:能力类型为摄像头时,在广播消息中能力类型对应的数值为1;能力类型为音频时,在广播消息中能力类型对应的数值为2;能力类型为显示屏时,在广播消息中能力类型对应的数值为3;能力类型为GPS时,在广播消息中能力类型对应的数值为4等等。可以理解的是,车载终端可以具有同一个能力类型下的多个硬件,例如:具有多个摄像头,包括汽车内部的摄像头和汽车外部的摄像头等。那么,可以对能力类型下的多个硬件分别进行编号,以示区分。
在一些示例中,车载终端还可以通过接口外接一些硬件。那么,车载终端在广播消息时,也可以携带外接的硬件的能力信息。例如:车载终端可以通过USB接口外接摄像头。那么,本步骤中车载终端发送的BLE广播消息中还携带车载终端外接的摄像头的信息。
其中,能力参数,为各个能力类型对应的具体参数。表一给出了各个能力类型对应的参数的一些示例。
表一
Figure PCTCN2020102803-appb-000002
在本申请的另一些实施例中,车载终端也可以在与手机建立通信连接之后,再携带车载终端能力信息,告知手机车载终端的能力。即,在车载终端发送的BLE广播消息中可以携带车载终端标识,但不携带车载终端能力信息。
当然,考虑到信息安全,通常会对BLE广播消息进行加密,则手机在接收到BLE广播消息进行相应的解密即可。
在一个具体的实现中,车载终端内的第三模块可用于收集车载终端硬件能力的信息。例如,车载终端在开机后或者开启无线功能后,第三模块可以要求车载终端各个硬件上报自身的能力信息。或者,车载终端各个硬件主动向第三模块上报自身的能力信息。而后,车载终端将第三模块获取的能力信息携带在BLE广播消息进行广播。又例如,车载终端在与手机建立通信连接后,车载终端收集车载终端的硬件能力信息,并上报给手机,便于手机对车载终端的硬件能力进行注册。注册相关的内容将在下文详细说明。
S402、手机进行蓝牙扫描,显示发现设备列表。该发现设备列表中显示有BLE广播消息中的车载终端标识。
一些实施例中,手机开启第一应用。第一应用可以显示提示界面,提示用户手动开启蓝牙和WIFI功能。或者,响应于用户开启第一应用,手机自动开启蓝牙和WIFI功能。手机开始进行蓝牙扫描。在扫描到发送BLE广播消息后,手机对BLE广播消息进行解析,获取到车载终端标识和车载终端的能力信息,并存储车载终端标识和车载终端的能力信息。然后,手机显示发现的蓝牙设备的列表,以提示用户选择连接哪个蓝牙设备。该蓝牙设备的列表上显示有BLE广播消息中携带的车载终端的标识。
例如:如图5中(1)所示的界面501,为手机显示的发现的蓝牙设备的列表的一个示例。界面501上显示有蓝牙设备的列表502。可以看出,此时手机扫描到两个蓝牙设备,分别为“上汽通用别克昂科威”和“上汽通用ATS-L”。
可选的,手机还可以根据BLE广播消息中的车载终端能力信息,对车载终端的硬件能力进行注册。该注册过程可理解为手机为车载终端的各个硬件创建一个虚拟驱动。后续,手机的应用在需要调用车载终端的硬件时,可以通过对应的虚拟驱动将数据传输给车载终端的硬件。在一个具体的实现中,请参见图2B,在手机应用程序框架层的第一模块发现车载终端的BLE广播消息时,可以向内核层的第二模块请求对车载终端的各个硬件进行注册,即为车载终端各个硬件创建虚拟驱动。例如:车载终端的摄像头对应的虚拟摄像头驱动,车载终端麦克风对应的虚拟音频驱动,车载终端显示器对应的虚拟显示驱动,车载终端传感器对应的传感器驱动等。需要说明的是,当手机与车载终端断开连接后,手机会对已注册的车载终端的硬件进行注销,例如删除车载终端的硬件对应的虚拟驱动,或者将车载终端的硬件对应的虚拟驱动设置为不可用。
当然,手机也可以在手机与车载终端建立连接之后,即步骤S403之后,对车载终端的硬件能力进行注册。可见,手机在调用车载终端的硬件之前完成注册即可,本申请实施例对注册时机不做具体限定。
S403、手机接收用户连接车载终端的指示(S403a),手机与车载终端建立WIFI连接(S403b)。
示例性的,响应于用户在如图5中(1)所示的界面501上选择连接“上汽通用别克昂科威”的操作,手机向“上汽通用别克昂科威”对应的车载终端发送连接命令。例如,手机可以采用BLE的普通属性协议(generic attribute profile,GATT)发送命令。命令的内容可以是命令头(cmd命令)+手机标识(例如手机名称和/或国际移动设备识别码(International Mobile Equipment Identity,IMEI));其中cmd命令为打开车载终端的WIFI连接。车载终端接收到命令后,对手机进行鉴权。在鉴权成功后,执行打开WIFI功能,并向手机发起WIFI连接的请求。手机接收该WIFI连接请求,则手机与车载终端建立WIFI连接。后续,手机和车载终端可通过该WIFI连接进行数据通信。
例如,手机与车载终端建立WIFI连接后,显示如图5中(2)所示的界面503。可以看出,手机与“上汽通用别克昂科威”对应的车载终端建立连接。界面503上还可以有与“上汽通用别克昂科威”对应的设置控件504。用户可以通过该设置控件504进行相关设置。例如,响应于用户点击设置控件504,手机显示如图5中(3)所示的设置界面505。在该设置界面505上,包含有车载终端上显示的多个应用图标、控件506、控件507、控件508以及控件509。其中,用户可以通过按住应用图标并拖动的 方式以调整车载终端上显示的应用图标的排序。控件506可用于下载新的HiCar应用。这里的HiCar应用是指,在车载终端上显示的应用。需要说明的是,车载终端上显示的应用是在手机上已经安装的应用。这是因为,这些应用实际上是在手机上运行的,而这些应用需要用到的硬件可以是使用车载终端的硬件。例如,使用车载终端的显示屏显示界面,使用车载终端的摄像头采集图像等。当然,车载终端也可以用于接收用户的操作指令,例如通过触摸车载终端的显示屏(通常为触摸屏)的控件,或者通过车载终端的麦克风采集用户的语音命令,或者通过车载终端上(包括方向盘上)的物理按键的按压动作等。控件507可以用于开启手机无线自动连接车载终端的功能。控件508可用于修改该汽车的车辆名称。控件509可用于解除手机和该车载终端的绑定关系。
在一个具体的实现方式中,手机的第一模块发现车载终端的BLE广播消息时,会确定手机是否第一次连接车载终端。若为第一次连接车载终端,或者虽然非第一次连接车载终端,但用户未开启机和车载终端的无线自动连接功能时,则会等待用户的连接指示。可选的,手机可以上报给第一应用,第一应用绘制提示信息,提示用户是否连接。若接收到用户的连接指示时,连接车载终端。否则,不连接车载终端。若为非第一次连接车载终端,且用户开启手机和车载终端的无线自动连接功能时,则自动连接车载终端。第一模块将连接成功的消息上报给第一应用。
还需要说明的是,上述步骤S401至S403是以手机通过低功耗蓝牙发现车载终端,并与车载终端建立WIFI连接为例进行说明的。在本申请另一些实施例中,手机也可以直接通过USB接口的数据线与车载终端建立连接,或者手机直接与车载终端通过WIFI建立连接,或者手机与车载终端通过经典蓝牙进行连接等。本申请实施例对手机与车载终端的连接方式不做具体限定。
S404、手机绘制车载终端的视频通话应用的界面,并发送给车载终端,由车载终端进行显示。
在一个具体的实现中,在手机的第一应用接收到应用程序框架层发送的连接成功的消息后,手机的第一应用可以根据获取车载终端的能力信息确定车载终端具有显示屏,并根据车载终端的显示屏的信息,绘制车载终端的桌面,并发送给车载终端,由车载终端显示。
例如,如图6A中(1)所示的界面601为车载终端桌面的一个示例。该界面601上显示有快捷菜单栏602、状态栏603、以及多个应用卡片(例如视频通话卡片604)。其中,快捷菜单栏602可用于快速进入相应的界面或应用中。状态栏603中显示有时间、电量、信号以及语音输入框等。用户可以通过桌面上的应用卡片进入各个应用。类似的,车载终端将接收到的用户对应用的操作发送给手机,由手机上的相应的应用进行响应,并绘制车载终端下一个界面,并发送给车载终端进行显示。
示例性的,以用户在车载终端上操作手机上的视频应用为例进行说明。
响应于用户在图6A中(1)所示的界面601上,点击视频通话卡片604,车载终端将该用户操作发送该手机。手机启动视频通话应用,绘制车载终端下一个界面,即视频通话应用的界面,并发送给车载终端。如图6A中(2)所示的界面605,为车载终端显示的一个视频通话应用的界面的示例。
S405、车载终端接收用户在视频通话应用的界面发起视频呼叫的操作(S405a),并将该视频呼叫操作发送给手机(S405b)。
S406、手机向服务器发送视频呼叫请求(S406a),并且绘制车载终端的视频呼叫界面并发送给车载终端进行显示(S406b)。
其中,服务器可以为手机提供视频通话服务的应用服务器。
接着上述举例,用户在如图6A中(2)所示的界面605上选择Andy,即向Andy发起视频呼叫指令,车载终端将该指令发送给手机。手机接收后,一方面,手机接着绘制车载终端的视频呼叫界面;另一方面,手机的视频通话应用向服务器发送视频呼叫请求。该视频呼叫请求携带有Andy的标识。服务器根据Andy的标识向Andy使用的终端发送视频呼叫请求。若Andy接收本次视频呼叫请求,则服务器向手机返回视频通话建立事件,而后执行步骤S407。若Andy拒绝本次视频呼叫请求,则服务器向手机返回视频通话失败事件。手机绘制相应的界面由车载终端进行显示,以告知用户。
例如,如图6B中(3)所示的界面606,为车载终端显示的视频呼叫界面的示例。该界面606显示有提示框607和预览框608。其中,提示框607提示“正在呼叫Andy……”。预览框608用于显示车载终端摄像头采集到的画面。界面606还显示有挂断控件609,用于挂断视频通话。
需要注意的是,该实施例中,由于用户是通过在车载终端上开启视频通话应用的,表明用户处于汽车内,则手机可以默认使用车载终端的屏幕进行显示,以及使用车载终端的摄像头采集视频信息。也就是说,手机的视频通话应用在调用显示驱动进行显示时,可以调用车载终端显示屏对应的虚拟驱动,以便使得手机绘制的界面可以传输到车载终端进行显示。同理,手机的视频通话应用在调用摄像头驱动采集视频信息时,可以调用车载终端摄像头对应的虚拟驱动,以便使得车载终端将车载终端摄像头采集的视频信息发送到手机。
在一个具体的实现方式中,视频通话应用在接收到用户发起视频通话的指示后,也可以从第二模块中查询手机是否注册有车载终端的摄像头。若确定注册了车载终端具有摄像头,则视频通话应用通过第二模块、第一模块向车载终端发送打开摄像头的指令。车载终端接收到打开摄像头的指令后,开启摄像头采集画面,并返回给视频通话应用。在一个示例中,手机可以在接收到车载终端发起视频通话的指示后,就指示车载终端发送打开摄像头,开始采集画面。在另一个示例中,手机也可以在接收到服务器发送的视频通话连接成功的消息后,再指示车载终端发送打开摄像头,开始采集画面。若确定车载终端不具有摄像头,则视频通话应用需要调用手机的摄像头采集画面。
S407、手机接收服务器发送的视频呼叫建立的消息(S407a),绘制车载终端的视频通话界面,并发送给车载终端,由车载终端进行显示(S407b)。
接着上述举例,在Andy接收本次视频呼叫请求后,Andy的终端将采集Andy的视频信息,并通过服务器发送给手机。然后手机根据Andy的视频信息绘制车载终端的界面,并发送给车载终端进行显示。其中,车载终端的视频通话界面中显示有通过车载终端的摄像头采集到的视频画面。例如:如图6B中(4)所示的界面610,则为视频通话接通后,车载终端显示的视频通话的界面。
在本申请实施例中,手机与车载终端在传输应用数据(例如视频通话应用数据)时,涉及到多个应用程序(第一应用和视频通话应用)之间的数据传输。这里对手机与车载终端之间的传输应用数据(例如视频通话应用数据)过程进行详细说明。
如图7所示,为一个包括手机和车载终端的系统结构示意图。其中,手机的视频通话服务,为手机在框架层和系统库中为视频通话应用提供服务的模块。设备驱动则包括视频通话应用需要调用手机相关硬件的驱动。其中,第一模块中包括:设备发现模块,用于执行手机发现车载终端的相关功能等。设备管理模块,用于根据接收到的车载终端上报的车载终端硬件能力信息,向第二模块进行注册等。远程服务模块用于向车载终端发送数据,以及接收车载终端的数据,对数据进行加解密处理等。编解码则用于对接收到的数据进行解码,对发送的数据进行编码处理等。其余模块的功能可参考图2B中相关模块的描述。车载终端侧的模块则可以参考图3B中相关模块的描述。
车载终端向手机传输应用数据的过程是:车载终端的第三模块将需要传输的数据(用户在车载终端上的操作、车载终端摄像头采集的画面、麦克风采集的音频等)进行编码加密等,并将编码加密后的数据通过与手机的连接链路传输到手机中的第一模块。手机中的第一模块对接收到的数据进行解密解码等,并确定数据为视频通话应用的数据。则通过第二模块、设备驱动和视频通话服务传输给视频通话应用,由视频通话应用进行处理。
手机向车载终端传输应用数据的过程是:视频通话应用将数据(绘制的车载终端侧的应用界面,从服务器接收的数据等)将视频通话服务、设备驱动、第二模块、第一模块发送给第一应用。第一应用将手机侧的应用界面转换为车载终端侧的应用界面,再由第一模块进行加解密等,将手机和车载终端的连通信链路发送给车载终端。车载终端的第三模块对接收到的数据进行解密解码后进行显示。
例如,传输的应用数据是用户在车载终端上发起视频通话的操作。那么,车载终端将应用数据传输到手机的第一模块后,手机的第一模块确定该应用数据为开启视频通话的操作,则将该应用数据通过第二模块、设备驱动和视频通话服务传输给视频通话应用。视频通话应用,一方面向服务器发送视频呼叫请求,另一方面绘制手机侧视频呼叫界面。手机将绘制好的手机侧的视频呼叫界面,经视频通话服务、设备驱动、第二模块、第一模块发送给第一应用。第一应用将手机侧的视频呼叫界面转换为适合车载终端显示的车载终端侧的视频呼叫界面,并经第一模块、手机与车载终端的通信链路发送给车载终端,由车载终端的显示屏进行显示。
其中,上述手机侧的视频呼叫界面,是指视频通话应用通常绘制的视频呼叫界面,该界面一般是在手机的显示屏上显示的。而在本申请中,视频通话应用需要在车载终端也有显示界面。故,这里为了区分车载终端显示的界面,故将手机上显示的界面称之为手机侧的显示界面(例如手机侧视频呼叫界面等)。需要说明的是,在本申请实施例中,当手机和车载终端建立连接,由车载终端显示视频通话的界面后,手机可以不显示视频通话相关的界面。
还需要说明的是,在本申请中,若手机和车载终端通过蓝牙连接时,手机的视频通话应用在使用车载终端侧显示屏显示界面时,也可以采用蓝牙协议中的投屏方法传输界面数据,即手机可通过蓝牙驱动直接调用车载终端的显示屏。手机的视频通话应 用在使用车载终端的麦克风时,也可以采用蓝牙协议中音频传输的方法传输音频数据,即手机可通过蓝牙驱动直接调用车载终端的音频设备。但需要注意的是,目前尚没有支持手机直接调用车载终端的摄像头,将车载终端摄像头采集的视频数据传输到手机的方案。然而,采用本申请提供的技术方案可以实现手机调用车载终端的摄像头采集图像。
如图8所示,为手机和车载终端发现连接过程和视频通话业务过程的示意图。该示意图中示出了手机中和车载终端中各个模块间交互。具体的交互过程在上述实施例已详细说明,这里不再赘述。
由上可见,当用户A位于汽车内时,手机上运行的视频通话可以调用车载终端的显示屏显示用户B(即被呼叫方)的画面,也可以调用车载终端的摄像头采集用户A(即主叫方)的画面,释放了用户的双手,便于用户操控汽车,提升驾车安全性。
再有,由于整个视频通话是运行在手机侧,而车载终端侧只需要提供相应的硬件能力,例如提供显示屏进行显示,提供摄像头采集画面,提供麦克风采集音频以及播放音频等。因此,本申请实施例提供的方法对车载终端系统能力要求不高。例如,车载终端可不具有连接到移动通信网、互联网等能力。车载终端也可以不要求能够运行视频通话应用等。换言之,本申请实施例可适用于大多数的车载终端。
另外,手机侧主要由第一应用、第一模块和第二模块等与已有的视频通话应用进行配合,完成调用车载终端的硬件进行视频通话的。即是,本申请实施例提供的方法中不需对视频通话应用进行代码改动,即可以实现调用车载终端的硬件进行视频通话。这样可以使得本申请实施例可兼容手机上的视频通话应用。
本申请中,由于实现了手机上运行的视频通话应用可以调用车载终端的硬件(摄像头、显示屏等),使得用户可以在车载终端上实现视频通话(观看视频,以及使用车载终端摄像头采集自己的画面)。同样,手机上运行的视频通话应用仍然可以调用手机的硬件,即用户还是可以在手机上实现视频通话。进一步的,用户在视频通话的过程中,可以将视频通话在手机上或车载终端上进行自由切换,满足不同场景下的不同需求。以下分别示出本申请实施例提供的方法运用于其他场景下的情况。
场景二、用户A在汽车内使用车载终端与用户B进行视频通话,此时用户A需要离开汽车,则将视频通话切换到手机上。
在一个实施例中,车载终端显示的界面上可以显示有切换控件,该切换控件可用于指示手机上视频通话应用将调用车载终端的显示屏和摄像头(还可以包括麦克风以及外接的摄像头等)的模式,切换为调用手机的显示屏和摄像头等。或者,用户也可以通过语音命令,或者方向盘上的物理按键等实现切换。即,用户可以手动将视频通话从车载终端上切换到手机上。
在另一个实施例中,当用户A离开汽车时,或者用户A关闭车载终端时,手机与车载终端的连接断开,则手机自动调用手机的显示屏和摄像头等进行视频通话。即,手机自动将视频通话从车载终端上切换到手机上。
可以理解的是,用户可以设置手机采用手动切换还是自动切换方式。
场景三、用户A使用手机与用户B进行视频通话,此时用户进入汽车,则可以将视频通话切换到车载终端上。
与场景二类似的,手机显示的界面上可以显示有切换控件,用户可以手动将视频通话切换到车载终端上。或者,手机检测到与车载终端建立连接后,自动将视频通话切换到车载终端上。
又或者,手机也可以智能的判断是否切换到车载终端上。例如:车载终端的摄像头采集到车内的人像为一个时,则可以将视频通话切换到车载终端上。若检测到车内的人像为多个时,为了保证用户的隐私,可不将视频通话切换到车载终端上或者询问用户是否切换到车载终端上。
上述场景二和场景三,是在切换时,同时将视频通话应用使用手机上的显示屏和摄像头等,切换为使用车载终端上的显示屏和摄像头。或者,反之。然而在实际的场景中,还存在一些只需要切换其中一个或几个的情况。例如:只切换摄像头不切换显示屏,或者只切换显示屏不切换摄像头。
场景四、用户A在汽车内使用车载终端与用户B进行视频通话,且使用车内的摄像头采集图像。若汽车外接有车外的摄像头,用户A要使用车外的摄像头采集车外的图像。
如图9所示,为手机和车载终端发现连接过程,且车载终端接入外接摄像头后,切换摄像头的过程的示意图。其中,手机和车载终端的发现连接过程与图8相同,不再赘述。当车载终端连接了外接摄像头后,车载终端的第三模块会将外接的摄像头的信息告知手机。手机的第一模块在第二模块中对该外接摄像头进行注册。后续,在车载终端检测到用户切换摄像头的指示(触摸显示屏相关控件、输入语音命令、按压中控盘上的物理按键等)后,该切换摄像头的指示将发送给手机中的视频通话应用。视频通话应用向车载终端发送关闭当前摄像头,打开需要切换的摄像头的指令。在另一个示例中,若切换摄像头的指示中没有明确切换到具体哪个摄像头,则视频通话应用可以根据已有摄像头循环切换。本申请实施例对此不做限定。
切换车载终端上其他硬件的方法与切换摄像头类似,不再赘述。
同理,切换手机上的硬件的方法也与切换车载终端上摄像头的方法类似,不再赘述。
场景五、用户A在汽车内使用车载终端与用户B进行视频通话,手机还可以获取车载终端中其他硬件的数据,例如传感器的数据。并根据车载终端的传感器数据进行相应的操作。
例如,图10为本申请实施例提供的又一种视频通话的方法的交互图。具体的,车载终端的传感器等可以实时检测汽车的行驶状态,例如车速、驾驶路段等。若车载终端的传感器检测到汽车的车速超过阈值,则将车速上报给车载终端的视频通话应用。在一些示例中,在车速过快时,为了保证驾驶安全,视频通话应用可以指示车载终端的显示屏关闭对端的画面,或者,视频通话应用直接结束视频通话。在另一些示例中,由于车速过快,可能会造成车载终端的摄像头采集的画面质量降低。故,当手机是视频通话应用接收到车速过快的消息后,也可以向车载终端的摄像头下发提高采集帧率等指令,以提高车载终端的摄像头采集的画面质量。
可以理解的是,本文是以手机上运行的视频通话应用在使用手机上硬件和使用车载终端上硬件之间切换为例进行说明的。可以理解的是,按照本申请实施例提供的方 法,手机上运行的其他应用也可以实现使用手机上的硬件和使用车载终端上硬件之间的任意切换。本申请实施例不再一一赘述。
本申请实施例还提供一种芯片系统,如图11所示,该芯片系统包括至少一个处理器1101和至少一个接口电路1102。处理器1101和接口电路1102可通过线路互联。例如,接口电路1102可用于从其它装置(例如移动终端100的存储器)接收信号。又例如,接口电路1102可用于向其它装置(例如处理器1101)发送信号。示例性的,接口电路1102可读取存储器中存储的指令,并将该指令发送给处理器1101。当所述指令被处理器1101执行时,可使得电子设备执行上述实施例中的移动终端100(比如,手机)执行的各个步骤。当然,该芯片系统还可以包含其他分立器件,本申请实施例对此不作具体限定。
本申请实施例还提供一种芯片系统,如图12所示,该芯片系统包括至少一个处理器1201和至少一个接口电路1202。处理器1201和接口电路1202可通过线路互联。例如,接口电路1202可用于从其它装置(例如车载终端200的存储器)接收信号。又例如,接口电路1202可用于向其它装置(例如处理器1201)发送信号。示例性的,接口电路1202可读取存储器中存储的指令,并将该指令发送给处理器1201。当所述指令被处理器1201执行时,可使得电子设备执行上述实施例中的车载终端200执行的各个步骤。当然,该芯片系统还可以包含其他分立器件,本申请实施例对此不作具体限定。
可以理解的是,上述终端等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明实施例的范围。
本申请实施例可以根据上述方法示例对上述终端等进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本发明实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方 案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (20)

  1. 一种视频通话的方法,其特征在于,应用于移动终端和车载终端,所述车载终端包括一个或多个显示屏,以及一个或多个摄像头,所述方法包括:
    所述移动终端和所述车载终端建立通信连接;
    所述移动终端接收所述车载终端发送的第一信息,所述第一信息为第一用户在所述车载终端上发起与第二用户视频通话的指示;
    响应于所述第一信息,所述移动终端与所述第二用户的终端建立视频通话连接,接收所述第二用户的视频数据;
    所述移动终端向所述车载终端发送所述第二用户的视频数据,向所述第二用户的终端发送所述车载终端的摄像头采集的所述第一用户的视频数据。
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    在所述移动终端接收到所述车载终端发送的所述第一信息之后,或者,在所述移动终端与所述第二用户的终端建立视频通话之后,所述移动终端接收所述车载终端发送的所述车载终端的摄像头采集的所述第一用户的视频数据。
  3. 根据权利要求2所述的方法,其特征在于,所述移动终端向所述车载终端发送所述第二用户的视频数据,具体为:
    所述移动终端根据所述第二用户的视频数据,以及所述车载终端的摄像头采集的所述第一用户的视频数据绘制第一界面,并将所述第一界面发送给所述车载终端;其中,所述第一界面包括所述第一用户的视频数据,以及所述车载终端的摄像头采集的所述第二用户的视频数据。
  4. 根据权利要求1-3任一项所述的方法,其特征在于,在所述移动终端接收所述车载终端发送的第一信息之前,所述方法还包括:
    所述移动终端接收所述车载终端发送的第二信息,所述第二信息包括所述车载终端的显示屏的参数,以及所述车载终端的摄像头的参数;
    所述移动终端根据所述第二信息对所述车载终端的显示屏和所述车载终端的摄像头进行注册。
  5. 根据权利要求4所述的方法,其特征在于,所述车载终端通过蓝牙低功耗BLE传输所述第二信息给所述移动终端。
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述方法还包括:
    在所述移动终端接收所述车载终端发送的第一信息之后,或者,在所述移动终端与所述第二用户的终端的建立视频通话连接之后,所述移动终端确定是否注册了所述车载终端的摄像头;
    若确定注册了所述车载终端的摄像头,则所述移动终端向所述车载终端发送打开所述车载终端的摄像头的指示。
  7. 根据权利要求1-6任一项所述的方法,其特征在于,所述方法还包括:
    所述移动终端接收所述车载终端发送的第三信息,所述第三信息为所述第一用户指示切换到所述移动终端的摄像头和显示屏的操作;或者,所述移动终端检测到所述移动终端与所述车载终端断开通信连接;
    所述移动终端的显示屏显示所述第二用户的视频数据,以及所述移动终端的摄像 头采集到的所述第一用户的视频数据。
  8. 根据权利要求1-7任一项所述的方法,其特征在于,所述方法还包括:
    所述移动终端接收所述车载终端发送的第四信息,所述第四信息为所述第一用户指示将当前摄像头切换到所述车载终端的另一个摄像头;
    所述移动终端指示所述车载终端关闭当前摄像头,以及打开所述车载终端的另一个摄像头;
    所述移动终端接收所述车载终端的另一个摄像头采集的所述第一用户的视频数据;
    所述移动终端向所述车载终端发送所述第二用户的视频数据,以及所述车载终端的另一个摄像头采集的所述第一用户的视频数据。
  9. 根据权利要求1-8任一项所述的方法,其特征在于,所述方法还包括:
    所述移动终端接收所述车载终端发送的第五信息,所述第五信息为所述第一用户指示将当前摄像头切换到所述移动终端的摄像头;
    所述移动终端指示所述车载终端关闭当前摄像头,并打开所述移动终端的摄像头;
    所述移动终端的摄像头采集的所述第一用户的视频数据;
    所述移动终端向所述车载终端发送所述第二用户的视频数据,以及所述移动终端的摄像头采集的所述第一用户的视频数据。
  10. 根据权利要求1-9任一项所述的方法,其特征在于,所述方法还包括:
    在所述移动终端和所述车载终端断开通信连接时,所述移动终端对所述车载终端的显示屏和所述车载终端的摄像头进行注销。
  11. 一种视频通话的方法,其特征在于,应用于移动终端和车载终端,所述车载终端包括一个或多个显示屏,以及一个或多个摄像头,所述方法包括:
    所述移动终端和所述车载终端建立通信连接;
    所述移动终端接收第二用户的终端发送的视频通话请求;
    所述移动终端接所述第二用户的终端发送的所述第二用户的视频数据,以及接收所述车载终端的摄像头采集的第一用户的视频数据;
    所述移动终端向所述车载终端发送所述第二用户的视频数据,向所述第二用户的终端发送所述车载终端的摄像头采集的所述第一用户的视频数据。
  12. 根据权利要求11所述的方法,其特征在于,所述移动终端向所述车载终端发送所述第二用户的视频数据,具体为:
    所述移动终端根据所述第二用户的视频数据,以及所述车载终端的摄像头采集的所述第一用户的视频数据绘制第一界面,并将所述第一界面发送给所述车载终端;其中,所述第一界面包括所述第一用户的视频数据,以及所述车载终端的摄像头采集的所述第二用户的视频数据。
  13. 根据权利要求11或12所述的方法,其特征在于,在所述移动终端与所述第二用户的终端建立视频通话连接之后,所述方法还包括:
    若所述移动终端注册了所述车载终端的摄像头,则向所述车载终端发送打开所述车载终端的摄像头的指示。
  14. 根据权利要求11-13任一项所述的方法,其特征在于,在所述移动终端和所述第二用户的终端建立视频通话连接之前,所述方法还包括:
    所述移动终端接收所述车载终端发送的第一信息,所述第一信息包括所述车载终端的显示屏的参数,以及所述车载终端的摄像头的参数;
    所述移动终端根据所述第一信息对所述车载终端的显示屏和所述车载终端的摄像头进行注册。
  15. 根据权利要求14所述的方法,其特征在于,所述车载终端通过蓝牙低功耗BLE传输所述第一信息给所述移动终端。
  16. 根据权利要求11-15任一项所述的方法,其特征在于,所述方法还包括:
    所述移动终端接收所述车载终端发送的第二信息,所述第二信息为所述第一用户指示切换到所述移动终端的摄像头和显示屏的操作;或者,所述移动终端检测到所述移动终端与所述车载终端断开通信连接;
    所述移动终端的显示屏显示所述第二用户的视频数据,以及所述移动终端的摄像头采集到的所述第一用户的视频数据。
  17. 根据权利要求16所述的方法,其特征在于,在所述移动终端的显示屏显示所述第二用户的视频数据,以及所述移动终端的摄像头采集到的所述第一用户的视频数据之后,所述方法还包括:
    所述移动终端接收到第三信息,所述第三信息为所述第一用户指示切换到所述车载终端的摄像头和显示屏的操作,或者,所述移动终端检测到所述移动终端连接到所述车载终端;
    若所述移动终端确定注册了所述车载终端的摄像头,则向所述车载终端发送打开所述车载终端的摄像头的指示;
    所述移动终端向所述车载终端发送所述第二用户的视频数据,以及所述车载终端的摄像头采集的所述第一用户的视频数据。
  18. 一种电子设备,其特征在于,包括:处理器、存储器和触摸屏,所述存储器、所述触摸屏与所述处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述处理器从所述存储器中读取所述计算机指令,以使得所述电子设备执行如权利要求1-10中任一项所述视频通话的方法,或执行如权利要求11-17中任一项所述视频通话的方法。
  19. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在终端上运行时,使得所述终端执行如权利要求1-10中任一项所述视频通话的方法,或执行如权利要求11-17中任一项所述视频通话的方法。
  20. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-10中任一项所述视频通话的方法,或执行如权利要求11-17中任一项所述视频通话的方法。
PCT/CN2020/102803 2019-09-18 2020-07-17 一种视频通话的方法及电子设备 WO2021051989A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910883084.0A CN110769394B (zh) 2019-09-18 2019-09-18 一种视频通话的方法及电子设备
CN201910883084.0 2019-09-18

Publications (1)

Publication Number Publication Date
WO2021051989A1 true WO2021051989A1 (zh) 2021-03-25

Family

ID=69330095

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/102803 WO2021051989A1 (zh) 2019-09-18 2020-07-17 一种视频通话的方法及电子设备

Country Status (2)

Country Link
CN (2) CN114071423A (zh)
WO (1) WO2021051989A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113099420A (zh) * 2021-04-02 2021-07-09 湖南汽车工程职业学院 一种智能连接app的车载辅流数据传输系统
CN115314584A (zh) * 2021-05-07 2022-11-08 华为技术有限公司 一种音频播放方法、装置和设备
CN115442468A (zh) * 2022-08-31 2022-12-06 重庆长安汽车股份有限公司 一种语音通话切换方法及装置、设备和介质
CN115529381A (zh) * 2021-06-25 2022-12-27 博泰车联网科技(上海)股份有限公司 通话处理方法、装置、系统、电子设备及介质
WO2024051636A1 (zh) * 2022-09-06 2024-03-14 华为技术有限公司 视频通话交互方法、车辆和电子设备

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114071423A (zh) * 2019-09-18 2022-02-18 华为技术有限公司 一种视频通话的方法及电子设备
CN111447323B (zh) * 2020-03-20 2021-07-09 华为技术有限公司 一种应用显示接续方法及装置
CN111899545B (zh) * 2020-07-29 2021-11-16 Tcl通讯(宁波)有限公司 一种行车提醒方法、装置、存储介质及移动终端
CN114125352A (zh) * 2020-08-29 2022-03-01 华为技术有限公司 屏幕共享方法、电子设备及系统
CN112739593B (zh) * 2020-12-22 2022-09-09 华为技术有限公司 汽车的驻车制动系统、汽车及其控制方法
CN117692484A (zh) * 2021-01-25 2024-03-12 华为技术有限公司 一种移动终端和车载终端的交互方法、终端以及系统
CN114915747B (zh) * 2021-02-09 2024-05-03 华为技术有限公司 视频通话的方法、电子设备及可读存储介质
CN112995631A (zh) * 2021-03-19 2021-06-18 恒大新能源汽车投资控股集团有限公司 车辆信息处理系统及信息处理方法
CN115065799B (zh) * 2021-09-03 2023-05-16 荣耀终端有限公司 一种视频通话方法及电子设备
CN113923305B (zh) * 2021-12-14 2022-06-21 荣耀终端有限公司 一种多屏协同的通话方法、系统、终端及存储介质
CN114500716A (zh) * 2022-01-10 2022-05-13 荣耀终端有限公司 协同通话方法、装置、设备、存储介质和程序产品
CN115242994B (zh) * 2022-06-10 2023-07-18 荣耀终端有限公司 视频通话系统、方法和装置

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150019967A1 (en) * 2013-07-15 2015-01-15 BNC Systems Ltd. System and method for promoting connectivity between a mobile communication device and a vehicle touch screen
CN106341654A (zh) * 2016-08-30 2017-01-18 珠海格力节能环保制冷技术研究中心有限公司 一种车载摄像头控制装置、方法及车载摄像系统
CN106888312A (zh) * 2016-12-27 2017-06-23 比亚迪股份有限公司 车载终端的屏幕状态的切换方法和装置
CN108632560A (zh) * 2018-05-14 2018-10-09 聚好看科技股份有限公司 视频通话方法、装置及终端设备
CN109348419A (zh) * 2018-10-26 2019-02-15 中国联合网络通信集团有限公司 通话切换方法、车载终端以及核心网
CN109495845A (zh) * 2018-09-29 2019-03-19 百度在线网络技术(北京)有限公司 场景切换方法和设备
CN110138937A (zh) * 2019-05-07 2019-08-16 华为技术有限公司 一种通话方法、设备及系统
CN110769394A (zh) * 2019-09-18 2020-02-07 华为技术有限公司 一种视频通话的方法及电子设备

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4797903B2 (ja) * 2006-09-19 2011-10-19 ソニー株式会社 携帯電話及び携帯電話の制御方法
CN106911908A (zh) * 2015-12-23 2017-06-30 北汽福田汽车股份有限公司 车载聊天的方法、装置以及汽车
CN106210148A (zh) * 2016-09-13 2016-12-07 乐视控股(北京)有限公司 实时通话处理方法及装置
KR20180117262A (ko) * 2017-04-19 2018-10-29 최학균 자율주행 차에서의 인포테인먼트 소프트웨어를 표시하는 3차원적인 그래픽 유저 인터페이스
CN106953986A (zh) * 2017-04-20 2017-07-14 维沃移动通信有限公司 一种通话切换方法及移动终端
CN109766066B (zh) * 2018-12-29 2022-03-01 华为技术有限公司 一种消息处理的方法、相关装置及系统
CN112422874B (zh) * 2019-04-17 2022-06-24 荣耀终端有限公司 一种摄像头的控制方法及电子设备
CN110166820B (zh) * 2019-05-10 2021-04-09 华为技术有限公司 音视频的播放方法、终端及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150019967A1 (en) * 2013-07-15 2015-01-15 BNC Systems Ltd. System and method for promoting connectivity between a mobile communication device and a vehicle touch screen
CN106341654A (zh) * 2016-08-30 2017-01-18 珠海格力节能环保制冷技术研究中心有限公司 一种车载摄像头控制装置、方法及车载摄像系统
CN106888312A (zh) * 2016-12-27 2017-06-23 比亚迪股份有限公司 车载终端的屏幕状态的切换方法和装置
CN108632560A (zh) * 2018-05-14 2018-10-09 聚好看科技股份有限公司 视频通话方法、装置及终端设备
CN109495845A (zh) * 2018-09-29 2019-03-19 百度在线网络技术(北京)有限公司 场景切换方法和设备
CN109348419A (zh) * 2018-10-26 2019-02-15 中国联合网络通信集团有限公司 通话切换方法、车载终端以及核心网
CN110138937A (zh) * 2019-05-07 2019-08-16 华为技术有限公司 一种通话方法、设备及系统
CN110769394A (zh) * 2019-09-18 2020-02-07 华为技术有限公司 一种视频通话的方法及电子设备

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113099420A (zh) * 2021-04-02 2021-07-09 湖南汽车工程职业学院 一种智能连接app的车载辅流数据传输系统
CN113099420B (zh) * 2021-04-02 2022-04-08 湖南汽车工程职业学院 一种智能连接app的车载辅流数据传输系统
CN115314584A (zh) * 2021-05-07 2022-11-08 华为技术有限公司 一种音频播放方法、装置和设备
CN115529381A (zh) * 2021-06-25 2022-12-27 博泰车联网科技(上海)股份有限公司 通话处理方法、装置、系统、电子设备及介质
CN115529381B (zh) * 2021-06-25 2024-03-01 博泰车联网科技(上海)股份有限公司 通话处理方法、装置、系统、电子设备及介质
CN115442468A (zh) * 2022-08-31 2022-12-06 重庆长安汽车股份有限公司 一种语音通话切换方法及装置、设备和介质
CN115442468B (zh) * 2022-08-31 2023-08-29 重庆长安汽车股份有限公司 一种语音通话切换方法及装置、设备和介质
WO2024051636A1 (zh) * 2022-09-06 2024-03-14 华为技术有限公司 视频通话交互方法、车辆和电子设备

Also Published As

Publication number Publication date
CN114071423A (zh) 2022-02-18
CN110769394A (zh) 2020-02-07
CN110769394B (zh) 2021-10-01

Similar Documents

Publication Publication Date Title
WO2021051989A1 (zh) 一种视频通话的方法及电子设备
WO2020253719A1 (zh) 一种录屏方法及电子设备
CN112399390B (zh) 一种蓝牙回连的方法及相关装置
CN113438354B (zh) 数据传输方法、装置、电子设备和存储介质
WO2022033296A1 (zh) 蓝牙通信方法、可穿戴设备及系统
CN110602686B (zh) 一种使用远程sim模块的方法及电子设备
WO2021052204A1 (zh) 基于通讯录的设备发现方法、音视频通信方法及电子设备
US20230189366A1 (en) Bluetooth Communication Method, Terminal Device, and Computer-Readable Storage Medium
US20220353819A1 (en) Method for Reducing Power Consumption of Mobile Terminal and Mobile Terminal
CN113556479A (zh) 一种多应用共享摄像头的方法与电子设备
WO2021031865A1 (zh) 通话方法及装置
CN113472477B (zh) 无线通信系统及方法
CN114554000A (zh) 摄像头调用方法、系统及电子设备
WO2022170854A1 (zh) 视频通话的方法与相关设备
CN112335294A (zh) 一种紧急呼叫方法及用户终端
WO2021218544A1 (zh) 一种提供无线上网的系统、方法及电子设备
WO2021114950A1 (zh) 一种多路http通道复用的方法及终端
CN114928898A (zh) 建立基于WiFi直接连接的会话的方法和装置
CN114928900A (zh) 通过WiFi直接连接进行传输的方法和装置
WO2023051204A1 (zh) 跨设备连接方法、电子设备及存储介质
WO2022267917A1 (zh) 蓝牙通信方法及系统
WO2023025059A1 (zh) 一种通信系统及通信方法
CN114125805B (zh) 蓝牙回连方法及终端设备
CN115087134B (zh) 一种蓝牙连接的方法和电子设备
WO2024093703A1 (zh) 一种实例的管理方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20865361

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20865361

Country of ref document: EP

Kind code of ref document: A1