CN110769394A

CN110769394A - Video call method and electronic equipment

Info

Publication number: CN110769394A
Application number: CN201910883084.0A
Authority: CN
Inventors: 陶强; 高光远; 韩静
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-09-18
Filing date: 2019-09-18
Publication date: 2020-02-07
Anticipated expiration: 2039-09-18
Also published as: CN114071423A; WO2021051989A1; CN110769394B

Abstract

A video call method and electronic equipment relate to the technical field of communication, the video call can be freely switched between a mobile terminal and a vehicle-mounted terminal, different requirements of a user under various scenes are met, driving safety of the user can be guaranteed, and using experience of the user can be improved, and the method comprises the following steps: the mobile terminal and the vehicle-mounted terminal establish communication connection; the method comprises the steps that a mobile terminal receives first information sent by a vehicle-mounted terminal, wherein the first information is an instruction of a first user initiating a video call with a second user on the vehicle-mounted terminal; responding to the first information, the mobile terminal establishes video call connection with a terminal of a second user, and receives video data of the second user; the mobile terminal sends video data of a second user to the vehicle-mounted terminal, and sends video data of the first user collected by a camera of the vehicle-mounted terminal to the terminal of the second user.

Description

Video call method and electronic equipment

Technical Field

The present application relates to the field of communications technologies, and in particular, to a method for video call and an electronic device.

Background

At present, a user can conveniently use a mobile phone to carry out video call with other users and the like. However, when the user is in the car, the user still uses the mobile phone to make a video call, which is inconvenient and even unsafe.

Disclosure of Invention

According to the video call method and the electronic equipment, the video call can be freely switched between the mobile terminal and the vehicle-mounted terminal, different requirements of a user under various scenes are met, the driving safety of the user can be guaranteed, and the use experience of the user can be improved.

In a first aspect, a method for video call is provided, which is applied to a mobile terminal and a vehicle-mounted terminal, where the vehicle-mounted terminal includes one or more display screens and one or more cameras, and the method includes: the mobile terminal and the vehicle-mounted terminal establish communication connection; the method comprises the steps that a mobile terminal receives first information sent by a vehicle-mounted terminal, wherein the first information is an instruction of a first user initiating a video call with a second user on the vehicle-mounted terminal; responding to the first information, the mobile terminal establishes video call connection with a terminal of a second user, and receives video data of the second user; the mobile terminal sends video data of a second user to the vehicle-mounted terminal, and sends video data of the first user collected by a camera of the vehicle-mounted terminal to the terminal of the second user.

Because the first user opens the video call application on the vehicle-mounted terminal, the user is in the automobile, and the mobile terminal can display by default by using a screen of the vehicle-mounted terminal and acquire video information by using a camera of the vehicle-mounted terminal. That is to say, when the video call application of the mobile terminal calls the display driver to display, the virtual driver corresponding to the display screen of the vehicle-mounted terminal can be called, so that the interface drawn by the mobile terminal can be transmitted to the vehicle-mounted terminal to be displayed. Similarly, when the video call application of the mobile terminal calls the camera to drive and collect video information, the virtual drive corresponding to the camera of the vehicle-mounted terminal can be called, so that the vehicle-mounted terminal sends the video information collected by the camera of the vehicle-mounted terminal to the mobile terminal.

Therefore, when the first user is located in the automobile, the video call running on the mobile terminal can call the display screen of the vehicle-mounted terminal to display the picture of the second user, and the camera of the vehicle-mounted terminal can also be called to collect the picture of the second user, so that the hands of the user are released, the user can conveniently control the automobile, and the driving safety is improved.

Moreover, the whole video call is operated on the mobile terminal side, and the vehicle-mounted terminal side only needs to provide corresponding hardware capabilities, such as a display screen for displaying, a camera for collecting pictures, a microphone for collecting audio, playing audio and the like. Therefore, the method provided by the embodiment of the application has low requirements on the capability of the vehicle-mounted terminal system. For example, the in-vehicle terminal may not have the capability of connecting to a mobile communication network, the internet, or the like. The in-vehicle terminal may not be required to be able to run a video call application or the like. In other words, the embodiment of the application is applicable to most vehicle-mounted terminals.

In a possible implementation, the method further includes: after the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call with a terminal of a second user, the mobile terminal receives video data of the first user, which is sent by the vehicle-mounted terminal and collected by a camera of the vehicle-mounted terminal.

In a possible implementation, the method further includes: after the mobile terminal establishes a video call with a terminal of a second user, the mobile terminal receives video data of the second user, which is sent by the terminal of the second user; the mobile terminal sends video data of a second user to the vehicle-mounted terminal, and the specific steps are as follows: the mobile terminal draws a first interface according to the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; the first interface comprises video data of a first user and video data of a second user, wherein the video data of the second user are collected by a camera of the vehicle-mounted terminal.

In a possible implementation manner, before the mobile terminal receives the first information sent by the vehicle-mounted terminal, the method further includes: the mobile terminal receives second information sent by the vehicle-mounted terminal, wherein the second information comprises parameters of a display screen of the vehicle-mounted terminal and parameters of a camera of the vehicle-mounted terminal; and the mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the second information.

The registration process may be understood as the mobile terminal creating a virtual driver for each hardware of the in-vehicle terminal. Subsequently, when the application of the mobile terminal needs to call the hardware of the vehicle-mounted terminal, the data can be transmitted to the hardware of the vehicle-mounted terminal through the corresponding virtual drive. Therefore, the method for calling the hardware of the vehicle-mounted terminal by the mobile terminal is provided.

In one possible implementation, the vehicle-mounted terminal transmits the second information to the mobile terminal through the bluetooth low energy BLE.

In some embodiments of the application, after the vehicle-mounted terminal is turned on or the wireless connection function is turned on, the BLE broadcast message may be sent through the bluetooth low energy, so that the mobile terminal may scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal. The BLE broadcast message can carry the vehicle-mounted terminal identification and the vehicle-mounted terminal capability information. The vehicle-mounted terminal identifier may be, for example, a car model, and is used for identifying the vehicle-mounted terminal. The in-vehicle terminal capability information may include hardware capability information of the in-vehicle terminal, such as camera information, display screen information, audio information, GPS information, sensor information, and the like.

In a possible implementation, the method further includes: after the mobile terminal receives first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes video call connection with a terminal of a second user, the mobile terminal determines whether a camera of the vehicle-mounted terminal is registered; and if the camera of the vehicle-mounted terminal is determined to be registered, the mobile terminal sends an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

In a possible implementation, the method further includes: the mobile terminal receives third information sent by the vehicle-mounted terminal, wherein the third information is the operation of switching to a camera and a display screen of the mobile terminal instructed by the first user; or the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal; and the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

Therefore, in the process of video call, a user can freely switch the video call on the mobile terminal or the vehicle-mounted terminal, and different requirements under different scenes are met.

In a possible implementation, the method further includes: the mobile terminal receives fourth information sent by the vehicle-mounted terminal, wherein the fourth information is used for indicating that the current camera is switched to another camera of the vehicle-mounted terminal by the first user; the mobile terminal instructs the vehicle-mounted terminal to close the current camera and open another camera of the vehicle-mounted terminal; the mobile terminal receives video data of a first user, which is acquired by another camera of the vehicle-mounted terminal; and the mobile terminal sends the video data of the second user to the vehicle-mounted terminal and the video data of the first user, which is acquired by the other camera of the vehicle-mounted terminal.

Therefore, a user can switch among the multiple cameras of the vehicle-mounted terminal in the video call process, and different requirements under different scenes are met.

In a possible implementation, the method further includes: the mobile terminal receives fifth information sent by the vehicle-mounted terminal, wherein the fifth information is used for indicating that the current camera is switched to the camera of the mobile terminal by the first user; the mobile terminal instructs the vehicle-mounted terminal to close the current camera and open the camera of the mobile terminal; video data of a first user are collected by a camera of the mobile terminal; and the mobile terminal sends the video data of the second user to the vehicle-mounted terminal and the video data of the first user, which is acquired by the camera of the mobile terminal.

Therefore, in the process of video call, a user can switch from the camera of the vehicle-mounted terminal to the camera of the mobile terminal, and different requirements under different scenes are met.

In a possible implementation, the method further includes: and when the mobile terminal and the vehicle-mounted terminal are disconnected in communication, the mobile terminal logs off a display screen of the vehicle-mounted terminal and a camera of the vehicle-mounted terminal.

When the mobile terminal is disconnected from the vehicle-mounted terminal, the mobile terminal may log off the registered hardware of the vehicle-mounted terminal, for example, delete the virtual drive corresponding to the hardware of the vehicle-mounted terminal, or set the virtual drive corresponding to the hardware of the vehicle-mounted terminal as unavailable.

In a second aspect, a method for video call is provided, which is applied to a mobile terminal and a vehicle-mounted terminal, where the vehicle-mounted terminal includes one or more display screens and one or more cameras, and the method includes: the mobile terminal and the vehicle-mounted terminal establish communication connection; the mobile terminal receives a video call request sent by a terminal of a second user; the mobile terminal receives video data of a second user sent by the server and receives video data of a first user collected by a camera of the vehicle-mounted terminal; the mobile terminal sends video data of a second user to the vehicle-mounted terminal, and sends video data of the first user collected by a camera of the vehicle-mounted terminal to the terminal of the second user.

In a possible implementation manner, the sending, by the mobile terminal, the video data of the second user to the vehicle-mounted terminal specifically includes: the mobile terminal draws a first interface according to the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; the first interface comprises video data of a first user and video data of a second user, wherein the video data of the second user are collected by a camera of the vehicle-mounted terminal.

In one possible implementation, after the mobile terminal establishes the video call connection with the terminal of the second user, the method further includes: and if the mobile terminal registers the camera of the vehicle-mounted terminal, sending an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

In one possible implementation, before the mobile terminal and the terminal of the second user establish the video call connection, the method further includes: the mobile terminal receives first information sent by the vehicle-mounted terminal, wherein the first information comprises information of a display screen of the vehicle-mounted terminal and information of a camera of the vehicle-mounted terminal; and the mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the first information.

In one possible implementation, the vehicle-mounted terminal transmits the first information to the mobile terminal through the Bluetooth Low Energy (BLE).

In a possible implementation, the method further includes: the mobile terminal receives second information sent by the vehicle-mounted terminal, wherein the second information is the operation of indicating to switch to a camera and a display screen of the mobile terminal by a first user; or the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal; and the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

In a possible implementation manner, after the display screen of the mobile terminal displays the video data of the second user and the video data of the first user acquired by the camera of the mobile terminal, the method further includes: the mobile terminal receives three information, wherein the third information is the operation of indicating to switch to a camera and a display screen of the vehicle-mounted terminal by a first user, or the mobile terminal detects that the mobile terminal is connected to the vehicle-mounted terminal; if the mobile terminal determines that the camera of the vehicle-mounted terminal is registered, sending an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal; and the mobile terminal sends the video data of the second user received from the server and the video data of the first user collected by the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

In a third aspect, a method for video call is provided, which is applied to a mobile terminal and a vehicle-mounted terminal, where the vehicle-mounted terminal includes one or more display screens and one or more cameras, and the method includes: the vehicle-mounted terminal and the mobile terminal establish communication connection; the method comprises the steps that a vehicle-mounted terminal receives a first operation of a first user, wherein the first operation is used for indicating to establish a video call with a terminal of a second user; the method comprises the steps that a camera of a vehicle-mounted terminal collects video data of a first user and sends the video data of the first user to a mobile terminal, and the vehicle-mounted terminal receives video data of a second user sent by the mobile terminal and displays a video of the first user.

In a fourth aspect, an electronic device is provided, including: a processor, a memory and a touch screen, the memory and the touch screen being coupled to the processor, the memory being configured to store computer program code comprising computer instructions which, when read by the processor from the memory, cause the electronic device to perform the method as set forth in the above aspects and any one of its possible implementations.

In a fifth aspect, an apparatus is provided, where the apparatus is included in an electronic device, and the apparatus has a function of implementing the behavior of the vehicle-mounted terminal in any one of the foregoing aspects and possible implementation manners. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes at least one module or unit corresponding to the above functions. For example, a receiving module or unit, a displaying module or unit, an acquiring module or unit, and a transmitting module or unit, etc.

A sixth aspect provides a computer storage medium comprising computer instructions which, when run on a mobile terminal, cause the mobile terminal to perform the method as described in the above aspect and any one of its possible implementations.

A seventh aspect provides a computer program product for causing a computer to perform the method as described in the above aspects and any one of the possible implementations when the computer program product runs on the computer.

In an eighth aspect, a chip system is provided, which includes a processor, and when the processor executes the instructions, the processor executes the method as described in the above aspects and any one of the possible implementations.

Drawings

Fig. 1 is a schematic structural diagram of a communication system according to an embodiment of the present application;

fig. 2A is a first schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure;

fig. 2B is a schematic structural diagram of a mobile terminal according to an embodiment of the present application;

fig. 3A is a first schematic structural diagram of a vehicle-mounted terminal according to an embodiment of the present disclosure;

fig. 3B is a schematic structural diagram of a vehicle-mounted terminal according to an embodiment of the present application;

fig. 4 is a schematic flowchart of a method for video call according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a user interface of some mobile terminals provided by embodiments of the present application;

FIG. 6A is a schematic view of a user interface of some vehicle-mounted terminals according to an embodiment of the present disclosure;

FIG. 6B is a schematic view of user interfaces of further vehicle-mounted terminals according to an embodiment of the present disclosure;

fig. 7 is a schematic diagram illustrating a method for transmitting data between a vehicle-mounted terminal and a mobile phone according to an embodiment of the present application;

fig. 8 is a schematic flowchart of another video call method according to an embodiment of the present application;

fig. 9 is a schematic flowchart of another video call method according to an embodiment of the present application;

fig. 10 is a flowchart illustrating a further method for video call according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a chip system according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of another chip system according to an embodiment of the present disclosure.

Detailed Description

In the description of the embodiments of the present application, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

At present, video call applications can also be installed on some vehicle-mounted terminals. Thus, when the user is located in the automobile, the video call application on the in-vehicle terminal can be used. However, in some specific scenarios, the user experience of using only the video call application on the vehicle-mounted terminal or only the video call application on the mobile phone for video call is not good. For example, a user is using a mobile phone to perform a video call, and when the user enters a car, the user needs to hang up the video call on the mobile phone and reuse a video call application on the in-vehicle terminal to perform the video call. Or, the user is using the vehicle-mounted terminal to perform the video call, and when the user leaves the automobile, the user needs to hang up the video call on the vehicle-mounted terminal and reuse the video call application on the mobile phone to perform the call.

Therefore, the embodiment of the application provides a method for video call, so that a video call application running on a mobile phone can call hardware on a vehicle-mounted terminal connected with the mobile phone, for example, call a display screen of the vehicle-mounted terminal to display an interface of the video call, and also call a camera of the vehicle-mounted terminal to acquire a picture of a user. Certainly, the mobile phone can still call the display screen of the mobile phone to display the interface of the video call, and the camera of the mobile phone is used for collecting the picture of the user. In other words, the method provided by the embodiment of the application can realize that the video application on the mobile phone can freely call the camera of the mobile phone or the vehicle-mounted terminal to acquire the picture, and can freely call the display screen display interface of the mobile phone or the vehicle-mounted terminal, and the like. Furthermore, the ongoing video call can be freely switched between the mobile phone and the vehicle-mounted terminal, different requirements of the user in different scenes can be met, and the use experience of the user is improved.

As shown in fig. 1, which is a schematic structural diagram of a communication system provided in the embodiment of the present application, the method for video call provided in the embodiment of the present application can be applied to the communication system. Specifically, the communication system includes a mobile terminal 100 and a vehicle-mounted terminal 200.

The mobile terminal 100 and the in-vehicle terminal 200 may establish a communication connection in a wired or wireless manner. For example: a wired connection may be established with the mobile terminal 100 through a line through a USB interface on the in-vehicle terminal 200. Another example is: the wireless connection may be established via bluetooth or WLAN, etc.

In the application, when the user is located in the automobile (for example, the user is in a driving state or a parking state), the vehicle-mounted terminal 200 can be operated to control the application program (for example, the video call application) installed on the mobile terminal 100, so that the driving safety and the driving comfort of the application are improved. In some embodiments, the mobile terminal 100 may transmit an interface of the application to the in-vehicle terminal 200 to be displayed by the in-vehicle terminal 200. In some examples, parameters such as the size and resolution of the screen on the in-vehicle terminal 200 are different from those of the mobile terminal 100, and the mobile terminal 100 draws a special interface for the in-vehicle terminal 200. That is, the mobile terminal 100 may draw a specific interface for the in-vehicle terminal 200 according to the operation status of the application program, and transmit the drawn specific interface to the in-vehicle terminal 200 for display through the communication connection. Accordingly, the user may also manipulate the application program through the in-vehicle terminal 200. For example, the user may manipulate the application program by touching a control on a touch screen of the in-vehicle terminal 200, pressing a physical button on the in-vehicle terminal (including on a steering wheel), inputting a voice command through a microphone of the in-vehicle terminal, and the like.

In the present application, the in-vehicle terminal 200 may be understood as an external device of the mobile terminal 100. In other words, the mobile terminal 100 may call a screen of the in-vehicle terminal 200 to display an interface on which an application is running on the mobile terminal 100; the mobile terminal 100 may also call an image collected by a camera on the in-vehicle terminal 200 (including a camera externally connected to the in-vehicle terminal 200); the mobile terminal 100 may also call a microphone on the in-vehicle terminal 200 to collect voice, play voice, and so on. Of course, the mobile terminal 100 may call a sensor or the like connected to the in-vehicle terminal 200. The specific implementation of the mobile terminal 100 invoking hardware, peripheral devices, and the like on the in-vehicle terminal 200 will be described below, and will not be described here.

In some embodiments, the applications installed on the mobile terminal 100 may also correspond to one or more application servers 400. That is, the application program of the mobile terminal 100 communicates with the one or more application servers 400. For example: the application server may be a server of a video call application, may provide a video call function for the mobile terminal 100, and the like.

In particular, the mobile terminal 100 may establish a connection with the application server 400 through one or more networks 300. The network 300 may be a Local Area Network (LAN) or a Wide Area Network (WAN), such as the internet. The network 300 may be implemented using any known network communication protocol, which may be various wired or wireless communication protocols, such as ethernet, Universal Serial Bus (USB), FIREWIRE (FIREWIRE), any cellular communication protocol (e.g., 3G/4G/5G/future communication technology), bluetooth, wireless fidelity (Wi-Fi), NFC, or any other suitable communication protocol.

In some embodiments, the communication system may also include an electronic device 500. The electronic device 500 may also establish a communication connection with the application server 400 over one or more networks 300.

For example: the description will be given taking a video call application as an example. The video call application may be, for example, an instant messaging application (e.g., a wechat application) having a video call function, facetime (a type of video call software), and other applications having a video pass-through function. For example, user A may engage in a video call with user B (using electronic device 500) via a video call application on mobile terminal 100. That is, the mobile terminal 100 transmits the video of the user a to the electronic device 500 via the application server 400 for the user B to view. Correspondingly, the electronic device 500 may also send the video of the user B to the mobile terminal 100 via the application server 400 for the user a to watch.

When the user a is located in the automobile, the video call running on the mobile terminal 100 may call the display screen of the vehicle-mounted terminal 200 to display the picture of the user B, or call the camera of the vehicle-mounted terminal 200 to collect the picture of the user a, so that the hands of the user are released, and the user can conveniently operate and control the automobile. When the user a leaves the automobile, the video call running on the mobile terminal 100 may switch to use the display screen of the mobile terminal 100 to display the picture of the user B, and call the camera of the mobile terminal 100 to capture the picture of the user a. That is, the user can realize the switching of the video call from the vehicle-mounted terminal to the mobile terminal without hanging up the call. Similarly, when the user a enters the automobile, the video call running on the mobile terminal 100 may switch to use the display screen of the vehicle-mounted terminal 200 to display the picture of the user B, or call the camera of the vehicle-mounted terminal 200 to acquire the picture of the user a. That is, the user can realize the switching of the video call from the mobile terminal to the vehicle-mounted terminal without hanging up the call. Therefore, the video method provided by the embodiment of the application can meet different requirements of users in different scenes.

For example, the mobile terminal 100 may be, for example, a mobile phone, a tablet computer, a Personal Computer (PC), a Personal Digital Assistant (PDA), a smart watch, a netbook, a wearable electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, an in-vehicle device, a smart car, a smart audio, a robot, and the like, and the specific form of the mobile terminal 100 is not particularly limited in this application. The electronic device 500 may be the same as or different from the mobile terminal 100. The structure of the electronic device 500 may refer to the mobile terminal 100, and is not described in detail.

Fig. 2A shows a hardware configuration diagram of the mobile terminal 100.

The mobile terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the mobile terminal 100, and may also be used to transmit data between the mobile terminal 100 and peripheral devices. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

In some embodiments of the present application, the mobile terminal 100 may be connected to the in-vehicle terminal 200 through the USB interface 130 to enable data communication between the mobile terminal 100 and the in-vehicle terminal 200. Of course, the mobile terminal 100 may be connected to the in-vehicle terminal 200 through another interface, or the mobile terminal 100 may be connected to the in-vehicle terminal 200 through a wireless connection.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative, and is not limited to the structure of the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the mobile terminal 100. The charging management module 140 may also supply power to the mobile terminal through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the mobile terminal 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the mobile terminal 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the mobile terminal 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the mobile terminal 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments of the present application, the mobile terminal 100 may establish a wireless connection with the in-vehicle terminal 200 through the wireless communication module 160 and the antenna 2 to enable data communication between the mobile terminal 100 and the in-vehicle terminal 200.

In some embodiments, the antenna 1 of the mobile terminal 100 is coupled to the mobile communication module 150 and the antenna 2 is coupled to the wireless communication module 160 so that the mobile terminal 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou satellite navigation system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

In some embodiments of the present application, the mobile terminal 100 may establish a connection with the application server 400 through the mobile communication module 150 and the antenna 1 to enable data communication between the mobile terminal 100 and the application server 400.

The mobile terminal 100 implements a display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the mobile terminal 100 may include 1 or N display screens 194, with N being a positive integer greater than 1.

The mobile terminal 100 may implement a photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the mobile terminal 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the mobile terminal 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The mobile terminal 100 may support one or more video codecs. In this way, the mobile terminal 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU may implement applications such as intelligent recognition of the mobile terminal 100, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the mobile terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (e.g., audio data, a phonebook, etc.) created during use of the mobile terminal 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 110 executes various functional applications of the mobile terminal 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The mobile terminal 100 may implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The mobile terminal 100 may listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the mobile terminal 100 receives a call or voice information, it can receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking the user's mouth near the microphone 170C. The mobile terminal 100 may be provided with at least one microphone 170C. In other embodiments, the mobile terminal 100 may be provided with two microphones 170C to implement a noise reduction function in addition to collecting sound signals. In other embodiments, the mobile terminal 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The mobile terminal 100 may receive a key input, and generate a key signal input related to user setting and function control of the mobile terminal 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be attached to and detached from the mobile terminal 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The mobile terminal 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The mobile terminal 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the mobile terminal 100 employs eSIM, namely: an embedded SIM card. The eSIM card may be embedded in the mobile terminal 100 and may not be separated from the mobile terminal 100.

The software system of the mobile terminal 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of the mobile terminal 100.

Fig. 2B is a block diagram of a software configuration of the mobile terminal 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 2B, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.

In some embodiments of the present application, the application package further comprises a video call application having video call functionality, such as: WeChat applications, QQ applications, facetime, and the like. The video call application may be an application program preset on the mobile terminal 100, or may also be an application program downloaded by the user through an application market or in another manner, and the video call application is not limited in this embodiment of the present application.

Optionally, the application package may further include the first application. For example, a HiCar application (a software to which a mobile phone and a car terminal are connected). Specifically, the first application may draw a relevant interface where the mobile terminal 100 and the in-vehicle terminal 200 are connected, convert an application interface drawn by an application installed on the mobile terminal 100 into an interface displayed by the in-vehicle terminal 200, and the like. For example, a display desktop of the in-vehicle terminal 200 is drawn according to an application installed on the mobile terminal 100, and a card corresponding to all or part of the application installed on the mobile terminal 100 is included on the display desktop. For another example, when a video call application is running on the mobile terminal 100, the first application converts an application program interface (such as a video request interface, a video call interface, etc.) drawn by the video call application into an interface displayed by the in-vehicle terminal 200, and the like.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2B, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide a communication function of the mobile terminal 100. Such as management of call status (including on, off, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like. The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the mobile terminal vibrates, an indicator light flashes, and the like.

In some embodiments of the present application, the application framework layer may further include a first module for communicating with other devices (e.g., the in-vehicle terminal 200). The first module is specifically used for discovering the vehicle-mounted terminal 200 and connecting the vehicle-mounted terminal 200; data transmission with the in-vehicle terminal 200 (e.g., sending a graphical interface on the side of the in-vehicle terminal to the in-vehicle terminal 200, receiving image data captured by a camera of the in-vehicle terminal 200, receiving input of a user on the in-vehicle terminal 200), encoding and decoding data at the time of data transmission, and the like.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system. The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android. The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), and the like. The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

In this application, the kernel layer further includes a second module for managing external devices of the mobile terminal 100. The second module may be specifically used for managing hardware on the in-vehicle terminal 200 connected with the mobile terminal 100, such as: a screen, a camera, a microphone, and a sensor of the in-vehicle terminal 200.

Fig. 3A shows a hardware configuration diagram of the in-vehicle terminal 200.

The in-vehicle terminal 200 may include a processor 210, a memory 220, a wireless communication module 230, a speaker 240, a microphone 250, a display screen 260, a camera 270, a USB interface 280, a sensor module 290, and the like. The sensor module 290 may include a pressure sensor 290A, a magnetic sensor 290B, an acceleration sensor 290C, a temperature sensor 290D, a touch sensor 290E, an ambient light sensor 290F, a positioning system 290G, and the like.

Processor 210 may include one or more processing units, such as: the processor 210 may include an Electronic Control Unit (ECU), a telematics box (telematics box), and the like. The different processing units may be separate devices or may be integrated into one or more processors.

A memory may also be provided in processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 210. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 210, thereby increasing the efficiency of the system.

Memory 220 may be used to store computer-executable program code, including instructions. The internal memory 220 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, video data, etc.) created during use of the in-vehicle terminal 200, and the like. Further, the memory 220 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 210 executes various functional applications of the in-vehicle terminal 200 and data processing by executing instructions stored in the memory 220 and/or instructions stored in a memory provided in the processor.

The wireless communication module 230 may provide a solution for wireless communication applied on the in-vehicle terminal 200, including WLAN, such as Wi-Fi network, bluetooth, NFC, IR, etc. The wireless communication module 230 may be one or more devices integrating at least one communication processing module.

In some embodiments of the present application, the in-vehicle terminal 200 may establish a wireless communication connection with the mobile terminal 100 through the wireless communication module 230. Alternatively, the in-vehicle terminal 200 may establish a wired communication connection with the mobile terminal 100 through the USB interface 280, which is not limited in this embodiment.

The functions of the speaker 240, the microphone 250, the display screen 260, the camera 270 and other components can refer to the related descriptions in the mobile terminal 100, and are not described herein again.

It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the in-vehicle terminal 200. In other embodiments of the present application, the in-vehicle terminal 200 may include more or fewer components than those shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Fig. 3B shows a software configuration diagram of the in-vehicle terminal 200.

Illustratively, the software structure of the in-vehicle terminal 200 may include an application module, a control module, a man-machine interface module, a telematics module, an electronic control unit, and an operating system.

The application module is used for video entertainment in the vehicle, vehicle information display and the like. A control module may control operation of the vehicle and its components, such as controlling steering, throttle, braking, etc. The human-machine interface, also called human-machine interface, is a medium for interaction and information exchange between the in-vehicle terminal 200 and a user, and it implements conversion between an internal form of information and a human-acceptable form. The remote information processing module is mainly used for communicating with a background operating system/mobile phone APP to realize vehicle information display and control of the mobile phone APP. The electronic control unit is also called as a traveling computer, a vehicle-mounted computer, and the like, and is a special microcomputer controller for the automobile in terms of application.

In some embodiments of the present application, the in-vehicle terminal 200 further includes a third module for communicating with other electronic devices (e.g., the mobile terminal 100). It is understood that the third module may be a separate functional module, or may be a part of an existing module (for example, a telematics module), which is not limited in this embodiment of the present application.

The following takes the mobile terminal 100 as a mobile phone as an example, and details the technical solution provided by the embodiment of the present application with reference to a specific application scenario.

In the first scenario, a mobile phone is in communication connection with a vehicle-mounted terminal, a user A initiates a video call with a user B through the vehicle-mounted terminal, the mobile phone uses a camera of the vehicle-mounted terminal to acquire images, and a display screen of the vehicle-mounted terminal is used for displaying an interface.

As shown in fig. 4, a schematic flow diagram of a video call provided in an embodiment of the present application is provided, where the flow specifically includes:

s401, the vehicle-mounted terminal sends BLE broadcast messages, and the BLE broadcast messages carry vehicle-mounted terminal identification and vehicle-mounted terminal capacity information.

In some embodiments of the application, after the vehicle-mounted terminal is turned on or the wireless connection function is turned on, the BLE broadcast message may be sent through the bluetooth low energy, so that the mobile phone may scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal. The BLE broadcast message can carry the vehicle-mounted terminal identification and the vehicle-mounted terminal capability information. The vehicle-mounted terminal identifier may be, for example, a car model, and is used for identifying the vehicle-mounted terminal. The in-vehicle terminal capability information may include hardware capability information of the in-vehicle terminal, such as camera information, display screen information, audio information, GPS information, sensor information, and the like.

The BLE broadcast message may be in a format pre-agreed with the mobile phone. For example, the pre-agreed format may be: header + model: + vehicle type name + capacitypype + competency type + capacityvalue + competency parameter. The capability type may refer to hardware capabilities of a camera, audio, a display screen, a GPS, and the like of the vehicle-mounted terminal.

By way of example, an example of a capability type value is given as follows:

enum{

HICAR_CAPACITY_CAMERA_UNORM＝1，

HICAR_CAPACITY_AUDIO_UNORM＝2，

HICAR_CAPACITY_LCD_UNORM＝3，

HICAR_CAPACITY_GPS_UNORM＝4，

……

}

meaning that: when the capability type is a camera, the numerical value corresponding to the capability type in the broadcast message is 1; when the capability type is audio, the numerical value corresponding to the capability type in the broadcast message is 2; when the capability type is a display screen, the numerical value corresponding to the capability type in the broadcast message is 3; when the capability type is GPS, the value corresponding to the capability type in the broadcast message is 4, and so on. It is understood that the in-vehicle terminal may have multiple hardware of the same capability type, for example: the system is provided with a plurality of cameras, including a camera inside the automobile, a camera outside the automobile and the like. Then, the hardware under the power type may be numbered separately for distinction.

In some examples, the vehicle-mounted terminal may also be externally connected with some hardware through an interface. Then, the vehicle-mounted terminal may also carry capability information of the external hardware when broadcasting the message. For example: the vehicle-mounted terminal can be externally connected with a camera through a USB interface. Then, the BLE broadcast message sent by the vehicle-mounted terminal in this step also carries information of a camera externally connected to the vehicle-mounted terminal.

The capability parameter is a specific parameter corresponding to each capability type. Table one gives some examples of parameters corresponding to various capability types.

Watch 1

Serial number	Type of capability	Capability parameter
				1	Camera head	Resolution, acquisition frame rate, auto focus, zoom capability, etc
2	Display screen	Size, resolution, etc
			3	Microphone (CN)	Sampling rate, etc

In other embodiments of the present application, the vehicle-mounted terminal may also carry the vehicle-mounted terminal capability information after establishing a communication connection with the mobile phone, and notify the mobile phone of the capability of the vehicle-mounted terminal. That is, the BLE broadcast message sent by the vehicle terminal may carry the vehicle terminal identifier, but does not carry the vehicle terminal capability information.

Of course, considering information security, the BLE broadcast message is usually encrypted, and the mobile phone may perform corresponding decryption after receiving the BLE broadcast message.

In one specific implementation, a third module within the vehicle terminal may be used to collect information about the hardware capabilities of the vehicle terminal. For example, after the vehicle-mounted terminal is turned on or the wireless function is turned on, the third module may request each hardware of the vehicle-mounted terminal to report the capability information of the vehicle-mounted terminal. Or each hardware of the vehicle-mounted terminal actively reports the capability information of the vehicle-mounted terminal to the third module. And then, the vehicle-mounted terminal carries the capability information acquired by the third module in a BLE broadcast message for broadcasting. For another example, after the vehicle-mounted terminal establishes a communication connection with the mobile phone, the vehicle-mounted terminal collects the hardware capability information of the vehicle-mounted terminal and reports the hardware capability information to the mobile phone, so that the mobile phone can register the hardware capability of the vehicle-mounted terminal conveniently. Registration-related content will be described in detail below.

S402, the mobile phone performs Bluetooth scanning and displays a discovered equipment list. The vehicle-mounted terminal identification in the BLE broadcast message is displayed in the discovery equipment list.

In some embodiments, the cell phone opens the first application. The first application can display a prompt interface for prompting a user to manually start Bluetooth and WIFI functions. Or responding to the user to start the first application, and automatically starting the Bluetooth and WIFI functions by the mobile phone. The handset starts bluetooth scanning. After the BLE broadcast message is scanned and sent, the mobile phone analyzes the BLE broadcast message, obtains the vehicle-mounted terminal identification and the capability information of the vehicle-mounted terminal, and stores the vehicle-mounted terminal identification and the capability information of the vehicle-mounted terminal. The handset then displays a list of discovered bluetooth devices to prompt the user to select which bluetooth device to connect to. And the identifier of the vehicle-mounted terminal carried in the BLE broadcast message is displayed on the list of the Bluetooth equipment.

For example: an interface 501, shown in fig. 5 (1), is an example of a list of discovered bluetooth devices displayed for a cell phone. A list 502 of bluetooth devices is displayed on the interface 501. It can be seen that the mobile phone scans two bluetooth devices, namely 'general BuckonKewei for getting on the gasoline' and 'general ATS-L for getting on the gasoline'.

Optionally, the mobile phone may further register the hardware capability of the vehicle-mounted terminal according to the vehicle-mounted terminal capability information in the BLE broadcast message. The registration process can be understood as that the mobile phone creates a virtual driver for each hardware of the vehicle-mounted terminal. Subsequently, when the application of the mobile phone needs to call the hardware of the vehicle-mounted terminal, the data can be transmitted to the hardware of the vehicle-mounted terminal through the corresponding virtual drive. In a specific implementation, please refer to fig. 2B, when the first module of the mobile application framework layer finds the BLE broadcast message of the vehicle terminal, the registration of each hardware of the vehicle terminal may be requested from the second module of the kernel layer, that is, a virtual driver is created for each hardware of the vehicle terminal. For example: the system comprises a virtual camera drive corresponding to a camera of the vehicle-mounted terminal, a virtual audio drive corresponding to a microphone of the vehicle-mounted terminal, a virtual display drive corresponding to a display of the vehicle-mounted terminal, a sensor drive corresponding to a sensor of the vehicle-mounted terminal and the like. It should be noted that, after the mobile phone is disconnected from the vehicle-mounted terminal, the mobile phone may log off the registered hardware of the vehicle-mounted terminal, for example, delete the virtual driver corresponding to the hardware of the vehicle-mounted terminal, or set the virtual driver corresponding to the hardware of the vehicle-mounted terminal as unavailable.

Of course, the mobile phone may register the hardware capability of the in-vehicle terminal after the mobile phone establishes connection with the in-vehicle terminal, that is, after step S403. Therefore, the mobile phone can complete registration before calling the hardware of the vehicle-mounted terminal, and the registration time is not specifically limited in the embodiment of the application.

And S403, the mobile phone receives an instruction of connecting the vehicle-mounted terminal by the user (S403a), and the mobile phone establishes WIFI connection with the vehicle-mounted terminal (S403 b).

Illustratively, in response to the user selecting an operation of connecting "baxoncower for upper gas" on the interface 501 as shown in (1) in fig. 5, the mobile phone sends a connection command to the in-vehicle terminal corresponding to "baxoncower for upper gas". For example, the handset may send the command using the general attribute protocol (GATT) of BLE. The content of the command may be a command header (cmd command) + a handset identification (e.g., a handset name and/or International Mobile Equipment Identity (IMEI)); and the cmd command is used for opening the WIFI connection of the vehicle-mounted terminal. And after receiving the command, the vehicle-mounted terminal authenticates the mobile phone. And after the authentication is successful, executing the WIFI function, and initiating a WIFI connection request to the mobile phone. And the mobile phone receives the WIFI connection request, and then the mobile phone establishes WIFI connection with the vehicle-mounted terminal. Subsequently, the mobile phone and the vehicle-mounted terminal can be in data communication through the WIFI connection.

For example, after the mobile phone establishes a WIFI connection with the in-vehicle terminal, an interface 503 as shown in (2) in fig. 5 is displayed. It can be seen that the mobile phone is connected with the vehicle-mounted terminal corresponding to the "general purpose for getting on the gas" okuan. There may also be a setting control 504 on the interface 503 corresponding to "available for gasoline" for Buckowei. The user can make relevant settings through the settings control 504. For example, in response to the user clicking on settings control 504, the handset displays settings interface 505 as shown in (3) in fig. 5. The setting interface 505 includes a plurality of application icons, a control 506, a control 507, a control 508, and a control 509, which are displayed on the in-vehicle terminal. The user can adjust the sequencing of the application icons displayed on the vehicle-mounted terminal in a mode of pressing and dragging the application icons. The control 506 may be used to download a new HiCar application. The HiCar application here means an application displayed on the in-vehicle terminal. The application displayed on the in-vehicle terminal is an application already installed on the mobile phone. This is because these applications are actually running on the mobile phone, and the hardware required by these applications may be the hardware using the in-vehicle terminal. For example, the display screen of the in-vehicle terminal is used for displaying an interface, and the camera of the in-vehicle terminal is used for collecting images. Of course, the vehicle-mounted terminal may also be configured to receive an operation instruction of the user, for example, by touching a control of a display screen (usually a touch screen) of the vehicle-mounted terminal, or by collecting a voice command of the user through a microphone of the vehicle-mounted terminal, or by pressing a physical key on the vehicle-mounted terminal (including on a steering wheel). The control 507 may be used to start a function of the mobile phone wirelessly and automatically connecting to the vehicle-mounted terminal. Control 508 can be used to modify the vehicle name of the car. The control 509 can be used to release the binding relationship between the mobile phone and the vehicle-mounted terminal.

In a specific implementation manner, when discovering the BLE broadcast message of the vehicle terminal, the first module of the mobile phone determines whether the mobile phone is connected to the vehicle terminal for the first time. If the in-vehicle terminal is connected for the first time or if the wireless automatic connection function between the device and the in-vehicle terminal is not turned on although the in-vehicle terminal is not connected for the first time, a connection instruction of the user is waited. Optionally, the mobile phone may report to the first application, and the first application draws a prompt message to prompt the user whether to connect. And if receiving a connection instruction of the user, connecting the vehicle-mounted terminal. Otherwise, the vehicle-mounted terminal is not connected. If the mobile phone is not connected with the vehicle-mounted terminal for the first time and the user starts the wireless automatic connection function of the mobile phone and the vehicle-mounted terminal, the vehicle-mounted terminal is automatically connected. The first module reports the connection success message to the first application.

It should be further noted that, in the above steps S401 to S403, the mobile phone discovers the vehicle-mounted terminal through the bluetooth low energy, and establishes the WIFI connection with the vehicle-mounted terminal as an example. In other embodiments of the present application, the mobile phone may also be directly connected to the vehicle-mounted terminal through a data line of the USB interface, or the mobile phone may be directly connected to the vehicle-mounted terminal through WIFI, or the mobile phone may be connected to the vehicle-mounted terminal through classic bluetooth, or the like. The connection mode of the mobile phone and the vehicle-mounted terminal is not particularly limited in the embodiment of the application.

And S404, drawing an interface of the video call application of the vehicle-mounted terminal by the mobile phone, sending the interface to the vehicle-mounted terminal, and displaying the interface by the vehicle-mounted terminal.

In a specific implementation, after the first application of the mobile phone receives the message of successful connection sent by the application framework layer, the first application of the mobile phone may determine that the vehicle-mounted terminal has the display screen according to the acquired capability information of the vehicle-mounted terminal, and draw the desktop of the vehicle-mounted terminal according to the information of the display screen of the vehicle-mounted terminal, and send the desktop to the vehicle-mounted terminal for display by the vehicle-mounted terminal.

For example, the interface 601 shown in (1) in fig. 6A is an example of a desktop of the in-vehicle terminal. The interface 601 displays a shortcut menu bar 602, a status bar 603, and a plurality of application cards (e.g., video call cards 604). Wherein the quick menu bar 602 can be used to quickly enter a corresponding interface or application. The status bar 603 displays time, power, signals, and voice input boxes. The user can access each application through the application card on the desktop. Similarly, the vehicle-mounted terminal sends the received operation of the user on the application to the mobile phone, the corresponding application on the mobile phone responds, the next interface of the vehicle-mounted terminal is drawn, and the next interface is sent to the vehicle-mounted terminal for displaying.

For example, the description will be given by taking an example in which a user operates a video application on a mobile phone on a vehicle-mounted terminal.

In response to the user clicking the video call card 604 on the interface 601 shown in (1) in fig. 6A, the in-vehicle terminal transmits the user operation to the mobile phone. And starting the video call application by the mobile phone, drawing the next interface of the vehicle-mounted terminal, namely the interface of the video call application, and sending the next interface to the vehicle-mounted terminal. The interface 605 shown in (2) in fig. 6A is an example of an interface of one video call application displayed by the in-vehicle terminal.

S405, the vehicle-mounted terminal receives the operation that the user initiates the video call on the interface of the video call application (S405a), and sends the video call operation to the mobile phone (S405 b).

S406, the mobile phone sends a video call request to the server (S406a), and draws a video call interface of the vehicle-mounted terminal and sends the video call interface to the vehicle-mounted terminal for display (S406 b).

The server can be an application server for providing video call service for the mobile phone.

Next to the above example, the user selects Andy on the interface 605 shown in (2) in fig. 6A, that is, initiates a video call instruction to Andy, and the vehicle-mounted terminal sends the instruction to the mobile phone. After the mobile phone receives the information, on one hand, the mobile phone draws a video call interface of the vehicle-mounted terminal; on the other hand, the video call application of the mobile phone sends a video call request to the server. The video call request carries the identification of Andy. And the server sends a video call request to the terminal used by Andy according to the identifier of Andy. If Andy receives the video call request, the server returns a video call establishment event to the mobile phone, and then step S407 is executed. And if Andy refuses the video call request, the server returns a video call failure event to the mobile phone. And drawing a corresponding interface by the mobile phone, and displaying the corresponding interface by the vehicle-mounted terminal to inform a user.

For example, the interface 606 shown in (3) in fig. 6B is an example of a video call interface displayed by the in-vehicle terminal. The interface 606 displays a prompt box 607 and a preview box 608. Where prompt box 607 prompts "Andy … … being called". The preview frame 608 is used for displaying a picture acquired by the vehicle-mounted terminal camera. The interface 606 also displays a hang-up control 609 for hanging up the video call.

It should be noted that, in this embodiment, since the user opens the video call application on the vehicle-mounted terminal to indicate that the user is in the automobile, the mobile phone may default to use the screen of the vehicle-mounted terminal to display, and use the camera of the vehicle-mounted terminal to acquire the video information. That is to say, when the video call application of the mobile phone calls the display driver to display, the virtual driver corresponding to the display screen of the vehicle-mounted terminal can be called, so that the interface drawn by the mobile phone can be transmitted to the vehicle-mounted terminal to display. Similarly, when the video call application of the mobile phone calls the camera to drive and collect video information, the virtual drive corresponding to the camera of the vehicle-mounted terminal can be called, so that the vehicle-mounted terminal can send the video information collected by the camera of the vehicle-mounted terminal to the mobile phone.

In a specific implementation manner, after receiving the instruction of initiating the video call by the user, the video call application may also query whether the mobile phone is registered with the camera of the vehicle-mounted terminal from the second module. And if the fact that the vehicle-mounted terminal is registered to be provided with the camera is determined, the video call application sends a command for opening the camera to the vehicle-mounted terminal through the second module and the first module. And after receiving the command of opening the camera, the vehicle-mounted terminal opens the camera to collect pictures and returns the pictures to the video call application. In one example, after receiving an instruction that the vehicle-mounted terminal initiates a video call, the mobile phone may instruct the vehicle-mounted terminal to send a camera to be turned on, and start to collect a picture. In another example, after receiving the message that the video call connection is successful, the mobile phone may instruct the vehicle-mounted terminal to send a command to turn on the camera and start to capture the picture. If the fact that the vehicle-mounted terminal does not have the camera is determined, the video call application needs to call the camera of the mobile phone to acquire pictures.

And S407, the mobile phone receives the video call establishment message sent by the server (S407a), draws a video call interface of the vehicle-mounted terminal, sends the video call interface to the vehicle-mounted terminal and displays the video call interface by the vehicle-mounted terminal (S407 b).

For the above example, after Andy receives the video call request, the terminal of Andy collects the video information of Andy and sends the video information to the mobile phone through the server. And then the mobile phone draws an interface of the vehicle-mounted terminal according to the video information of Andy and sends the interface to the vehicle-mounted terminal for displaying. The video call interface of the vehicle-mounted terminal displays a video picture acquired by a camera of the vehicle-mounted terminal. For example: as shown in (4) of fig. 6B, the interface 610 is an interface of the video call displayed on the in-vehicle terminal after the video call is connected.

In the embodiment of the application, when the mobile phone and the vehicle-mounted terminal transmit application data (for example, video call application data), data transmission between a plurality of application programs (a first application and a video call application) is involved. A detailed description will be given here of a procedure for transmitting application data (e.g., video call application data) between the cellular phone and the in-vehicle terminal.

Fig. 7 is a schematic diagram of a system structure including a mobile phone and a vehicle-mounted terminal. The video call service of the mobile phone is a module for providing service for video call application of the mobile phone in a framework layer and a system library. The device driver comprises a driver that the video call application needs to call the related hardware of the mobile phone. Wherein, the first module includes: and the equipment discovery module is used for executing relevant functions of the mobile phone discovery vehicle-mounted terminal and the like. And the equipment management module is used for registering to the second module according to the received vehicle-mounted terminal hardware capability information reported by the vehicle-mounted terminal. The remote service module is used for sending data to the vehicle-mounted terminal, receiving the data of the vehicle-mounted terminal, encrypting and decrypting the data and the like. The codec is used to decode the received data, encode the transmitted data, and so on. The functions of the rest of the modules can be referred to the description of the relevant modules in fig. 2B. The modules at the vehicle-mounted terminal side can refer to the description of the relevant modules in fig. 3B.

The process of transmitting the application data to the mobile phone by the vehicle-mounted terminal is as follows: the third module of the vehicle-mounted terminal encodes and encrypts data (such as operation of a user on the vehicle-mounted terminal, pictures collected by a camera of the vehicle-mounted terminal, audio collected by a microphone and the like) to be transmitted, and transmits the encoded and encrypted data to the first module of the mobile phone through a connection link with the mobile phone. The first module in the mobile phone decrypts and decodes the received data, and determines that the data is data applied to the video call. The video call application is transmitted through the second module, the device driver and the video call service and processed by the video call application.

The process of transmitting the application data to the vehicle-mounted terminal by the mobile phone is as follows: the video call application sends data (a drawn application interface on the vehicle-mounted terminal side, data received from a server and the like) to the video call service, the device driver, the second module and the first module to the first application. The first application converts the application interface of the mobile phone side into the application interface of the vehicle-mounted terminal side, then the first module performs encryption, decryption and the like, and sends the communication link between the mobile phone and the vehicle-mounted terminal to the vehicle-mounted terminal. And a third module of the vehicle-mounted terminal decrypts and decodes the received data and displays the data.

For example, the transmitted application data is an operation in which the user initiates a video call on the in-vehicle terminal. Then, after the vehicle-mounted terminal transmits the application data to the first module of the mobile phone, the first module of the mobile phone determines that the application data is the operation of starting the video call, and then the application data is transmitted to the video call application through the second module, the device driver and the video call service. And the video call application sends a video call request to the server on one hand and draws a mobile phone side video call interface on the other hand. And the mobile phone sends the drawn video call interface of the mobile phone side to the first application through the video call service, the equipment driver, the second module and the first module. The first application converts the video call interface at the mobile phone side into a video call interface at the vehicle-mounted terminal side suitable for being displayed by the vehicle-mounted terminal, and the video call interface is sent to the vehicle-mounted terminal through the first module, the communication link between the mobile phone and the vehicle-mounted terminal and displayed by a display screen of the vehicle-mounted terminal.

The video call interface on the mobile phone side refers to a video call interface generally drawn by a video call application, and the interface is generally displayed on a display screen of the mobile phone. In the application, the video call application needs to have a display interface on the vehicle-mounted terminal. Therefore, in order to distinguish the interfaces displayed on the in-vehicle terminal, the interface displayed on the mobile phone is referred to as a display interface on the mobile phone side (for example, a mobile phone side video call interface). It should be noted that, in the embodiment of the present application, after the mobile phone and the vehicle-mounted terminal establish a connection and the vehicle-mounted terminal displays an interface of a video call, the mobile phone may not display an interface related to the video call.

It should be further noted that, in the present application, if the mobile phone and the vehicle-mounted terminal are connected through bluetooth, and the video call of the mobile phone is applied when the display screen on the vehicle-mounted terminal is used to display the interface, the screen projection method in the bluetooth protocol may also be used to transmit the interface data, that is, the mobile phone may directly call the display screen of the vehicle-mounted terminal through the bluetooth driver. When the video call of the mobile phone is applied to the microphone of the vehicle-mounted terminal, the audio data can also be transmitted by adopting an audio transmission method in a Bluetooth protocol, namely, the mobile phone can directly call the audio equipment of the vehicle-mounted terminal through the Bluetooth drive. However, it should be noted that there is no scheme that the mobile phone directly calls the camera of the vehicle-mounted terminal and transmits video data acquired by the camera of the vehicle-mounted terminal to the mobile phone at present. However, the technical scheme provided by the application can realize that the mobile phone calls the camera of the vehicle-mounted terminal to acquire the image.

Fig. 8 is a schematic diagram illustrating a connection discovery process and a video call service process of a mobile phone and a vehicle-mounted terminal. The schematic diagram shows the interaction among the modules in the mobile phone and the vehicle-mounted terminal. The specific interaction process is described in detail in the above embodiments, and is not described herein again.

Therefore, when the user A is located in the automobile, the video call running on the mobile phone can call the display screen of the vehicle-mounted terminal to display the picture of the user B (namely, the called party), and can also call the camera of the vehicle-mounted terminal to collect the picture of the user A (namely, the calling party), so that the two hands of the user are released, the user can conveniently control the automobile, and the driving safety is improved.

Moreover, the whole video call is operated on the mobile phone side, and the vehicle-mounted terminal side only needs to provide corresponding hardware capabilities, such as a display screen for displaying, a camera for collecting pictures, a microphone for collecting audio, playing audio and the like. Therefore, the method provided by the embodiment of the application has low requirements on the capability of the vehicle-mounted terminal system. For example, the in-vehicle terminal may not have the capability of connecting to a mobile communication network, the internet, or the like. The in-vehicle terminal may not be required to be able to run a video call application or the like. In other words, the embodiment of the application is applicable to most vehicle-mounted terminals.

In addition, the mobile phone side is mainly matched with the existing video call application through the first application, the first module, the second module and the like, and the video call is completed by calling the hardware of the vehicle-mounted terminal. That is, the method provided by the embodiment of the present application can call the hardware of the vehicle-mounted terminal to perform the video call without performing code modification on the video call application. Therefore, the embodiment of the application can be compatible with the video call application on the mobile phone.

In the application, the video call application running on the mobile phone can call the hardware (the camera, the display screen and the like) of the vehicle-mounted terminal, so that a user can realize video call (watch videos) on the vehicle-mounted terminal and acquire own pictures by using the camera of the vehicle-mounted terminal. Similarly, the video call application running on the mobile phone can still call the hardware of the mobile phone, that is, the user can still realize the video call on the mobile phone. Furthermore, in the process of video call, the user can freely switch the video call on the mobile phone or the vehicle-mounted terminal, so that different requirements under different scenes are met. The following respectively shows the case where the method provided by the embodiment of the present application is applied to other scenarios.

And in a second scene, the user A uses the vehicle-mounted terminal to carry out video call with the user B in the automobile, and at the moment, the user A needs to leave the automobile, and the video call is switched to the mobile phone.

In one embodiment, a switching control may be displayed on an interface displayed by the in-vehicle terminal, and the switching control may be used to instruct the video call application on the mobile phone to switch to a mode of calling a display screen and a camera (which may further include a microphone, an external camera, and the like) of the in-vehicle terminal, and to call the display screen and the camera, and the like of the mobile phone. Alternatively, the user may also switch via voice commands, or physical buttons on the steering wheel, etc. Namely, the user can manually switch the video call from the vehicle-mounted terminal to the mobile phone.

In another embodiment, when the user a leaves the automobile or closes the vehicle-mounted terminal, the connection between the mobile phone and the vehicle-mounted terminal is disconnected, and then the mobile phone automatically calls a display screen, a camera and the like of the mobile phone to perform video call. Namely, the mobile phone automatically switches the video call from the vehicle-mounted terminal to the mobile phone.

It can be understood that the user can set whether the mobile phone adopts a manual switching mode or an automatic switching mode.

And in the third scenario, the user A uses the mobile phone to carry out video call with the user B, and at the moment, the user enters the automobile, so that the video call can be switched to the vehicle-mounted terminal.

Similar to the second scenario, a switching control can be displayed on the interface displayed by the mobile phone, and the user can manually switch the video call to the vehicle-mounted terminal. Or after the mobile phone detects that the connection with the vehicle-mounted terminal is established, the video call is automatically switched to the vehicle-mounted terminal.

Or, the mobile phone can also intelligently judge whether to switch to the vehicle-mounted terminal. For example: when the camera of the vehicle-mounted terminal collects one portrait in the vehicle, the video call can be switched to the vehicle-mounted terminal. If a plurality of images in the vehicle are detected, in order to ensure the privacy of the user, the video call is not switched to the vehicle-mounted terminal or the user is asked whether to switch to the vehicle-mounted terminal.

The second scene and the third scene are the display screen and the camera on the mobile phone used by the video call application when switching, and are switched to the display screen and the camera on the vehicle-mounted terminal. Or vice versa. However, in practical scenarios, there are also some cases where only one or a few of them need to be switched. For example: only the camera is switched and the display screen is not switched, or only the display screen is switched and the camera is not switched.

And fourthly, carrying out video call between the user A and the user B by using the vehicle-mounted terminal in the automobile, and acquiring images by using a camera in the automobile. If the automobile is externally connected with a camera outside the automobile, the user A needs to use the camera outside the automobile to acquire images outside the automobile.

As shown in fig. 9, a schematic diagram of a process of switching a camera after a connection process is discovered between a mobile phone and a vehicle-mounted terminal and the vehicle-mounted terminal accesses an external camera. The process of discovering and connecting the mobile phone and the vehicle-mounted terminal is the same as that in fig. 8, and is not described again. When the vehicle-mounted terminal is connected with the external camera, the third module of the vehicle-mounted terminal can inform the mobile phone of the information of the external camera. And the first module of the mobile phone registers the external camera in the second module. Subsequently, after the vehicle-mounted terminal detects an instruction (such as touching a related control of a display screen, inputting a voice command, pressing a physical key on a central control panel, and the like) of the user for switching the camera, the instruction for switching the camera is sent to the video call application in the mobile phone. And the video call application sends an instruction for closing the current camera and opening the camera to be switched to the vehicle-mounted terminal. In another example, the video call application may cycle through existing cameras if the indication to switch cameras does not explicitly switch to which particular camera. The embodiment of the present application does not limit this.

The method for switching other hardware on the vehicle-mounted terminal is similar to the method for switching the camera, and is not repeated.

Similarly, the method for switching the hardware on the mobile phone is similar to the method for switching the camera on the vehicle-mounted terminal, and is not described again.

And in a fifth scene, the user A uses the vehicle-mounted terminal to carry out video call with the user B in the automobile, and the mobile phone can also acquire data of other hardware in the vehicle-mounted terminal, such as data of a sensor. And corresponding operation is carried out according to the sensor data of the vehicle-mounted terminal.

For example, fig. 10 is an interaction diagram of another video call method provided in an embodiment of the present application. Specifically, the sensors and the like of the in-vehicle terminal can detect the driving state of the automobile, such as the speed, the driving section and the like, in real time. And if the sensor of the vehicle-mounted terminal detects that the speed of the vehicle exceeds a threshold value, reporting the speed to the video call application of the vehicle-mounted terminal. In some examples, when the vehicle speed is too fast, in order to ensure driving safety, the video call application may instruct the display screen of the in-vehicle terminal to close the picture of the opposite terminal, or the video call application may directly end the video call. In other examples, the quality of the image captured by the camera of the in-vehicle terminal may be degraded due to the excessive speed of the vehicle. Therefore, when the mobile phone receives the message that the vehicle speed is too fast by the video call application, the mobile phone can also issue an instruction for improving the acquisition frame rate and the like to the camera of the vehicle-mounted terminal so as to improve the image quality acquired by the camera of the vehicle-mounted terminal.

It will be appreciated that the video call application running on the handset is described herein as an example of switching between using hardware on the handset and using hardware on the vehicle terminal. It can be understood that according to the method provided by the embodiment of the present application, other applications running on the mobile phone may also implement any switching between using hardware on the mobile phone and using hardware on the vehicle-mounted terminal. The embodiments of the present application are not described in detail.

Embodiments of the present application further provide a chip system, as shown in fig. 11, where the chip system includes at least one processor 1101 and at least one interface circuit 1102. The processor 1101 and the interface circuit 1102 may be interconnected by wires. For example, the interface circuit 1102 may be used to receive signals from other devices, such as a memory of the mobile terminal 100. As another example, the interface circuit 1102 may be used to send signals to other devices (e.g., the processor 1101). Illustratively, the interface circuit 1102 may read instructions stored in the memory and send the instructions to the processor 1101. The instructions, when executed by the processor 1101, may cause the electronic device to perform the various steps performed by the mobile terminal 100 (e.g., a cell phone) in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

An embodiment of the present application further provides a chip system, as shown in fig. 12, where the chip system includes at least one processor 1201 and at least one interface circuit 1202. The processor 1201 and the interface circuit 1202 may be interconnected by wires. For example, the interface circuit 1202 may be used to receive signals from other devices (e.g., a memory of the in-vehicle terminal 200). Also for example, the interface circuit 1202 may be used to send signals to other devices, such as the processor 1201. Illustratively, the interface circuit 1202 may read instructions stored in a memory and send the instructions to the processor 1201. The instructions, when executed by the processor 1201, may cause the electronic device to perform the various steps performed by the in-vehicle terminal 200 in the above-described embodiments. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

It is to be understood that the above-mentioned terminal and the like include hardware structures and/or software modules corresponding to the respective functions for realizing the above-mentioned functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.

In the embodiment of the present application, the terminal and the like may be divided into functional modules according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiment of the present invention is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.

Each functional unit in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or make a contribution to the prior art, or all or part of the technical solutions may be implemented in the form of a software product stored in a storage medium and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard drive, read only memory, random access memory, magnetic or optical disk, and the like.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for video call is applied to a mobile terminal and a vehicle-mounted terminal, wherein the vehicle-mounted terminal comprises one or more display screens and one or more cameras, and the method comprises the following steps:

the mobile terminal and the vehicle-mounted terminal establish communication connection;

the mobile terminal receives first information sent by the vehicle-mounted terminal, wherein the first information is an instruction of a first user initiating a video call with a second user on the vehicle-mounted terminal;

responding to the first information, the mobile terminal establishes video call connection with the terminal of the second user and receives video data of the second user;

and the mobile terminal sends the video data of the second user to the vehicle-mounted terminal and sends the video data of the first user, which is acquired by a camera of the vehicle-mounted terminal, to the terminal of the second user.

2. The method of claim 1, further comprising:

after the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives video data of the first user, which is sent by the vehicle-mounted terminal and collected by a camera of the vehicle-mounted terminal.

3. The method according to claim 2, wherein the sending, by the mobile terminal, the video data of the second user to the in-vehicle terminal specifically includes:

the mobile terminal draws a first interface according to the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; the first interface comprises video data of the first user and video data of the second user, wherein the video data of the second user are collected by a camera of the vehicle-mounted terminal.

4. The method according to any one of claims 1-3, wherein before the mobile terminal receives the first information sent by the in-vehicle terminal, the method further comprises:

the mobile terminal receives second information sent by the vehicle-mounted terminal, wherein the second information comprises parameters of a display screen of the vehicle-mounted terminal and parameters of a camera of the vehicle-mounted terminal;

and the mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the second information.

5. The method according to claim 4, wherein the in-vehicle terminal transmits the second information to the mobile terminal via Bluetooth Low Energy (BLE).

6. The method according to any one of claims 1-5, further comprising:

after the mobile terminal receives first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call connection with the terminal of the second user, the mobile terminal determines whether a camera of the vehicle-mounted terminal is registered;

and if the camera of the vehicle-mounted terminal is determined to be registered, the mobile terminal sends an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

7. The method according to any one of claims 1-6, further comprising:

the mobile terminal receives third information sent by the vehicle-mounted terminal, wherein the third information is the operation of indicating to switch to a camera and a display screen of the mobile terminal by the first user; or the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal in communication;

and the display screen of the mobile terminal displays the video data of the second user and the video data of the first user, which is acquired by the camera of the mobile terminal.

8. The method according to any one of claims 1-7, further comprising:

the mobile terminal receives fourth information sent by the vehicle-mounted terminal, wherein the fourth information indicates that the current camera is switched to another camera of the vehicle-mounted terminal for the first user;

the mobile terminal instructs the vehicle-mounted terminal to close the current camera and open another camera of the vehicle-mounted terminal;

the mobile terminal receives video data of the first user, which is acquired by another camera of the vehicle-mounted terminal;

and the mobile terminal sends the video data of the second user and the video data of the first user, which is acquired by another camera of the vehicle-mounted terminal, to the vehicle-mounted terminal.

9. The method according to any one of claims 1-8, further comprising:

the mobile terminal receives fifth information sent by the vehicle-mounted terminal, wherein the fifth information indicates that a current camera is switched to a camera of the mobile terminal for the first user;

the mobile terminal instructs the vehicle-mounted terminal to close the current camera and open the camera of the mobile terminal;

the video data of the first user are collected by a camera of the mobile terminal;

and the mobile terminal sends the video data of the second user and the video data of the first user collected by the camera of the mobile terminal to the vehicle-mounted terminal.

10. The method according to any one of claims 1-9, further comprising:

and when the mobile terminal and the vehicle-mounted terminal are disconnected in communication, the mobile terminal logs off a display screen of the vehicle-mounted terminal and a camera of the vehicle-mounted terminal.

11. A method for video call is applied to a mobile terminal and a vehicle-mounted terminal, wherein the vehicle-mounted terminal comprises one or more display screens and one or more cameras, and the method comprises the following steps:

the mobile terminal receives a video call request sent by a terminal of a second user;

the mobile terminal is connected with the video data of the second user sent by the terminal of the second user and receives the video data of the first user collected by the camera of the vehicle-mounted terminal;

12. The method according to claim 11, wherein the sending, by the mobile terminal, the video data of the second user to the in-vehicle terminal specifically includes:

13. The method according to claim 11 or 12, wherein after the mobile terminal establishes a video call connection with the terminal of the second user, the method further comprises:

and if the mobile terminal registers the camera of the vehicle-mounted terminal, sending an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

14. The method according to any of claims 11-13, wherein before the mobile terminal and the terminal of the second user establish a video call connection, the method further comprises:

the mobile terminal receives first information sent by the vehicle-mounted terminal, wherein the first information comprises parameters of a display screen of the vehicle-mounted terminal and parameters of a camera of the vehicle-mounted terminal;

and the mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the first information.

15. The method according to claim 14, wherein the in-vehicle terminal transmits the first information to the mobile terminal via Bluetooth Low Energy (BLE).

16. The method according to any one of claims 11-15, further comprising:

the mobile terminal receives second information sent by the vehicle-mounted terminal, wherein the second information is the operation of indicating to switch to a camera and a display screen of the mobile terminal by the first user; or the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal in communication;

17. The method of claim 16, wherein after the video data of the second user is displayed on the display screen of the mobile terminal and the video data of the first user is captured by the camera of the mobile terminal, the method further comprises:

the mobile terminal receives third information, wherein the third information is the operation of indicating to switch to a camera and a display screen of the vehicle-mounted terminal by the first user, or the mobile terminal detects that the mobile terminal is connected to the vehicle-mounted terminal;

if the mobile terminal determines that the camera of the vehicle-mounted terminal is registered, sending an instruction for opening the camera of the vehicle-mounted terminal to the vehicle-mounted terminal;

and the mobile terminal sends the video data of the second user and the video data of the first user acquired by the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

18. An electronic device, comprising: a processor, a memory and a touch screen, the memory and the touch screen being coupled to the processor, the memory for storing computer program code, the computer program code comprising computer instructions that, when read from the memory by the processor, cause the electronic device to perform the method of video telephony as claimed in any of claims 1-10 or to perform the method of video telephony as claimed in any of claims 11-17.

19. A computer storage medium comprising computer instructions which, when run on a terminal, cause the terminal to perform a method of video telephony as claimed in any of claims 1-10 or to perform a method of video telephony as claimed in any of claims 11-17.

20. A computer program product, which, when run on a computer, causes the computer to perform the method of video telephony as claimed in any one of claims 1 to 10, or to perform the method of video telephony as claimed in any one of claims 11 to 17.