WO2021023055A1 - Video call method - Google Patents

Abstract

The present application provides a video call method, applied to a first device having at least one camera. The first device establishes a video call with a second device by means of a camera and an application. Said method comprises: after a first device establishes a video call with a second device by means of a camera and an application, displaying, on an interaction interface for performing the video call, identification information of at least one third device that is in wireless connection with the first device and has a camera; when the first device detects a preset operation of a user acting on first identification information on the interaction interface, triggering at least one camera of a device corresponding to the first identification information to collect video data, the first identification information being one piece of identification information of the at least one third device having a camera; and the first device acquiring the video data collected by at least one camera of the device corresponding to the first identification information, and using the video data, collected by the at least one camera of a target device corresponding to the first identification information, for the video call.

Description

A method of video call

This application requires a Chinese patent application filed with the Chinese Patent Office on November 13, 2019, the application number is 201911108857.4, and the application name is "a method of video call", and on August 6, 2019, the Chinese patent application with the application number is 201910723119.4. The priority of the Chinese patent application titled "A method and mobile device for video calling", the entire content of which is incorporated into this application by reference.

Technical field

This application relates to the field of wireless communication, and in particular to a method of video call.

Background technique

With the popularization of various mobile devices, there are more and more scenarios in which applications on mobile devices (such as mobile phones) are used to make video calls with another mobile device. During a video call on a mobile device, the mobile device can only Use the image data or video data acquired by the camera of the mobile device. If the camera performance parameters of the mobile device are poor or the viewing angle is blocked due to obstructions, the mobile device can distinguish the video images during the video call. The rate is low and the visual range is small. This application provides a video call method, which uses other mobile devices that maintain a communication connection with the mobile device to make a video call, which can greatly improve user experience.

Summary of the invention

This application provides a video call method. The application program can obtain images acquired by the cameras of other devices, but the application program thinks that at least one camera of the first device is still being used, and the cameras of other devices are equivalent to the local With the virtual camera, the data can be switched from one camera to the camera of another device, and the application has no perception. A better viewing angle can be obtained through the camera of other devices, which improves the user experience.

The first aspect provides a video call method, which is applied to a first device with at least one camera. The first device uses at least one camera and an application to establish a video call with a second device. The first device and the The second device is installed with the application, the application has a video call function, and the method includes: after the first device establishes a video call with the second device using the at least one camera and the application, connecting The identification information of at least one third device that maintains a wireless connection with the first device and has a camera is displayed on the interactive interface for making a video call; the first device detects that the user acts on the interactive interface. During the preset operation of triggering at least one camera of the device corresponding to the first identification information to collect video data, the first identification information is one of the identification information of the at least one third device with the camera; The first device obtains the video data collected by the at least one camera of the device corresponding to the first identification information, and uses the video data collected by the at least one camera of the device corresponding to the first identification information for a video call. It should be understood that: "at least one third device" refers to one or more devices, and the one or more devices do not include the first device and the second device.

Wherein, the identification information may include an icon, icon and text, control, control or text, and this application does not limit its specific form.

The user can select any one of the multiple devices to obtain video data through the camera of the selected device. For example, when the device is one of at least one third device, the application can obtain the video data obtained by the camera of the device, but The application program considers that at least one camera of the first device is still being used, and the device’s camera is equivalent to the local virtual camera of the first device. Data is switched from the at least one camera of the first device to the device’s camera, but the application does not Perception, a better viewing angle can be obtained through the camera of an external device, which improves the user experience.

With reference to the first aspect, in some implementations of the first aspect, the method further includes: when the first device detects that a user has acted on a preset operation of the second identification information on the interactive interface, triggering the At least one camera of the device corresponding to the second identification information collects video data, where the second identification information is one of the identification information of the at least one third device with the camera; the first device acquires the second identification The video data collected by at least one camera of the device corresponding to the information is used, and the video data collected by the at least one camera of the device corresponding to the second identification information is used for a video call.

After the user can select the device corresponding to the first identification information among the multiple devices as the device for acquiring video data, the user can also select the device corresponding to the second identification information as the device for acquiring video data, so as to pass the status of the device corresponding to the second identification information. The camera obtains the video data. The camera of the device is equivalent to the local virtual camera of the first device, so that the data is switched from at least one camera of the first device to the camera of the device, and the application has no perception, and the camera of the external device can obtain more information. A good perspective improves the user experience.

With reference to the first aspect, in some implementations of the first aspect, the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and corresponds to the first identification information The video data collected by at least one camera of the device is used for the video call, including: the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and no longer obtains the video data of the first device. Video data collected by at least one camera, and the video data collected by at least one camera of the device corresponding to the first identification information is used for a video call; or, the first device obtains the information of the device corresponding to the first identification information Video data collected by at least one camera, and the video data collected by the at least one camera of the first device is acquired, and the video data collected by the at least one camera of the device corresponding to the first identification information is used for a video call; or, The first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and obtains the video data collected by the at least one camera of the first device, and assigns the first identification information to the The video data collected by the at least one camera of the device and the video data collected by the at least one camera of the first device are used for a video call.

According to the embodiment of the present application, after the user selects the device corresponding to the first identification information among the multiple devices as the device for acquiring video data, at least one camera of the first device can be reconfigured according to actual needs.

With reference to the first aspect, in some implementations of the first aspect, the first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and corresponds to the second identification information The video data collected by at least one camera of the device is used for the video call, including: the first device obtains the video data collected by the at least one camera of the device corresponding to the second identification information, and no longer obtains the video data of the first device At least one camera and the video data collected by at least one camera of the device corresponding to the first identification information, and use the video data collected by the at least one camera of the device corresponding to the second identification information for a video call; or The first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and obtains the at least one camera of the first device and the video data collected by the first identification information, and combines the first 2. The video data collected by at least one camera of the device corresponding to the identification information is used for video calls; or, the first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and obtains the first The video data collected by at least one camera of a device is not obtained by the video data collected by at least one camera of the device corresponding to the first identification information, and the at least one camera of the device corresponding to the second identification information and the first Video data collected by at least one camera of a device is used for video calls; or, the first device obtains video data collected by at least one camera of the device corresponding to the second identification information, and obtains the first identification information corresponding to the video data The video data collected by at least one camera of the device of the first device is not acquired, and the video data collected by the at least one camera of the first device is not obtained, and at least one camera of the device corresponding to the second identification information corresponds to the first identification information The video data collected by at least one camera of the device of the device is used for a video call; or, the first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and obtains the first device Video data collected by at least one camera of the device corresponding to the first identification information and at least one camera of the device corresponding to the first identification information, and at least one camera of the device corresponding to the first identification information and at least one of the device corresponding to the second identification information The video data collected by one camera and the video data collected by at least one camera of the first device are used for a video call.

According to the embodiment of the present application, after the user selects the device corresponding to the second identification information among the multiple devices to replace the device corresponding to the first identification information as the device for acquiring video data, the remaining cameras and devices can be configured according to actual needs.

With reference to the first aspect, in some implementations of the first aspect, before using the at least one camera of the device corresponding to the first identification information, the first device is configured according to the configuration parameter of the at least one camera of the first device. Configure at least one camera of the device corresponding to the identification information; and/or, before using the at least one camera of the device corresponding to the second identification information, perform configuration parameters on the at least one camera of the first device At least one camera of the device corresponding to the second identification information is configured.

According to the embodiment of the present application, the first device can configure the camera of the device according to at least one camera of the first device, so that the image obtained by the camera of the device can meet the requirements.

With reference to the first aspect, in some implementations of the first aspect, the interactive interface for performing a video call further includes third identification information of a fourth device that maintains a wireless connection with the first device and has at least one microphone; When the first device detects that the user acts on the preset operation of the third identification information on the interactive interface, it triggers the device corresponding to the third identification information to use at least one microphone to collect audio data; the first device acquires all The audio data collected by the at least one microphone of the device corresponding to the third identification information is used, and the audio data collected by the at least one microphone of the device corresponding to the third identification information is used for a video call.

With reference to the first aspect, in some implementations of the first aspect, the interactive interface for conducting a video call further includes a fourth identifier of a fifth device that maintains a wireless connection with the first device and has at least one speaker; When the first device detects that the user acts on the preset operation of the fourth identifier on the interactive interface, it sends the audio data received in the video call to the device corresponding to the fourth identifier, and triggers the fourth identifier The corresponding device plays the received audio data.

With reference to the first aspect, in some implementations of the first aspect, the interactive interface for conducting a video call further includes a sixth device that maintains a wireless connection with the first device and has at least one microphone and at least one speaker. Five identification; when the first device detects that the user acts on the preset operation of the fifth identification on the interactive interface, it triggers the device corresponding to the fifth identification to use at least one microphone to collect audio data and receive the video call The audio data is sent to the device corresponding to the fifth identifier, and the device corresponding to the fifth identifier is triggered to play the received audio data; the first device acquires at least one microphone of the device corresponding to the fifth identifier. And use the audio data collected by the at least one microphone for the video call.

With reference to the first aspect, in some implementations of the first aspect, the device maintaining the wireless connection with the first device is implemented through any one of the Bluetooth protocol, the Wi-Fi protocol, the NFC protocol, or the mobile communication protocol.

Among them, the mobile communication protocol may include 2G standard protocol, 3G standard protocol, 4G standard protocol, 5G standard protocol, 6G standard protocol or, 6G follow-up standard protocol, etc.

With reference to the first aspect, in some implementations of the first aspect, the first device obtains video data collected by at least one camera of the target device corresponding to the first identification information, and corresponds to the first identification information The video data collected by at least one camera of the target device is used for video calls, including: after the data transmission channel module of the first device receives the video data, it determines the resolution and resolution of the received video data according to the requirements of the application. The color space performs format conversion; the data switching module receives an acquisition request from at least one camera of the first device, and forwards the acquisition request to the data transmission channel module; the data transmission channel module will receive the first identification information from the The corresponding device receives video data and transmits it to the data switching module; the data switching module transmits the received video data collected by at least one camera of the device corresponding to the first identification information to the data return of the camera device session management module In the interface, the acquired video data collected by at least one camera of the device corresponding to the first identification information is returned to the application according to the original data return procedure.

A second aspect provides a method of shooting, which is applied to a first device, the first device having at least one camera, and the method includes: presenting identification information of each of a plurality of devices, and the plurality of devices The device includes a first device and at least one third device, the at least one third device is in communication connection with the first device, and each of the at least one third device has a camera; Identify the device; acquire and present the image taken by the device. It should be understood that: "at least one third device" refers to one or more devices, and the one or more devices do not include the first device.

The user can select the camera of any one of the multiple devices (for example, the third device) to obtain images. It should be understood that the third device is one of at least one third device, and the application inside the first device can obtain the image. The image obtained by the camera of the third device, but the application program thinks that at least one camera of the first device is still being used, and a better viewing angle can be obtained through the camera of the external device, which improves the user experience.

With reference to the second aspect, in some implementations of the second aspect, the acquiring and presenting the image captured by the device includes: sending a shooting instruction to the device; and receiving the image captured by the device according to the shooting instruction.

According to the embodiment of the present application, the first device may send a shooting instruction to the device according to the shooting demand of the application program being used, so that the device can shoot according to the demand.

With reference to the second aspect, in some implementations of the second aspect, the at least one third device is installed with a corresponding application, and the first device and the at least one third device respectively perform signaling interaction through the application And data transmission.

It should be understood that at least one third device is installed with the application, so that the first device and the at least one third device respectively use the application for signaling interaction and data transmission, and the transmission efficiency of the application is higher.

With reference to the second aspect, in some implementations of the second aspect, the presenting the identification information of each of the multiple devices includes: presenting the multiple devices on an interactive interface corresponding to the at least one camera The identification information of each device in.

In a scenario where the application is using at least one camera, such as a video call or shooting, the identification information of each of the multiple devices can be displayed in the interactive interface for the user to select, and the camera can be switched to improve user experience.

With reference to the second aspect, in some implementations of the second aspect, when the device is a third device among the at least one third device, the method further includes: according to the configuration of the at least one camera , Generate first configuration information; send the first configuration information to the device.

The first device can configure the camera of the device according to the at least one camera, so that the image obtained by the camera of the device can meet the requirements.

With reference to the second aspect, in some implementations of the second aspect, the method further includes: acquiring second configuration information, where the second configuration information is used to indicate the configuration of the camera of the device; The configuration of the at least one camera to generate the first configuration information includes: generating the first configuration information according to the configuration of the at least one camera and the second configuration information.

When the device is one of at least one third device, the second configuration information can be sent to the first device according to the capabilities of the device's camera, which can be used to indicate the configuration of the device's camera, and the first device can determine the device according to the second configuration information Therefore, the first device can generate the first configuration information for configuring the camera of the device according to the configuration of at least one camera and the second configuration information.

With reference to the second aspect, in some implementations of the second aspect, when the device is a third device among the at least one third device, the method further includes: presenting the image taken by the device When, turn off the at least one camera.

When the device is a third device among the at least one third device, when the image taken by the device is presented, at least one camera of the first device is turned off, which can reduce the power consumption of the first device.

With reference to the second aspect, in some implementations of the second aspect, the wireless connection is implemented through any one of a Bluetooth protocol, a wireless local area network Wi-Fi protocol, an NFC protocol, or a mobile communication protocol.

In a third aspect, the present application provides a mobile device, including: a touch screen, wherein the touch screen includes a touch-sensitive surface and a display; at least one camera; at least one processor; a memory; multiple application programs; and at least one program, The at least one program is stored in the memory, and the at least one program includes instructions, and when the instructions run on the first device, the first device executes the first aspect or the first aspect. The method of any one of the two aspects.

In a fourth aspect, a computer storage medium is provided. The computer storage medium stores computer-executable instructions. When called by the computer, the computer-executable instructions are used to make the computer execute the first aspect or The method of any one of the above second aspects.

In a fifth aspect, a graphical user interface system on an electronic device is provided. The electronic device has a display screen, a camera, a memory, and one or more processors, and the one or more processors are configured to execute The one or more computer programs in the memory, wherein the graphical user interface includes a graphical user interface displayed when the electronic device executes the method according to any one of the foregoing first aspect or the foregoing second aspect .

Description of the drawings

FIG. 1 is a schematic diagram of the architecture of a communication system applicable to an embodiment of the present application.

FIG. 2 is a schematic flowchart of a shooting method provided by an embodiment of the present application.

Fig. 3 is an interactive interface of a mobile device provided by an embodiment of the present application.

Fig. 4 is an interactive interface of a mobile device provided by an embodiment of the present application.

Fig. 5 is an interactive interface of a mobile device provided by an embodiment of the present application.

Fig. 6 is a schematic diagram of a software architecture of a first device provided by an embodiment of the present application.

FIG. 7 is a schematic diagram of interaction between modules of a first device according to an embodiment of the present application.

FIG. 8 is a schematic diagram of a switching principle provided by an embodiment of the present application.

FIG. 9 is a schematic diagram of the software architecture of another first device provided in an embodiment of the present application.

FIG. 10 is a schematic diagram of the interaction of various modules of another first device according to an embodiment of the present application.

FIG. 11 is a schematic diagram of another switching principle provided by an embodiment of the present application.

detailed description

The technical solution in this application will be described below in conjunction with the drawings.

The mobile device in the embodiment of the present application may be a mobile device with a camera such as a mobile phone, a tablet computer, a notebook computer, a smart bracelet, a smart watch, a smart helmet, a smart glasses, and a drone. Mobile devices can also be cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), and wireless communications Functional handheld devices, computing devices, or other processing devices connected to wireless modems, in-vehicle devices, mobile devices in 5G networks, or mobile devices in the public land mobile network (PLMN) that will evolve in the future. The application embodiment does not limit this.

Figure 1 is a schematic diagram of the architecture of a system suitable for an embodiment of the present application.

As shown in Figure 1, the system 100 can include at least one mobile device 101, which can be wirelessly connected to other mobile devices, and the other mobile devices can be mobile phones, drones, external cameras, computers, and wireless smart devices. Speakers, wireless players, wireless TVs, wireless large-screen devices or smart wearable devices, etc., among which wireless connection technologies include but are not limited to: including global system for mobile communications (GSM), general packet wireless services ( general packet radio service, GPRS, code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (time-division code division multiple access) access, TD-SCDMA), long term evolution (LTE), the fifth generation of mobile communication technology (English: 5th generation mobile networks or 5th generation wireless systems, referred to as 5G) global navigation satellite system (global navigation satellite system, GNSS) ), wireless local area networks (wireless local area networks, WLAN), wireless fidelity (Wi-Fi) networks, Bluetooth (Bluetooth, BT), frequency modulation (FM), near field communication technology (near field communication) , NFC), infrared technology (infrared, IR), etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

It should be understood that, in some specific cases, mobile devices may also communicate with each other in a wired manner.

The mobile device 101 may include a housing and a display screen, and the display screen is installed on the housing. The mobile device 101 also includes electronic components (not shown in the figure) arranged inside the casing. The electronic components include a processor, a camera, a flash, a microphone, a battery, etc., but are not limited thereto.

Optionally, the communication connection between the mobile device 101 and other mobile devices in a wireless communication mode may be achieved through any one of a Bluetooth protocol, a wireless local area network (Wireless Fidelity, Wi-Fi) protocol, and a mobile communication protocol.

Among them, the mobile communication protocol may include 2G standard protocol, 3G standard protocol, 4G standard protocol or 5G standard protocol, 6G standard protocol or 6G follow-up standard protocol, etc.

With the popularity of various mobile devices, there are more and more scenes of using applications on mobile devices (such as mobile phones) to shoot or make video calls with another mobile device. During the shooting or video calls on the mobile device, The mobile device can only use the image data or video data acquired by the camera of the mobile device. If the camera performance parameters of the mobile device are poor or the viewing angle is blocked due to obstacles, the mobile device will cause The lower resolution of the acquired image or the lower resolution of the video image during the video call and the smaller visual range will reduce the user experience. This application provides a video call method, which uses video data obtained by cameras of other mobile devices that maintain a wireless connection with the mobile device to conduct a video call, which can greatly improve user experience.

This application provides a video call method. When a mobile device obtains image data through a camera, the mobile device uses other mobile devices with cameras that are wirelessly connected to the mobile device to obtain image data, and obtain The data is applied to the application on the phone.

It should be understood that a video is a continuous image sequence, which is a multi-frame interconnected image, and is dynamic, also called a video stream. The video data described in the embodiments of this application may be pictures or videos taken in a mobile device. This application is not restricted.

Here, several usage scenarios of the technical solutions of the present application are listed, which are only examples and do not limit the use scenarios of the technical solutions of the present application.

Scene 1: Driving scene

In the driving scenario, the user is using the mobile phone to make a video call before getting into the car, enters the car cockpit, and starts driving, the user can place the mobile phone in the central control, the mobile phone camera cannot capture the face image, only voice calls, the user You can also fix the mobile phone near the steering wheel of the car, facing the front of the human face, but this may cause driving risks, and these operating experiences are not good enough.

In the future, some smart car driving dashboards have their own cameras. If the user’s mobile phone can be connected to the camera on the dashboard of the car wirelessly after entering the car, the mobile phone can directly use the camera on the dashboard of the car to obtain video data. While driving the car, there is no need to place or pick up the phone. The mobile phone uses the camera on the dashboard of the car for video calls. You can use the following methods. For example, when the mobile phone is in a video call, after the mobile phone establishes a connection with a camera in the car, the mobile phone automatically switches the front camera to the camera in the car. The camera, that is, the mobile phone uses the data collected by the camera in the car to make a video call; the mobile phone can also switch the camera after receiving the user's voice command, or after the mobile phone is connected with a camera in the car, the mobile phone displays on the video call interface The logo of the camera in the car. After the mobile phone detects that the user clicks on the logo of the camera in the car, the mobile phone will switch the front camera to the camera in the car, that is, the mobile phone uses the data collected by the camera in the car to make a video call. It should be understood that when the mobile phone and multiple cameras in the car (for example, the dashboard camera, and the camera of the driving recorder, etc.), the aforementioned three methods can also be used to select the camera for the video call. If the mobile phone automatically selects the camera, The mobile phone can determine which camera in the car to automatically switch according to the default setting, or the commonly used selection, or the last selection. Optionally, when the mobile phone detects that it enters the car, the mobile phone can automatically switch the camera, or switch the camera through the user's voice command, or manually switch on the interactive interface of the video call. The mobile phone application directly uses the camera of the dashboard to obtain images, so that the opposite end of the video call can also see the front view of the driver, which can provide users with a more friendly experience. The mobile phone can use the screen of the driving recorder when making a video call, and share the journey scenery for the peer user of the video call.

Scene 2: Home scene

Nowadays, there are a lot of electronic devices in the home, and different devices have their own advantages. For example, the viewing angle of the TV camera is relatively wide, the TV screen is large, the display is clear, and the sound playback and pickup effects of smart speakers are good. In mobile phone video, if there are many people in the family who want to participate in the video, if the mobile phone is held at this time, the viewing angle of the mobile phone camera is narrow, and multiple people may not be able to access the mobile phone video screen at the same time. If the mobile phone is placed far away, the mobile phone screen is smaller. If the video on the opposite side is unclear, if you can use the camera of the TV in the living room to get the video as the input of video data during the video call of the mobile phone application, then multiple people can sit on the sofa opposite to the TV and use the TV camera to make a video call , Display the mobile phone video screen on the TV screen, and project the mobile phone microphone/speaker data to the home smart speaker, which can provide a good home audio and video experience.

Scene 3: UAV scene

At present, the popularity of drones is becoming more and more common, but the videos taken by general drones can only cooperate with the applications of drone manufacturers. When the user releases the drone, the user watches through the corresponding application on the mobile phone. If the camera of the drone can be used when the application on the mobile phone is used for shooting, for example, the camera of the drone can be used to take a picture, it can provide a brand-new shooting embodiment, or when the application on the mobile phone makes a video call , The video screen shot by the drone camera is used instead of the video screen shot by the front camera of the mobile phone, so that the opposite end of the video call can see the video screen shot by the drone camera, which provides a brand new The flight video viewing experience provides a more real-time drone perspective.

In these scenarios, the mobile phone side is required to provide a universal external camera video stream acquisition solution, and at the same time, it is necessary to ensure that the video streams of other devices can be used without adapting and modifying the existing applications of the mobile phone, so as to facilitate the The use and promotion of the method requires that the application used for video calls does not need to be adapted when using external camera data.

Fig. 2 is a schematic flowchart of a video call method provided by an embodiment of the present application.

S101: The first device establishes a video call with the second device.

The technical solution of this application can be applied to a first device having at least one camera. The first device uses at least one camera and an application to establish a video call with a second device. The first device and the second device are both installed with the same application. With video call function.

It should be understood that the application is a video call application, or the application is an application with a video call function, such as WeChat.

S102: The first device displays identification information.

Wherein, the identification information may include an icon, icon and text, control, control or text, and this application does not limit its specific form.

After the first device uses the at least one camera and the application to establish a video call with the second device, the identification information of the at least one third device that maintains a wireless connection with the first device and has a camera is displayed on the interactive interface for the video call.

As shown in Figures 3 to 5, the first identification information can correspond to an external camera, the second identification information can correspond to a drone, and the third identification information can correspond to a wireless TV. Figure 3 is provided by an embodiment of the application. After the user selects the first identification information on the interactive interface of the mobile device, the external camera is used to obtain the image displayed on the interactive interface of the video call established by the first device and the second device. After the second identification information on the device interactive interface, the drone is used to obtain the image displayed on the interactive interface of the video call established by the first device and the second device. Figure 5 shows the user's choice of mobile device interaction provided by this embodiment of the application. After the third identification information on the interface, the wireless TV image is displayed on the interactive interface of the video call established by the first device and the second device. The third identification information can be hidden in the total identification information. Specific identification information is displayed after the information.

It should be understood that the first identification information, the second identification information, and the third identification information can be specific texts or special marks or menu buttons. The menu buttons require the user to click to display detailed options or display on other interactive interfaces, such as Shown in Figure 3 to Figure 5.

Optionally, on the video call interface of the first device as shown in FIG. 3 or FIG. 4, the selected identification information is highlighted relative to other identification information to remind the user of the device currently acquiring video data. In addition, among the multiple identification information displayed on the video call interface of the first device, in addition to the identification information of at least one third device that maintains a wireless connection with the first device, it also includes at least one camera of the first device (for example, displaying all front and back The identification information of the camera, or the identification information of some cameras).

Optionally, the way for the user to select the first identification information can be to click on the first identification information, or to select through a voice command, or it is detected that a device wirelessly connected to the first device has selected the identification information in the history, and it is automatically selected With regard to the identification information, this application does not limit the way for the user to select the first identification information.

S103: The first device determines first identification information.

When the first device detects that the user acts on the preset operation of the first identification information on the interactive interface, it triggers at least one camera of the device corresponding to the first identification information to collect video data, and the first identification information is at least one third device with a camera One of the identification information.

Optionally, the preset operation may be that the user clicks on the identification information, or the user voice instruction selects the identification information, or automatically selects the identification information according to the user's history.

S104: The first device obtains video data.

The first device obtains the video data collected by the at least one camera of the device corresponding to the first identification information, and uses the video data collected by the at least one camera of the device corresponding to the first identification information for a video call.

It should be understood that the user can select the camera of any one of the multiple devices (for example, a third device) to obtain video data. It should be understood that the third device is one of at least one third device, and the application program inside the first device The video data obtained by the camera of the third device can be obtained, but the application program thinks that at least one camera of the first device is still being used. The camera of the third device is equivalent to the local virtual camera of the first device. Switching from the video data obtained by using the at least one camera of the first device to the video data obtained by using the camera of the third device device, and the application is unaware, a better viewing angle can be obtained through the camera of the external device, which improves the user experience.

Optionally, after the first device obtains the video data collected by the at least one camera of the device corresponding to the first identification information, it will no longer obtain the video data collected by the at least one camera of the first device, and the device corresponding to the first identification information The video data collected by at least one camera is used for the video call, that is, the video data collected by the first device directly through the external device, and the video data collected by the external camera is used for the video call.

Optionally, the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and obtains the video data collected by at least one camera of the first device, and compares at least one of the devices corresponding to the first identification information The video data collected by the camera is used for the video call, that is, the first device simultaneously obtains the video data collected by the local camera and the external device head, and uses the video data collected by the external camera for the video call.

Optionally, the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and obtains the video data collected by at least one camera of the first device, and compares at least one of the devices corresponding to the first identification information The video data collected by the camera and the video data collected by at least one camera of the first device are used for the video call, that is, the first device simultaneously obtains the video data collected by the local camera and the external device head, and combines the video data collected by the local camera and the external camera Used for video calls.

Optionally, the video call method may further include: when the first device detects that the user performs a preset operation on the second identification information on the interactive interface, triggering at least one camera of the device corresponding to the second identification information to collect video data, and The second identification information is one of the identification information of at least one third device with a camera. The first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and compares the Video data collected by a camera is used for video calls. The user can select at least one camera of the device corresponding to other identification information to obtain the video data required for the video call, and can switch freely.

Optionally, the first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and no longer obtains the video data collected by the at least one camera of the first device and the first identification information, and sets the second identification The video data collected by at least one camera of the device corresponding to the information is used for the video call. After the user switches the external camera, the video data of the previously applied camera can no longer be obtained.

Optionally, the first device obtains video data collected by at least one camera of the device corresponding to the second identification information, and obtains the video data collected by at least one camera of the first device and the first identification information, and corresponds to the second identification information The video data collected by at least one camera of the device is used for video calls. After switching the external camera, the user can also obtain the video data of the previously applied camera, which can be stored in the memory or the cloud for later viewing.

Optionally, the first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and acquires video data collected by at least one camera of the first device, but does not acquire at least one of the devices corresponding to the first identification information The video data collected by the camera, and the video data collected by the at least one camera of the device corresponding to the second identification information and the at least one camera of the first device are used for the video call. After the user switches the external camera, the user may not obtain the video data of the previously applied external camera, but only obtain the video data of the local camera, which can be stored in the memory or the cloud for later viewing.

Optionally, the first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and acquires video data collected by at least one camera of the device corresponding to the first identification information, without acquiring at least one of the first device The video data collected by the camera, and the video data collected by at least one camera of the device corresponding to the second identification information and at least one camera of the device corresponding to the first identification information are used for the video call. After the user switches the external camera, it is not necessary to obtain the video data of the local camera, but only obtain the video data of the previously applied external camera, which can be stored in the memory or the cloud for later viewing.

Optionally, the first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and acquires video data collected by at least one camera of the first device and at least one camera of the device corresponding to the first identification information, The video data collected by the at least one camera of the device corresponding to the first identification information and the at least one camera of the device corresponding to the second identification information and the video data collected by the at least one camera of the first device are used for the video call.

Optionally, before the application uses the at least one camera of the device corresponding to the first identification information, the first device may configure the at least one camera of the device corresponding to the first identification information according to the configuration parameters of the at least one camera of the first device .

Optionally, before the application uses the at least one camera of the device corresponding to the second identification information, the first device may configure the at least one camera of the device corresponding to the second identification information according to the configuration parameters of the at least one camera of the first device .

It should be understood that using the configuration parameters of the at least one camera of the first device to configure the at least one external camera can make the video data obtained by the external camera and the video data obtained by the local camera have the same format, for example, to facilitate related processing.

Optionally, the first device may further include third identification information of a fourth device that maintains a wireless connection with the first device and has at least one microphone on the interactive interface for the video call; the first device detects that the user acts on the interactive interface During the preset operation of the third identification information, the device corresponding to the third identification information is triggered to use at least one microphone to collect audio data; the first device acquires the audio data collected by the at least one microphone of the device corresponding to the third identification information, and then The audio data collected by at least one microphone of the device corresponding to the three identification information is used for the video call.

Optionally, the first device may further include a fourth identifier of the fifth device that maintains a wireless connection with the first device and has at least one speaker on the interactive interface for the video call; the first device detects that the user acts on the interactive interface During the preset operation of the fourth identifier, the audio data received in the video call is sent to the device corresponding to the fourth identifier, and the device corresponding to the fourth identifier is triggered to play the received audio data.

Users can also use an external microphone to collect audio data, or use an external speaker to play audio data in a video call.

Optionally, the first device may further include a fifth identifier of a sixth device that maintains a wireless connection with the first device and has at least one microphone and at least one speaker on the interactive interface for making a video call; the first device detects the user action During the preset operation of the fifth identifier on the interactive interface, the device corresponding to the fifth identifier is triggered to collect audio data using at least one microphone, and the audio data received in the video call is sent to the device corresponding to the fifth identifier, and the fifth identifier is triggered. The device corresponding to the identifier plays the received audio data; the first device acquires audio data collected by at least one microphone of the device corresponding to the fifth identifier, and uses the audio data collected by the at least one microphone for a video call.

Optionally, the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and uses the video data collected by the at least one camera of the device corresponding to the first identification information for the video call, including: The device acquires video data collected by at least one camera of the device corresponding to the first identification information, acquires video data collected by at least one camera of the first device, and stores the video data collected by at least one camera of the first device in the first device And use the video data collected by at least one camera of the device corresponding to the first identification information in the video call.

Optionally, the video data collected by the at least one camera of the first device can also be uploaded to the cloud server for storage for the user to query.

Optionally, this application also provides a method for taking pictures.

S201: The first device presents identification information of each of the multiple devices.

The first device has at least one camera, the multiple devices include the first device and at least one third device, at least one third device is wirelessly connected to the first device, and at least one third device has a camera.

Optionally, multiple pieces of identification information may be displayed on the interactive interface of the first device to indicate selectable devices.

Optionally, at least one third device is installed with a corresponding application. The application can be used for data transmission between the first device and the at least one third device. For example, the first device can send a shooting instruction or configuration to the third device. Information, etc., the third device may send the captured image or camera capability information to the first device.

Optionally, the first device may present the identification information of each of the multiple devices on the interactive interface corresponding to the at least one camera, that is, when the application of the first device calls at least one camera to obtain image data, The identification information is displayed on the interactive interface of the application program.

Optionally, the wireless connection is realized through any one of Bluetooth protocol, Wi-Fi protocol, NFC protocol or mobile communication protocol.

Among them, the mobile communication protocol may include 2G standard protocol, 3G standard protocol, 4G standard protocol or 5G standard protocol, 6G standard protocol or 6G follow-up standard protocol, etc.

S202: The first device responds to a user operation to determine a target device from multiple devices.

Optionally, when the user performs an operation on the identification information displayed on the interactive interface of the first device, the user may perform a preset operation. The preset operation may be that the user clicks on the identification information displayed on the interactive interface of the first device, or The user slides the identification information displayed on the interactive interface of the first device from left to right. The first device may store preset operations in advance, and when the user completes the preset operations, the target device is determined according to the user operations.

Optionally, the preset operation may be that the user clicks on the identification information, or the user voice instruction selects the identification information, or automatically selects the identification information according to the user's history.

Optionally, the first device may send a shooting instruction to the target device, and the first device may receive an image captured by the target device according to the shooting instruction, and the shooting instruction may instruct the target device to shoot time and other information.

Optionally, when the target device is a third device among at least one third device, the first device may generate first configuration information according to the configuration of the at least one camera, and send the first configuration information to the target device information.

Optionally, the first device may obtain second configuration information, the second configuration information is used to indicate the configuration of at least one camera of the target device, and the first device is generated according to the configuration of the at least one camera of the first device and the second configuration information. Configuration information.

S203: The first device acquires and presents an image taken by the target device.

Optionally, when the target device is a third device among the at least one third device, the first device turns off at least one camera of the first device when presenting an image taken by the target device.

Optionally, the multiple devices may further include at least one fourth device, at least one fourth device is wirelessly connected to the first device, and at least one fourth device has a microphone. When the user operates the identification information corresponding to the fourth device displayed on the interactive interface, the microphone of the corresponding fourth device can be triggered to acquire audio data, and the acquired audio data can be transmitted to the first device.

Optionally, the multiple devices may further include at least one fifth device, the at least one fifth device is wirelessly connected to the first device, and each of the at least one fifth device has a speaker. When the user performs an operation on the identification information corresponding to the fifth device displayed on the interactive interface, the audio data for the currently running application is sent to the corresponding fifth device, and the speaker of the corresponding fifth device is triggered to play Audio data.

Optionally, the multiple devices may also include at least one sixth device, at least one sixth device is wirelessly connected to the first device, and has at least one microphone and at least one speaker, and the first device detects that the user acts on the interactive interface. When the identification information of the sixth device is operated, the sixth device is triggered to collect audio data by using at least one microphone, send the received audio data to the speaker, and play the received audio data.

It should be understood that the data information obtained by the fourth device, the fifth device, and the sixth device can all be applied to the video call of the first device, and the fourth device, the fifth device, and the sixth device can respectively correspond to the third identification information, The fourth identification information and fifth identification information are not limited in this application.

Fig. 6 is a schematic diagram of a software architecture of a first device provided by an embodiment of the present application.

In this embodiment, an Android system is taken as an example. The layered architecture divides the software into several layers, and the layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer (FWK), the hardware abstraction layer (HAL), and the kernel layer (kernel).

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications at the application layer. The application framework layer includes some predefined functions.

The application framework layer can include window managers, content providers, view systems, resource managers, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.

The content provider is used to store and retrieve data and make these data accessible to applications. The data may include video, image, audio, phone calls made and received, browsing history and bookmarks, phone book, etc.

For example, in this application, the content controller can acquire the image acquired in the preview interface in real time, and display the processed image in the corresponding interactive interface of the application program.

The view system includes visual controls, such as controls that display text and controls that display pictures. The view system can be used to build applications. The display interface can be composed of at least one view. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.

For example, in this application, content such as "first identification information" displayed on the interactive interface may be displayed by the view system receiving an instruction from the processor, and used for reminding information such as available external cameras.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

The hardware abstraction layer is the interface layer between the kernel layer and the hardware circuit, and its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform, provides a virtual hardware platform for the operating system, makes it hardware-independent, and can be transplanted on multiple platforms.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

In the Android system, the camera system is located at the application framework layer, hardware abstraction layer, and kernel layer. Mobile device applications, such as shooting, video, etc., use the standard camera API of the application framework layer to operate the local camera to obtain images. Between the hardware abstraction layer and the application framework layer, a standard interface is defined for business communication between the application framework layer and the hardware abstraction layer. The kernel layer is the driver layer of the camera of the mobile device, which is called by the hardware abstraction layer camera module to operate the hardware device of the camera.

In the embodiment of the present application, a data switching module is added to the hardware abstraction layer. After one of the at least one third device corresponding to the identification information selected by the user is the target device, the first device adopts the camera of the third device After acquiring the image, the first device can complete the data switching according to the following process, so as to display the image taken by the target device.

It should be understood that, in this embodiment of the present application, the first device and at least one third device maintain a wireless connection as an example for description, and it does not limit other devices of different types to implement the technical solutions of the present application. The left side of Figure 6 is the internal software framework of the first device. It should be noted that: the application scenario of the first device includes the first device and the second device respectively using the second application and their respective cameras to make video calls, and the first device Maintain a wireless connection with the third device.

1) The data switching module of the first device obtains image format information of at least one camera of the first device, and sends the image format information to the data transmission channel module.

Optionally, the image format information may include information such as the number of data streams that provide the format information data for the first device to provide the image, the resolution, frame rate, and color space of each data stream.

2) The data transmission channel module of the first device receives the image format information sent by the data switching module, determines the first configuration information of at least one camera of the target device according to the image format information, and sends the first configuration information to the target device.

Optionally, the target device is installed with a corresponding application, where the application can be used for signaling interaction and data transmission between the first device and the target device, and the application includes a communication protocol adapted to the first device. Parameters etc.

Optionally, the application can be installed in an adaptation module of the target device.

Optionally, the adaptation module may be an adaptation software development kit (SDK) module, and the application may communicate through the SDK module.

Optionally, the first device may send the first configuration information to the target device through the data transmission channel module, and the target device-side adaptation module may perform related configuration on at least one camera of the target device according to the first configuration information, for example, the first configuration The information can instruct the camera to obtain the resolution, frame rate, color space, etc. of the image format. At the same time, the adaptation module of the target device can configure the camera according to the first configuration information. The target device obtains video data through the camera and sends the acquired video data to the data transmission channel module of the first device through the adaptation module.

Optionally, when the data transmission channel module determines the first configuration information for the target device according to the image format information sent by the data switching module, it may obtain the second configuration information of at least one camera of the target device in advance, and according to the at least The configuration of a camera and the second configuration information generate the first configuration information.

Optionally, the first device may shield capabilities that are not supported by at least one camera of the target device according to the second configuration information. For example, the resolution information of at least one camera of the target device can be obtained in advance. If the image format information requires that the video resolution is 1080p, and at least one camera of the target device can only obtain data with a resolution of 480p, then the data transmission channel The module shields the resolution in the image format information, and does not send the configuration along with the first configuration information to the target device.

Optionally, if the application at the application layer has multiple data acquisition requests, there can be only one data stream between the data transmission channel module and the adaptation module of the target device. The data transmission channel module receives the data transmitted by the adaptation module. After the data stream, the data stream can be transmitted to multiple demand ends. For example, if the application of the first device needs to store the video shot by the target device in the local and the cloud at the same time, the data transmission module can transmit the data transmitted by the adaptation module. Stream to local and cloud servers. Since this will not occupy too much wireless resources, bandwidth requirements and delays can be reduced.

Optionally, the first device may send a shooting instruction to the target device, and the shooting instruction may instruct the target device to perform shooting time and other information.

Optionally, the shooting instruction may be included in the first configuration information.

3) After the data transmission channel module receives the video data, it may need to convert the resolution and color space and other related formats of the video data according to the business requirements of the application to meet the format requirements of each data stream of the application, and the data transmission channel After the module obtains the valid video data, it considers that the data source of the target device is ready, and at this time the data transmission channel module sends a switching preparation completion instruction to the data switching module.

4) After the data switch module receives the instruction to complete the switch preparation, it notifies the camera device session management module, which can suspend the image acquisition process of the local camera hardware, take over the camera acquisition request, forward the camera acquisition request to the data transmission channel module, and the data transmission channel module will The data received from the target device is transmitted to the data switching module, and the data switching module fills the video data into the data return interface of the camera device session management module. After that, the acquired video data is returned to the upper service according to the original data return process Finally, the application program can obtain the image acquired by at least one camera of the target device, but the application program thinks that at least one camera of the first device is still being used, and the at least one camera of the target device is equivalent to the local virtual camera of the first device , The data is switched from at least one camera to at least one camera of the target device, and the application is unaware, and a better viewing angle can be obtained through the camera of the external device, which improves the user experience.

FIG. 7 is a schematic diagram of interaction between modules of a first device according to an embodiment of the present application.

S401: The first device detects a user's preset operation on the identification information on the interactive interface, triggers at least one camera switching operation of the device corresponding to the identification, and collects video data.

Optionally, the preset operation may be that the user clicks on the identification information, or the user voice instruction selects the identification information, or automatically selects the identification information according to the user's history.

Optionally, the first device presents identification information of each of the multiple devices. Wherein, the first device has at least one camera, the multiple devices include the first device and at least one third device, at least one third device is wirelessly connected to the first device, and at least one third device has a camera.

Optionally, when the user performs an operation on the identification information displayed on the interactive interface, the user may perform a preset operation. The preset operation may be that the user clicks on the identification information displayed on the interactive interface of the first device, or the user moves from the left to the left Swipe right to the identification information displayed on the interactive interface of the first device. The first device may store preset operations in advance, and when the user completes the preset operations, the target device is determined according to the user operations.

Optionally, the interactive interface may be an interactive interface of an application program, and the application program may be an application that requires a camera, such as a camera application, a camera application, or a video call application.

Optionally, the identification information of each of the multiple devices is presented on the interactive interface corresponding to the at least one camera, that is, when the application of the first device calls the at least one camera to obtain video data, the The identification information is displayed on the interactive interface of the program.

S402: The data switching module judges whether the camera switching parameter is legal, and records whether there is at least one camera of the first device being used.

Optionally, the camera switching parameter may be the operating state of at least one camera of the first device, the camera information of the first device of the target device, or whether other switching tasks currently conflict with this task.

Optionally, the switching can only be performed when at least one camera of the first device is running.

S403: The data switching module records the configuration of at least one camera of the first device currently running.

S404: The data switching module instructs the data transmission channel module to interact with the adaptation module of the target device, and initiates a connection to at least one camera of the target device.

S405: The data transmission module is connected to the adaptation module of the target device.

Optionally, the adaptation module may send second configuration information to the data transmission module, where the second configuration information is used to indicate the configuration of at least one camera of the target device.

S406: The data switching module obtains second configuration information.

S407: The data switching module may determine the configuration of at least one camera of the target device according to the second configuration information, and configure the at least one camera interface of the first device, and the data switching module may determine the configuration of at least one camera of the first device and the second configuration Information to generate the first configuration information.

Optionally, the data switching module may shield capabilities that are not supported by at least one camera of the target device according to the second configuration information.

S408: The data transmission channel module sends the first configuration information to the adaptation module of the target device, and the target device can configure the camera according to the first configuration information.

Optionally, the data transmission channel module may send a shooting instruction to the adaptation module of the target device, and the shooting instruction may instruct the target device to perform shooting time and other information.

Optionally, the shooting instruction may be included in the first configuration information.

S409: The data switching module triggers a switch for switching the data stream and the control stream to switch the camera, where the switch may be located in the camera unit of the application architecture layer.

S410: The data switching module instructs the data transmission channel module to obtain a data stream obtained by at least one camera of the target device.

Optionally, the user's related operations on the camera are also transferred to at least one camera of the target device for implementation, for example, selecting any one of the at least one camera to obtain video data.

S411a: At least one camera of the target device acquires video data and transmits the video data to the data transmission channel module through the adaptation module.

S411b: The data transmission channel module can transmit the video data to the data switching module.

Optionally, the video data transmission method may be realized by a wireless communication method or a wired communication method or a server communication method.

Optionally, the wireless communication method is implemented by any one of Bluetooth protocol, Wi-Fi protocol, NFC protocol or mobile communication protocol.

Among them, the mobile communication protocol may include 2G standard protocol, 3G standard protocol, 4G standard protocol, 5G standard protocol, 6G standard protocol or, 6G follow-up standard protocol, etc.

S412: The data switching module fills the image buffer with video data obtained by at least one camera of the target device.

Optionally, the image buffer may be located in the memory of the first device.

S413: The data switching module may perform a stop/close operation on at least one camera of the first device, so as to reduce power consumption of the first device.

S414: After the data flow and control flow are switched, the data switching module may return a switching success response to the interactive interface of the application program.

Optionally, the handover success response may be displaying completion identification information on the interactive interface, for example, displaying "switching completed" or "switching successful" on the interactive interface.

According to the technical solution provided by the embodiments of the present application, the application program can obtain images acquired by at least one camera of the target device, but the application program thinks that at least one camera of the first device is still being used, and at least one camera of the target device is equivalent to The local virtual camera of the first device enables data to be switched from at least one camera to at least one camera of the target device, and the application is unaware. A better viewing angle can be obtained through the camera of the external device, which improves the user experience.

FIG. 8 is a schematic diagram of a switching principle provided by an embodiment of the present application.

As shown in FIG. 8, the technical solution of the present application adds a data switching module and a data transmission channel module on the first device side, and adds an adaptation module on the target device side. The technical solution of this application can modify the code corresponding to the camera of the hardware abstraction layer, and can add an image acquisition request tag. The image acquisition request tag can be used to mark that the image acquisition request issued by the application framework layer is issued by at least one of the first device. Whether the camera processing is sent to the data stream switching module is processed by at least one camera of the target device.

In the process of using at least one camera of the first device, the image acquisition request issued by the application framework layer will be sent to at least one camera driver of the first device for processing. The camera driver calls the kernel layer camera hardware driver to operate at least one of the first device. A camera acquires video data.

In the process of using at least one camera of the target device, after the user triggers the use of at least one camera of the target device, the data stream switching module triggers the data stream and control stream switching switch, sets the label, and then applies the image acquisition request issued by the framework layer It will be forwarded to the data stream switching module for processing. At this time, at least one camera of the first device can be paused/closed to reduce power consumption. If the user no longer uses the at least one camera of the target device thereafter, the data stream and control stream switching switch can be turned off, and subsequent image acquisition requests issued by the application framework layer continue to be processed by the at least one camera of the first device.

FIG. 9 is a schematic diagram of the software architecture of another first device provided in an embodiment of the present application.

It should be understood that, in this embodiment of the present application, the first device and at least one third device maintain a wireless connection as an example for description, and it does not limit other devices of different types to implement the technical solutions of the present application. The left side of Figure 9 is the internal software framework of the first device. It should be noted that the application scenario of the first device includes the first device using the second application and its own camera to take photos or videos, and the first device and the third device maintain Wireless connections.

In this embodiment of the application, a data switching module is added to the application framework layer for the user to select one of the at least one third device as the target device, and the first device uses the camera of the third device to obtain an image. The device can complete the data switching according to the following process, so as to display the image taken by the target device.

1) The data switching module of the first device obtains image format information of at least one camera of the first device, and sends the image format information to the data transmission channel module.

Optionally, the image format information may include information such as the number of data streams provided to provide the first device with the format information data of the image, the resolution, frame rate, and color space of each data stream.

2) The data transmission channel module of the first device receives the image format information sent by the data switching module, determines the first configuration information of at least one camera of the target device according to the image format information, and sends the first configuration information to the target device.

Optionally, the target device installs a corresponding application, where the application can be used for signaling interaction and data transmission between the first device and the target device, and the application can include a communication protocol adapted to the first device. Parameters etc.

Optionally, the application can be installed in an adaptation module of the target device.

Optionally, the adaptation module may be an adaptation SDK module, and the application may communicate through the SDK module.

Optionally, the first device may send the first configuration information to the target device through the data transmission channel module, and the target device-side adaptation module may perform related configuration on at least one camera of the target device according to the first configuration information, for example, the first configuration The information can instruct the camera to obtain the resolution, frame rate, color space, etc. of the image format. At the same time, the adaptation module of the target device can configure the camera according to the first configuration information. The target device obtains video data through the camera and sends the acquired video data to the data transmission channel module of the first device through the adaptation module.

Optionally, when the data transmission channel module determines the first configuration information for the target device according to the image format information sent by the data switching module, it may obtain the second configuration information of at least one camera of the target device in advance, and according to the at least The configuration of a camera and the second configuration information generate the first configuration information.

Optionally, the first device may shield capabilities that are not supported by at least one camera of the target device according to the second configuration information. For example, the resolution information of at least one camera of the target device can be obtained in advance. If the image format information requires that the video resolution is 1080p, and at least one camera of the target device can only obtain data with a resolution of 480p, then the data transmission channel The module shields the resolution in the image format information, and does not send the configuration along with the first configuration information to the target device.

Optionally, if the application at the application layer has multiple data acquisition requests, there can be only one data stream between the data transmission channel module and the adaptation module of the target device. The data transmission channel module receives the data transmitted by the adaptation module. After the data stream, the data stream can be transmitted to multiple demand ends. For example, if the application of the first device needs to store the video shot by the target device in the local and the cloud at the same time, the data transmission module can transmit the data transmitted by the adaptation module. Stream to local and cloud servers. Since this will not occupy too much wireless resources, bandwidth requirements and delays can be reduced.

Optionally, the first device may send a shooting instruction to the target device, and the shooting instruction may instruct the target device to perform shooting time and other information.

Optionally, the shooting instruction may be included in the first configuration information.

3) After the data transmission channel module receives the video data, it may need to convert the resolution and color space and other related formats of the video data according to the business requirements of the application to meet the format requirements of each data stream of the application, and the data transmission channel After the module obtains the valid video data, it considers that the data source of the target device is ready, and at this time the data transmission channel module sends a switching preparation completion instruction to the data switching module.

4) After the data switch module receives the switch preparation completion instruction, the data switch module continuously obtains video data from the data transmission channel module and fills it into the temporary buffer returned by the camera application framework layer, because the application at the application layer does not know that the target has been adopted At least one camera of the device obtains data, so the image processing request is still sent from the application layer to the application framework layer and then to the hardware abstraction layer, but after using at least one camera of the target device to obtain the video data, the hardware abstraction layer does not obtain the video data Therefore, the hardware abstraction layer can return the image processing request, and the data switching module performs the operation. After receiving the image processing request returned by the hardware abstraction layer, the video data in the temporary buffer can be filled into the image buffer. Finally, the application can obtain the image obtained by at least one camera of the target device, but the application It is considered that at least one camera of the first device is still in use, and at least one camera of the target device is equivalent to the local virtual camera of the first device, which enables the user to obtain different perspectives after selecting different target devices and apply it to Video calls greatly improve flexibility. .

FIG. 10 is a schematic diagram of the interaction of various modules of another first device according to an embodiment of the present application.

S801: The first device detects that the user acts on the preset operation of the identification information on the interactive interface, triggers at least one camera switching operation of the device corresponding to the identification, and collects video data.

Optionally, the preset operation may be that the user clicks on the identification information, or the user voice instruction selects the identification information, or automatically selects the identification information according to the user's history.

Optionally, the first device presents identification information of each of the multiple devices. The first device has at least one camera, the multiple devices include the first device and at least one third device, at least one third device is wirelessly connected to the first device, and at least one third device has a camera.

Optionally, when the user performs an operation on the identification information displayed on the interactive interface, the user may perform a preset operation. The preset operation may be that the user clicks on the identification information displayed on the interactive interface of the first device, or the user moves from the left to the left Swipe right to the identification information displayed on the interactive interface of the first device. The first device may store preset operations in advance, and when the user completes the preset operations, the target device is determined according to the user operations.

Optionally, the interactive interface may be an interactive interface of an application program, and the application program may be an application that requires a camera, such as a camera application, a camera application, or a video call application.

Optionally, the identification information of each of the multiple devices is presented on the interactive interface corresponding to the at least one camera of the first device, that is, when the application of the first device calls at least one camera to obtain video data, The identification information is displayed on the interactive interface of the application program.

S802: The data switching module judges whether the camera switching parameter is legal, and records whether there is at least one camera of the first device in use.

Optionally, the camera switching parameter may be the operating state of at least one camera of the first device, at least one camera information of the target device, or whether there is currently another switching task that conflicts with this task.

Optionally, the switching can only be performed when at least one camera of the first device is running.

S803: The data switching module records the configuration of at least one camera of the first device currently running.

S804: The data switching module instructs the data transmission channel module to interact with the adaptation module of the target device, and initiates a connection to at least one camera of the target device.

S805: The data transmission module is connected to the adaptation module of the target device.

Optionally, the adaptation module may send second configuration information to the data transmission module, where the second configuration information is used to indicate the configuration of at least one camera of the target device.

S806: The data switching module obtains second configuration information.

S807. The data switching module may determine the configuration of at least one camera of the target device according to the second configuration information, and configure at least one camera interface of the first device, and the data switching module may determine the configuration of at least one camera of the first device and the second configuration Information to generate the first configuration information.

Optionally, the data switching module may shield capabilities that are not supported by at least one camera of the target device according to the second configuration information.

S808: The data transmission channel module sends the first configuration information to the adaptation module of the target device, and the target device can configure the camera according to the first configuration information.

Optionally, the data transmission channel module may send a shooting instruction to the adaptation module of the target device, and the shooting instruction may instruct the target device to perform shooting time and other information.

Optionally, the shooting instruction may be included in the first configuration information.

S809: The data switching module triggers a switch for switching the data stream and the control stream to switch the camera, where the switch may be located in the camera unit of the application architecture layer.

S810: The data switching module instructs the data transmission channel module to obtain a data stream obtained by at least one camera of the target device.

Optionally, the user's related operations on the camera are also transferred to at least one camera of the target device for implementation, for example, selecting any one of the at least one camera to obtain video data.

S811a: At least one camera of the target device acquires video data and transmits the video data to the data transmission channel module through the adaptation module.

S811b: The data transmission channel module can transmit video data to the data switching module.

Optionally, the video data transmission method may be realized by a wireless communication method or a wired communication method or a server communication method.

Optionally, the wireless communication method is implemented by any one of Bluetooth protocol, Wi-Fi protocol or mobile communication protocol.

Among them, the mobile communication protocol may include 2G standard protocol, 3G standard protocol, 4G standard protocol or 5G standard protocol, 6G standard protocol or 6G follow-up standard protocol, etc.

S812: The data switching module buffers the video data acquired by the target device in the temporary buffer of the first device.

S813: After receiving the image processing request returned by the hardware abstraction layer, the data switching module fills the video data in the temporary buffer into the image buffer.

Optionally, both the temporary buffer and the image buffer may be located in the memory of the first device.

S813: The data switching module may perform a stop/close operation on at least one camera of the first device, so as to reduce power consumption of the first device.

S814: After the data flow and the control flow are switched, the data switching module may return a switching success response to the interactive interface of the application program.

Optionally, the handover success response may be displaying completion identification information on the interactive interface, for example, displaying "switching completed" or "switching successful" on the interactive interface.

According to the technical solution provided by the embodiments of the present application, the application program can obtain images acquired by at least one camera of the target device, but the application program thinks that at least one camera of the first device is still being used, and at least one camera of the target device is equivalent to The local virtual camera of the first device. Users can select different target devices according to their actual needs, and obtain video images through at least one camera of the target device, and apply them to video calls, which enhances the user's selection range and provides a better user experience.

FIG. 11 is a schematic diagram of another switching principle provided by an embodiment of the present application.

As shown in FIG. 11, the technical solution of the present application adds a data switching module and a data transmission channel module on the first device side, and adds an adaptation module on the target device side. The technical solution of this application can modify the code corresponding to the camera of the application framework layer. The camera service module (CameraService) in the camera unit of the application framework layer can add the label of whether to use the video data obtained by the external camera to cover the local video data, because the data switching module obtains the video data obtained by at least one camera of the target device through the data transmission channel module And perform a temporary caching. When the camera service module processes the video data returned by the hardware abstraction layer, it uses the temporarily cached video data to cover the image buffer of the video data returned by the hardware abstraction layer, and then the video data is uploaded back to the application framework layer. The image API of the camera. At this time, the video data obtained by the application program is already an image obtained by at least one camera of the target device, and the application program does not perceive changes in the underlying data.

The embodiment of the present application also provides a mobile device, which may include at least one camera, a display module, a data switching module, and a data transmission channel module.

Among them, at least one camera is used to obtain images; the display module is used to present the identification information of each of the multiple devices, the multiple devices including a first device and at least one third device, and at least one third device and the first device Wireless connection, and at least one third device has a camera; the data switching module is used to respond to user operations to determine the target device from multiple devices; the data transmission channel module is used to obtain images taken by the target device; the display module is also used to Present the image taken by the target device.

Optionally, the data transmission channel module may also be used to send a shooting instruction to the target device, and the data transmission channel module may also be used to receive an image captured by the target device according to the shooting instruction.

Optionally, each of the at least one third device includes an adaptation module, and the adaptation module is used for data transmission between the first device and the at least one third device.

Optionally, the display module presenting the identification information of each of the multiple devices includes: the display module presents the identification information of each of the multiple devices on an interactive interface corresponding to at least one camera.

Optionally, when the target device is one of the at least one third device, the data switching module generates first configuration information according to the configuration of the at least one camera; the data transmission channel module may also send the first configuration to the target device information.

Optionally, the data transmission channel module is also used to obtain second configuration information, the second configuration information is used to indicate the configuration of at least one camera of the target device; and the processing module generates the first configuration according to the configuration of the at least one camera of the first device. The configuration information includes: the data switching module generates the first configuration information according to the configuration of the at least one camera and the second configuration information.

Optionally, when the target device is a third device among the at least one third device, when the display module presents an image taken by the target device, at least one camera of the first device is turned off.

Optionally, the wireless connection is achieved through any one of Bluetooth protocol, wireless local area network Wi-Fi protocol, NFC protocol or mobile communication protocol.

A person of ordinary skill in the art may be aware that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or wireless connection may be indirect coupling or wireless connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes at least one computer instruction. When the computer program instructions are loaded and executed on the computer, the procedures or functions described in the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website site, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with at least one available medium. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk, SSD), etc.

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (13)

1. A video call method applied to a first device with at least one camera, wherein the first device uses the at least one camera and an application to establish a video call with a second device, and the first device and The second device is installed with the application, the application has a video call function, the second device has at least one camera, and the method includes:

   After the first device uses the at least one camera and the application to establish a video call with the second device, the identification information of the at least one third device that maintains a wireless connection with the first device and has a camera is displayed on On the interactive interface for video calls;

   When the first device detects that the user acts on a preset operation of the first identification information on the interactive interface, it triggers at least one camera of the device corresponding to the first identification information to collect video data, and the first identification information is One of the identification information of the at least one third device;

   The first device obtains video data collected by at least one camera of the device corresponding to the first identification information, and uses the video data collected by the at least one camera of the device corresponding to the first identification information for a video call.
2. The method of claim 1, wherein the method further comprises:

   When the first device detects that the user acts on the preset operation of the second identification information on the interactive interface, it triggers at least one camera of the device corresponding to the second identification information to collect video data, and the second identification information is One of the identification information of the at least one third device;

   The first device obtains the video data collected by the at least one camera of the device corresponding to the second identification information, and uses the video data collected by the at least one camera of the device corresponding to the second identification information for a video call.
3. The method according to claim 1, wherein the first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and compares the video data collected by at least one camera of the device corresponding to the first identification information. The video data collected by a camera is used for video calls, including:

   The first device acquires the video data collected by at least one camera of the device corresponding to the first identification information, and no longer acquires the video data collected by the at least one camera of the first device, and combines the first identification information The video data collected by at least one camera of the corresponding device is used for video calls; or,

   The first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and obtains the video data collected by the at least one camera of the first device, and assigns the first identification information to the The video data collected by at least one camera of the device is used for video calls; or,

   The first device obtains the video data collected by at least one camera of the device corresponding to the first identification information, and obtains the video data collected by the at least one camera of the first device, and assigns the first identification information to the The video data collected by the at least one camera of the device and the video data collected by the at least one camera of the first device are used for a video call.
4. The method according to claim 2, wherein the first device obtains the video data collected by at least one camera of the device corresponding to the second identification information, and combines at least one of the device corresponding to the second identification information The video data collected by a camera is used for video calls, including:

   The first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and no longer acquires at least one camera of the first device and at least one of the device corresponding to the first identification information The video data collected by a camera, and the video data collected by at least one camera of the device corresponding to the second identification information is used for a video call; or,

   The first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and acquires at least one camera of the first device and at least one camera of the device corresponding to the first identification information. Using the video data collected by at least one camera of the device corresponding to the second identification information for the video call; or,

   The first device acquires video data collected by at least one camera of the device corresponding to the second identification information, and acquires video data collected by at least one camera of the first device, and does not acquire the video data corresponding to the first identification information. Video data collected by at least one camera of the device, and using the video data collected by at least one camera of the device and at least one camera of the first device corresponding to the second identification information for a video call; or,

   The first device acquires the video data collected by at least one camera of the device corresponding to the second identification information, and acquires the video data collected by at least one camera of the device corresponding to the first identification information, without acquiring the first The video data collected by at least one camera of the device, and the video data collected by the at least one camera of the device corresponding to the second identification information and the at least one camera of the device corresponding to the first identification information are used for a video call; or,

   The first device obtains video data collected by at least one camera of the device corresponding to the second identification information, and obtains at least one camera of the first device and at least one of the device corresponding to the first identification information The video data collected by the camera, and the video data collected by at least one camera of the device corresponding to the first identification information and at least one camera of the device corresponding to the second identification information and at least one camera of the first device are collected The video data of is used for video calls.
5. The method according to any one of claims 1 to 4, characterized in that:

   Before using the at least one camera of the device corresponding to the first identification information, configure at least one camera of the device corresponding to the first identification according to the configuration parameters of the at least one camera of the first device; and/or,

   Before using the at least one camera of the device corresponding to the second identification information, configure the at least one camera of the device corresponding to the second identification information according to the configuration parameters of the at least one camera of the first device.
6. The method according to any one of claims 1 to 5, characterized in that:

   The interactive interface for performing a video call further includes third identification information of a fourth device that maintains a wireless connection with the first device and has at least one microphone;

   When the first device detects that the user acts on the preset operation of the third identification information on the interactive interface, triggering the device corresponding to the third identification information to collect audio data using at least one microphone;

   The first device obtains audio data collected by at least one microphone of the device corresponding to the third identification information, and uses the audio data collected by at least one microphone of the device corresponding to the third identification information for a video call.
7. The method according to any one of claims 1 to 6, characterized in that,

   The interactive interface for making a video call further includes fourth identification information of a fifth device that maintains a wireless connection with the first device and has at least one speaker;

   When the first device detects that the user acts on the preset operation of the fourth identification information on the interactive interface, it sends the audio data received in the video call to the device corresponding to the fourth identification, and triggers the first Fourth, the device corresponding to the identification information plays the received audio data.
8. The method according to any one of claims 1 to 5, characterized in that:

   The interactive interface for performing a video call further includes fifth identification information of a sixth device that maintains a wireless connection with the first device and has at least one microphone and at least one speaker;

   When the first device detects that the user has acted on the preset operation of the fifth identification information on the interactive interface, it triggers the device corresponding to the fifth identification information to collect audio data using at least one microphone, and transfer the data received in the video call Sending the audio data to the device corresponding to the fifth identification information, and triggering the device corresponding to the fifth identification information to play the received audio data;

   The first device obtains the audio data collected by the at least one microphone of the device corresponding to the fifth identification information, and uses the audio data collected by the at least one microphone of the device corresponding to the fifth identification information for a video call.
9. The method according to any one of claims 1 to 8, wherein the device that maintains a wireless connection with the first device is implemented through any one of Bluetooth protocol, Wi-Fi protocol, NFC protocol or mobile communication protocol of.
10. The method according to any one of claims 1 to 9, wherein the first device obtains video data collected by at least one camera of the device corresponding to the first identification information, and combines the first identification information The video data collected by at least one camera of the corresponding device is used for video calls, including:

    After receiving the video data, the data transmission channel module of the first device performs format conversion on the resolution and color space of the received video data according to the requirements of the application;

    The data switching module of the first device receives an acquisition request of at least one camera of the first device, and forwards the acquisition request to the data transmission channel module;

    The data transmission channel module will receive video data from the device corresponding to the first identification information and transmit it to the data switching module;

    The data switching module transmits the received video data collected by at least one camera of the device corresponding to the first identification information to the data return interface of the camera device session management module, and the acquired first identification information corresponds to the device The video data collected by at least one camera is returned to the application according to the original data return procedure.
11. A mobile device, characterized in that it comprises:

    A touch screen, wherein the touch screen includes a touch-sensitive surface and a display;

    One or more cameras;

    One or more processors;

    Memory

    Multiple applications;

    And one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs include instructions that, when the instructions run on the mobile device, cause the mobile The device executes the method according to any one of claims 1 to 10.
12. A computer-readable storage medium, comprising instructions, wherein when the instructions run on a device, the device executes the method according to any one of claims 1 to 10.
13. A graphical user interface system on an electronic device, characterized in that the electronic device has a display screen, a camera, a memory, and one or more processors, and the one or more processors are used to execute One or more computer programs in, wherein the graphical user interface comprises a graphical user interface displayed when the electronic device executes the method according to any one of claims 1 to 10.

Images