WO2023142959A1 - 多机位拍摄系统的拍摄方法、设备、存储介质和程序产品 - Google Patents

多机位拍摄系统的拍摄方法、设备、存储介质和程序产品 Download PDF

Info

Publication number
WO2023142959A1
WO2023142959A1 PCT/CN2023/070822 CN2023070822W WO2023142959A1 WO 2023142959 A1 WO2023142959 A1 WO 2023142959A1 CN 2023070822 W CN2023070822 W CN 2023070822W WO 2023142959 A1 WO2023142959 A1 WO 2023142959A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
video image
standby
video
camera
Prior art date
Application number
PCT/CN2023/070822
Other languages
English (en)
French (fr)
Inventor
张运玑
张利
吴国亮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202210501226.4A external-priority patent/CN116582754A/zh
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023142959A1 publication Critical patent/WO2023142959A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays

Definitions

  • the embodiments of the present application relate to the technical field of video shooting, and in particular to a shooting method, device, storage medium and program product of a multi-camera shooting system.
  • the multi-camera shooting system refers to the system that uses multiple camera equipment to shoot the subject; it is a commonly used shooting method in movies, live broadcast platforms, and stage shooting. The picture is more vivid and has a better sense of substitution.
  • Mobile phones and small handheld shooting devices can be combined into a multi-camera shooting system through short-distance communication technologies, such as WiFi, to bring users a more convenient shooting experience.
  • short-distance communication technologies such as WiFi
  • the picture is called the guide picture
  • the mobile phone or wireless shooting device that controls other camera positions in the multi-camera shooting system is called the main position
  • the controlled mobile phone or wireless shooting device is called the auxiliary camera position.
  • the multi-camera shooting system composed of mobile phones and small shooting equipment adopts two ways of directing pictures.
  • One way is that there is no directing picture. Display the prompt box of the optional lens name. When the selection is successful, it will directly switch to the corresponding lens image without the guide screen; another way is to lock the shooting lens once the preview image is selected, that is, the host is positioned before shooting the video. , all possible lens images will be displayed, and the photographer can select any two images to start shooting, but only the images of these two lenses are recorded during the shooting process, and cannot be re-selected, that is, the video image cannot be switched. Because the shooting process of the prior art cannot present the guide picture, or cannot switch the shooting images, the flexibility of video shooting is poor.
  • Embodiments of the present application provide a shooting method, device, storage medium and program product of a multi-camera shooting system, capable of presenting a guide screen and switching video images during multi-camera shooting, thereby improving the flexibility of video shooting.
  • a shooting method of a multi-camera shooting system is provided, which is applied to a first electronic device, where the first electronic device is a master position of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera position,
  • the method includes: the first electronic device displays a main interface, and the main interface includes a first video image; the first electronic device receives a first user operation in video shooting mode; the first electronic device displays a second video image on the main interface according to the first user operation.
  • Video images the first video image comes from the main machine position or the auxiliary machine position, and the second video image comes from the auxiliary machine position; the first electronic device receives the video switching operation, and the video switching operation is aimed at the second video image; the first electronic device according to the video The switching operation is to switch the first video image and the second video image.
  • the host position When the host position is in the video shooting mode, after receiving the first user operation, the second video image that is in the main interface at the same time as the first video image is displayed, and the first video image and the second video image will be switched after receiving the video switching operation, It realizes the display of the guide screen on the multi-camera shooting interface and switches the video image during the shooting process through the guide screen, thereby improving the flexibility of video shooting.
  • the main interface includes an operation control
  • the operation control is used to trigger the display of the second video image on the main interface
  • the first user operation includes a click operation acting on the operation control.
  • the first user operation includes a first sliding gesture operation acting on a preset position of the main interface.
  • the control based on the guide screen can be conveniently realized to improve the flexibility of video shooting.
  • the video switching operation includes a click operation acting on the second video image in the main interface.
  • the control based on the guide screen can be conveniently realized to improve the flexibility of video shooting.
  • one of the first video image and the second video image comes from the second electronic device, and the second electronic device is an auxiliary camera position of a multi-camera shooting system; the first video image and the second video image The other of the second video images comes from the first electronic device or the third electronic device, and the third electronic device is another auxiliary camera position of the multi-camera shooting system.
  • the method further includes: the first electronic device receives a second user operation; An electronic device hides the first video image on the main interface according to the second user operation; the first electronic device receives the third user operation; and the first electronic device displays the first video image on the main interface according to the third user operation.
  • the function of hiding the guide screen is provided so that users can better watch the guide screen.
  • the main interface includes an operation control
  • the operation control is used to trigger hiding the first video image on the main interface and hiding the first video image on the main interface, for example, the second user operation and the third user operation include an action For the click operation of the operation control.
  • the third user operation includes a first slide gesture operation acting on a preset position
  • the second user operation includes a second slide gesture operation acting on a preset position
  • the method further includes: the first electronic device receives the bit switching operation, and the computer The bit switching operation is for the first video image; the first electronic device replaces the first video image with the third video image according to the camera position switching operation, and the first video image and the third video image are different camera positions in the multi-camera shooting system Video image provided. It is convenient for users to switch the guide screens from different camera positions.
  • the camera location switching operation includes a double-click operation on the first video image.
  • the method further includes: the first electronic device receives the camera switching operation, and the camera switching The operation is aimed at the first video image; the first electronic device replaces the first video image with the fourth video image according to the camera switching operation, and the first video image and the fourth video image are provided by different cameras of the same camera position in the multi-camera shooting system video image. It is convenient for users to switch the guide screens from different cameras in the same position.
  • the camera switching operation includes a triple-click operation on the first video image.
  • the method further includes: the first electronic device receives the picture-in-picture display operation, The picture-in-picture display operation is aimed at the first video image; the first electronic device displays a fifth video image at least partially surrounded by the second video image on the main interface according to the picture-in-picture display operation, and the fifth video image is the same as the first video image .
  • the first electronic device receives the picture-in-picture display operation, The picture-in-picture display operation is aimed at the first video image; the first electronic device displays a fifth video image at least partially surrounded by the second video image on the main interface according to the picture-in-picture display operation, and the fifth video image is the same as the first video image .
  • the picture-in-picture display operation includes a drag operation acting on the first video image.
  • the method also includes: after the main interface hides the first video image, and the first electronic device does not display the video image from the second electronic device, the first electronic device sends a standby control instruction to the second electronic device, and the standby control The instruction is used to instruct the second electronic device to turn off any or any combination of the following components or work in a low power consumption mode: camera module, image signal processor ISP, video processor VPU, display screen and wireless communication link, wireless The communication link is used to transmit video images from the second electronic device to the first electronic device. By sending the standby control command, it is possible to make unused positions or corresponding communication links standby to reduce power consumption.
  • the standby control instruction is also used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the periodic dormant communication state; when the wireless communication link is in the periodic dormant communication state When the duration reaches the first preset duration, the first electronic device establishes a Bluetooth Low Energy BLE connection between the first electronic device and the second electronic device, and disconnects the wireless communication link; the first electronic device sends a message to the second electronic device
  • the method further includes: the first electronic device executes a first standby recovery process or a second standby recovery process; both the first standby recovery process and the second standby recovery process include: the first electronic device receives a third user operation , and the process of the first electronic device displaying the first video image on the main interface according to the third user operation; in the first standby recovery process, the third user operation is a standby recovery operation; the second standby recovery process also includes: the first Before receiving the third user operation, the electronic device receives a standby recovery operation;
  • the link is restored to the continuous communication state; the first electronic device is operated according to the standby recovery, and if the standby recovery operation is received when the wireless communication link is disconnected, the standby recovery control command is sent to the second electronic device through the Bluetooth Low Energy BLE connection , the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to a continuous communication state.
  • the rapid recovery of the wireless communication link can be realized, so as to improve the response speed of the displayed video image; in the second standby recovery process, based on the standby recovery operation before the third user operation to restore the wireless communication link in advance, and then display the first video image according to the third user operation, so as to improve the response speed of displaying the video image.
  • the standby recovery operation includes a touch operation acting on a preset position.
  • the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic dormant communication state; the method further includes: the first electronic device when the wireless communication link When the duration of the first periodic dormancy communication state reaches the first preset duration, the wireless communication link is changed to the second periodic communication state, and the dormancy period of the first periodic dormancy communication state is shorter than the second periodic dormancy The dormancy period of the communication state; after sending the standby control instruction to the second electronic device, the method further includes: the first electronic device executes the third standby recovery process or the fourth standby recovery process; the third standby recovery process and the fourth standby recovery process both Including receiving a third user operation, and according to the third user operation, the process of displaying the first video image on the main interface; in the third standby recovery process, the third user operation is a standby recovery operation; the fourth standby recovery process also includes: Before receiving the third user operation, the first electronic device receives a
  • the wireless communication link automatically changes state according to the length of sleep. On the one hand, it reduces power consumption when there is no communication. On the other hand, it can respond and recover in time when communication is frequent, so as to improve the response speed of displaying video images; in the fourth standby recovery process In this method, the wireless communication link is restored in advance based on the standby recovery operation before the third user operation, and then the video image is displayed according to the third user operation, so as to improve the response speed of displaying the video image.
  • the standby recovery operation is a touch operation acting on a preset position.
  • the method further includes: the first electronic device displays a transition image at a preset position according to a third user operation;
  • the third user operation the process of displaying the first video image on the main interface includes: the first electronic device according to the third user operation, when the first electronic device receives a message from the second electronic device through the wireless communication link restored to the continuous communication state When the device's first video image is displayed, replace the transition image with the first video image.
  • the transitional image is displayed first, and then the transitional image is replaced with a video image until the wireless communication link is restored, so as to improve the display delay problem caused by the inability to transmit the video image in time.
  • a shooting device of a multi-camera shooting system which is applied to a first electronic device.
  • the first electronic device is a master position of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera position.
  • the device includes: an interface display module, configured to display a main interface, and the main interface includes a first video image; an operation receiving module, configured to receive a first user operation in video shooting mode; the interface display module is also configured to, according to the first user operation , displaying the second video image on the main interface, the first video image comes from the main machine position or the auxiliary machine position, and the second video image comes from the auxiliary machine position; the operation receiving module is also used to receive the video switching operation, and the video switching operation is aimed at the first Two video images: a video switching module, configured to switch the first video image and the second video image according to the video switching operation.
  • the main interface includes an operation control
  • the operation control is used to trigger the display of the second video image on the main interface, for example, the first user operation includes a click operation acting on the operation control.
  • the first user operation includes a first sliding gesture operation acting on a preset position of the main interface.
  • the video switching operation includes a click operation acting on the second video image in the main interface.
  • one of the first video image and the second video image comes from the second electronic device, and the second electronic device is an auxiliary camera position of a multi-camera shooting system; the first video image and the second video image The other of the second video images comes from the first electronic device or the third electronic device, and the third electronic device is another auxiliary camera position of the multi-camera shooting system.
  • the operation receiving module is also used to receive a second user operation; the interface display module is also used to hide the first video image on the main interface according to the second user operation; the operation receiving module is also used to , receiving a third user operation; the interface display module is further configured to, according to the third user operation, display the first video image on the main interface.
  • the main interface includes an operation control
  • the operation control is used to trigger, hide the first video image on the main interface and hide the first video image on the main interface, for example, the second user operation and the third user operation include Acts on the click action of the action control.
  • the third user operation includes a first slide gesture operation acting on a preset position
  • the second user operation includes a second slide gesture operation acting on a preset position
  • the operation receiving module is further configured to receive a position switching operation, and the position switching operation is aimed at the first video image;
  • the interface display module is also configured to, according to the position switching operation, convert the first video image to Instead of the third video image, the first video image and the third video image are video images provided by different cameras in the multi-camera shooting system.
  • the camera location switching operation includes a double-click operation on the first video image.
  • the operation receiving module is further configured to receive a camera switching operation, and the camera switching operation is for the first video image; the interface display module is also configured to replace the first video image with the first video image according to the camera switching operation.
  • Four video images, the first video image and the fourth video image are video images provided by different cameras of the same camera position in the multi-camera shooting system.
  • the camera switching operation includes a triple-click operation on the first video image.
  • the operation receiving module is further configured to receive a picture-in-picture display operation, and the picture-in-picture display operation is aimed at the first video image;
  • the interface display module is also configured to, according to the picture-in-picture display operation, The interface displays a fifth video image at least partially surrounded by the second video image, the fifth video image being the same as the first video image.
  • the picture-in-picture display operation includes a drag operation acting on the first video image.
  • the device further includes: a standby control module, configured to, after the main interface hides the first video image and the first electronic device does not display the video image from the second electronic device, The electronic device sends a standby control command, and the standby control command is used to instruct the second electronic device to turn off any of the following components or any combination of components or work in a low power consumption mode: camera module, image signal processor ISP, video processor VPU, The display screen and the wireless communication link, the wireless communication link is used to transmit the video image from the second electronic device to the first electronic device, the second electronic device is an auxiliary camera position of the multi-camera shooting system, and the current video image is the first electronic device A video image or a second video image.
  • a standby control module configured to, after the main interface hides the first video image and the first electronic device does not display the video image from the second electronic device, The electronic device sends a standby control command, and the standby control command is used to instruct the second electronic device to turn off any of the following components or any combination of components or work
  • the standby control instruction is also used to instruct the second electronic device to change the wireless communication link from a continuous communication state to a periodic dormant communication state;
  • the device also includes a communication control module, configured to When the duration of the periodical dormant communication state reaches the first preset duration, establish a low-power Bluetooth BLE connection between the first electronic device and the second electronic device, and disconnect the wireless communication link;
  • the specific operation of the receiving module For receiving the third user operation in the first standby recovery process, or receiving the standby recovery operation and the third user operation in the second standby recovery process, in the first standby recovery process, the third user operation is standby recovery Operation;
  • the standby control module is also used for, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic dormant communication state, then the standby recovery control instruction is sent to the second electronic device through the wireless communication link, The standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state;
  • the standby recovery operation includes a touch operation acting on a preset position.
  • the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic dormant communication state;
  • the device also includes a communication control module, configured to When the duration of the link in the first periodic dormant communication state reaches the first preset duration, the wireless communication link is changed into the second periodic communication state, and the dormancy period of the first periodic dormant communication state is shorter than the second periodic The dormancy cycle of the dormant communication state;
  • the operation receiving module is specifically used to receive the third user operation in the third standby recovery process, or receive the standby recovery operation and the third user operation in the fourth standby recovery process, and receive the third user operation in the third standby recovery process.
  • the third user operation is a standby recovery operation; the standby control module is also used to send a standby recovery control instruction to the second electronic device through a wireless communication link according to the standby recovery operation, and the standby recovery control command is used to instruct the second electronic device to The device restores the wireless communication link to a continuous communication state.
  • the standby recovery operation is a touch operation acting on a preset position.
  • the device further includes: the interface display module is further configured to, according to the third user operation, display the transition image at a preset position; the interface display module is further specifically configured to: according to the third user operation, when the third user operation When an electronic device receives the video image from the second electronic device through the wireless communication link restored to the continuous communication state, it replaces the transition image with the first video image.
  • an electronic device including a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the above method .
  • a computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute the above method.
  • a computer program product includes executable instructions, and when the executable instructions are executed on a computer, the computer is made to perform the above-mentioned method.
  • the shooting method, device, storage medium, and program product of the multi-camera shooting system in the embodiment of the present application when the host is in the video shooting mode, after receiving the first user operation, the second video image that is in the main interface at the same time as the first video image is displayed.
  • Video image after receiving the video switching operation, the first video image and the second video image will be switched, which realizes the display of the guide screen on the multi-camera shooting interface and switches the video image during the shooting process through the guide screen, thus improving the video quality. Shooting flexibility.
  • FIG. 1 is a schematic structural diagram of a multi-camera shooting system provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a camera of an electronic device provided in an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a shooting method of a multi-camera shooting system provided in an embodiment of the present application
  • Fig. 4a is a schematic diagram of a main interface of a first electronic device including a first video image according to an embodiment of the present application
  • FIG. 4b is a schematic diagram of a main interface of a first electronic device including a first video image and a second video image according to an embodiment of the present application;
  • Fig. 4c is a schematic diagram of switching between the first video image and the second video image in Fig. 4b;
  • Fig. 4d is a schematic diagram of the first electronic device hiding the first video image in Fig. 4c;
  • Fig. 5a is a schematic flow chart of another shooting method of a multi-camera shooting system provided by an embodiment of the present application.
  • Fig. 5b is a schematic flowchart of another shooting method of a multi-camera shooting system provided in an embodiment of the present application;
  • FIG. 6 is a schematic diagram of a scene where a first electronic device performs a camera switch operation according to an embodiment of the present application
  • FIG. 7 is a schematic diagram of a scene where a first electronic device performs a camera switching operation according to an embodiment of the present application
  • FIG. 8 is a schematic diagram of a scene where a first electronic device displays a picture-in-picture effect according to an embodiment of the present application
  • FIG. 9 is a schematic diagram of a scene where a first electronic device hides a picture-in-picture effect provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of a transmission queue when communicating via WiFi in an embodiment of the present application.
  • FIG. 11 is a schematic flowchart of a shooting method of a multi-camera shooting system including a first standby recovery process provided by an embodiment of the present application;
  • FIG. 12 is a schematic diagram of a state change of a wireless communication link in an embodiment of the present application.
  • FIG. 13 is a schematic flowchart of a shooting method of a multi-camera shooting system including a second standby recovery process provided by an embodiment of the present application;
  • FIG. 14 is a schematic diagram of another wireless communication link state change in the embodiment of the present application.
  • FIG. 15 is a schematic diagram of another wireless communication link state change in the embodiment of the present application.
  • FIG. 16 is a schematic flowchart of a shooting method of a multi-camera shooting system including a third standby recovery process provided by an embodiment of the present application;
  • Fig. 17 is a schematic flowchart of a shooting method of a multi-camera shooting system including a fourth standby recovery process provided by an embodiment of the present application;
  • FIG. 18 is a schematic diagram of a synchronization cycle of a wireless communication link in an embodiment of the present application.
  • FIG. 19 is a schematic structural diagram of another multi-camera shooting system in the embodiment of the present application.
  • FIG. 20 is a schematic diagram of a first electronic device displaying a transition image scene provided by an embodiment of the present application.
  • FIG. 21 is a schematic diagram of a scene change in which a mobile phone and a mobile phone form a multi-camera shooting system in an embodiment of the present application;
  • FIG. 22 is a schematic diagram of a scene change in a multi-camera shooting system composed of a mobile phone and a shooting device in the embodiment of the present application;
  • FIG. 23 is a structural block diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 1 is a schematic structural diagram of a multi-camera shooting system provided by an embodiment of the present application.
  • the shooting method and equipment provided by the embodiment of the present application can be applied to a multi-camera shooting system.
  • the multi-camera shooting system includes at least Two wireless shooting devices.
  • the multi-camera shooting system 10 includes three wireless shooting devices: the first electronic device 100, the second electronic device 200 and the third electronic device 300, and one wireless shooting device is a camera position of the multi-camera shooting system.
  • a convenient way to select and switch the video images captured by each camera position in the multi-camera shooting system is to integrate the guide screen into the main position of the multi-camera shooting system.
  • the first electronic device 100 is used as a multi-camera
  • the main position of the shooting system, the first electronic device 100 as the main position needs to shoot video images, and at the same time manage the video images shot by each camera position in the multi-camera shooting system, so the first electronic device 100 must at least have a shooting function, display function, communication function and data processing function
  • the first electronic device 100 can be a mobile phone or other wireless shooting device
  • the second electronic device 200 and the third electronic device 300 are auxiliary camera positions of the multi-camera shooting
  • the electronic device at the stand needs to capture video images and transmit them to the host stand, so the second electronic device 200 needs to have at least a shooting function and a communication function
  • the second electronic device 200 and the third electronic device 300 can be wireless shooting devices without a display function or cell phone.
  • the master position and the auxiliary position in the multi-camera shooting system need to be networked first to establish a communication connection. After that, the master position can send control commands to the auxiliary position through the communication connection.
  • the control instruction can realize, for example, the screen control of the shooting video, the control of the shooting camera, the control of whether the video image is transmitted to the main position, the control of whether the auxiliary position sleeps, etc.
  • the first electronic device 100, the second electronic device 200 and the third electronic device 300 establish a connection through a wireless communication network, for example, a wireless communication connection can be established through WiFi, and the first electronic device 100, the second electronic device 200 and the third electronic device
  • the instruction transmission and data transmission between the electronic devices 300 can be transmitted through the WiFi wireless communication link.
  • the master position can set the camera hardware abstraction layer CameraHAL
  • the slave position can set the VirtualCameraAgent virtual camera agent.
  • the control command is forwarded to the VirtualCameraAgent of the peer auxiliary machine through the CameraHAL to control the auxiliary machine, and the VirtualCameraAgent of the auxiliary machine is used to escape the control command sent by the peer master to the corresponding ISP to control the camera.
  • the master position allows the peer slave position to transmit the video image to the master position, and present the video image of the slave position on the master position.
  • the structure of the multi-camera shooting system 10 shown in the embodiment of the present application does not constitute a limitation on the structure of the multi-camera shooting system 10.
  • the multi-camera shooting system 10 may include Show more or less wireless camera equipment.
  • the multi-camera shooting system 10 generally has one host location, and in special cases, multiple host locations may also be set.
  • FIG. 2 is a schematic diagram of a camera of an electronic device provided in an embodiment of the present application.
  • the mobile phone is taken as an example to illustrate the first electronic device 100 in FIG. 1.
  • FIG. 2 shows the front view and rear view of the mobile phone, and two front cameras 111 are arranged on the front side of the mobile phone. , 112, four rear cameras 121, 122, 123, 124 are arranged on the rear side of the mobile phone.
  • users can be provided with a variety of shooting modes, which improves the flexibility of users in shooting videos.
  • FIG. 2 is only an exemplary illustration, and should not be taken as a limitation of the protection scope of the present application.
  • the electronic devices involved in the embodiments of the present application can also be tablet computers, personal computers (personal computers, PCs), personal digital assistants (personal digital assistants, PDAs), smart watches, netbooks, wearable electronic devices, Augmented reality (augmented reality, AR) equipment, virtual reality (virtual reality, VR) equipment, vehicle equipment, smart car, smart audio, robot, smart glasses, smart TV, etc.
  • an electronic device may also be called a terminal device, a user equipment (User Equipment, UE), etc., which is not limited in this embodiment of the present application.
  • the second electronic device and the third electronic device shown in FIG. 1 may also use the electronic device shown in FIG. 2 .
  • the electronic equipment of multiple camera positions enters the working mode.
  • the master position will display the main interface .
  • the main interface is used to display video images.
  • the video images displayed here are the video images provided by the master position or the auxiliary position.
  • the master position When the master position is successfully networked for the first time, it can display the master position or One channel of video image provided by the auxiliary unit is used as the initial video image in the main interface.
  • FIG. 3 is a schematic flowchart of a shooting method of a multi-camera shooting system provided in an embodiment of the present application, which is applied to the first electronic device 100 of the multi-camera shooting system shown in FIG. 1 , and the first electronic device 100 It is the main position of the multi-camera shooting system, as shown in Figure 3, and the shooting methods may include:
  • Step 1000 As shown in Figure 4a, the first electronic device displays the main interface 20, the main interface 20 is the interface watched by the broadcaster or the recorder, the main interface 20 includes the first video image 201, the first video image 201 is, for example, a hand held bike screen;
  • Step 1001 the first electronic device receives a first user operation in video shooting mode
  • Step 1002 As shown in FIG. 4b, the first electronic device displays a second video image 202 on the main interface 20 according to the first user operation.
  • the second video image 202 is, for example, a meditation picture, the first video image 201 and the second video image 202 can be overlapped and displayed on the main interface 20, the display area of the first video image 201 can be larger than the display area of the second video image 202, the second video image 202 can be displayed on the upper layer of the first video image 201, and the first video image 201
  • the second video image 202 is from the master position or the auxiliary position, that is, the first video image 201 and the second video image 202 are video images provided by different positions in the multi-camera shooting system;
  • the first video image 201 is a recorded image or a live image, that is, the first video image 201 will be recorded and saved or transmitted to the server for live broadcasting, which is the video image finally presented to the audience
  • the second video image 202 is a non-recording screen, or a guide screen, that is, the second video image 202 is only used for the host to watch and preview, and will not be presented to the audience. If the second video image 202 comes from the second electronic device, then on the main interface 20. When the second video image 202 is displayed, the first electronic device will send an instruction to acquire the second video image to the second electronic device, and the second electronic device will transmit the captured second video image to the first electronic device according to the instruction.
  • Step 1003 the first electronic device receives a video switching operation, and the video switching operation is aimed at the second video image 202, for example, the user clicks on the meditation screen in the main interface 20;
  • Step 1004 As shown in FIG. 4c, the first electronic device switches the first video image 201 and the second video image 202 according to the video switching operation, that is, switches the first video image 201 to the original display area of the second video image 202 , switch the second video image 202 to the original display area of the first video image 201.
  • the first video image 201 becomes a guide screen only for the host to watch and preview, and is no longer presented to the audience.
  • the second video image 202 becomes a recording screen or a live broadcast screen, which is presented to the audience.
  • the first video image 201 can be displayed on the upper layer of the second video image 202 .
  • the first electronic device when the user clicks on the meditation screen in the main interface 20 shown in FIG. 4b, the first electronic device will switch the video image, and the main interface 20 will be switched from the one shown in FIG. 4b to the one shown in FIG. 4c.
  • the video switching operation In addition to the switching of the video image in the interface, in terms of function, the meditation screen is switched to the recording screen, and the hand-held bicycle screen is switched to the director screen.
  • the first electronic device 100 enters the shooting application.
  • the shooting application here includes but is not limited to shooting or live broadcasting. Camera applications or other applications that support multi-camera systems.
  • the user can see the first video image 201 of the main interface 20, and the user wants to view the video images provided by each camera through the guide screen, and can perform the first user operation , so that the second video image 202 as the conduction screen is displayed on the main interface 20 , so that the main interface 20 can watch the video image from one camera position while viewing the video image from another camera position.
  • the main interface 20 may include a plurality of second video images 202, for example, the user may see multiple second video images 202 provided by multiple cameras through the main interface 20, and the user may select from the main interface 20 to A certain path of the second video image recorded is switched with the first video image 201 to realize the recording of the second video image 202 of the path, that is, the second video image 202 to be recorded and the second video image 202 to be recorded are selected from the main interface 20 through the video switching operation.
  • a video image 201 is switched. By switching the video image, the flexibility of video shooting is improved.
  • the original first video image 201 of the main interface 20 is switched to a guide screen, so that the host can continue to watch the first video image 201 in the main interface 20 .
  • the main interface 20 includes operation controls, such as a video recording button, a pause button, a floating ball, a zoom button, etc.
  • the floating ball can be dragged to any position, and the floating ball is used to trigger the display of the second video image on the main interface
  • the first user operation includes a click operation acting on an operation control (such as a floating ball), or the first user operation includes a first sliding gesture operation acting on a preset position 30, for example, as shown in FIG.
  • the preset Position 30 is the display area corresponding to the second video image 202 before the video switching; the video switching operation is before the video switching operation, and the video switching operation includes a click operation acting on the second video image 202, which can be a fast single click Click operation, also can be long press operation.
  • the first slide gesture operation is a right slide gesture operation.
  • the main interface 20 will become as shown in FIG.
  • a second video image 202 is displayed.
  • the first electronic device displays a floating ball
  • the main interface 20 will change to display the second video image 202 as shown in FIG. 4 b .
  • the first user operation may also be other forms of user operations, such as virtual button operations, physical button operations, etc., and the form of the first user operation is not limited in this embodiment.
  • the video switching operation may include a user's long press operation on the second video image 202 .
  • the main interface 20 will become as shown in Figure 4c, and the first video image 201 and the second video image 202 are switched.
  • the first video image 201, then the first video image 201 and the second video image 202 will switch again, that is, the main interface 20 will change back to that shown in FIG. 4b.
  • the video switching operation can also be other forms of user operations, such as virtual button operation, physical button operation, etc.
  • the main interface 20 can include a video switching control, and the video switching operation can include operations acting on the video switching control.
  • the form of the switching operation is not limited.
  • the second video image 202 shown in FIG. 4b can be hidden, or the first video image 201 shown in FIG. 4c can be hidden, so that the user can better Watch the video image of a road being recorded.
  • the first electronic device in step 1004 switches the first video image 201 and the second video image 202 according to the video switching operation
  • the shooting method can also include:
  • Step 1005 the first electronic device receives a second user operation
  • Step 1006 The first electronic device hides the first video image 201 on the main interface according to the second user operation, that is, according to the second user operation, the screen display state of the first electronic device changes from Figure 4c to Figure 4d, in this example the hidden
  • the main interface 20 only displays the second video image 202 after the first video image 201 .
  • steps 1007 and 1008 can also be performed.
  • the non-recording screen can be displayed or hidden as needed, which improves the flexibility of video shooting.
  • the first video image 201 comes from the second electronic device, when the first electronic device hides the first video image 201 on the main interface, there may be two situations for the second electronic device, one situation is The second electronic device still transmits the first video image to the first electronic device, so that when the first electronic device can quickly resume displaying the first video image, in another case the second electronic device receives an instruction from the first electronic device, And no longer transmit the first video image to the first electronic device according to the instruction to save power consumption, but if the first electronic device needs to resume displaying the first video image, the first electronic device needs to send a message to resume displaying the first video image
  • the instruction is sent to the second electronic device, and the second electronic device receives the instruction, and restores and transmits the first video image to the first electronic device according to the instruction.
  • the second electronic device is a mobile phone, during the process of the first electronic device hiding the first video image, the screen of the second electronic device may always display the first video image, or may hide the first video image at the same time.
  • the process shown in Figure 5b is another shooting process parallel to the process shown in Figure 5a.
  • the shooting method further includes: receiving a second user operation; according to the second user operation, hiding the second video image on the main interface, even if the interface shown in Figure 4b changes to It is the interface shown in Figure 4a; receiving a third user operation; according to the third user operation, displaying the second video image on the main interface, even if the interface shown in Figure 4a is restored to the interface shown in Figure 4b.
  • steps 1003 and 1004 can be performed to realize video switching, so that the interface shown in FIG. 4b becomes the interface shown in FIG. 4c.
  • the third user operation may be the same as the above-mentioned first user operation, or may be different from the above-mentioned second user operation.
  • the operation control (such as a floating ball) is used to trigger the hiding of the first video image on the main interface and the hiding of the first video image on the main interface.
  • the second user operation and the third user operation include acting on the operation control (such as
  • the third user operation may also include a first slide gesture operation acting on the preset position 30;
  • the second user operation may include a second slide gesture operation acting on the preset position 30, the first
  • the sliding gesture operation and the second sliding gesture operation may be sliding gesture operations in opposite directions, for example, the second sliding gesture operation is a leftward sliding gesture operation. For example, when the user performs a gesture operation of sliding left at the preset position 30 shown in FIG.
  • the main interface 20 will change as shown in FIG. 4c, that is, the display of the first video image 201 will resume.
  • the second user operation and the third user operation may also be other forms of user operations, such as virtual button operations, physical button operations, etc., and this embodiment does not limit the forms of the second user operations and the third user operations.
  • a first video image 201 is displayed on the main interface 20 of the first electronic device, and the first video image 201 is a channel of video images provided by the first electronic device or the auxiliary device.
  • the first video image 201 can be recorded.
  • the first electronic device receives the video recording operation and saves the data of the first video image 201, or saves the first video image 201.
  • the data of the video image 201 is transmitted to the server for live broadcast, etc.
  • the data of the video image is acquired by the camera that provides the video image and transmitted to the first electronic device, and the first electronic device saves it after encoding.
  • the first video image 201 can be displayed on the main interface 20 in full screen, or not in full screen, but in a medium screen or in a small screen. Requirements are set, and the size of the first video image 201 is not limited in this embodiment.
  • the first video image 201 is a video image provided by the first electronic device or the auxiliary machine position. If the display screen of the first electronic device is small, the main interface 20 may only display one channel of the first video image. Larger, the main interface 20 can also display multiple first video images, and the multiple first video images can come from different camera positions or different cameras from the same camera position, for example, when the main interface 20 displays two first video images. In the case of video images, the two first video images can be displayed on the main interface in vertical tiles or horizontal tiles. In actual application scenarios, they can be set based on the screen size of the first electronic device. In this embodiment, the main interface displays The number of first video images is not limited.
  • the second video image 202 is displayed on the main interface 20, the second video image 202 is the video image provided by the first electronic device or the auxiliary machine position, the first video image 201 and the second video image 202 It is a video image provided by different cameras.
  • the display size of the second video image 202 will not be set too large, generally the display size of the second video image 202 is smaller than the display size of the first video image 201, And the resolution of the second video image 202 is smaller than the resolution of the first video image 201.
  • the first electronic device sends a video acquisition instruction to the auxiliary machine position, and the auxiliary machine position
  • the low-resolution video images can be transmitted to the first electronic device, so as to reduce the amount of data transmission.
  • the second video image 202 will be superimposed on the first video image 201 for display, if the first video image 201 is not displayed in full screen, then the second video image 202 can be superimposed or not A video image 201 is displayed.
  • the size and position of the second video image and the positional relationship with the first video image are not limited.
  • the main interface 20 may include more than one second video image, for example, the main interface 20 may display two second video images, and the two second video images may be tiled vertically Alternatively, it may be displayed horizontally in partial areas of the main interface 20 . In actual application scenarios, it may be set based on the size of the display screen and the size of the main interface.
  • the number of second video images 202 is not limited in this embodiment.
  • one of the first video image and the second video image comes from the second electronic device 200, and the second electronic device 200 is an auxiliary camera position of a multi-camera shooting system; the first video The other of the image and the second video image comes from the first electronic device 100 or the third electronic device 300, and the third electronic device 300 is another auxiliary camera position of the multi-camera shooting system. That is to say, in the scene shown in FIG. 4b or 4c, combined with the multi-camera shooting system shown in FIG.
  • the first video image 201 and the second video image 202 One is taken by the first electronic device 100 itself, and the other of the first video image 201 and the second video image 202 is taken by the second electronic device 200; in another possible shooting process, the first One of the video image 201 and the second video image 202 is taken by the second electronic device 200 , and the other of the first video image 201 and the second video image 202 is taken by the third electronic device 300 .
  • FIG. 4d is a schematic diagram of a scene after the first electronic device hides the first video image in FIG. 4c.
  • the main interface 20 hides the first video image, and now the main interface 20 only displays the second video image 202 .
  • the user when the user needs to view other video images, it can be realized by performing a camera switch operation.
  • the shooting method may further include:
  • Execute step 1009 the first electronic device receives a position switching operation, and the position switching operation is aimed at the first video image 201;
  • Execute step 1010 the first electronic device replaces the first video image 201 with the third video image 203 according to the camera position switching operation, and the first video image 201 and the third video image 203 are like different camera positions in a multi-camera shooting system Video image provided.
  • a multi-camera shooting system includes three electronic devices.
  • the second video image 202 of the main interface 20 in the first electronic device 100 is a video image captured by the camera of the first electronic device 100 itself, such as a picture of sitting in meditation.
  • the second video image 202 of the main interface 20 is a video image taken by the second electronic device 200, such as a picture of a bicycle being held in hand, and the video image taken by the third electronic device 300 (for example, a landscape picture) has not yet been displayed on the second video image.
  • An electronic device 100 after receiving the position switch operation, according to the position switch operation, the first electronic device 100's main interface 20 switches the image of holding a bicycle to a landscape image. That is, it is realized to switch the non-recording screen in the main interface 20 to video images provided by different cameras.
  • the camera location switching operation may be performed, so that the user can view video images provided by other camera locations through the main interface 20 of the first electronic device 100 .
  • the first electronic device 100 receives the position switching operation, it displays a video image of another position provided by the main position or the auxiliary position at the position where the picture is not recorded. For example, there are four video images provided by the main machine position and the auxiliary machine position, and the video image provided by one machine position is the recording screen of the main interface 20, and the video images provided by the remaining three machine positions can be used as the main interface.
  • the non-recording screen at 20 is presented, if the current non-recording screen only displays the video image provided by one camera, and the video images provided by two cameras are not displayed on the main interface 20, then perform a camera switching operation, and the main interface 20
  • the non-recording screen of the camera is switched to the video image provided by another camera, and the video images provided by the three cameras can be viewed in turn by performing the camera switch operation repeatedly.
  • the user can easily view the video images of all camera positions that have not entered the main interface 20 through the camera position switching operation, which is convenient for the user to watch video images of different camera positions.
  • the camera position switching operation includes a double-click operation on the first video image 201 .
  • the first video image 201 switches to the third video image 203 of another camera position, if the user continues to double-click the third video image 203, the third video image 203 Switch to the video image of another camera, and so on, and switch once every time you double-click.
  • the sequence of camera position switching can be preset by the system.
  • the camera switch operation can also be other forms of operations, such as virtual button operations, physical button operations, etc.
  • the main interface can include camera switch controls, and the camera switch operations can include operations that act on the camera switch controls. There is no limitation on the form of the machine location switching operation.
  • the second electronic device can continuously transmit the first video image
  • the third electronic device can also transmit the third video image to the first electronic device, so that the first electronic device can quickly resume displaying the first video image or the third video image.
  • the first electronic device can also send instructions to the second electronic device and the third electronic device, for example, the second electronic device receives an instruction from the first electronic device, and no longer transmits the first video image to the first electronic device according to the instruction.
  • the third electronic device receives an instruction from the first electronic device, and restores and transmits the third video image to the first electronic device according to the instruction.
  • the screen of the second electronic device may always display the first video image, or the first electronic device may display the first video image After the image is switched to the third video image, the second electronic device hides the first video image, and the screen of the third electronic device can always display the third video image, or the first electronic device can switch the first video image to the third video image After the image, the third electronic device starts to display the third video image.
  • the second electronic device 200 when the second electronic device 200 is a mobile phone including a front camera and a rear camera as shown in FIG. 2, the first video in the main interface 20 of the first electronic device 100 is The image comes from the rear camera of the second electronic device 200 , and in order to view the video image provided by the front camera of the second electronic device 200 , it can be implemented through a camera switching operation.
  • the shooting method may further include:
  • Execute step 1011 the first electronic device 100 receives a camera switching operation, and the camera switching operation is for the first video image 201;
  • Execute step 1012 the first electronic device 100 replaces the first video image 201 with the fourth video image 204 according to the camera switching operation, and the first video image 201 and the fourth video image 204 are from the same camera position in the multi-camera shooting system Video images provided by different cameras.
  • the multi-camera shooting system includes a first electronic device 100 and a second electronic device 200, wherein the second electronic device 200 has a front camera and a rear camera.
  • the second video image 202 in the main interface 20 of the first electronic device 100 is a video image captured by the camera of the first electronic device 100 itself, such as a meditation picture
  • the main interface of the first electronic device 100 In 20 the first video image 201 is a video image captured by the rear camera of the second electronic device 200, such as a picture of holding a bicycle, and what the second electronic device 200 displays at this time is also the image captured by its rear camera.
  • the first electronic device 100 switches the first video image 201 in the main interface 20 to the fourth video image 204, and the fourth video image 204 comes from the second
  • the selfie picture taken by the front camera of the electronic device 200 can also send a corresponding control command to the second electronic device 200 according to the camera switching operation, so that the second electronic device 200 also switches to display the selfie picture taken by its front camera. picture. That is, it is realized that the non-recording screen of the main interface 20 in the first electronic device 100 is switched to a video image provided by a different camera in the same position.
  • a camera switching operation may be performed.
  • the first electronic device 100 receives the camera switching operation, it will switch the current non-recording picture in the main interface 20 to the video image provided by another camera at the same position.
  • the user can easily view the video images provided by each camera in the same position, which is convenient for the user to watch the video images of different cameras, and improves the flexibility of video shooting.
  • the camera switching operation includes a triple-click operation on the first video image 201 .
  • the first video image 201 will switch to the video image provided by another camera of the same camera position. If there are more than two cameras, the user can continue to click three times. Click once to switch once.
  • the sequence of camera switching can be preset by the system.
  • the camera switching operation can also be other forms of operations, such as virtual button operations, physical button operations, etc.
  • the main interface 20 can include a camera position switching control, and the camera position switching operation can include operations that act on the camera position switching controls. The form of the camera switching operation is not limited.
  • the second electronic device can continuously transmit the first video image and the fourth video image to the second electronic device.
  • An electronic device so that the first electronic device can quickly resume displaying the first video image or the fourth video image.
  • the first electronic device can also send instructions to the second electronic device, for example, when the first electronic device Before the device receives the camera switching operation, both the first electronic device and the second electronic device display the first video image, and when the first electronic device receives the camera switching operation, it sends a response instruction to the second electronic device, and the second electronic device according to the Instructing to display the fourth video image, the first electronic device switches the first video image to the fourth video image.
  • the second electronic device may not transmit the fourth video image to the first electronic device. At this time, when the second electronic device receives an instruction from the first electronic device, it may transmit the fourth video image to the The first electronic device, so that the first electronic device performs camera switching.
  • a picture-in-picture effect can also be added to the recording screen.
  • the shooting method can also be include:
  • Execute step 1013 the first electronic device 100 receives a picture-in-picture display operation, and the picture-in-picture display operation is for the first video image 201;
  • Execute step 1014 the first electronic device 100 displays a fifth video image 205 at least partially surrounded by the second video image 202 on the main interface 20 according to the picture-in-picture display operation, the fifth video image 205 is the same as the first video image 201, The fifth video image 205 and the second video image 202 are recorded images or live images, that is, superimposed images of the fifth video image 205 and the second video image 202 are presented to the audience.
  • the picture-in-picture display operation includes a drag operation on the first video image 201 , and the user presses and drags the first video image 201 upwards to generate the fifth video image 205 .
  • the display size of the fifth video image 205 is smaller than the display size of the second video image 202, and the resolution of the fifth video image 205 is smaller than the resolution of the second video image 202, when the fifth video image 205
  • the auxiliary machine position can transmit low-resolution video images to the first electronic device, so as to reduce the amount of data transmission.
  • the picture-in-picture display operation can be performed, so that the main interface 20 of the first electronic device 100 displays the fifth video image 205 as a part of the recording picture, the fifth video image At least part of 205 is surrounded by the second video image 202, the superposition of the fifth video image 205 and the second video image 202 is a recording picture, that is, the fifth video image 205 and the second video image 202 are recorded as superimposed video images, so that It can be saved as a video screen with picture-in-picture effect, or transmitted to the server for live broadcast to form a live screen with picture-in-picture effect.
  • the video image recording effect of picture-in-picture increases the expression form of video and improves the flexibility of video shooting.
  • the picture-in-picture display operation may include a drag operation on the first video image 201 .
  • a drag operation on the first video image 201 .
  • the picture-in-picture display operation can also be other forms of operation, such as virtual button operation, physical button operation, etc.
  • the main interface includes a picture-in-picture control.
  • the picture-in-picture display operation can include operations acting on the picture-in-picture control.
  • the form of the picture-in-picture display operation is not limited.
  • the fifth video image 205 can be dragged in any area covered by the main interface 20 .
  • the user can move the position of the fifth video image 205 in the main interface 20 by dragging the fifth video image 205 to move in the main interface 20, and the user can select a position to place the fifth video image 205 according to requirements, Improved flexibility for video shooting.
  • the fifth video image 205 may be hidden to end the picture-in-picture display effect.
  • the shooting method may further include:
  • Execute step 1015 the first electronic device 100 receives a picture-in-picture hiding operation, and the picture-in-picture hiding operation may include a drag operation acting on the fifth video image 205, for example, the user presses and drags the fifth video image 205 upwards and slides out When the border of the main interface 20 is displayed, the fifth video image 205 is hidden, that is, the main interface 20 of the first electronic device 100 does not display the fifth video image.
  • the picture-in-picture hiding operation may include a drag operation acting on the fifth video image 205, for example, the user presses and drags the fifth video image 205 upwards and slides out
  • the fifth video image 205 is hidden, that is, the main interface 20 of the first electronic device 100 does not display the fifth video image.
  • Step 1016 The first electronic device 100 hides the fifth video image 205 on the main interface 20 according to the picture-in-picture hiding operation.
  • a picture-in-picture hiding operation may be performed to hide the fifth video image 205 .
  • the picture-in-picture display operation can be performed again, so that the fifth video image 205 is displayed.
  • the picture-in-picture effect can be displayed or hidden as needed, which improves the flexibility of video shooting.
  • the picture-in-picture hidden operation can also be other forms of operations, such as virtual button operations, physical button operations, etc.
  • the main interface includes picture-in-picture controls
  • the hidden operation on the third interface can be For the operation of the picture-in-picture control, this embodiment does not limit the form of the hidden operation on the third interface.
  • the video image data is the video image data corresponding to the video image after the first video image 201 and the fifth video image 205 are superimposed, the video image data is collected by the camera position that provides the video image and transmitted to the second An electronic device 100, the first electronic device 100 is encoded and stored or transmitted to a server for live broadcast.
  • the user can control the video images displayed on the main interface 20 of the first electronic device 100 , and can respectively realize the screen control of different video images, such as zooming, focusing and other operations.
  • the main interface 20 in the first electronic device 100 may present a video image after screen control.
  • the implementation method is that the first electronic device 100 transmits the picture control instruction to the corresponding camera position, and the corresponding camera position adjusts the video image according to the picture control command, and transmits the adjusted video image to the first electronic device 100 for display.
  • the special effect control instructions can be transmitted to the auxiliary machine position corresponding to the video image.
  • the corresponding auxiliary machine position adjusts the video image according to the special effect control instruction, and transmits the adjusted video image to the first electronic device 100 for display.
  • the first electronic device 100 displays a fifth video image
  • the same special effect control can be implemented on the second video image and the fifth video image, or can be performed on the second video image and the fifth video image.
  • the five video images implement different special effect controls respectively.
  • the first electronic device 100 when the user operates the video image displayed on the main interface 20 on the first electronic device 100, and the video image to be operated is a video image provided by the auxiliary machine position, the first electronic device 100 needs to send a message to the auxiliary machine.
  • the camera station sends a shooting control instruction, so that the auxiliary camera station transmits the operated video image to the first electronic device 100 for display.
  • all shooting control instructions sent by the first electronic device 100 to the auxiliary machine position need to be transmitted with priority.
  • the process of the first electronic device 100 displaying the second video image 202 on the main interface 20 according to the first user operation includes:
  • Step 10021 the first electronic device 100 generates a data transmission control command according to the first user operation, and the data transmission control command carries a high priority tag;
  • Step 10022 the first electronic device 100 transmits the data transmission instruction to the second electronic device 200 based on high priority
  • the data transmission instruction is used to control the second electronic device 200 to return the captured second video image to the first electronic device 100;
  • Step 10023 the first electronic device 100 receives the second video image sent by the second electronic device 200;
  • Step 10024 The first electronic device 100 displays the second video image 202 on the main interface 20 .
  • the above method may further include: sending a focus control instruction or a zoom control instruction, etc. to the second electronic device 200 based on a high priority according to a user operation.
  • the shooting control commands such as data transmission control command, focus control command and zoom control command are transmitted to the auxiliary machine position through WiFi for shooting control.
  • Figure 10 shows a schematic diagram of the transmission queue.
  • the media access control service data unit (Mac Service Data Units, MSDU) is classified into multiple transmission queues VO, A_VO, A_VI, VI, BE, BK, VO refers to voice (Voice), VI refers to video (Video), BE refers to best effort (Best effort), BK refers to background (Background); the transmission queue will be classified into enhanced distributed channel access (enhanced distributed channel access, EDCA) queue, EDCA queue includes VO, VI, BE and BK according to the priority level.
  • VO voice
  • VI refers to video
  • BE refers to best effort (Best effort)
  • BK refers to background (Background)
  • the transmission queue will be classified into enhanced distributed channel access (enhanced distributed channel access, EDCA) queue
  • EDCA queue includes VO, VI, BE and BK according to the priority level.
  • the data packets of these shooting control instructions in the embodiment of the present application carry high priority tags, and these data packets carrying high priority tags are treated differently and put into the EDCA queue of WiFi
  • the high-priority queue (that is, the VO queue in Figure 10) is used to transmit to the second electronic device, and other control commands other than shooting control commands and video image transmission data are placed according to the default queue of the protocol.
  • the corresponding camera position in order to reduce the power consumption of each camera position in the multi-camera shooting system, when the video image of a certain camera position is not displayed on the main interface of the first electronic device, the corresponding camera position can be controlled to enter low power consumption working status.
  • Fig. 11 is a schematic flowchart of another shooting method of a multi-camera shooting system provided by the embodiment of the present application.
  • the shooting method may also include:
  • Step 1005 receiving a second user operation
  • Step 1006 According to the second user operation, hide the first video image 201 on the main interface 20.
  • steps 1005 and 1006 please refer to the above-mentioned related descriptions in FIG. 5a and FIG. 5b;
  • Step 1017 After the main interface 20 hides the first video image 201, and the first electronic device 100 does not display the video image from the second electronic device 200, the first electronic device 100 sends a standby control instruction to the second electronic device 200,
  • the standby control instruction is used to instruct the second electronic device 200 to turn off any or any combination of the following components or work in a low power consumption mode: camera module, image signal processor ISP, video processor VPU, display screen and wireless communication link
  • a wireless communication link is used to transmit video images from the second electronic device 200 to the first electronic device 100 .
  • the second electronic device 200 if it receives a standby control instruction, it will perform standby according to the standby control instruction, such as shutting down any of the above-mentioned components or combinations or switching them to work in a low power consumption mode.
  • the camera positions in the multi-camera shooting system may be mobile devices or other wireless shooting devices, which can only rely on their own power.
  • the second electronic device 200 can be a mobile phone, and it is necessary to consider reducing the shooting power consumption of the mobile phone.
  • the low power consumption mode is used to maintain low power consumption of the device, for example, controlling the second electronic device 200 to enter a standby mode. That is to say, for a multi-camera shooting system, if the video image of a certain camera is not displayed by the first electronic device 100, that is, it is not used by the first electronic device 100, then the first electronic device 100 can pass Send it a standby control command to control the corresponding machine position to reduce power consumption.
  • the first electronic device 100 itself, if the video images it displays are all from the auxiliary machine position, that is, the first electronic device 100 does not display the video images captured by itself, then the first electronic device 100 can also be controlled to Its own camera module, image signal processor ISP and other devices that do not affect the display are turned off or controlled to work in a low power consumption mode.
  • the multi-camera shooting system includes a first electronic device 100 and a second electronic device 200, as shown in FIG. 4c and FIG.
  • the image 201 comes from the second electronic device 200.
  • the first electronic device 100 may send a corresponding standby control command to the second electronic device 200 to control the second electronic device 200.
  • the second electronic device 200 enters the standby mode to save power consumption.
  • the user may re-control the display of the first video image 201 in a short time after hiding the first video image 201.
  • the above step 1017 after the main interface 20 hides the first video image 201, and the first electronic device 100 does not display the video image from the second electronic device 200, the first The process of the electronic device 100 sending the standby control instruction to the second electronic device 200 may include:
  • the first electronic device 100 When the first electronic device 100 hides the first video image 201 on the main interface 20 for more than a preset time, and the first electronic device 100 does not display the video image from the second electronic device 200 within the preset time, the first electronic device The 100 sends a standby control instruction to the second electronic device 200 . In order to prevent the second electronic device 200 and the wireless communication link from being frequently woken up from the standby mode.
  • the first electronic device 100 may be provided with a detection module, which is used to periodically detect the target camera position whose video image is not used in the display screen of the device, and when the target camera position is detected, it will notify the target camera position to enter the standby mode, and turn off the corresponding device.
  • a detection module which is used to periodically detect the target camera position whose video image is not used in the display screen of the device, and when the target camera position is detected, it will notify the target camera position to enter the standby mode, and turn off the corresponding device.
  • the quick start of the second electronic device 200 entering the standby mode requires: 1) quick recovery of the wireless communication link; 2) quick recovery of power components that have been turned off: camera module, ISP, VPU and/or display screen wait.
  • the wireless communication link has a continuous communication state.
  • the video image transmission efficiency between the first electronic device 100 and the second electronic device 200 is relatively high, so as to facilitate
  • the first electronic device 100 receives the video image from the second electronic device 200 through a wireless communication link, and displays the video image on the main interface 20 of the first electronic device 100, when the first electronic device 100 hides the first video image
  • the first electronic device 100 does not display the video image from the second electronic device 200 within the preset time, it means that the user may not use the video image from the second electronic device 200 for a period of time. Therefore, the standby control command is sent to the second electronic device 200.
  • the standby control command is used to instruct the second electronic device 200 to shut down components such as the camera.
  • the electronic device 200 changes the wireless communication link from a continuous communication state to a periodic dormant communication state.
  • the wireless communication link includes alternate dormancy phases and wake-up phases. Data can be transmitted during the wake-up phase, that is, data transmission can be realized intermittently to save power consumption, while ensuring the basic information of the wireless communication link transfer function.
  • a Bluetooth Low Energy (BLE) connection between the first electronic device 100 and the second electronic device 200 is established, And disconnect the wireless communication link.
  • the first electronic device 100 and the second electronic device 200 judge to disconnect the wireless communication link (that is, the WiFi link) when the duration of the periodic dormant communication state reaches the first preset duration through the inactivity timer, that is, when When the inactivity timer expires, the wireless communication link is disconnected to reduce power consumption.
  • a BLE connection between the two can be established to realize functions such as command transmission.
  • the above method further includes: the first electronic device 100 executes the first standby recovery process S1 or the second standby recovery process S2 .
  • the first standby recovery process S1 and the second standby recovery process S2 both include the first electronic device 100 receiving the third user operation, and the first electronic device 100 displaying the first video image on the main interface 20 according to the third user operation 201 process.
  • the third user operation is a standby recovery operation, that is, the first standby recovery process S1 includes: Step 1018: the first electronic device 100 receives the standby recovery operation; the first electronic device 100 executes step 1021 according to the standby recovery operation: displaying the first video image 201 on the main interface 20 .
  • the second standby recovery process S2 includes:
  • Step 1007 the first electronic device 100 receives a third user operation
  • the first electronic device 100 performs step 1021 according to the third user operation: displaying the first video image 201 on the main interface 20;
  • the second standby recovery process S2 also includes: before receiving the third user operation, perform step 1018: the first electronic device 100 receives the standby recovery operation.
  • the first standby recovery process S1 and the second standby recovery process S2 also include:
  • the first electronic device 100 executes step 1019 according to the standby recovery operation: determining whether the wireless communication link is in a periodic dormant communication state or disconnected when the standby recovery operation is received;
  • step 10201 is performed: sending a standby recovery control instruction to the second electronic device 200 through the wireless communication link, and the standby recovery The control instruction is used to instruct the second electronic device 200 to restore the wireless communication link to the continuous communication state.
  • the wireless communication link can be quickly enabled.
  • step 10202 is performed: sending a standby recovery control command to the second electronic device 200 through a Bluetooth Low Energy BLE connection, the standby recovery control command It is used to instruct the second electronic device 200 to restore the wireless communication link to a continuous communication state, and at the same time disconnect the BLE connection to save power consumption.
  • the standby restoration control instruction because the wireless communication link has been disconnected before, authentication needs to be performed first, and the wireless communication link can be restored to the continuous communication state only after the authentication is successful.
  • the first electronic device 100 can receive the video image from the second electronic device 200 through the wireless communication link, and then perform step 1021 according to the standby recovery operation: on the main interface 20 A first video image 201 is displayed.
  • the transmission of the standby recovery control command and the display of the first video image 201 can be triggered by one standby recovery operation; while in the second standby recovery process S2, the standby recovery is triggered by the standby recovery operation
  • the sending of the instruction triggers the display of the first video image 201 through another third user operation.
  • the standby recovery operation can be set as the pre-operation of the third user operation, that is, the standby recovery command can be sent in advance before the user performs the third user operation, and the wireless network will be restored in advance.
  • the communication link, recovering the closed parts of the second electronic device, and then when the third user operation is received, the first video image 201 from the second electronic device will be displayed on the main interface 20, so as to improve the display of the first video image 201 response speed.
  • the third user operation is a standby recovery operation, that is, the standby recovery operation includes a click operation acting on an operation control (such as a hovering ball); in addition, the third user operation may also include Let the first swipe gesture operation of position 30.
  • the process from step 1019 to step 1021 is executed, to restore the display of the first video image 201.
  • the standby recovery operation includes a touch operation on the preset position 30, assuming that the preset position 30 is the area to be displayed corresponding to the first video image, as shown in FIG. 13 , in step After step 1017, when the first electronic device receives the user's touch operation on the preset position 30, it executes step 1019 to step 10202, so as to send a standby recovery control command to the second electronic device, when the first electronic device receives When the user performs the first sliding gesture operation on the preset position 30 , step 1021 is executed to restore the display of the first video image 201 .
  • the broadcast cycle interval of the BLE connection used is adjusted to be shorter than the broadcast cycle in other processes, such as the process of using BLE to realize smart home appliance control Among them, the broadcast cycle interval of the BLE connection is 200ms, but in the shooting method of the multi-camera shooting system in the embodiment of the present application, the broadcast cycle interval of the BLE connection can be adjusted to 50ms, so that it is convenient to send to An instruction of the second electronic device can be quickly responded to.
  • the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic dormant communication state, and in the first periodic dormant communication state
  • the power consumption is lower compared to the continuous communication state
  • the first electronic device changes the wireless communication link to the second when the duration of the wireless communication link in the first periodic dormant communication state reaches the first preset duration In the periodic communication state, the dormant period of the first periodic dormant communication state is shorter than the dormant period of the second periodic dormant communication state, and the power consumption can be further reduced by changing the wireless communication link into the second periodic dormant communication state.
  • the above method further includes: the first electronic device executes the third standby recovery process S3 or the fourth standby recovery process S4; the third standby Both the recovery process S3 and the fourth standby recovery process S4 include the above-mentioned process of receiving the third user operation and displaying the first video image 201 on the main interface 20 according to the third user operation;
  • the third user operation is a standby recovery operation; that is, the third standby recovery process S3 includes: Step 1018: receiving the standby recovery operation; according to the standby recovery operation, perform step 1021, Step 1021 : Display the first video image 201 on the main interface 20 .
  • the fourth standby recovery process S4 includes:
  • Step 1007 receiving a third user operation
  • step 1021 display the first video image 201 on the main interface 20;
  • the fourth standby recovery process S4 also includes: before receiving the third user operation, perform step 1018: receive a standby recovery operation.
  • the third standby recovery process S3 and the fourth standby recovery process S4 also include:
  • step 10201 send a standby recovery control command to the second electronic device through the wireless communication link, and the standby recovery control command is used to instruct the second electronic device to restore the wireless communication link to a continuous communication state.
  • the first electronic device 100 can receive the video image from the second electronic device 200 through the wireless communication link, and then perform step 1021 according to the standby recovery operation, step 1021:
  • the main interface 20 displays a first video image 201 .
  • the third user operation is a standby recovery operation, that is, the standby recovery operation includes a click operation acting on an operation control (such as a hovering ball); in addition, the third user operation may also include Assume that the first sliding gesture operation at position 30 is shown in FIG. 16.
  • the process from step 10201 to step 1021 is executed to restore the display of the first video image 201 .
  • the standby recovery operation includes a touch operation on the preset position 30, assuming that the preset position 30 is the area to be displayed corresponding to the first video image, as shown in FIG. 17 , in step After step 1017, when the first electronic device receives the user's touch operation on the preset position 30, it executes step 10201 to realize sending a standby recovery control instruction to the second electronic device. If the first sliding gesture operation is performed at the preset position 30 , step 1021 is executed to restore the display of the first video image 201 .
  • the wireless communication link can apply the data transmission process shown in Figure 18, the wireless communication link includes a plurality of synchronization cycles, the duration of the synchronization cycle is, for example, 524ms, each synchronization cycle Including the exploration window and data transmission phase, the duration of the exploration window is, for example, 16ms.
  • the master device Master involved in the wireless communication link will send a synchronization beacon Sync Beacons, and the slave device Slave involved in the wireless communication link It only needs to receive Sync Beacons to achieve synchronization with the master device. Therefore, the power consumption of the slave device is lower than that of the master device.
  • the multi-camera shooting system includes mobile phones and wireless shooting devices
  • the mobile phone is used as the master device
  • the wireless shooting device is used as the slave device to reduce the power consumption of the wireless shooting device.
  • the data transmission phase in each synchronization cycle transmits data; in the first periodic dormant communication state and the second periodic communication state, the wireless communication link includes Alternate sleep phases and wake-up phases, the data transmission phase of the wake-up phase can transmit data, and the data transmission phase of the sleep phase cannot transmit data, wherein the duration of the sleep phase of the first periodic sleep communication state is shorter than that of the second periodic communication The duration of the dormant phase of the state.
  • the auxiliary light on the second electronic device can be controlled to blink to remind the user that the camera position is still in use in the standby mode of the multi-camera shooting system, but it is not used.
  • Lens and other components of the second electronic device It can be understood that other methods may be used to remind the user, not limited to the auxiliary light blinking, so this embodiment does not limit the method of reminding the user that the camera position is working in the standby mode.
  • the first electronic device 100 and the second electronic device 200 are mobile phones
  • the third electronic device 300 is a wireless camera device.
  • the second electronic device 200 and the third electronic device 300 are respectively provided with auxiliary lights 900, and the first electronic device 100 sends a standby control command to the second electronic device 200 and the third electronic device 300 , turn off the screen and camera of the second electronic device 200, turn off the camera of the third electronic device 300, and the auxiliary lights on the second electronic device 200 and the third electronic device 300 flash to remind the user that the device is still in standby It is used in multi-camera, but the camera of the device is not used.
  • the first electronic device 100 receives a user's touch operation or click operation on the preset position 30, and according to the operation, sends a standby recovery instruction to the second electronic device, After sending the standby recovery control instruction to the second electronic device, the above method further includes:
  • the first electronic device 100 displays a transition image 209 at the preset position 30 according to a third user operation, for example, a first sliding gesture operation acting on the preset position 30;
  • the above-mentioned process of the first electronic device 100 displaying the first video image on the main interface according to the third user operation includes: the first electronic device 100 according to the third user operation, when the first electronic device returns to the continuous communication state through the wireless communication link
  • the transitional image 209 is replaced by the first video image 201, that is, the restored first video image 201 is displayed on the first electronic device 100, and the restored first video image 201 is displayed on the first electronic device 100.
  • a video image 201 is from the second electronic device.
  • the third user operation is a standby recovery operation. That is, the same user operation can be used to instruct to restore the wireless communication link, restore the turned off components of the second electronic device, and restore the first video image 201 displayed by the first electronic device.
  • the method further includes:
  • the first electronic device 100 displays a transition image at a preset position according to the standby recovery operation
  • the first electronic device 100 replaces the transition image 209 with the first video image when the first electronic device receives the first video image from the second electronic device through the wireless communication link restored to the continuous communication state.
  • Image 201 That is to say, on the basis of what is shown in FIG. 11 or FIG. 16 , a step of displaying a transitional image is added, and step 1021 is replaced with a process of "replacing the transitional image 209 with the first video image 201".
  • the third user operation is the first sliding gesture operation acting on the preset position 30 .
  • the first electronic device 100 hides the first video image 201 and sends a standby control instruction to the second electronic device
  • the user can perform an action on the first electronic device 100 at a preset position 30, since the video image of the auxiliary machine position needs to be displayed, the auxiliary machine position needs to transmit the video image to the first electronic device 100, and the first sliding gesture operation and the auxiliary machine position displayed on the main interface will appear.
  • the time difference of the camera's video image is the first sliding gesture operation acting on the preset position 30 .
  • the first electronic device 100 operates according to the first sliding gesture, and displays the pre-stored transition image 209 at the preset position 30; when the second electronic device and the wireless communication link recover from the low power consumption state, the first When the electronic device 100 receives the first video image 201, the transition image 209 is replaced by the first video image 201, so that the first electronic device 100 resumes displaying the first video image 201, which solves the problem of image display delay.
  • the transition image may be a motion effect of blurred and rotating pictures, or other types of fixed images, and this embodiment does not limit the type of transition image.
  • the standby recovery operation and the third user operation are different operations, for example, the standby recovery operation is a touch operation or a click operation acting on the preset position 30 .
  • the standby recovery operation is a touch operation or a click operation acting on the preset position 30 .
  • the first electronic device 100 displays a transition image at a preset position according to a third user operation
  • the first electronic device 100 replaces the transition image 209 with the first video image when the first electronic device receives the first video image from the second electronic device through the wireless communication link restored to the continuous communication state.
  • Image 201 That is to say, on the basis of what is shown in FIG. 13 or FIG. 17 , the step of displaying the transition image is added, and step 1021 is replaced with the process of "replacing the transition image 209 with the first video image 201".
  • the standby recovery operation is a touch operation or click operation on the preset position 30 of the first electronic device 100
  • the third user operation is a first sliding gesture operation acting on the preset position 30 .
  • the first electronic device 100 hides the first video image 201 and sends a standby control command to the second electronic device, when the user wishes to restore the display of the first video image 201, click the preset position 30 of the first electronic device 100 and execute the second electronic device.
  • a sliding gesture operation during which the standby recovery operation and the third user operation are executed in sequence.
  • the user clicks on the preset position 30 to restore the standby mode it will send a standby recovery control instruction to the second electronic device to restore the standby state in advance; If there is a video image in the first position, then the auxiliary unit needs to transmit the video image to the first electronic device 100, and there will be a time difference between the operation of the first sliding gesture and the display of the video image of the auxiliary unit on the main interface.
  • the first electronic device 100 operates according to the first sliding gesture, and displays the pre-stored transition image 209 at the preset position 30; when the second electronic device and the wireless communication link recover from the low power consumption state, the first When the electronic device 100 receives the first video image, the transition image 209 is replaced by the first video image 201, so that the first electronic device 100 resumes displaying the first video image 201, which solves the problem of image display delay.
  • different auxiliary positions may have different preset positions on the first electronic device, for example, the second electronic device has a corresponding preset position on the upper left corner of the screen on the first electronic device, and the third electronic device has a corresponding preset position on the first electronic device.
  • the upper right corner of the screen on the electronic device has a corresponding preset position.
  • the first electronic device when the user clicks on the upper left corner, or swipes the screen from the upper left corner to the lower right corner, as a third user operation, the first electronic device will send a standby recovery control command to the second electronic device.
  • the first electronic device when the user taps the upper right corner, or swipes the screen from the upper right corner to the lower left corner, the first electronic device will send a standby recovery control instruction to the third electronic device.
  • the following describes an embodiment in one scenario in conjunction with the process of realizing control based on a wireless communication link between the first electronic device and the second electronic device:
  • the first electronic device In the initial state, the first electronic device only displays the second video image 202 , and the second video image 202 is a video image taken by the first electronic device itself; after that, the user controls the first electronic device through a touch event, if the touch screen event involves the screen control of the remote second electronic device
  • the user controls to display the first video image from the second electronic device on the first electronic device, then the CameraHAL forwards to the VirtualCameraAgent of the second electronic device for control, so that the video image captured by the second electronic device is transmitted to the first On the electronic device, a first video image displayed on the main interface is formed.
  • two mobile phones supporting multi-camera shooting are used as the first electronic device 100 and the second electronic device 200 respectively.
  • Displaying and hiding of video images can be realized on the screen of the first electronic device 100 through slide-in and slide-out operations acting on the preset position 30 .
  • the main interface of the first electronic device 100 can display the second video image 202 taken by the first electronic device 100 itself.
  • the second video image 202 is used as the recording screen, which acts on the right sliding screen at the preset position 30.
  • the slide out operation can make the first video image 201 taken by the second electronic device 200 displayed on the main interface of the first electronic device 100, and the video switching operation can make the first video image 201 and the second video image 202 in the main interface Switching is performed so that the first video image 201 is switched to the recording screen.
  • the slide-in operation of sliding to the left at the preset position 30 can hide the second video image 202 .
  • picture-in-picture recording is also possible. If the first electronic device 100 hides the first video image 201 and does not use the video image of the second electronic device 200, the second electronic device 200 may choose to enable the low power consumption mode; or may choose not to enable the low power consumption mode.
  • the time delay of the control operation on the first electronic device 100 can be reduced through the aforementioned priority optimization strategy.
  • a mobile phone supporting multi-camera shooting is used as the first electronic device 100 and the fourth electronic device 400 to form a network
  • the fourth electronic device 400 is a shooting device.
  • the specific process and principle can be similar to the content involved in the above-mentioned Figure 21, the difference is that the first video image 201 in Figure 22 comes from the fourth electronic device 400, and the fourth electronic device 400 can be provided with a low power consumption warning light And start the prompt light, when the first electronic device 100 does not use the video image of the fourth electronic device 400, the low power consumption prompt light of the fourth electronic device 400 flickers, indicating that the network has been established, but no shooting or preview is used;
  • the startup indicator light of the fourth electronic device 400 will blink, indicating that the device has started shooting or previewing.
  • An embodiment of the present application also provides a shooting device for a multi-camera shooting system, which is applied to a first electronic device.
  • the first electronic device is the main position of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera position , the device includes: an interface display module, for displaying a main interface, the main interface includes a first video image; an operation receiving module, for receiving a first user operation in a video shooting mode; the interface display module is also used for, according to the first user Operation, display the second video image on the main interface, the first video image comes from the master position or the auxiliary position, and the second video image comes from the auxiliary position, that is, the first video image and the second video image are multi-camera shooting systems
  • the video images provided by different camera positions; the operation receiving module is also used to receive the video switching operation, and the video switching operation is aimed at the second video image; the video switching module is used to combine the first video image with the second video image according to the video switching operation The image is
  • the shooting device of the multi-camera shooting system can be applied to the shooting method of the multi-camera shooting system in any of the above-mentioned embodiments, and the specific process and principle are the same as those in the above-mentioned embodiments, and will not be repeated here.
  • the above division of the shooting devices of the multi-camera shooting system is only a division of logical functions, which may be fully or partially integrated into one physical entity or physically separated in actual implementation.
  • these modules can all be implemented in the form of software called by the processing element; they can also be implemented in the form of hardware; some modules can also be implemented in the form of software called by the processing element, and some modules can be implemented in the form of hardware.
  • any one of the interface display module, the operation receiving module, and the video switching module may be a separate processing element, or it may be integrated in the shooting device, such as being integrated in a certain chip of the shooting device.
  • each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or an instruction in the form of software.
  • the photographing device may be one or more integrated circuits configured to implement the above method, for example: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC), or, one or more microprocessors (digital singnal processor, DSP), or, one or more Field Programmable Gate Arrays (Field Programmable Gate Array, FPGA), etc.
  • ASIC Application Specific Integrated Circuit
  • DSP digital singnal processor
  • FPGA Field Programmable Gate Array
  • the processing element may be a general-purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processors that can call programs.
  • CPU central processing unit
  • these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).
  • SOC system-on-a-chip
  • the main interface includes an operation control
  • the operation control is used to trigger the display of the second video image on the main interface, for example, the first user operation includes a click operation acting on the operation control.
  • the first user operation includes a first sliding gesture operation acting on a preset position on the main interface.
  • the video switching operation includes a click operation on the second video image in the main interface.
  • one of the first video image and the second video image comes from the second electronic device, and the second electronic device is an auxiliary camera position of a multi-camera shooting system; the first video image and the second video image The other one of the images comes from the first electronic device or the third electronic device, and the third electronic device is another auxiliary camera position of the multi-camera shooting system.
  • the operation receiving module is also used to receive a second user operation; the interface display module is also used to hide the first video image on the main interface according to the second user operation; the operation receiving module is also used to receive the second user operation Three user operations; the interface display module is also used to display the first video image on the main interface according to the third user operation.
  • the main interface includes an operation control
  • the operation control is used to trigger, hide the first video image on the main interface and hide the first video image on the main interface, for example, the second user operation and the third user operation include acting on the operation The click action of the control.
  • the third user operation includes a first slide gesture operation acting on a preset position
  • the second user operation includes a second slide gesture operation acting on a preset position
  • the operation receiving module is also used to receive the position switching operation, and the position switching operation is aimed at the first video image; the interface display module is also used to replace the first video image with the second video image according to the position switching operation
  • Three video images, the first video image and the third video image are video images provided by different camera positions in the multi-camera shooting system.
  • the camera switch operation includes a double-click operation on the first video image.
  • the operation receiving module is also used to receive the camera switching operation, and the camera switching operation is aimed at the first video image;
  • the interface display module is also used to replace the first video image with the fourth video image according to the camera switching operation , the first video image and the fourth video image are video images provided by different cameras of the same camera position in the multi-camera shooting system.
  • the camera switching operation includes a triple tap operation on the first video image.
  • the operation receiving module is also used to receive a picture-in-picture display operation, and the picture-in-picture display operation is aimed at the first video image; the interface display module is also used to, according to the picture-in-picture display operation, display at least A fifth video image partially surrounded by the second video image, the fifth video image being identical to the first video image.
  • the picture-in-picture display operation includes a drag operation on the first video image.
  • the device further includes: a standby control module, configured to, after the main interface hides the first video image and the first electronic device does not display the video image from the second electronic device, send Standby control instruction, the standby control instruction is used to instruct the second electronic device to turn off any of the following components or any combination of components or work in a low power consumption mode: camera module, image signal processor ISP, video processor VPU, display screen and A wireless communication link, the wireless communication link is used to transmit video images from the second electronic device to the first electronic device, the second electronic device is an auxiliary camera position of the multi-camera shooting system, and the current video image is the first video image or the second video image.
  • a standby control module configured to, after the main interface hides the first video image and the first electronic device does not display the video image from the second electronic device, send Standby control instruction, the standby control instruction is used to instruct the second electronic device to turn off any of the following components or any combination of components or work in a low power consumption mode: camera module, image signal processor ISP, video processor V
  • the standby control instruction is also used to instruct the second electronic device to change the wireless communication link from a continuous communication state to a periodic dormant communication state;
  • the device also includes a communication control module, configured to When the duration of the dormant communication state reaches the first preset duration, establish a low-power Bluetooth BLE connection between the first electronic device and the second electronic device, and disconnect the wireless communication link;
  • the operation receiving module is specifically used for, Receive a third user operation in the first standby recovery process, or receive a standby recovery operation and a third user operation in the second standby recovery process, and in the first standby recovery process, the third user operation is a standby recovery operation;
  • standby The control module is also used for, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic dormant communication state, then the standby recovery control instruction is sent to the second electronic device through the wireless communication link, and the standby recovery control The instruction is used to instruct the second electronic device to restore the wireless communication link to
  • the standby recovery operation includes a touch operation on a preset position.
  • the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic dormant communication state;
  • the device also includes a communication control module, configured to When the duration of the first periodic dormant communication state reaches the first preset duration, the wireless communication link is changed to the second periodic communication state, and the dormancy period of the first periodic dormant communication state is shorter than the second periodic dormant communication state The dormancy period;
  • the operation receiving module is specifically used to receive the third user operation in the third standby recovery process, or receive the standby recovery operation and the third user operation in the fourth standby recovery process, and in the third standby recovery process,
  • the third user operation is a standby recovery operation;
  • the standby control module is also used to, according to the standby recovery operation, send a standby recovery control command to the second electronic device through a wireless communication link, and the standby recovery control command is used to instruct the second electronic device to enable the wireless The communication link is restored to a continuous communication
  • the standby recovery operation is a touch operation on a preset position.
  • the device further includes: the interface display module is further configured to, according to the third user operation, display the transition image at a preset position; the interface display module is further specifically configured to: according to the third user operation, when the first electronic device When the video image from the second electronic device is received through the wireless communication link restored to the continuous communication state, the transition image is replaced with the first video image.
  • the present application also provides an electronic device, the electronic device includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the When executed by the processor, the electronic device is triggered to execute some or all of the steps in the above method embodiments.
  • FIG. 23 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device 500 may be any electronic device in any of the foregoing embodiments.
  • the electronic device 500 may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (universal serial bus, USB) interface 430, a charge management module 440, a power management module 441, a battery 442, an antenna 1, and an antenna 2.
  • a processor 410 an external memory interface 420, an internal memory 421, a universal serial bus (universal serial bus, USB) interface 430, a charge management module 440, a power management module 441, a battery 442, an antenna 1, and an antenna 2.
  • USB universal serial bus
  • Mobile communication module 450 wireless communication module 460, audio module 470, speaker 470A, receiver 470B, microphone 470C, earphone jack 470D, sensor module 480, button 490, motor 491, indicator 492, camera 493, display screen 494, And a subscriber identification module (subscriber identification module, SIM) card interface 495, etc.
  • SIM subscriber identification module
  • the sensor module 480 may include a pressure sensor 480A, a gyroscope sensor 480B, an air pressure sensor 480C, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a temperature sensor 480J, a touch sensor 480K, and ambient light Sensor 480L, bone conduction sensor 480M, etc.
  • the electronic device 500 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 410 may include one or more processing units, for example: the processor 410 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 410 for storing instructions and data.
  • the memory in processor 410 is a cache memory.
  • the memory may hold instructions or data that the processor 410 has just used or recycled. If the processor 410 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 410 is reduced, thus improving the efficiency of the system.
  • processor 410 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
  • processor 410 may include multiple sets of I2C buses.
  • the processor 410 can be respectively coupled to the touch sensor 480K, the charger, the flashlight, the camera 493 and the like through different I2C bus interfaces.
  • the processor 410 may be coupled to the touch sensor 480K through an I2C interface, so that the processor 410 communicates with the touch sensor 480K through the I2C bus interface to realize the touch function of the electronic device 500 .
  • the I2S interface can be used for audio communication.
  • processor 410 may include multiple sets of I2S buses.
  • the processor 410 may be coupled to the audio module 470 through an I2S bus to implement communication between the processor 410 and the audio module 470 .
  • the audio module 470 can transmit audio signals to the wireless communication module 460 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
  • the PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal.
  • the audio module 470 and the wireless communication module 460 may be coupled through a PCM bus interface.
  • the audio module 470 can also transmit audio signals to the wireless communication module 460 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is generally used to connect the processor 410 and the wireless communication module 460 .
  • the processor 410 communicates with the Bluetooth module in the wireless communication module 460 through the UART interface to realize the Bluetooth function.
  • the audio module 470 can transmit audio signals to the wireless communication module 460 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 410 with peripheral devices such as the display screen 494 and the camera 493 .
  • MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 410 communicates with the camera 493 through the CSI interface to realize the shooting function of the electronic device 500 .
  • the processor 410 communicates with the display screen 494 through the DSI interface to realize the display function of the electronic device 500 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 410 with the camera 493 , the display screen 494 , the wireless communication module 460 , the audio module 470 , the sensor module 480 and so on.
  • the GPIO interface can also be configured as I15c interface, I14S interface, UART interface, MIPI interface, etc.
  • the USB interface 430 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 430 can be used to connect a charger to charge the electronic device 500 , and can also be used to transmit data between the electronic device 500 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 500 .
  • the electronic device 500 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 440 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 440 can receive the charging input of the wired charger through the USB interface 430 .
  • the charging management module 440 may receive wireless charging input through a wireless charging coil of the electronic device 500 . While the charging management module 440 is charging the battery 442 , it can also supply power to the electronic device through the power management module 441 .
  • the power management module 441 is used for connecting the battery 442 , the charging management module 440 and the processor 410 .
  • the power management module 441 receives the input of the battery 442 and/or the charging management module 440 to supply power for the processor 410 , the internal memory 421 , the display screen 494 , the camera 493 , and the wireless communication module 460 .
  • the power management module 441 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 441 may also be set in the processor 410 .
  • the power management module 441 and the charging management module 440 may also be set in the same device.
  • the wireless communication function of the electronic device 500 can be realized by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 500 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 450 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 500 .
  • the mobile communication module 450 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 450 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 450 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 450 may be set in the processor 410 .
  • at least part of the functional modules of the mobile communication module 450 and at least part of the modules of the processor 410 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs sound signals through audio equipment (not limited to speaker 470A, receiver 470B, etc.), or displays images or videos through display screen 494 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 410, and be set in the same device as the mobile communication module 450 or other functional modules.
  • the wireless communication module 460 can provide wireless local area network (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 460 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 460 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 410 .
  • the wireless communication module 460 can also receive the signal to be transmitted from the processor 410 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the electronic device 500 is coupled to the mobile communication module 450, and the antenna 2 is coupled to the wireless communication module 460, so that the electronic device 500 can communicate with the network and other devices through wireless communication technology.
  • Described wireless communication technology can comprise global system for mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access address (wideband codedivision multiple access, WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology etc.
  • GSM global system for mobile communications
  • general packet radio service general packet radio service
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access address
  • WCDMA wideband codedivision multiple access
  • time-division code division multiple access time-division
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenithsatellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 500 implements a display function through a GPU, a display screen 494, and an application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 494 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 494 is used to display images, videos and the like.
  • Display 494 includes a display panel.
  • the display panel can adopt liquid crystal display (liquid crystal display, LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrixorganic light-emitting diode) , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the electronic device 500 may include 1 or N display screens 494, where N is a positive integer greater than 1.
  • the electronic device 500 can realize the shooting function through the ISP, the camera 493 , the video codec, the GPU, the display screen 494 and the application processor.
  • the ISP is used to process data fed back by the camera 493 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 493 .
  • Camera 493 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the electronic device 500 may include 1 or N cameras 493, where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 500 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 500 may support one or more video codecs.
  • the electronic device 500 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG moving picture experts group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 500 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 420 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500.
  • the external memory card communicates with the processor 410 through the external memory interface 420 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 421 may be used to store computer-executable program code, which includes instructions.
  • the internal memory 421 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the electronic device 500 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 421 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the processor 410 executes various functional applications and data processing of the electronic device 500 by executing instructions stored in the internal memory 421 and/or instructions stored in a memory provided in the processor.
  • the electronic device 500 can implement audio functions through the audio module 470 , the speaker 470A, the receiver 470B, the microphone 470C, the earphone interface 470D, and the application processor. Such as music playback, recording, etc.
  • the audio module 470 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 470 may also be used to encode and decode audio signals.
  • the audio module 470 can be set in the processor 410, or some functional modules of the audio module 470 can be set in the processor 410.
  • Loudspeaker 470A also called “horn” is used to convert audio electrical signals into sound signals.
  • Electronic device 500 can listen to music through speaker 470A, or listen to hands-free calls.
  • Receiver 470B also called “earpiece” is used to convert audio electrical signals into audio signals.
  • the receiver 470B can be placed close to the human ear to receive the voice.
  • the microphone 470C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can put his mouth close to the microphone 470C to make a sound, and input the sound signal to the microphone 470C.
  • the electronic device 500 may be provided with at least one microphone 470C. In some other embodiments, the electronic device 500 may be provided with two microphones 470C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 500 can also be provided with three, four or more microphones 470C, so as to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 470D is used to connect wired earphones.
  • the earphone interface 470D can be a USB interface 430, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 480A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • pressure sensor 480A may be located on display screen 494 .
  • pressure sensors 480A such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors.
  • a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material.
  • the electronic device 500 may also calculate the touched position according to the detection signal of the pressure sensor 480A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.
  • the gyro sensor 480B can be used to determine the motion posture of the electronic device 500 .
  • the angular velocity of the electronic device 500 about three axes may be determined by the gyro sensor 480B.
  • the gyro sensor 480B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 480B detects the shaking angle of the electronic device 500, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the electronic device 500 through reverse movement to achieve anti-shake.
  • the gyroscope sensor 480B can also be used for navigation and somatosensory game scenes.
  • the air pressure sensor 480C is used to measure air pressure.
  • the electronic device 500 calculates the altitude based on the air pressure value measured by the air pressure sensor 480C to assist positioning and navigation.
  • the magnetic sensor 480D includes a Hall sensor.
  • the electronic device 500 may use the magnetic sensor 480D to detect the opening and closing of the flip leather case.
  • the electronic device 500 may detect opening and closing of the flip according to the magnetic sensor 480D.
  • features such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 480E can detect the acceleration of the electronic device 500 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the electronic device 500 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.
  • the electronic device 500 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 500 may use the distance sensor 480F to measure a distance to achieve fast focusing.
  • Proximity light sensor 480G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 500 emits infrared light through the light emitting diode.
  • Electronic device 500 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 500 . When insufficient reflected light is detected, the electronic device 500 may determine that there is no object near the electronic device 500 .
  • the electronic device 500 can use the proximity light sensor 480G to detect that the user holds the electronic device 500 close to the ear to make a call, so as to automatically turn off the screen to save power.
  • Proximity light sensor 480G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.
  • the ambient light sensor 480L is used for sensing ambient light brightness.
  • the electronic device 500 can adaptively adjust the brightness of the display screen 494 according to the perceived ambient light brightness.
  • the ambient light sensor 480L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 480L can also cooperate with the proximity light sensor 480G to detect whether the electronic device 500 is in the pocket to prevent accidental touch.
  • the fingerprint sensor 480H is used to collect fingerprints.
  • the electronic device 500 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, fingerprint photography, and fingerprint answering of incoming calls.
  • the temperature sensor 480J is used to detect temperature.
  • the electronic device 500 uses the temperature detected by the temperature sensor 480J to implement a temperature treatment strategy. For example, when the temperature reported by the temperature sensor 480J exceeds the threshold, the electronic device 500 may reduce the performance of the processor located near the temperature sensor 480J, so as to reduce power consumption and implement thermal protection.
  • the electronic device 500 when the temperature is lower than another threshold, the electronic device 500 heats the battery 442 to avoid abnormal shutdown of the electronic device 500 caused by the low temperature.
  • the electronic device 500 boosts the output voltage of the battery 442 to avoid abnormal shutdown caused by low temperature.
  • Touch sensor 480K also known as "touch device”.
  • the touch sensor 480K can be arranged on the display screen 494, and the touch sensor 480K and the display screen 494 form a touch screen, also called “touch screen”.
  • the touch sensor 480K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations can be provided through the display screen 494 .
  • the touch sensor 480K may also be disposed on the surface of the electronic device 500 , which is different from the position of the display screen 494 .
  • the bone conduction sensor 480M can acquire vibration signals.
  • the bone conduction sensor 480M can acquire the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 480M can also contact the human pulse and receive the blood pressure beating signal.
  • the bone conduction sensor 480M can also be disposed in the earphone, combined into a bone conduction earphone.
  • the audio module 470 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 480M, so as to realize the voice function.
  • the application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 480M, so as to realize the heart rate detection function.
  • the button 490 includes a power button, a volume button, and the like.
  • the key 490 may be a mechanical key. It can also be a touch button.
  • the electronic device 500 can receive key input and generate key signal input related to user settings and function control of the electronic device 500 .
  • the motor 491 can generate a vibrating prompt.
  • the motor 491 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 491 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 494 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 492 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 495 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the electronic device 500 by inserting it into the SIM card interface 495 or pulling it out from the SIM card interface 495 .
  • the electronic device 500 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 495 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 495 at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 495 is also compatible with different types of SIM cards.
  • the SIM card interface 495 is also compatible with external memory cards.
  • the electronic device 500 interacts with the network through the SIM card to implement functions such as calling and data communication.
  • the electronic device 500 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 500 and cannot be separated from the electronic device 500 .
  • An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium can store a program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute part or all of the above-mentioned embodiments step.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated: ROM) or a random access memory (English: random access memory, abbreviated: RAM), etc.
  • the embodiment of the present application also provides a computer program product, the computer program product includes executable instructions, and when the executable instructions are executed on a computer, the computer is made to perform some or all of the steps in the above method embodiments.
  • "at least one” means one or more, and “multiple” means two or more.
  • “And/or” describes the association relationship of associated objects, indicating that there may be three kinds of relationships, for example, A and/or B may indicate that A exists alone, A and B exist simultaneously, or B exists alone. Among them, A and B can be singular or plural.
  • the character “/” generally indicates that the contextual objects are an “or” relationship.
  • “At least one of the following” and similar expressions refer to any combination of these items, including any combination of single items or plural items.
  • At least one of a, b, and c may represent: a, b, c, a-b, ac, b-c, or a-b-c, where a, b, and c may be single or multiple.
  • any function is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, referred to as ROM), random access memory (random access memory, referred to as RAM), magnetic disk or optical disc, etc., which can store program codes. medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

一种多机位拍摄系统的拍摄方法,应用于第一电子设备,第一电子设备为多机位拍摄系统的主机位,多机位拍摄系统还包括至少一个辅机位,方法包括:第一电子设备显示主界面,主界面包括第一视频图像;第一电子设备在视频拍摄模式下接收第一用户操作;第一电子设备根据第一用户操作,在主界面显示第二视频图像,第一视频图像来自于主机位或辅机位,第二视频图像来自于辅机位;第一电子设备接收视频切换操作,视频切换操作针对第二视频图像;第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换。

Description

多机位拍摄系统的拍摄方法、设备、存储介质和程序产品
本申请要求于2022年1月30日提交中国专利局、申请号为202210113987.2、申请名称为“多机位拍摄系统的拍摄方法、设备、存储介质和程序产品”,以及于2022年5月9日提交中国专利局、申请号为202210501226.4、申请名称为“多机位拍摄系统的拍摄方法、设备、存储介质和程序产品”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及视频拍摄技术领域,尤其涉及一种多机位拍摄系统的拍摄方法、设备、存储介质和程序产品。
背景技术
多机位拍摄系统是指对被摄物体采用多个摄像设备进行拍摄的系统;它是在电影、直播平台、舞台拍摄中的一种常用的拍摄手段,通过该手法,可以让故事、直播的画面更加生动,有更好的代入感。
手机与手持的小型拍摄设备可以通过短距离通信技术,比如WiFi组合成多机位拍摄系统,给用户带来更为便捷的拍摄体验。对于手机或手持小型拍摄设备组成的多机位拍摄系统,拍摄者往往需要在拍摄创作过程中对多个拍摄机位的视频图像进行图像的选择或拼接,我们通常将多个机位的视频预览画面称为导播画面,将多机位拍摄系统中控制其他机位拍摄的手机或无线拍摄设备称为主机位,被控制的手机或无线拍摄设备称为辅机位。
现有相关技术中,手机与小型拍摄设备组成的多机位拍摄系统采用的导播画面方式有两种,一种方式是无导播画面,即主机位在录制视频时,如果选择切换镜头,只能显示备选的镜头名字提示框,当选择成功后,则直接切换到对应的镜头图像,没有导播画面;另一种方式是一旦选择预览图像即锁定拍摄镜头的方式,即主机位在拍摄视频前,会呈现出所有可能用到的镜头图像,拍摄者可以从中选取任意2个图像启动拍摄,但拍摄过程中仅限这两个镜头的图像拍摄记录,无法进行重新选择,即无法切换视频图像。由于现有技术的拍摄过程不能呈现导播画面,或不能切换拍摄图像,即导致了视频拍摄的灵活性较差。
发明内容
本申请实施例提供了一种多机位拍摄系统的拍摄方法、设备、存储介质和程序产品,能够在多机位拍摄中呈现导播画面并切换视频图像,从而改善了视频拍摄的灵活性。
第一方面,提供一种多机位拍摄系统的拍摄方法,应用于第一电子设备,第一电子设备为多机位拍摄系统的主机位,多机位拍摄系统还包括至少一个辅机位,方法包 括:第一电子设备显示主界面,主界面包括第一视频图像;第一电子设备在视频拍摄模式下接收第一用户操作;第一电子设备根据第一用户操作,在主界面显示第二视频图像,第一视频图像来自于主机位或辅机位,第二视频图像来自于辅机位;第一电子设备接收视频切换操作,视频切换操作针对第二视频图像;第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换。
在主机位处于视频拍摄模式时接收第一用户操作后显示与第一视频图像同时处于主界面的第二视频图像,在接收视频切换操作后将将第一视频图像和第二视频图像进行切换,实现了在多机位拍摄界面显示导播画面并通过导播画面在拍摄过程中切换视频图像,从而改善了视频拍摄的灵活性。
在一种可能的实施方式中,主界面包括操作控件,操作控件用于触发在主界面显示第二视频图像,例如第一用户操作包括作用于操作控件的点击操作。通过作用于操作控件的点击,可以便捷地实现基于导播画面的控制,以提高视频拍摄的灵活性。
在一种可能的实施方式中,第一用户操作包括作用于主界面的预设位置的第一滑动手势操作。通过作用于预设位置的滑动手势操作,可以便捷地实现基于导播画面的控制,以提高视频拍摄的灵活性。
在一种可能的实施方式中,视频切换操作包括作用于主界面中第二视频图像的单击操作。通过作用于视频图像的单击操作,可以便捷地实现基于导播画面的控制,以提高视频拍摄的灵活性。
在一种可能的实施方式中,第一视频图像和第二视频图像中的一者来自于第二电子设备,第二电子设备为多机位拍摄系统的一个辅机位;第一视频图像和第二视频图像中的另一者来自于第一电子设备或第三电子设备,第三电子设备为多机位拍摄系统的另一个辅机位。
在一种可能的实施方式中,在第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换的过程之后,方法还包括:第一电子设备接收第二用户操作;第一电子设备根据第二用户操作,在主界面隐藏第一视频图像;第一电子设备接收第三用户操作;第一电子设备根据第三用户操作,在主界面显示第一视频图像。提供了导播画面隐藏功能,以便于用户更好地观看导播画面。
在一种可能的实施方式中,主界面包括操作控件,操作控件用于触发在主界面隐藏第一视频图像以及在主界面隐藏第一视频图像,例如第二用户操作以及第三用户操作包括作用于操作控件的点击操作。
在一种可能的实施方式中,第三用户操作包括作用于预设位置的第一滑动手势操作,第二用户操作包括作用于预设位置的第二滑动手势操作。
在一种可能的实施方式中,在第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换的过程之后,方法还包括:第一电子设备接收机位切换操作,机位切换操作针对第一视频图像;第一电子设备根据机位切换操作,将第一视频图像替换为第三视频图像,第一视频图像与第三视频图像是多机位拍摄系统中不同机位提供的视频图像。以便于用户切换来自于不同机位的导播画面。
在一种可能的实施方式中,机位切换操作包括作用于第一视频图像的双击操作。
在一种可能的实施方式中,在第一电子设备根据视频切换操作,将第一视频图像 与第二视频图像进行切换的过程之后,方法还包括:第一电子设备接收摄像头切换操作,摄像头切换操作针对第一视频图像;第一电子设备根据摄像头切换操作,将第一视频图像替换为第四视频图像,第一视频图像与第四视频图像是多机位拍摄系统中同一机位不同摄像头提供的视频图像。以便于用户切换来自于同一机位不同摄像头的导播画面。
在一种可能的实施方式中,摄像头切换操作包括作用于第一视频图像的三击操作。
在一种可能的实施方式中,在第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换的过程之后,方法还包括:第一电子设备接收画中画显示操作,画中画显示操作针对第一视频图像;第一电子设备根据画中画显示操作,在主界面显示至少部分被第二视频图像包围的第五视频图像,第五视频图像与第一视频图像相同。以便于实现画中画的录制效果。
在一种可能的实施方式中,画中画显示操作包括作用于第一视频图像的拖拽操作。
在一种可能的实施方式中,
在第一电子设备根据视频切换操作,将第一视频图像与第二视频图像进行切换的过程之后,第一视频图像来自于第二电子设备,第二电子设备为多机位拍摄系统的一个辅机位;方法还包括:在主界面隐藏第一视频图像后,且第一电子设备未显示来自于第二电子设备的视频图像,第一电子设备向第二电子设备发送待机控制指令,待机控制指令用于指示第二电子设备使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器VPU、显示屏以及无线通信链路,无线通信链路用于将视频图像从第二电子设备传输至第一电子设备。通过发送待机控制指令的方式,可以使暂未使用的机位或相应的通信链路待机以降低功耗。
在一种可能的实施方式中,待机控制指令还用于指示第二电子设备使无线通信链路由持续通信状态变为周期性休眠通信状态;当无线通信链路在周期性休眠通信状态的持续时长达到第一预设时长时,第一电子设备建立第一电子设备和第二电子设备之间的低功耗蓝牙BLE连接,并断开无线通信链路;第一电子设备向第二电子设备发送待机控制指令之后,方法还包括:第一电子设备执行第一待机恢复流程或第二待机恢复流程;第一待机恢复流程和第二待机恢复流程均包括:第一电子设备接收第三用户操作,以及第一电子设备根据第三用户操作,在主界面显示第一视频图像的过程;在第一待机恢复流程中,第三用户操作为待机恢复操作;第二待机恢复流程还包括:第一电子设备在接收第三用户操作之前,接收待机恢复操作;在主界面显示第二视频图像的过程之前,第一待机恢复流程和第二待机恢复流程还包括:第一电子设备根据待机恢复操作,如果在无线通信链路处于周期性休眠通信状态时接收到待机恢复操作,则通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态;第一电子设备根据待机恢复操作,如果在无线通信链路断开时接收到待机恢复操作,则通过低功耗蓝牙BLE连接向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。利用无线通信链路与BLE之间的配合,可 以实现无线通信链路的快速恢复,以利用提高显示视频图像的响应速度;在第二待机恢复流程中,基于第三用户操作之前的待机恢复操作来预先恢复无线通信链路,然后根据第三用户操作来显示第一视频图像,以提高显示视频图像的响应速度。
在一种可能的实施方式中,在在第二待机恢复流程中,待机恢复操作包括作用于预设位置的触碰操作。
在一种可能的实施方式中,待机控制指令用于指示第二电子设备使无线通信链路由持续通信状态变为第一周期性休眠通信状态;方法还包括:第一电子设备当无线通信链路在第一周期性休眠通信状态的持续时长达到第一预设时长时,使无线通信链路变为第二周期性通信状态,第一周期性休眠通信状态的休眠周期小于第二周期性休眠通信状态的休眠周期;向第二电子设备发送待机控制指令之后,方法还包括:第一电子设备执行第三待机恢复流程或第四待机恢复流程;第三待机恢复流程和第四待机恢复流程均包括接收第三用户操作,以及根据第三用户操作,在主界面显示第一视频图像的过程;在第三待机恢复流程中,第三用户操作为待机恢复操作;第四待机恢复流程还包括:第一电子设备在接收第三用户操作之前,接收待机恢复操作;在主界面显示第一视频图像的过程之前,第三待机恢复流程和第四待机恢复流程还包括:第一电子设备根据待机恢复操作,通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。无线通信链路根据休眠时长自动改变状态,一方面,在无通信时降低功耗,另一方面,在通信频繁时可以及时响应恢复,以提高显示视频图像的响应速度;在第四待机恢复流程中,基于第三用户操作之前的待机恢复操作来预先恢复无线通信链路,然后根据第三用户操作来显示视频图像,以提高显示视频图像的响应速度。
在一种可能的实施方式中,在第四待机恢复流程中,待机恢复操作为作用于预设位置的触碰操作。
在一种可能的实施方式中,向第二电子设备发送待机恢复控制指令的过程之后,方法还包括:第一电子设备根据第三用户操作,在预设位置显示过渡图像;第一电子设备根据第三用户操作,在主界面显示第一视频图像的过程包括:第一电子设备根据第三用户操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的第一视频图像时,将过渡图像替换为第一视频图像。在接收到第三用户操作时,首先显示过渡图像,直到无线通信链路恢复之后,再将过渡图像替换为视频图像,以改善视频图像无法及时传输而导致的显示延迟问题。
第二方面,提供一种多机位拍摄系统的拍摄装置,应用于第一电子设备,第一电子设备为多机位拍摄系统的主机位,多机位拍摄系统还包括至少一个辅机位,装置包括:界面显示模块,用于显示主界面,主界面包括第一视频图像;操作接收模块,用于在视频拍摄模式下接收第一用户操作;界面显示模块还用于,根据第一用户操作,在主界面显示第二视频图像,第一视频图像来自于主机位或辅机位,第二视频图像来自于辅机位;操作接收模块还用于,接收视频切换操作,视频切换操作针对第二视频图像;视频切换模块,用于根据视频切换操作,将第一视频图像与第二视频图像进行切换。
在一种可能的实施方式中,主界面包括操作控件,操作控件用于触发在主界面显 示第二视频图像,例如第一用户操作包括作用于操作控件的点击操作。
在一种可能的实施方式中,第一用户操作包括作用于主界面的预设位置的第一滑动手势操作。
在一种可能的实施方式中,视频切换操作包括作用于主界面中第二视频图像的单击操作。
在一种可能的实施方式中,第一视频图像和第二视频图像中的一者来自于第二电子设备,第二电子设备为多机位拍摄系统的一个辅机位;第一视频图像和第二视频图像中的另一者来自于第一电子设备或第三电子设备,第三电子设备为多机位拍摄系统的另一个辅机位。
在一种可能的实施方式中,操作接收模块还用于,接收第二用户操作;界面显示模块还用于,根据第二用户操作,在主界面隐藏第一视频图像;操作接收模块还用于,接收第三用户操作;界面显示模块还用于,根据第三用户操作,在主界面显示第一视频图像。
在一种可能的实施方式中,主界面包括操作控件,操作控件用于触发,在主界面隐藏第一视频图像以及在主界面隐藏第一视频图像,例如第二用户操作以及第三用户操作包括作用于操作控件的点击操作。
在一种可能的实施方式中,第三用户操作包括作用于预设位置的第一滑动手势操作,第二用户操作包括作用于预设位置的第二滑动手势操作。
在一种可能的实施方式中,操作接收模块还用于,接收机位切换操作,机位切换操作针对第一视频图像;界面显示模块还用于,根据机位切换操作,将第一视频图像替换为第三视频图像,第一视频图像与第三视频图像是多机位拍摄系统中不同机位提供的视频图像。
在一种可能的实施方式中,机位切换操作包括作用于第一视频图像的双击操作。
在一种可能的实施方式中,操作接收模块还用于,接收摄像头切换操作,摄像头切换操作针对第一视频图像;界面显示模块还用于,根据摄像头切换操作,将第一视频图像替换为第四视频图像,第一视频图像与第四视频图像是多机位拍摄系统中同一机位不同摄像头提供的视频图像。
在一种可能的实施方式中,摄像头切换操作包括作用于第一视频图像的三击操作。
在一种可能的实施方式中,操作接收模块还用于,接收画中画显示操作,画中画显示操作针对第一视频图像;界面显示模块还用于,根据画中画显示操作,在主界面显示至少部分被第二视频图像包围的第五视频图像,第五视频图像与第一视频图像相同。
在一种可能的实施方式中,画中画显示操作包括作用于第一视频图像的拖拽操作。
在一种可能的实施方式中,装置还包括:待机控制模块,用于,在主界面隐藏第一视频图像后,且第一电子设备未显示来自于第二电子设备的视频图像,向第二电子设备发送待机控制指令,待机控制指令用于指示第二电子设备使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器 VPU、显示屏以及无线通信链路,无线通信链路用于将视频图像从第二电子设备传输至第一电子设备,第二电子设备为多机位拍摄系统的一个辅机位,当前视频图像为第一视频图像或第二视频图像。
在一种可能的实施方式中,待机控制指令还用于指示第二电子设备使无线通信链路由持续通信状态变为周期性休眠通信状态;装置还包括通信控制模块,用于当无线通信链路在周期性休眠通信状态的持续时长达到第一预设时长时,建立第一电子设备和第二电子设备之间的低功耗蓝牙BLE连接,并断开无线通信链路;操作接收模块具体用于,在第一待机恢复流程中接收第三用户操作,或者在第二待机恢恢恢复流程中接收待机恢复操作和第三用户操作,在第一待机恢复流程中,第三用户操作为待机恢复操作;待机控制模块还用于,根据待机恢复操作,如果在无线通信链路处于周期性休眠通信状态时接收到待机恢复操作,则通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态;待机控制模块还用于,根据待机恢复操作,如果在无线通信链路断开时接收到待机恢复操作,则通过低功耗蓝牙BLE连接向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。
在一种可能的实施方式中,在第二待机恢复流程中,待机恢复操作包括作用于预设位置的触碰操作。
在一种可能的实施方式中,待机控制指令用于指示第二电子设备使无线通信链路由持续通信状态变为第一周期性休眠通信状态;装置还包括通信控制模块,用于当无线通信链路在第一周期性休眠通信状态的持续时长达到第一预设时长时,使无线通信链路变为第二周期性通信状态,第一周期性休眠通信状态的休眠周期小于第二周期性休眠通信状态的休眠周期;操作接收模块具体用于,在第三待机恢复流程中接收第三用户操作,或者在第四待机恢复流程中接收待机恢复操作和第三用户操作,在第三待机恢复流程中,第三用户操作为待机恢复操作;待机控制模块还用于,根据待机恢复操作,通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。
在一种可能的实施方式中,在第四待机恢复流程中,待机恢复操作为作用于预设位置的触碰操作。
在一种可能的实施方式中,装置还包括:界面显示模块还用于,根据第三用户操作,在预设位置显示过渡图像;界面显示模块还具体用于:根据第三用户操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的视频图像时,将过渡图像替换为第一视频图像。
第三方面,提供一种电子设备,包括用于存储计算机程序指令的存储器和用于执行计算机程序指令的处理器,其中,当该计算机程序指令被处理器执行时,触发电子设备执行上述的方法。
第四方面,提供一种计算机可读存储介质,计算机可读存储介质包括存储的程序,其中,在程序运行时控制计算机可读存储介质所在设备执行上述的方法。
第五方面,提供一种计算机程序产品,计算机程序产品包含可执行指令,当可执 行指令在计算机上执行时,使得计算机执行上述的方法。
本申请实施例中的多机位拍摄系统的拍摄方法、设备、存储介质和程序产品,在主机位处于视频拍摄模式时接收第一用户操作后显示与第一视频图像同时处于主界面的第二视频图像,在接收视频切换操作后将将第一视频图像和第二视频图像进行切换,实现了在多机位拍摄界面显示导播画面并通过导播画面在拍摄过程中切换视频图像,从而改善了视频拍摄的灵活性。
附图说明
为了更清楚地说明本申请实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本说明书的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。
图1为本申请实施例提供的一种多机位拍摄系统的结构示意图;
图2为本申请实施例提供的一种电子设备的摄像头示意图;
图3为本申请实施例提供的一种多机位拍摄系统的拍摄方法的流程示意图;
图4a为本申请实施例提供的一种第一电子设备的主界面包括第一视频图像的示意图;
图4b为本申请实施例提供的一种第一电子设备的主界面包括第一视频图像和第二视频图像的示意图;
图4c为图4b中第一视频图像和第二视频图像切换后的示意图;
图4d为图4c中第一电子设备隐藏第一视频图像后的示意图;
图5a为本申请实施例提供的另一种多机位拍摄系统的拍摄方法的流程示意图;
图5b为本申请实施例提供的又一种多机位拍摄系统的拍摄方法的流程示意图;
图6为本申请实施例提供的一种第一电子设备执行机位切换操作的场景示意图;
图7为本申请实施例提供的一种第一电子设备执行摄像头切换操作的场景示意图;
图8为本申请实施例提供的一种第一电子设备显示画中画效果的场景示意图;
图9为本申请实施例提供的一种第一电子设备隐藏画中画效果的场景示意图;
图10本申请实施例中一种通过WiFi通信时的传输队列的示意图;
图11为本申请实施例提供的一种包含第一待机恢复流程的多机位拍摄系统的拍摄方法的流程示意图;
图12为本申请实施例中一种无线通信链路状态变化的示意图;
图13为本申请实施例提供的一种包含第二待机恢复流程的多机位拍摄系统的拍摄方法的流程示意图;
图14为本申请实施例中另一种无线通信链路状态变化的示意图;
图15为本申请实施例中又一种无线通信链路状态变化的示意图;
图16为本申请实施例提供的一种包含第三待机恢复流程的多机位拍摄系统的拍摄方法的流程示意图;
图17为本申请实施例提供的一种包含第四待机恢复流程的多机位拍摄系统的拍 摄方法的流程示意图;
图18为本申请实施例中一种无线通信链路的同步周期示意图;
图19为本申请实施例中另一种多机位拍摄系统的结构示意图;
图20为本申请实施例提供的一种第一电子设备的显示过渡图像的场景示意图;
图21为本申请实施例中手机和手机组成多机位拍摄系统的一种场景变化示意图;
图22为本申请实施例中手机和拍摄设备组成多机位拍摄系统的一种场景变化示意图;
图23为本申请实施例提供的一种电子设备的结构框图。
具体实施方式
为了更好的理解本说明书的技术方案,下面结合附图对本申请实施例进行详细描述。
应当明确,所描述的实施例仅仅是本说明书一部分实施例,而不是全部的实施例。基于本说明书中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例,都属于本说明书保护的范围。
在本申请实施例中使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本说明书。在本申请实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。
应当理解,本文中使用的术语“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,甲和/或乙,可以表示:单独存在甲,同时存在甲和乙,单独存在乙这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
应当理解,在本申请的各实施例中,“第一”、“第二”等仅是为了指代不同的对象,并不表示对指代的对象有其它限定。
参见图1,图1为本申请实施例提供的一种多机位拍摄系统的结构示意图,本申请实施例提供的拍摄方法和设备可以适用于多机位拍摄系统,多机位拍摄系统包括至少两个无线拍摄设备。例如,多机位拍摄系统10包括三个无线拍摄设备:第一电子设备100、第二电子设备200和第三电子设备300,一个无线拍摄设备为多机位拍摄系统的一个机位,为了对多机位拍摄系统中各个机位拍摄的视频图像进行选择和切换,一种便捷的方式是将导播画面集成到多机位拍摄系统的主机位,因此,将第一电子设备100作为多机位拍摄系统的主机位,作为主机位的第一电子设备100需要拍摄视频图像,同时对多机位拍摄系统中各个机位拍摄的视频图像进行管理,因此第一电子设备100至少需要具备拍摄功能、显示功能、通信功能和数据处理功能,第一电子设备100可以为一部手机或其他无线拍摄设备,第二电子设备200和第三电子设备300为多机位拍摄系统的辅机位,作为辅机位的电子设备需要拍摄视频图像并传输给主机位,因此第二电子设备200至少需要具备拍摄功能和通信功能,第二电子设备200和第三电子设备300可以为无显示功能的无线拍摄设备或手机。在进行拍摄之前,多机位拍摄系统中的主机位和辅机位之间需要先组网,以建立通信连接,之后,主机位可以通过 通信连接发送控制指令至辅机位,辅机位根据控制指令可以实现例如对拍摄视频的画面控制、对于拍摄摄像头的控制、对于视频图像是否传输至主机位的控制、对于辅机位是否休眠的控制等。
其中,第一电子设备100、第二电子设备200和第三电子设备300通过无线通信组网建立连接,例如可以通过WiFi建立无线通信连接,第一电子设备100、第二电子设备200和第三电子设备300之间的指令传输和数据传输可以通过WiFi无线无线通信链路传输。为了实现主机位对辅机位拍摄视频图像的管理和控制,主机位可以设置摄像头硬件抽象层CameraHAL,辅机位可以设置VirtualCameraAgent虚拟摄像头代理,当主机位检测到控制指令涉及远端的辅机位时,将控制指令通过CameraHAL转发到对端辅机位的VirtualCameraAgent对辅机位进行控制,辅助机的VirtualCameraAgent用来转义对端主机位发过来的控制指令到对应的ISP进而控制摄像头。例如可以实现主机位让对端辅机位将视频图像传输到主机位,在主机位上呈现辅机位的视频图像。
可以理解的是,本申请实施例示意的多机位拍摄系统10的结构并不构成对多机位拍摄系统10结构的限定,本申请另一些实施例中,多机位拍摄系统10可以包括比图示更多或更少的无线拍摄设备。多机位拍摄系统10一般设置一个主机位,在特殊情况也可能设置多个主机位。
参见图2,图2为本申请实施例提供的一种电子设备的摄像头示意图。在图2中以手机为例对图1中的第一电子设备100进行示例性说明,图2中示出了手机的前视图和后视图,在手机的前侧配置有两个前置摄像头111、112,在手机的后侧面配置有四个后置摄像头121、122、123、124。通过配置多个摄像头,可以为用户提供多种拍摄模式,提高用户拍摄视频的灵活性。
可以理解的是,图2所示仅为一种示例性说明,并不应当将其作为本申请保护范围的限制。例如,不同的手机,其摄像头的配置数量和配置位置可能不同。另外,本申请实施例涉及的电子设备除了手机以外,还可以为平板电脑、个人计算机(personal computer,PC)、个人数字助理(personal digital assistant,PDA)、智能手表、上网本、可穿戴电子设备、增强现实技术(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、车载设备、智能汽车、智能音响、机器人、智能眼镜、智能电视等。在一些可能的实现方式中,电子设备也可能称为终端设备、用户设备(User Equipment,UE)等,本申请实施例对此不作限制。此外,图1所示的第二电子设备和第三电子设备也可以采用图2所示的电子设备。
在实际应用场景中,在多机位拍摄系统组网成功建立连接后,多个机位的电子设备都进入工作模式,当作为主机位的电子设备进入视频拍摄模式后,主机位会显示主界面。主界面用于显示视频图像,这里显示的视频图像是主机位或者辅机位提供的视频图像,当主机位首次组网成功后,可以根据系统的预先设置显示多机位拍摄系统中主机位或辅机位提供的一路视频图像作为主界面中初始的视频图像。
参见图3,图3为本申请实施例提供的一种多机位拍摄系统的拍摄方法的流程示意图,应用于图1所示多机位拍摄系统的第一电子设备100,第一电子设备100为多机位拍摄系统的主机位,如图3所示,拍摄方法可以包括:
步骤1000:如图4a所示,第一电子设备显示主界面20,主界面20为主播或者说 录制者观看的界面,主界面20包括第一视频图像201,第一视频图像201例如为手举自行车画面;
步骤1001:第一电子设备在视频拍摄模式下接收第一用户操作;
步骤1002:如图4b所示,第一电子设备根据第一用户操作,在主界面20显示第二视频图像202,第二视频图像202例如为打坐画面,第一视频图像201和第二视频图像202可以交叠显示在主界面20,第一视频图像201的显示区域可以大于第二视频图像202的显示区域,第二视频图像202可以位于第一视频图像201的上层显示,第一视频图像201来自于主机位或辅机位,第二视频图像202来自于辅机位,即第一视频图像201和第二视频图像202是多机位拍摄系统中不同机位提供的视频图像;
此时,第一视频图像201为录制画面或者说直播画面,即第一视频图像201会被录制下来保存或者传输至服务器进行直播的画面,即为最终呈现给观众的视频图像,第二视频图像202为非录画面,或者说是导播画面,即第二视频图像202仅用于主播观看预览,并不会呈现给观众观看,如果第二视频图像202来自于第二电子设备,那么在主界面20显示第二视频图像202时,第一电子设备会向第二电子设备发送获取第二视频图像得指令,第二电子设备根据该指令将所拍摄得第二视频图像传输至第一电子设备。
步骤1003:第一电子设备接收视频切换操作,视频切换操作针对第二视频图像202,例如用户点击主界面20中的打坐画面;
步骤1004:如图4c所示,第一电子设备根据视频切换操作,将第一视频图像201与第二视频图像202进行切换,即将第一视频图像201切换至第二视频图像202原来的显示区域,将第二视频图像202切换至第一视频图像201原来的显示区域,切换之后,第一视频图像201变为仅用于主播观看预览的导播画面,不再呈现给观众观看,第二视频图像202变为录制画面或者说直播画面,呈现给观众观看,此时第一视频图像201可以位于第二视频图像202的上层显示。
例如,用户点击图4b所示主界面20中的打坐画面,第一电子设备会进行视频图像切换,将主界面20会由如图4b所示切换至如图4c所示,该视频切换操作,除了界面中视频图像的切换之外,在功能上,将打坐画面切换为录制画面,将手举自行车画面切换为导播画面。
具体地,当第一电子设备(主机位)与辅机位组网成功后,第一电子设备100进入拍摄应用,这里的应拍摄应用包括但不限于拍摄或直播的应用,可以为手机上的相机应用或者其它支持多机位系统的应用。当第一电子设备100进入拍摄应用,处于视频拍摄模式时,用户可以看到主界面20的第一视频图像201,用户希望通过导播画面查看各个机位提供的视频图像,可以执行第一用户操作,以使作为导通画面的第二视频图像202显示在主界面20,以便于在主界面20观看来自于一个机位的视频图像的同时可以观看来自于另一个机位的视频图像。
当用户希望将第二视频图像202切换为录制画面时,执行视频切换操作。需要说明的是,主界面20可以包括多个第二视频图像202,例如用户可以通过主界面20看到多个机位提供的多路第二视频图像202,用户可以从主界面20中选择要录制的某一路第二视频图像与第一视频图像201进行切换,以实现对该路第二视频图像202进行 录制,即通过视频切换操作从主界面20选择要录制的第二视频图像202与第一视频图像201进行切换。通过对视频图像的切换,提高了视频拍摄的灵活性。另外,原本主界面20的第一视频图像201被切换为导播画面,以便于主播在主界面20中继续观看第一视频图像201。
示例性的,主界面20包括操作控件,例如视频录制按键、暂停按键、悬浮球、变焦按键等,悬浮球可以被拖到至任意位置,悬浮球用于触发在主界面显示第二视频图像,例如,第一用户操作包括作用于操作控件(例如悬浮球)上的点击操作,或者,第一用户操作包括作用于预设位置30的第一滑动手势操作,例如如图4b所示,预设位置30为视频切换之前第二视频图像202对应的显示区域;视频切换操作在视频切换操作之前,视频切换操作包括作用于第二视频图像202的单击操作,该单击操作可以为快速的单次点击操作,也可以为长按操作。例如,第一滑动手势操作为向右滑动手势操作,当用户在如图4a所示的主界面20左下侧的预设位置30执行向右滑动手势操作时,主界面20会变为如图4b所示,显示第二视频图像202。再例如,当第一电子设备显示有悬浮球时,当用户点击如图4a所示的悬浮球后,主界面20会变为如图4b所示,显示第二视频图像202。第一用户操作还可以为其他形式的用户操作,比如虚拟按键操作、实体按键操作等,本实施例对第一用户操作的形式不作限定。
示例性的,视频切换操作可以包括用户对第二视频图像202的长按操作。例如,当用户长按如图4b所示的第二视频图像202,主界面20会变为如图4c所示,第一视频图像201和第二视频图像202进行切换,此时如果用户长按第一视频图像201,那么第一视频图像201和第二视频图像202会再次切换,即主界面20会变回至如图4b所示。视频切换操作还可以为其他形式的用户操作,比如虚拟按键操作、实体按键操作等,例如主界面20可以包括视频切换控件,视频切换操作可以包括作用于视频切换控件的操作,本实施例对视频切换操作的形式不作限定。
进一步的,当用户不需要使用非录制画面时,可以将图4b所示的第二视频图像202隐藏起来,或者将图4c所示的第一视频图像201隐藏起来,以便于用户可以更好的观看正在录制的一路视频图像。
如图4a~4d以及图5a所示,在图3所示实施例的基础上,在步骤1004的第一电子设备根据视频切换操作,将第一视频图像201与第二视频图像202进行切换的过程之后,拍摄方法还可以包括:
步骤1005:第一电子设备接收第二用户操作;
步骤1006:第一电子设备根据第二用户操作,在主界面隐藏第一视频图像201,即根据第二用户操作,第一电子设备的屏幕显示状态由图4c变为图4d,该示例中隐藏第一视频图像201之后主界面20仅显示第二视频图像202。
当用户再次需要第一视频图像201显示时,还可以执行步骤1007和步骤1008,步骤1007:接收第三用户操作,步骤1008:根据第三用户操作,在主界面20显示第一视频图像201。非录制画面按需显示或隐藏的方式,提高了视频拍摄的灵活性。其中,如果第一视频图像201来自于第二电子设备,当第一电子设备在主界面隐藏第一视频图像201时,对于第二电子设备来说,可能会存在两种情况,一种情况是第二电子设备仍然传输第一视频图像至第一电子设备,以便于当第一电子设备能够快速恢复 显示第一视频图像,另一种情况第二电子设备接收来自于第一电子设备的指令,并根据该指令不再传输第一视频图像至第一电子设备,以节省功耗,但是如果第一电子设备需要恢复显示第一视频图像,则需要第一电子设备发送恢复显示第一视频图像的指令至第二电子设备,第二电子设备接收该指令,并根据该指令将第一视频图像恢复传输至第一电子设备。第二电子设备如果为手机,在第一电子设备隐藏第一视频图像的过程种,第二电子设备的屏幕可以一直显示第一视频图像,也可以同时隐藏第一视频图像。
图5b所示的流程为与图5a所示的流程并列的另一种拍摄过程,在图3所示实施例的基础上,在第一电子设备显示第二视频图像之后、第一电子设备接收视频切换操作之前,即在步骤1002之后、步骤1003之前,拍摄方法还包括:接收第二用户操作;根据第二用户操作,在主界面隐藏第二视频图像,即使如图4b所示的界面变为如图4a所示的界面;接收第三用户操作;根据第三用户操作,在主界面显示第二视频图像,即使如图4a所示的界面恢复为如图4b所示的界面。之后可以执行步骤1003和1004,以实现视频切换,使如图4b所示的界面变为如图4c所示的界面。
也就是说,在图5a所示的流程中,用户在执行视频切换操作之后,隐藏作为非录制画面的第一视频图像201;在图5b所示的流程中,用户可以先隐藏作为非录制画面的第二视频图像202,可以通过主界面20在较大的画面中观看第一视频图像201,在需要进行视频切换时,先通过执行第三用户操作恢复第二视频图像202的显示,然后执行视频切换操作。
另外需要说明的是,在5a和图5b所示的流程中,第三用户操作可以与上述的第一用户操作相同,也可以与上述的第二用户操作不同。
示例性的,操作控件(例如悬浮球)用于触发在主界面隐藏第一视频图像以及在主界面隐藏第一视频图像,例如,第二用户操作以及第三用户操作包括作用于操作控件(例如悬浮球)的点击操作,另外,第三用户操作还可以包括作用于预设位置30的第一滑动手势操作;第二用户操作可以包括作用于预设位置30的第二滑动手势操作,第一滑动手势操作与第二滑动手势操作可以为相反方向的滑动手势操作,例如第二滑动手势操作为向左滑动手势操作。例如,当用户在如图4c所示的预设位置30执行向左滑动手势操作时,或者点击悬浮球时,第一视频图像201会隐藏,主界面20会变为如图4d所示,之后如果用户在如图4d所示的预设位置30执行向右滑动手势操作,或者点击悬浮球时,主界面20会变为如图4c所示,即恢复第一视频图像201的显示。另外第二用户操作和第三用户操作还可以为其他形式的用户操作,比如虚拟按键操作、实体按键操作等,本实施例对第二用户操作和第三用户操作的形式不作限定。
以下基于图4a~4d对上述实施例进一步说明。
参见图4a,在第一电子设备的主界面20上显示第一视频图像201,第一视频图像201为第一电子设备或辅机位提供的一路视频图像。
其中,第一视频图像201是可以录制的,当用户执行视频录制操作,例如用户点击视频录制按键后,第一电子设备接收到视频录制操作,保存第一视频图像201的数据,或者将第一视频图像201的数据传输至服务器进行直播等,视频图像的数据由提供视频图像的机位获取并传输到第一电子设备,第一电子设备经过编码处理后保存。
可以理解的是,为了将第一视频图像201展现的更清晰,第一视频图像201可以全屏显示在主界面20,也可以不是全屏显示,而是中屏显示或者小屏显示,具体可以根据用户需求设置,本实施例对第一视频图像201的尺寸不作限定。
另外,第一视频图像201是第一电子设备或辅机位提供的视频图像,若第一电子设备显示屏较小,主界面20可以只显示一路第一视频图像,若第一电子设备显示屏较大,主界面20也可以显示多路第一视频图像,多路第一视频图像可以分别来自于不同的机位或者来自于同一机位的不同摄像头,例如,当主界面20显示两路第一视频图像时,两路第一视频图像可以垂直平铺或者水平平铺显示在主界面中,在实际应用场景中,可以基于第一电子设备的屏幕大小进行设置,本实施例对主界面显示的第一视频图像的数量不作限定。
参见图4b。在接收第一用户操作后,在主界面20上显示第二视频图像202,第二视频图像202为第一电子设备或辅机位提供的视频图像,第一视频图像201与第二视频图像202是不同机位提供的视频图像。
可以理解的是,为了不影响用户查看第一视频图像201,第二视频图像202的显示尺寸不会设置的太大,一般第二视频图像202的显示尺寸小于第一视频图像201的显示尺寸,并且第二视频图像202的分辨率小于第一视频图像201的分辨率,当辅机位的视频图像为第二视频图像202时,第一电子设备向辅机位发送视频获取指令,辅机位可以将低分辨率的视频图像传输给第一电子设备,以减少数据的传输量。若第一视频图像201为全屏显示,则第二视频图像202会叠加在第一视频图像201上显示,若第一视频图像201不是全屏显示,则第二视频图像202可以叠加或者不叠加在第一视频图像201上显示。本实施例对第二视频图像的尺寸、位置以及与第一视频图像的位置关系不作限定。
另外,当第一电子设备的显示屏比较大时,主界面20可以包括不止一路第二视频图像,例如,主界面20可以显示两路第二视频图像,两路第二视频图像可以垂直平铺或者水平平铺显示在主界面20的部分区域中,实际应用场景中,可以基于显示屏大小、主界面大小进行设置,本实施例对第二视频图像202的数量不作限定。
参见图4c。在图4b所示场景下,第一电子设备接收到用户的视频切换操作后,视频切换操作针对第二视频图像202,如图4c所示,第一视频图像201和第二视频图像202在主界面20中的显示效果进行切换,同时,在后台,将第一视频图像201切换为非录制画面,将第二视频图像202切换为录制画面。
在一种可能的实施方式中,第一视频图像和第二视频图像中的一者来自于第二电子设备200,第二电子设备200为多机位拍摄系统的一个辅机位;第一视频图像和第二视频图像中的另一者来自于第一电子设备100或第三电子设备300,第三电子设备300为多机位拍摄系统的另一个辅机位。也就是说,在图4b或图4c所示的场景中,结合图1所示的多机位拍摄系统,在一种可能的拍摄过程中,第一视频图像201和第二视频图像202中的一者来自于第一电子设备100自己所拍摄,第一视频图像201和第二视频图像202中另一者来自于第二电子设备200所拍摄;在另一种可能的拍摄过程中,第一视频图像201和第二视频图像202中一者自于第二电子设备200所拍摄,第一视频图像201和第二视频图像202中另一者来自于第三电子设备300所拍摄。
参见图4d,图4d为图4c中第一电子设备隐藏第一视频图像后的场景示意图。在接收第二用户操作后,如图4d所示,主界面20隐藏第一视频图像,此时主界面20仅显示第二视频图像202。
在一些实施例中,当用户需要查看其他视频图像时,可以通过执行机位切换操作实现。
如图6所示,在图3所示实施例的基础上,在第一电子设备根据视频切换操作,将第一视频图像201与第二视频图像202进行切换之后,拍摄方法还可以包括:
执行步骤1009:第一电子设备接收机位切换操作,机位切换操作针对第一视频图像201;
执行步骤1010:第一电子设备根据机位切换操作,将第一视频图像201替换为第三视频图像203,第一视频图像201与第三视频图203像是多机位拍摄系统中不同机位提供的视频图像。
例如,多机位拍摄系统包括三个电子设备。在接收机位切换操作之前,第一电子设备100中主界面20的第二视频图像202为来自于第一电子设备100本身摄像头所拍摄的视频图像,例如为打坐画面,第一电子设备100中主界面20的第二视频图像202为来自于第二电子设备200所拍摄的视频图像,例如为手举自行车画面,第三电子设备300所拍摄的视频图像(例如为风景画面)尚未显示在第一电子设备100;在接收到机位切换操作后,根据机位切换操作,将第一电子设备100的主界面20的手举自行车画面切换为风景画面。即实现了将主界面20中非录制画面切换由不同机位提供的视频图像。
当用户需要基于机位切换非录制画面时,可以执行机位切换操作,以使用户通过第一电子设备100的主界面20查看其他机位提供的视频图像。当第一电子设备100接收到机位切换操作,在非录制画面的位置显示主机位或辅机位提供的另一机位的视频图像。比如主机位和辅机位共有四个机位提供的视频图像,其中一个机位提供的视频图像为主界面20的录制画面,剩下的三个机位提供的视频图像都是可以作为主界面20的非录制画面呈现,若当前非录制画面只显示一个机位提供的视频图像,还有两个机位提供的视频图像未显示在主界面20,那么执行一次机位切换操作,主界面20的非录制画面就切换为另一个机位提供的视频图像,反复执行机位切换操作就能够轮流查看三个机位提供的视频图像。通过机位切换操作使用户能够轻松的查看所有机位的未进入主界面20的视频图像,方便用户观看不同机位的视频图像。
示例性的,机位切换操作包括作用于第一视频图像201的双击操作。例如,当用户双击主界面20显示的第一视频图像201时,第一视频图像201切换为另一个机位的第三视频图像203,如果用户继续双击第三视频图像203,第三视频图像203切换为再一个机位的视频图像,依次类推,每双击一次则切换一次。机位切换的顺序可以由系统预先设置。机位切换操作还可以为其他形式的操作,比如虚拟按键操作、实体按键操作等,例如主界面可以包括机位切换控件,机位切换操作可以包括作用于机位切换控件的操作,本实施例对机位切换操作的形式不作限定。
在机位切换过程中,对于第二电子设备和第三电子设备来说,可能会存在不同的情况,在第一电子设备的机位切换过程中,第二电子设备可以持续传输第一视频图像至第一电子 设备,第三电子设备也可以传输第三视频图像至第一电子设备,以便于第一电子设备能够快速恢复显示第一视频图像或第三视频图像,另外,在机位切换时,第一电子设备也可以发送指令至第二电子设备和第三电子设备,例如第二电子设备接收来自于第一电子设备的指令,并根据该指令不再传输第一视频图像至第一电子设备,以节省功耗,第三电子设备接收来自于第一电子设备的指令,并根据该指令将第三视频图像恢复传输至第一电子设备。第二电子设备和第三电子设备如果为手机,在第一电子设备机位切换的过程中,第二电子设备的屏幕可以一直显示第一视频图像,也可以在第一电子设备将第一视频图像切换为第三视频图像之后,第二电子设备隐藏第一视频图像,第三电子设备的屏幕可以一直显示第三视频图像,也可以在第一电子设备将第一视频图像切换为第三视频图像之后,第三电子设备开始显示第三视频图像。
在一些实施例中,如图7所示,例如第二电子设备200是图2所示的包括前置摄像头和后置摄像头的手机时,当前第一电子设备100的主界面20中第一视频图像来自于第二电子设备200的后置摄像头,为了查看第二电子设备200的前置摄像头提供的视频图像,可以通过摄像头切换操作实现。
在图3所示实施例的基础上,在第一电子设备100根据视频切换操作,将第一视频图像201与第二视频图像202进行切换之后,拍摄方法还可以包括:
执行步骤1011:第一电子设备100接收摄像头切换操作,摄像头切换操作针对第一视频图像201;
执行步骤1012:第一电子设备100根据摄像头切换操作,将第一视频图201像替换为第四视频图像204,第一视频图像201与第四视频图像204是多机位拍摄系统中同一机位不同摄像头提供的视频图像。
例如,多机位拍摄系统包括第一电子设备100和第二电子设备200,其中,第二电子设备200具有前置摄像头和后置摄像头。在接收摄像头切换操作之前,第一电子设备100的主界面20中第二视频图像202为来自于第一电子设备100本身摄像头所拍摄的视频图像,例如打坐画面,第一电子设备100的主界面20中第一视频图像201为来自于第二电子设备200的后置摄像头所拍摄的视频图像,例如手举自行车画面,此时第二电子设备200显示的也是其后置摄像头所拍摄的手举自行车画面;在接收到摄像头切换操作后,根据摄像头切换操作,第一电子设备100将主界面20中的第一视频图像201切换为第四视频图像204,第四视频图像204即来自于第二电子设备200的前置摄像头所拍摄的自拍画面,根据摄像头切换操作,还可以向第二电子设备200发送相应的控制指令,使第二电子设备200也切换为显示其前置摄像头所拍摄的自拍画面。即实现了将第一电子设备100中主界面20的非录制画面切换由同一机位不同摄像头提供的视频图像。
当用户需要将第一电子设备100中主界面20的非录制画面切换为同一机位的另一摄像头提供的视频图像时,可以执行摄像头切换操作。当第一电子设备100接收到摄像头切换操作,会将主界面20中当前的非录制画面切换为相同机位的另一个摄像头提供的视频图像。通过摄像头切换操作使用户能够轻松的查看同一个机位的每个摄像头提供的视频图像,方便用户观看不同摄像头的视频图像,提高了视频拍摄的灵活性。
示例性的,摄像头切换操作包括作用于第一视频图像201的三击操作。例如,当用 户三击主界面20的第一视频图像201时,第一视频图像201会切换为同一机位另一个摄像头提供的视频图像,如果不止两个摄像头,还可以继续三击,每三击一次则切换一次。摄像头切换的顺序可以由系统预先设置。摄像头切换操作还可以为其他形式的操作,比如虚拟按键操作、实体按键操作等,例如主界面20可以包括机位切换控件,机位切换操作可以包括作用于机位切换控件的操作,本实施例对摄像头切换操作的形式不作限定。
在摄像头切换过程中,对于第二电子设备来说,可能会存在不同的情况,在第一电子设备的摄像头切换过程中,第二电子设备可以持续传输第一视频图像以及第四视频图像至第一电子设备,以便于第一电子设备能够快速恢复显示第一视频图像或第四视频图像,另外,在摄像头切换时,第一电子设备也可以发送指令至第二电子设备,例如在第一电子设备接收摄像头切换操作之前,第一电子设备和第二电子设备均显示第一视频图像,在第一电子设备接收摄像头切换操作时,向第二电子设备发送响应的指令,第二电子设备根据该指令显示第四视频图像,第一电子设备将第一视频图像切换为第四视频图像。另外,在摄像头切换之前,第二电子设备也可以没有传输第四视频图像至第一电子设备,此时,当第二电子设备接收到第一电子设备的指令,可以将第四视频图像传输至第一电子设备,以便于第一电子设备进行摄像头切换。
在一些实施例中,为了满足用户对拍摄视频的多元化要求,增加视频的表现方式,也可以在录制画面中增加画中画效果。
如图8所示,在图3所示实施例的基础上,在第一电子设备100根据视频切换操作,将第一视频图像201和第二视频图像202进行切换的过程之后,拍摄方法还可以包括:
执行步骤1013:第一电子设备100接收画中画显示操作,画中画显示操作针对第一视频图像201;
执行步骤1014:第一电子设备100根据画中画显示操作,在主界面20显示至少部分被第二视频图像202包围的第五视频图像205,第五视频图像205与第一视频图像201相同,第五视频图像205和第二视频图像202为录制画面或者说直播画面,即第五视频图像205和第二视频图像202的叠加画面用于呈现给观众观看。
例如,画中画显示操作包括作用于第一视频图像201的拖拽操作,用户按住第一视频图像201向上拖拽,会生成第五视频图像205。
可以理解的是,第五视频图像205的显示尺寸是小于第二视频图像202的显示尺寸的,并且第五视频图像205的分辨率小于第二视频图像202的分辨率,当第五视频图像205来自于某一辅机位时,该辅机位可以将低分辨率的视频图像传输给第一电子设备,以减少数据的传输量。
当用户需要在录制画面中显示画中画效果时,可以执行画中画显示操作,以使第一电子设备100的主界面20显示作为录制画面中一部分的第五视频图像205,第五视频图像205的至少部分被第二视频图像202包围,第五视频图像205和第二视频图像202的叠加为录制画面,即第五视频图像205和第二视频图像202作为叠加的视频图像被录制,以便于保存为画中画效果的视频画面,或者传输至服务器进行直播,形成画中画效果的直播画面。画中画的视频图像录制效果,增加了视频的表现形式,提高了视屏拍摄的灵活性。
示例性的,画中画显示操作可以包括作用于第一视频图像201的拖拽操作。例如,当用户按住主界面20显示的第一视频图像201向上拖动或者向右上方向拖动后,会在主界面20上增加显示与第一视频图像201相同的第五视频图像205。画中画显示操作还可以为其他形式的操作,比如虚拟按键操作、实体按键操作等,例如主界面包括画中画控件画中画显示操作可以包括作用于画中画控件的操作,本实施例对画中画显示操作的形式不作限定。另外,对于第五视频图像205,可以在主界面20所覆盖的任意区域拖动。
示例性的,用户通过在主界面20中拖动第五视频图像205移动,可以实现第五视频图像205在主界面20中的位置移动,用户可以根据需求选择放置第五视频图像205的位置,改善了视频拍摄的灵活性。
进一步的,当用户不需要显示第五视频图像205时,可以将第五视频图像205隐藏起来,以结束画中画显示效果。
如图9所示,在图8所示实施例的基础上,当第一电子设备100的主界面20显示第五视频图像205时,拍摄方法还可以包括:
执行步骤1015:第一电子设备100接收画中画隐藏操作,画中画隐藏操作可以包括作用于第五视频图像205的拖拽操作,例如用户按住第五视频图像205向上拖拽并滑出主界面20的边界时,会隐藏第五视频图像205,即第一电子设备100的主界面20不显示第五视频图像。
步骤1016:第一电子设备100根据画中画隐藏操作,在主界面20隐藏第五视频图像205。
需要说明的是,当用户不再需要画中画效果时,可以执行画中画隐藏操作,以使第五视频图像205隐藏。当用户再次需要画中画显示时,还可以再次执行画中画显示操作,以使第五视频图像205显示。画中画效果按需显示或隐藏的方式,提高了视屏拍摄的灵活性。
示例性的,除了拖拽操作外,画中画隐藏操作还可以为其他形式的操作,比如虚拟按键操作、实体按键操作等,例如主界面包括画中画控件,第三界面隐藏操作可以为作用于画中画控件的操作,本实施例对第三界面隐藏操作的形式不作限定。
可以理解的是,图8和图9中的第一视频图像201和第五视频图像205的叠加为录制界面,当用户执行视频录制操作,例如点击视频录制按键后,第一电子设备100接收到视频录制操作,保存视频图像数据,该视频图像数据为第一视频图像201和第五视频图像205叠加后视频图像对应的视频图像数据,视频图像数据由提供视频图像的机位采集并传输到第一电子设备100,第一电子设备100经过编码处理后保存或传输至服务器直播。
在一些实施例中,用户可以对第一电子设备100中主界面20显示的视频图像进行画面控制,可以分别实现对不同视频图像的画面控制,比如缩放,对焦等操作。相应的,第一电子设备100中主界面20可以呈现出画面控制后的视频图像。实现的方式为第一电子设备100将画面控制指令传输到对应的机位,对应的机位根据画面控制指令调整视频图像,并将调整后的视频图像传输给第一电子设备100显示。
此外,视频图像拍摄过程中通常有一些特效控制,比如美颜等,这些这些效果可 以直接在第一电子设备上对视频图像直接实施,也可以将特效控制指令传输给视频图像对应的辅机位,对应的辅机位根据特效控制指令调整视频图像,并将调整后的视频图像传输给第一电子设备100显示。另外如果第一电子设备100显示有第五视频图像,即使用了画中画的录制方式,可以在第二视频图像和第五视频图像实施相同的特效控制,也可以在第二视频图像和第五视频图像分别实施不同的特效控制。
在一些实施例中,当用户在第一电子设备100对主界面20显示的视频图像进行操作,而被操作的视频图像是由辅机位提供的视频图像时,第一电子设备100需要向辅机位发送拍摄控制指令,以使辅机位将操作后的视频图像传输给第一电子设备100显示。为了减少图像显示的延迟,第一电子设备100向辅机位发送的拍摄控制指令均需要优先传输。
在一些实施例中,如图1和图3所示,假设在上述步骤1002中,第二视频图像来自于第二电子设备200,第二电子设备200为多机位拍摄系统的一个辅机位。上述步骤1002:第一电子设备100根据第一用户操作,在主界面20显示第二视频图像202的过程包括:
步骤10021:第一电子设备100根据第一用户操作,生成数据传输控制指令,数据传输控制指令携带有高优先级标签;
步骤10022:第一电子设备100基于高优先级将数据传输指令传输至第二电子设备200;
其中,数据传输指令用于控制第二电子设备200将其所拍摄的第二视频图像回传至第一电子设备100;
步骤10023:第一电子设备100接收第二电子设备200发送的第二视频图像;
步骤10024:第一电子设备100在主界面20显示第二视频图像202。
另外,上述方法还可以包括:根据用户操作,基于高优先级向第二电子设备200发送对焦控制指令或缩放控制指令等。当第一电子设备100与第二电子设备200通过WiFi通信时,数据传输控制指令、对焦控制指令和缩放控制指令等这些拍摄控制指令通过WiFi传输给辅机位进行拍摄控制。图10示意了传输队列的示意图,媒体存取控制服务数据单元(Mac Service Data Units,MSDU)通过传输队列和存取类别(access category)映射分类为多个传输队列VO、A_VO、A_VI、VI、BE、BK,VO是指声音(Voice),VI是指视频(Video),BE是指最大努力(Best effort),BK是指背景(Background);传输队列会分类进入增强型分布式信道存取(enhanced distributed channel access,EDCA)队列,EDCA队列依照优先级的高低分别包括VO、VI、BE和BK。为了让用户的操作体验更优,本申请实施例中这些拍摄控制指令的数据包携带有高优先级标签,并将这些携带有高优先级标签的数据包区分对待的放入到WiFi的EDCA队列中采用高优先级的队列(即图10中的VO队列)传输至第二电子设备,拍摄控制指令之外的其他控制指令与视频图像的传输数据按照协议默认的队列放置。通过将拍摄控制指令基于高优先传输给第二电子设备的方式,降低了第一电子设备与辅机位通信时延的问题。
在一些实施例中,为了降低多机位拍摄系统中各个机位的功耗,当某一机位的视频图像未显示在第一电子设备的主界面时,可以控制对应机位进入低功耗工作状态。
图11为本申请实施例提供的再一种多机位拍摄系统的拍摄方法的流程示意图,在图1所示实施例的基础上,在接收第三用户操作之前,例如在步骤1004之后,第一视频图像201来自于第二电子设备200,第二电子设备200为多机位拍摄系统的一个辅机位;拍摄方法还可以包括:
步骤1005:接收第二用户操作;
步骤1006:根据第二用户操作,在主界面20隐藏第一视频图像201,步骤1005和1006的具体过程可参照上述图5a和图5b相关描述内容;
步骤1017:在主界面20隐藏第一视频图像201后,且第一电子设备100未显示来自于第二电子设备200的视频图像,第一电子设备100向第二电子设备200发送待机控制指令,待机控制指令用于指示第二电子设备200使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器VPU、显示屏以及无线通信链路,无线通信链路用于将视频图像从第二电子设备200传输至第一电子设备100。对于第二电子设备200来说,如果接收到待机控制指令,则会根据该待机控制指令进行待机,例如使上述任意部件或组合关闭或切换为工作于低功耗模式。
其中,多机位拍摄系统中的机位可能是移动设备或者其他无线拍摄设备,只能依靠自身的电量。例如第二电子设备200可以为手机,需要考虑降低手机的拍摄功耗,降低功耗的方式是在不使用第二电子设备200时,将第二电子设备200的至少部分部件关闭或控制工作于低功耗模式以保持设备的低功耗,例如控制第二电子设备200进入待机模式。也就是说,对于多机位拍摄系统来说,如果某一个机位的视频图像并没有被第一电子设备100所显示,即没有被第一电子设备100使用,那么第一电子设备100可以通过向其发送待机控制指令的方式来控制对应的机位降低功耗。另外,对于第一电子设备100本身来说,如果其显示的视频图像均来自于辅机位,即第一电子设备100没有显示其自身所拍摄的视频图像,那么也可以控制第一电子设备100自身的摄像头模组、图像信号处理器ISP等不影响显示的器件关闭或控制工作于低功耗模式。例如,多机位拍摄系统包括第一电子设备100和第二电子设备200,如图4c和图4d所示,第二视频图像202来自于第一电子设备100自身拍摄的视频图像,第一视频图像201来自于第二电子设备200,当第一电子设备100在主界面20隐藏第一视频图像201后,第一电子设备100可以会向第二电子设备200发送对应的待机控制指令,控制第二电子设备200进入待机模式,以节省功耗。
另外,在一种可能的实施方式中,用户在隐藏第一视频图像201后有可能会在很快的时间内重新控制显示第一视频图像201,为了改善在这种情况下需要频繁控制第二电子设备200待机并从待机模式中恢复的情况,上述步骤1017:在主界面20隐藏第一视频图像201后,且第一电子设备100未显示来自于第二电子设备200的视频图像,第一电子设备100向第二电子设备200发送待机控制指令的过程可以包括:
当第一电子设备100在主界面20隐藏第一视频图像201达到预设时间以上,且第一电子设备100在预设时间内未显示来自于第二电子设备200的视频图像,第一电子设备100向第二电子设备200发送待机控制指令。以避免第二电子设备200以及无线通信链路频繁从待机模式下被唤醒。
第一电子设备100可以设置有一个检测模块,用于周期检测本机的显示画面中没有用到其视频图像的目标机位,当检测到目标机位时,就通知目标机位进入待机模式,并关闭对应的器件。
当第二电子设备200至少部分部件关闭或控制工作于低功耗模式后,如果第一电子设备100再次使用该第二电子设备200的视频图像时,则需要快速唤醒该辅机位。需要说明的是,进入待机模式的第二电子设备200的快速启动需要:1)快速恢复无线通信链路;2)快速恢复已经关闭的电源部件:摄像头模组,ISP,VPU和/或显示屏等。
在一些实施例中,如图12所示,无线通信链路具有持续通信状态,在持续通信状态下,第一电子设备100和第二电子设备200之间的视频图像传输效率较高,以便于第一电子设备100通过无线通信链路接收来自于第二电子设备200的视频图像,并将该视频图像显示在第一电子设备100的主界面20,当第一电子设备100隐藏第一视频图像201达到预设时间以上,且第一电子设备100在预设时间内未显示来自于第二电子设备200的视频图像时,说明用户可能在一段时间内不会使用来自于第二电子设备200的视频图像,因此向第二电子设备200发送待机控制指令,一方面,待机控制指令用于指示第二电子设备200中的例如摄像头等部件关闭,另一方面,待机控制指令还用于指示第二电子设备200使无线通信链路由持续通信状态变为周期性休眠通信状态。在周期性休眠通信状态下,无线通信链路包括交替的休眠阶段和唤醒阶段,唤醒阶段可以传输数据,即可以间断地实现数据传输,以节省功耗,同时保证可以无线通信链路的基本信息传输功能。
当无线通信链路在周期性休眠通信状态的持续时长达到第一预设时长时,建立第一电子设备100和第二电子设备200之间的低功耗蓝牙(Bluetooth Low Energy,BLE)连接,并断开无线通信链路。例如第一电子设备100和第二电子设备200通过不活动计时器判断在周期性休眠通信状态的持续时长达到第一预设时长时断开无线通信链路(即WiFi链路),也就是当不活动计时器超时时,断开无线通信链路以降低功耗。但是,为了保证在无线通信链路断开后第一电子设备100和第二电子设备200之间仍能够保持通信,可以建立两者之间的BLE连接,来实现指令传输等功能。
如图11和图13所示,第一电子设备100向第二电子设备200发送待机控制指令之后,上述方法还包括:第一电子设备100执行第一待机恢复流程S1或第二待机恢复流程S2。其中,第一待机恢复流程S1和第二待机恢复流程S2均包括上述第一电子设备100接收第三用户操作,以及第一电子设备100根据第三用户操作,在主界面20显示第一视频图像201的过程。
如图11所示,在第一待机恢复流程S1中,第三用户操作为待机恢复操作,即第一待机恢复流程S1包括:步骤1018:第一电子设备100接收待机恢复操作;第一电子设备100根据待机恢复操作,执行步骤1021:在主界面20显示第一视频图像201。
如图13所示,第二待机恢复流程S2包括:
步骤1007:第一电子设备100接收第三用户操作;
第一电子设备100根据第三用户操作,执行步骤1021:在主界面20显示第一视频图像201;
第二待机恢复流程S2还包括:在接收第三用户操作之前,执行步骤1018:第一电 子设备100接收待机恢复操作。
如图11和图13所示,在主界面20显示第一视频图像201的过程之前,第一待机恢复流程S1和第二待机恢复流程S2还包括:
第一电子设备100根据待机恢复操作,执行步骤1019:确定接收到待机恢复操作时无线通信链路处于周期性休眠通信状态还是处于断开状态;
如图14所示,如果在无线通信链路处于周期性休眠通信状态时接收到待机恢复操作,则执行步骤10201:通过无线通信链路向第二电子设备200发送待机恢复控制指令,该待机恢复控制指令用于指示第二电子设备200使无线通信链路恢复至持续通信状态,这种情况下,不需要建立BLE连接,且由于没有断开无线通信链路,因此可以快速使无线通信链路恢复至持续通信状态;
如图12所示,如果在无线通信链路断开时接收到待机恢复操作,则执行步骤10202:通过低功耗蓝牙BLE连接向第二电子设备200发送待机恢复控制指令,该待机恢复控制指令用于指示第二电子设备200使无线通信链路恢复至持续通信状态,同时可以断开BLE连接,以节省功耗。基于待机恢复控制指令,由于之前无线通信链路已经断开,因此需要先进行认证,在认证成功之后,才能够将无线通信链路恢复至持续通信状态。
当无线通信链路恢复至持续通信状态之后,第一电子设备100即可以通过无线通信链路接收来自于第二电子设备200的视频图像,然后可以根据待机恢复操作执行步骤1021:在主界面20显示第一视频图像201。在第一待机恢复流程S1中,通过一个待机恢复操作即可触发待机恢复控制指令的发送以及第一视频图像201的显示;而在第二待机恢复流程S2中,通过待机恢复操作来触发待机恢复指令的发送,通过另外的第三用户操作来触发第一视频图像201的显示。因此,在第二待机恢复流程S2中,可以设置待机恢复操作为第三用户操作的前置操作,即可以在用户执行第三用户操作之前,提前发送待机恢复指令,此时即会预先恢复无线通信链路、恢复第二电子设备已经关闭的部件,然后在接收到第三用户操作时,会在主界面20显示来自于第二电子设备的第一视频图像201,以提高显示第一视频图像201的响应速度。
例如,在第一待机恢复流程S1中,第三用户操作为待机恢复操作,即待机恢复操作包括作用于操作控件(例如悬浮球)的点击操作,另外,第三用户操作还可以包括作用于预设位置30的第一滑动手势操作。如图11所示,在步骤1017之后,当第一电子设备接收到用户作用于悬浮球的点击操作或者作用于预设位置30的第一滑动手势操作,即执行步骤1019至步骤1021的过程,以恢复第一视频图像201的显示。
例如,在第二待机恢复流程S2中,待机恢复操作包括作用于预设位置30的触碰操作,假设预设位置30为第一视频图像对应的待显示区域,如图13所示,在步骤1017之后,当第一电子设备接收到用户作用于预设位置30的触碰操作,则执行步骤1019至步骤10202,以实现向第二电子设备发送待机恢复控制指令,当第一电子设备接收到用户作用于预设位置30的第一滑动手势操作,则执行步骤1021,以恢复第一视频图像201的显示。用户在执行作用于预设位置30的第一滑动手势操作时,必然会先触碰预设位置30,也就是说,在用户执行第三用户操作时,必然会由于第三用户操作的前置操作而预先触发发送待机恢复操作指令的过程,之后再根据第三用户操作显示第一视频图像201。
需要说明的是,本申请实施例中多机位拍摄系统的拍摄方法中,所使用的BLE连接的广播周期间隔相对于其他过程中的广播周期调整变短,比如使用BLE实现智能家电控制的过程中,BLE连接的广播周期间隔是200ms,而本申请实施例多机位拍摄系统的拍摄方法中,BLE连接的广播周期间隔可以调整到50ms,以使便于在拍摄过程中,通过BLE连接发送至第二电子设备的指令可以被快速响应。
在另一些实施例中,如图15所示,待机控制指令用于指示第二电子设备使无线通信链路由持续通信状态变为第一周期性休眠通信状态,在第一周期性休眠通信状态下,相对于持续通信状态,功耗更低;第一电子设备当无线通信链路在第一周期性休眠通信状态的持续时长达到第一预设时长时,使无线通信链路变为第二周期性通信状态,第一周期性休眠通信状态的休眠周期小于第二周期性休眠通信状态的休眠周期,通过使无线通信链路变为第二周期性通信状态可以进一步降低功耗。
具体地,如图15至图18所示,向第二电子设备发送待机控制指令之后,上述方法还包括:第一电子设备执行第三待机恢复流程S3或第四待机恢复流程S4;第三待机恢复流程S3和第四待机恢复流程S4均包括上述接收第三用户操作,以及根据第三用户操作,在主界面20显示第一视频图像201的过程;
如图16所示,在第三待机恢复流程S3中,第三用户操作为待机恢复操作;即第三待机恢复流程S3包括:步骤1018:接收待机恢复操作;根据待机恢复操作,执行步骤1021,步骤1021:在主界面20显示第一视频图像201。
如图17所示,第四待机恢复流程S4包括:
步骤1007:接收第三用户操作;
根据第三用户操作,执行步骤1021,步骤1021:在主界面20显示第一视频图像201;
第四待机恢复流程S4还包括:在接收第三用户操作之前,执行步骤1018:接收待机恢复操作。
如图16和图17所示,在主界面20显示第一视频图像201的过程之前,第三待机恢复流程S3和第四待机恢复流程S4还包括:
根据待机恢复操作,执行步骤10201:通过无线通信链路向第二电子设备发送待机恢复控制指令,该待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。
当无线通信链路恢复至持续通信状态之后,第一电子设备100即可以通过无线通信链路接收来自于第二电子设备200的视频图像,然后可以根据待机恢复操作执行步骤1021,步骤1021:在主界面20显示第一视频图像201。
例如,在第三待机恢复流程S3中,第三用户操作为待机恢复操作,即待机恢复操作包括作用于操作控件(例如悬浮球)的点击操作,另外,第三用户操作还可以包括作用于预设位置30的第一滑动手势操作,如图16所示,在步骤1017之后,当第一电子设备接收到用户作用于悬浮球的点击操作或者作用于预设位置30的第一滑动手势操作,即执行步骤10201至步骤1021的过程,以恢复第一视频图像201的显示。
例如,在第四待机恢复流程S4中,待机恢复操作包括作用于预设位置30的触碰操作,假设预设位置30为第一视频图像对应的待显示区域,如图17所示,在步骤1017 之后,当第一电子设备接收到用户作用于预设位置30的触碰操作,则执行步骤10201,以实现向第二电子设备发送待机恢复控制指令,当第一电子设备接收到用户作用于预设位置30的第一滑动手势操作,则执行步骤1021,以恢复第一视频图像201的显示。用户在执行作用于预设位置30的第一滑动手势操作时,必然会先触碰预设位置30,也就是说,在用户执行第三用户操作时,必然会由于第三用户操作的前置操作而预先触发发送待机恢复操作指令的过程,之后再根据第三用户操作显示第一视频图像201。
在图16和图17所示的实施例中,无线通信链路可以应用图18所示的数据传输过程,无线通信链路包括多个同步周期,同步周期的时长例如为524ms,每个同步周期包括探索窗口和数据传输阶段,探索窗口的时长例如为16ms,在每个探索窗口,无线通信链路所涉及的主设备Master会发送同步信标Sync Beacons,无线通信链路所涉及的从设备Slave只需要接收Sync Beacons以实现和主设备的同步即可,因此,从设备的功耗比主设备要低,因此在本申请实施例中,如果多机位拍摄系统包括手机和无线拍摄设备,则将手机作为主设备,将无线拍摄设备作为从设备,以降低无限拍摄设备的功耗。如图15和图18所示,在持续通信状态下,每个同步周期中的数据传输阶段均传输数据;在第一周期性休眠通信状态和第二周期性通信状态下,无线通信链路包括交替的休眠阶段和唤醒阶段,唤醒阶段的数据传输阶段可以传输数据,休眠阶段的数据传输阶段不可以传输数据,其中,第一周期性休眠通信状态的休眠阶段的持续时长小于第二周期性通信状态的休眠阶段的持续时长。
在一些实施例中,当第二电子设备进入待机模式时,可以通过控制第二电子设备上的辅助灯闪烁提醒用户该机位仍然在多机位拍摄系统的待机模式下使用,只是没有使用到第二电子设备的镜头等部件。可以理解的是,还可以采用其他方式提醒用户,而不仅限于辅助灯闪烁,因此本实施例对提示用户机位工作在待机模式的方式不作限定。如图19所示,以一个具体场景为例,其中,第一电子设备100和第二电子设备200为手机,第三电子设备300为无线拍摄设备,当第一电子设备100仅显示来自于第一电子设备100本身拍摄的画面时,第二电子设备200和第三电子设备300上分别设置有辅助灯900,第一电子设备100发送待机控制指令给第二电子设备200和第三电子设备300,使第二电子设备200的屏幕和摄像头关闭,使第三电子设备300的摄像头关闭,第二电子设备200和第三电子设备300上的辅助灯闪烁,以提示用户,该设备仍在待机的多机位下使用,但是并没有使用到设备的摄像头。
在一些实施例中,如图20所示,第一电子设备100接收到用户作用于预设位置30的触碰操作或者说点击操作,并根据该操作,向第二电子设备发送待机恢复指令,在上述向第二电子设备发送待机恢复控制指令之后,上述方法还包括:
第一电子设备100根据第三用户操作,例如作用于预设位置30的第一滑动手势操作,在预设位置30显示过渡图像209;
上述第一电子设备100根据第三用户操作,在主界面显示第一视频图像的过程包括:第一电子设备100根据第三用户操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的第一视频图像时,将过渡图像209替换为第一视频图像201,即在第一电子设备100上显示恢复后的第一视频图像201,恢复后的第一视频图像201来自于第二电子设备。
例如,在图11或图16所示的基础上,第三用户操作为待机恢复操作。即可以通过同一个用户操作来指示恢复无线通信链路、恢复第二电子设备已经关闭的部件以及恢复第一电子设备显示的第一视频图像201。在向第二电子设备发送待机恢复控制指令之后,方法还包括:
第一电子设备100根据待机恢复操作,在预设位置显示过渡图像;
第一电子设备100根据待机恢复操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的第一视频图像时,将过渡图像209替换为第一视频图像201。也就是说,图11或图16所示的基础上增加了显示过渡图像的步骤,并将步骤1021替换为“将过渡图像209替换为第一视频图像201”的过程。
例如第三用户操作,即待机恢复操作为作用于预设位置30的第一滑动手势操作。在第一电子设备100隐藏第一视频图像201,并向第二电子设备发送待机控制指令之后,用户希望恢复第一视频图像201显示时,可以在第一电子设备100上执行作用于预设位置30的第一滑动手势操作,由于需要显示的是辅机位的视频图像,那么就需要辅机位将视频图像传输到第一电子设备100,会出现第一滑动手势操作与在主界面显示辅机位的视频图像的时差。在这个时差里,第一电子设备100根据第一滑动手势操作,在预设位置30显示预先存储的过渡图像209;当第二电子设备以及无线通信链路从低功耗状态恢复完成,第一电子设备100接收到第一视频图像201时,将过渡图像209替换为第一视频图像201,以实现在第一电子设备100恢复显示第一视频图像201,解决了图像显示延迟的问题。过渡图像可以为画面模糊旋转的动效,也可以是其他类型的固定图像,本实施例对过渡图像的类型不作限定。
类似地,例如,在图13或图17所示的基础上,待机恢复操作和第三用户操作为不同的操作,例如待机恢复操作为作用于预设位置30的触碰操作或者说点击操作。例如当第二电子设备进入待机模式后,如果用户需要使用来自于第二电子设备的视频图像,可以通过在第一电子设备上预设位置30的触碰操作来触发。在向第二电子设备发送待机恢复控制指令之后,方法还包括:
第一电子设备100根据第三用户操作,在预设位置显示过渡图像;
第一电子设备100根据待机恢复操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的第一视频图像时,将过渡图像209替换为第一视频图像201。也就是说,在图13或图17所示的基础上,增加了显示过渡图像的步骤,并将步骤1021替换为“将过渡图像209替换为第一视频图像201”的过程。
具体例如,待机恢复操作为第一电子设备100预设位置30的触碰操作,或者说点击操作,第三用户操作为作用于预设位置30的第一滑动手势操作。在第一电子设备100隐藏第一视频图像201,并向第二电子设备发送待机控制指令之后,用户希望恢复第一视频图像201显示时,点击第一电子设备100的预设位置30并执行第一滑动手势操作,在该过程中依次执行了待机恢复操作和第三用户操作。在接收到用户点击预设位置30的待机恢复操作时,会向第二电子设备发送待机恢复控制指令,以提前恢复待机状态;在接收到第一滑动手势操作后,由于需要显示的是辅机位的视频图像,那么就需要辅机位将视频图像传输到第一电子设备100,会出现第一滑动手势操作与在主界面显示辅机位的视频图像的时差。在这个时差里,第一电子设备100根据第一滑动 手势操作,在预设位置30显示预先存储的过渡图像209;当第二电子设备以及无线通信链路从低功耗状态恢复完成,第一电子设备100接收到第一视频图像时,将过渡图像209替换为第一视频图像201,以实现在第一电子设备100恢复显示第一视频图像201,解决了图像显示延迟的问题。
另外,不同的辅机位可以在第一电子设备上具有不同的预设位置,例如第二电子设备在第一电子设备上屏幕的左上角具有对应的预设位置,第三电子设备在第一电子设备上屏幕的右上角具有对应的预设位置。假设第一电子设备当前仅显示有第二视频图像202,没有显示其他视频图像,第二视频图像202为第一电子设备自身拍摄的视频图像,此时第二电子设备和第三电子设备均可以处于待机模式。
例如在第一个场景下,当用户例如点击左上角,或者从左上角向右下角划屏操作,作为第三用户操作,第一电子设备会向第二电子设备发送待机恢复控制指令。
例如在第二个场景下,当用户例如点击右上角,或者从右上角向左下角划屏操作,第一电子设备会向第三电子设备发送待机恢复控制指令。以下结合第一电子设备和第二电子设备之间的基于无线无线通信链路实现控制的过程对一个场景下的实施例进行说明:在初始状态下,第一电子设备仅显示第二视频图像202,且第二视频图像202为第一电子设备本身拍摄的视频图像;之后,用户通过触控事件对第一电子设备进行控制,如果触屏事件中涉及到远端的第二电子设备的画面控制,例如用户控制在第一电子设备上显示来自于第二电子设备的第一视频图像,则通过CameraHAL转发到第二电子设备的VirtualCameraAgent进行控制,使第二电子设备拍摄的视频图像传输到第一电子设备上,形成显示在主界面中的第一视频图像。
以下通过两个具体例子对本申请实施例进行说明。
如图21所示,两部支持多机位拍摄的手机分别作为第一电子设备100和第二电子设备200。可以在第一电子设备100的屏幕上通过作用于预设位置30的滑入和滑出操作来实现视频图像的显示和隐藏。例如第一电子设备100的主界面可以显示来自于第一电子设备100本身拍摄的第二视频图像202,此时第二视频图像202作为录制画面,作用于预设位置30的向右滑屏的滑出操作可以使来自于第二电子设备200拍摄的第一视频图像201显示在第一电子设备100的主界面,视频切换操作可以使主界面中的第一视频图像201和第二视频图像202进行切换,使第一视频图像201被切换为录制画面,此时作用于预设位置30的向左滑屏的滑入操作可以使第二视频图像202隐藏。另外也可以实现画中画录制。如果第一电子设备100将第一视频图像201隐藏且未使用第二电子设备200的视频图像时,第二电子设备200可以选择启用低功耗模式;也可以选择不启用低功耗模式。对于第二电子设备200的控制传输,可以通过上述的优先级优化策略,减少第一电子设备100上控制操作的时延。
如图22所示,一部支持多机位拍摄的手机作为第一电子设备100和第四电子设备400组网,第四电子设备400为拍摄设备。具体的过程和原理可以与上述图21所涉及的内容类似,区别在于,图22中的第一视频图像201来自于第四电子设备400,第四电子设备400上可以设置有低功耗提示灯和启动提示灯,当第一电子设备100没有用到第四电子设备400的视频图像时,第四电子设备400的低功耗提示灯闪烁,表示已经组网,但未使用拍摄或预览;当滑出显示的第一视频图像201为来自于第四电子设 备400的图像时,第四电子设备400的启动提示灯闪烁,表示设备已经启用拍摄或预览。
本申请实施例还提供一种多机位拍摄系统的拍摄装置,应用于第一电子设备,第一电子设备为多机位拍摄系统的主机位,多机位拍摄系统还包括至少一个辅机位,装置包括:界面显示模块,用于显示主界面,主界面包括第一视频图像;操作接收模块,用于在视频拍摄模式下接收第一用户操作;界面显示模块还用于,根据第一用户操作,在主界面显示第二视频图像,第一视频图像来自于主机位或辅机位,第二视频图像来自于辅机位,即第一视频图像和第二视频图像是多机位拍摄系统中不同机位提供的视频图像;操作接收模块还用于,接收视频切换操作,视频切换操作针对第二视频图像;视频切换模块,用于根据视频切换操作,将第一视频图像与第二视频图像进行切换。该多机位拍摄系统的拍摄装置可以应用上述任意实施例中的多机位拍摄系统的拍摄方法,具体过程和原理与上述实施例相同,在此不再赘述。
应理解以上多机位拍摄系统的拍摄装置的划分仅仅是一种逻辑功能的划分,实际实现时可以全部或部分集成到一个物理实体上,也可以物理上分开。且这些模块可以全部以软件通过处理元件调用的形式实现;也可以全部以硬件的形式实现;还可以部分模块以软件通过处理元件调用的形式实现,部分模块通过硬件的形式实现。例如,界面显示模块、操作接收模块和视频切换模块中的任意一者可以为单独设立的处理元件,也可以集成在拍摄装置中,例如集成在拍摄装置的某一个芯片中实现,此外,也可以以程序的形式存储于拍摄装置的存储器中,由拍摄装置的某一个处理元件调用并执行以上各个模块的功能。其它模块的实现与之类似。此外这些模块全部或部分可以集成在一起,也可以独立实现。这里所述的处理元件可以是一种集成电路,具有信号的处理能力。在实现过程中,上述方法的各步骤或以上各个模块可以通过处理器元件中的硬件的集成逻辑电路或者软件形式的指令完成。
例如,拍摄装置可以是被配置成实施以上方法的一个或多个集成电路,例如:一个或多个特定集成电路(Application Specific Integrated Circuit,ASIC),或,一个或多个微处理器(digital singnal processor,DSP),或,一个或者多个现场可编程门阵列(Field Programmable Gate Array,FPGA)等。再如,当以上某个模块通过处理元件调度程序的形式实现时,该处理元件可以是通用处理器,例如中央处理器(Central Processing Unit,CPU)或其它可以调用程序的处理器。再如,这些模块可以集成在一起,以片上系统(system-on-a-chip,SOC)的形式实现。
在一些实施例中,主界面包括操作控件,操作控件用于触发在主界面显示第二视频图像,例如第一用户操作包括作用于操作控件的点击操作。
在一些实施例中,第一用户操作包括作用于主界面的预设位置的第一滑动手势操作。
在一些实施例中,视频切换操作包括作用于主界面中第二视频图像的单击操作。
在一些实施例中,第一视频图像和第二视频图像中的一者来自于第二电子设备,第二电子设备为多机位拍摄系统的一个辅机位;第一视频图像和第二视频图像中的另一者来自于第一电子设备或第三电子设备,第三电子设备为多机位拍摄系统的另一个辅机位。
在一些实施例中,操作接收模块还用于,接收第二用户操作;界面显示模块还用于,根据第二用户操作,在主界面隐藏第一视频图像;操作接收模块还用于,接收第三用户操作;界面显示模块还用于,根据第三用户操作,在主界面显示第一视频图像。
在一些实施例中,主界面包括操作控件,操作控件用于触发,在主界面隐藏第一视频图像以及在主界面隐藏第一视频图像,例如第二用户操作以及第三用户操作包括作用于操作控件的点击操作。
在一些实施例中,第三用户操作包括作用于预设位置的第一滑动手势操作,第二用户操作包括作用于预设位置的第二滑动手势操作。
在一些实施例中,操作接收模块还用于,接收机位切换操作,机位切换操作针对第一视频图像;界面显示模块还用于,根据机位切换操作,将第一视频图像替换为第三视频图像,第一视频图像与第三视频图像是多机位拍摄系统中不同机位提供的视频图像。
在一些实施例中,机位切换操作包括作用于第一视频图像的双击操作。
在一些实施例中,操作接收模块还用于,接收摄像头切换操作,摄像头切换操作针对第一视频图像;界面显示模块还用于,根据摄像头切换操作,将第一视频图像替换为第四视频图像,第一视频图像与第四视频图像是多机位拍摄系统中同一机位不同摄像头提供的视频图像。
在一些实施例中,摄像头切换操作包括作用于第一视频图像的三击操作。
在一些实施例中,操作接收模块还用于,接收画中画显示操作,画中画显示操作针对第一视频图像;界面显示模块还用于,根据画中画显示操作,在主界面显示至少部分被第二视频图像包围的第五视频图像,第五视频图像与第一视频图像相同。
在一些实施例中,画中画显示操作包括作用于第一视频图像的拖拽操作。
在一些实施例中,装置还包括:待机控制模块,用于,在主界面隐藏第一视频图像后,且第一电子设备未显示来自于第二电子设备的视频图像,向第二电子设备发送待机控制指令,待机控制指令用于指示第二电子设备使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器VPU、显示屏以及无线通信链路,无线通信链路用于将视频图像从第二电子设备传输至第一电子设备,第二电子设备为多机位拍摄系统的一个辅机位,当前视频图像为第一视频图像或第二视频图像。
在一些实施例中,待机控制指令还用于指示第二电子设备使无线通信链路由持续通信状态变为周期性休眠通信状态;装置还包括通信控制模块,用于当无线通信链路在周期性休眠通信状态的持续时长达到第一预设时长时,建立第一电子设备和第二电子设备之间的低功耗蓝牙BLE连接,并断开无线通信链路;操作接收模块具体用于,在第一待机恢复流程中接收第三用户操作,或者在第二待机恢恢恢复流程中接收待机恢复操作和第三用户操作,在第一待机恢复流程中,第三用户操作为待机恢复操作;待机控制模块还用于,根据待机恢复操作,如果在无线通信链路处于周期性休眠通信状态时接收到待机恢复操作,则通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态;待机控制模块还用于,根据待机恢复操作,如果在无线通信链路断开时接收到待机恢 复操作,则通过低功耗蓝牙BLE连接向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。
在一些实施例中,在第二待机恢复流程中,待机恢复操作包括作用于预设位置的触碰操作。
在一些实施例中,待机控制指令用于指示第二电子设备使无线通信链路由持续通信状态变为第一周期性休眠通信状态;装置还包括通信控制模块,用于当无线通信链路在第一周期性休眠通信状态的持续时长达到第一预设时长时,使无线通信链路变为第二周期性通信状态,第一周期性休眠通信状态的休眠周期小于第二周期性休眠通信状态的休眠周期;操作接收模块具体用于,在第三待机恢复流程中接收第三用户操作,或者在第四待机恢复流程中接收待机恢复操作和第三用户操作,在第三待机恢复流程中,第三用户操作为待机恢复操作;待机控制模块还用于,根据待机恢复操作,通过无线通信链路向第二电子设备发送待机恢复控制指令,待机恢复控制指令用于指示第二电子设备使无线通信链路恢复至持续通信状态。
在一些实施例中,在第四待机恢复流程中,待机恢复操作为作用于预设位置的触碰操作。
在一些实施例中,装置还包括:界面显示模块还用于,根据第三用户操作,在预设位置显示过渡图像;界面显示模块还具体用于:根据第三用户操作,当第一电子设备通过恢复至持续通信状态的无线通信链路接收到来自于第二电子设备的视频图像时,将过渡图像替换为第一视频图像。
与上述方法实施例相对应,本申请还提供了一种电子设备,该电子设备包括用于存储计算机程序指令的存储器和用于执行程序指令的处理器,其中,当该计算机程序指令被所述处理器执行时,触发所述电子设备执行上述方法实施例中的部分或全部步骤。
参见图23,图23为本申请实施例提供的一种电子设备的结构示意图。该电子设备500可以为上述任意实施例中的任意电子设备。该电子设备500可以包括处理器410,外部存储器接口420,内部存储器421,通用串行总线(universal serial bus,USB)接口430,充电管理模块440,电源管理模块441,电池442,天线1,天线2,移动通信模块450,无线通信模块460,音频模块470,扬声器470A,受话器470B,麦克风470C,耳机接口470D,传感器模块480,按键490,马达491,指示器492,摄像头493,显示屏494,以及用户标识模块(subscriber identification module,SIM)卡接口495等。其中传感器模块480可以包括压力传感器480A,陀螺仪传感器480B,气压传感器480C,磁传感器480D,加速度传感器480E,距离传感器480F,接近光传感器480G,指纹传感器480H,温度传感器480J,触摸传感器480K,环境光传感器480L,骨传导传感器480M等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备500的具体限定。
在本申请另一些实施例中,电子设备500可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器410可以包括一个或多个处理单元,例如:处理器410可以包括应用处理 器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器410中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器410中的存储器为高速缓冲存储器。该存储器可以保存处理器410刚用过或循环使用的指令或数据。如果处理器410需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器410的等待时间,因而提高了系统的效率。
在一些实施例中,处理器410可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器410可以包含多组I2C总线。处理器410可以通过不同的I2C总线接口分别耦合触摸传感器480K,充电器,闪光灯,摄像头493等。例如:处理器410可以通过I2C接口耦合触摸传感器480K,使处理器410与触摸传感器480K通过I2C总线接口通信,实现电子设备500的触摸功能。
I2S接口可以用于音频通信。在一些实施例中,处理器410可以包含多组I2S总线。处理器410可以通过I2S总线与音频模块470耦合,实现处理器410与音频模块470之间的通信。在一些实施例中,音频模块470可以通过I2S接口向无线通信模块460传递音频信号,实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块470与无线通信模块460可以通过PCM总线接口耦合。在一些实施例中,音频模块470也可以通过PCM接口向无线通信模块460传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器410与无线通信模块460。例如:处理器410通过UART接口与无线通信模块460中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块470可以通过UART接口向无线通信模块460传递音频信号,实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器410与显示屏494,摄像头493等外围器件。 MIPI接口包括摄像头串行接口(camera seria l interfa ce,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器410和摄像头493通过CSI接口通信,实现电子设备500的拍摄功能。处理器410和显示屏494通过DSI接口通信,实现电子设备500的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器410与摄像头493,显示屏494,无线通信模块460,音频模块470,传感器模块480等。GPIO接口还可以被配置为I15c接口,I14S接口,UART接口,MIPI接口等。
USB接口430是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口430可以用于连接充电器为电子设备500充电,也可以用于电子设备500与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备500的结构限定。在本申请另一些实施例中,电子设备500也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块440用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块440可以通过USB接口430接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块440可以通过电子设备500的无线充电线圈接收无线充电输入。充电管理模块440为电池442充电的同时,还可以通过电源管理模块441为电子设备供电。
电源管理模块441用于连接电池442,充电管理模块440与处理器410。电源管理模块441接收电池442和/或充电管理模块440的输入,为处理器410,内部存储器421,显示屏494,摄像头493,和无线通信模块460等供电。电源管理模块441还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块441也可以设置于处理器410中。在另一些实施例中,电源管理模块441和充电管理模块440也可以设置于同一个器件中。
电子设备500的无线通信功能可以通过天线1,天线2,移动通信模块450,无线通信模块460,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备500中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块450可以提供应用在电子设备500上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块450可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块450可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块450还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块450的至少部分功能模块可以被设置于处理器410中。在一些实施例中,移动通信模块450的至少部分功能模块可以与处理器 410的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器470A,受话器470B等)输出声音信号,或通过显示屏494显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器410,与移动通信模块450或其他功能模块设置在同一个器件中。
无线通信模块460可以提供应用在电子设备500上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块460可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块460经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器410。无线通信模块460还可以从处理器410接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备500的天线1和移动通信模块450耦合,天线2和无线通信模块460耦合,使得电子设备500可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(globalsystemformobil ecommunications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband codedivision multiple access,WCDMA),时分码分多址(time-division code divisionmultiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenithsatellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备500通过GPU,显示屏494,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏494和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器410可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏494用于显示图像,视频等。显示屏494包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emittingdiode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrixorganic light emitting diode的,AMOLED),柔性发光二极管(flex light-emittingdiode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot lightemitting diodes,QLED)等。在一些实施例中,电子设备500可以包括1个或N个显示屏494,N为大于1的正整数。
电子设备500可以通过ISP,摄像头493,视频编解码器,GPU,显示屏494以及应用处理器等实现拍摄功能。
ISP用于处理摄像头493反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头493中。
摄像头493用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备500可以包括1个或N个摄像头493,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备500在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备500可以支持一种或多种视频编解码器。这样,电子设备500可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备500的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口420可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备500的存储能力。外部存储卡通过外部存储器接口420与处理器410通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器421可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器421可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备500使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器421可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器410通过运行存储在内部存储器421的指令,和/或存储在设置于处理器中的存储器的指令,执行电子设备500的各种功能应用以及数据处理。
电子设备500可以通过音频模块470,扬声器470A,受话器470B,麦克风470C,耳机接口470D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块470用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块470还可以用于对音频信号编码和解码。在一些 实施例中,音频模块470可以设置于处理器410中,或将音频模块470的部分功能模块设置于处理器410中。
扬声器470A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备500可以通过扬声器470A收听音乐,或收听免提通话。
受话器470B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备500接听电话或语音信息时,可以通过将受话器470B靠近人耳接听语音。
麦克风470C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风470C发声,将声音信号输入到麦克风470C。电子设备500可以设置至少一个麦克风470C。在另一些实施例中,电子设备500可以设置两个麦克风470C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备500还可以设置三个,四个或更多麦克风470C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口470D用于连接有线耳机。耳机接口470D可以是USB接口430,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器480A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器480A可以设置于显示屏494。压力传感器480A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器480A,电极之间的电容改变。电子设备500根据电容的变化确定压力的强度。当有触摸操作作用于显示屏494,电子设备500根据压力传感器480A检测所述触摸操作强度。电子设备500也可以根据压力传感器480A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
陀螺仪传感器480B可以用于确定电子设备500的运动姿态。在一些实施例中,可以通过陀螺仪传感器480B确定电子设备500围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器480B可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器480B检测电子设备500抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消电子设备500的抖动,实现防抖。陀螺仪传感器480B还可以用于导航,体感游戏场景。
气压传感器480C用于测量气压。在一些实施例中,电子设备500通过气压传感器480C测得的气压值计算海拔高度,辅助定位和导航。
磁传感器480D包括霍尔传感器。电子设备500可以利用磁传感器480D检测翻盖皮套的开合。在一些实施例中,当电子设备500是翻盖机时,电子设备500可以根据磁传感器480D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。
加速度传感器480E可检测电子设备500在各个方向上(一般为三轴)加速度的大小。当电子设备500静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换,计步器等应用。
距离传感器480F,用于测量距离。电子设备500可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备500可以利用距离传感器480F测距以实现快速对焦。
接近光传感器480G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备500通过发光二极管向外发射红外光。电子设备500使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定电子设备500附近有物体。当检测到不充分的反射光时,电子设备500可以确定电子设备500附近没有物体。电子设备500可以利用接近光传感器480G检测用户手持电子设备500贴近耳朵通话,以便自动熄灭屏幕达到省电的目的。接近光传感器480G也可用于皮套模式,口袋模式自动解锁与锁屏。
环境光传感器480L用于感知环境光亮度。电子设备500可以根据感知的环境光亮度自适应调节显示屏494亮度。环境光传感器480L也可用于拍照时自动调节白平衡。环境光传感器480L还可以与接近光传感器480G配合,检测电子设备500是否在口袋里,以防误触。
指纹传感器480H用于采集指纹。电子设备500可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。
温度传感器480J用于检测温度。在一些实施例中,电子设备500利用温度传感器480J检测的温度,执行温度处理策略。例如,当温度传感器480J上报的温度超过阈值,电子设备500执行降低位于温度传感器480J附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,电子设备500对电池442加热,以避免低温导致电子设备500异常关机。在其他一些实施例中,当温度低于又一阈值时,电子设备500对电池442的输出电压执行升压,以避免低温导致的异常关机。
触摸传感器480K,也称“触控器件”。触摸传感器480K可以设置于显示屏494,由触摸传感器480K与显示屏494组成触摸屏,也称“触控屏”。触摸传感器480K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏494提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器480K也可以设置于电子设备500的表面,与显示屏494所处的位置不同。
骨传导传感器480M可以获取振动信号。在一些实施例中,骨传导传感器480M可以获取人体声部振动骨块的振动信号。骨传导传感器480M也可以接触人体脉搏,接收血压跳动信号。在一些实施例中,骨传导传感器480M也可以设置于耳机中,结合成骨传导耳机。音频模块470可以基于所述骨传导传感器480M获取的声部振动骨块的振动信号,解析出语音信号,实现语音功能。应用处理器可以基于所述骨传导传感器480M获取的血压跳动信号解析心率信息,实现心率检测功能。[0268]按键490包括开机键,音量键等。按键490可以是机械按键。也可以是触摸式按键。电子设备500 可以接收按键输入,产生与电子设备500的用户设置以及功能控制有关的键信号输入。
马达491可以产生振动提示。马达491可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏494不同区域的触摸操作,马达491也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器492可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口495用于连接SIM卡。SIM卡可以通过插入SIM卡接口495,或从SIM卡接口495拔出,实现和电子设备500的接触和分离。电子设备500可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口495可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口495可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口495也可以兼容不同类型的SIM卡。SIM卡接口495也可以兼容外部存储卡。电子设备500通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备500采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备500中,不能和电子设备500分离。
本申请实施例还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,其中,在所述程序运行时控制所述计算机可读存储介质所在设备执行上述实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-onlymemory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
本申请实施例还提供了一种计算机程序产品,所述计算机程序产品包含可执行指令,当所述可执行指令在计算机上执行时,使得计算机执行上述方法实施例中的部分或全部步骤。
本申请实施例中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示单独存在A、同时存在A和B、单独存在B的情况。其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项”及其类似表达,是指的这些项中的任意组合,包括单项或复数项的任意组合。例如,a,b和c中的至少一项可以表示:a,b,c,a-b,ac,b-c,或a-b-c,其中a,b,c可以是单个,也可以是多个。
本领域普通技术人员可以意识到,本文中公开的实施例中描述的各单元及算法步骤,能够以电子硬件、计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本发明所提供的几个实施例中,任一功能如果以软件功能单元的形式实现并作 为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read-only memory,简称ROM)、随机存取存储器(random access memory,简称RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。本发明的保护范围应以所述权利要求的保护范围为准。

Claims (25)

  1. 一种多机位拍摄系统的拍摄方法,其特征在于,应用于第一电子设备,所述第一电子设备为多机位拍摄系统的主机位,所述多机位拍摄系统还包括辅机位,所述方法包括:
    所述第一电子设备显示主界面,所述主界面包括第一视频图像;
    所述第一电子设备在视频拍摄模式下接收第一用户操作;
    所述第一电子设备根据所述第一用户操作,在所述主界面显示第二视频图像,所述第一视频图像来自于主机位或辅机位,所述第二视频图像来自于辅机位;
    所述第一电子设备接收视频切换操作,所述视频切换操作针对所述第二视频图像;
    所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换。
  2. 根据权利要求1所述的方法,其特征在于,
    所述主界面包括操作控件,所述操作控件用于触发所述在所述主界面显示第二视频图像。
  3. 根据权利要求1所述的方法,其特征在于,所述第一用户操作包括作用于所述主界面的预设位置的第一滑动手势操作。
  4. 根据权利要求1-3任一所述的方法,其特征在于,所述视频切换操作包括作用于所述主界面中所述第二视频图像的单击操作。
  5. 根据权利要求1所述的方法,其特征在于,
    所述第一视频图像和所述第二视频图像中的一者来自于第二电子设备,所述第二电子设备为所述多机位拍摄系统的一个辅机位;
    所述第一视频图像和所述第二视频图像中的另一者来自于所述第一电子设备或第三电子设备,所述第三电子设备为所述多机位拍摄系统的另一个辅机位。
  6. 根据权利要求1所述的方法,其特征在于,
    在所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换的过程之后,所述方法还包括:
    所述第一电子设备接收第二用户操作;
    所述第一电子设备根据所述第二用户操作,在所述主界面隐藏所述第一视频图像;
    所述第一电子设备接收第三用户操作;
    所述第一电子设备根据所述第三用户操作,在所述主界面显示所述第一视频图像。
  7. 根据权利要求6所述的方法,其特征在于,
    所述第三用户操作包括作用于预设位置的第一滑动手势操作,所述第二用户操作包括作用于预设位置的第二滑动手势操作。
  8. 根据权利要求1所述的方法,其特征在于,
    在所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换的过程之后,所述方法还包括:
    所述第一电子设备接收机位切换操作,所述机位切换操作针对所述第一视频图像;
    所述第一电子设备根据所述机位切换操作,将所述第一视频图像替换为第三视频图像,所述第一视频图像与所述第三视频图像是所述多机位拍摄系统中不同机位提供 的视频图像。
  9. 根据权利要求1所述的方法,其特征在于,
    在所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换的过程之后,所述方法还包括:
    所述第一电子设备接收摄像头切换操作,所述摄像头切换操作针对所述第一视频图像;
    所述第一电子设备根据所述摄像头切换操作,将所述第一视频图像替换为第四视频图像,所述第一视频图像与所述第四视频图像是所述多机位拍摄系统中同一机位不同摄像头提供的视频图像。
  10. 根据权利要求1所述的方法,其特征在于,
    在所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换的过程之后,所述方法还包括:
    所述第一电子设备接收画中画显示操作,所述画中画显示操作针对所述第一视频图像;
    所述第一电子设备根据所述画中画显示操作,在所述主界面显示至少部分被所述第二视频图像包围的第五视频图像,所述第五视频图像与所述第一视频图像相同。
  11. 根据权利要求6所述的方法,其特征在于,
    在所述第一电子设备根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换的过程之后,所述第一视频图像来自于第二电子设备,所述第二电子设备为所述多机位拍摄系统的一个辅机位;
    所述方法还包括:在所述主界面隐藏所述第一视频图像后,且所述第一电子设备未显示来自于所述第二电子设备的视频图像,所述第一电子设备向所述第二电子设备发送待机控制指令,所述待机控制指令用于指示所述第二电子设备使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器VPU、显示屏以及无线通信链路,所述无线通信链路用于将视频图像从所述第二电子设备传输至所述第一电子设备。
  12. 根据权利要求11所述的方法,其特征在于,
    所述待机控制指令还用于指示所述第二电子设备使所述无线通信链路由持续通信状态变为周期性休眠通信状态;
    当所述无线通信链路在所述周期性休眠通信状态的持续时长达到第一预设时长时,所述第一电子设备建立所述第一电子设备和所述第二电子设备之间的低功耗蓝牙BLE连接,并断开所述无线通信链路;
    所述第一电子设备向所述第二电子设备发送待机控制指令之后,所述方法还包括:所述第一电子设备执行第一待机恢复流程或第二待机恢复流程;
    所述第一待机恢复流程和所述第二待机恢复流程均包括:所述第一电子设备接收第三用户操作,以及所述第一电子设备根据所述第三用户操作,在所述主界面显示所述第一视频图像的过程;
    在所述第一待机恢复流程中,所述第三用户操作为待机恢复操作;
    所述第二待机恢复流程还包括:所述第一电子设备在所述接收第三用户操作之前, 接收待机恢复操作;
    在所述主界面显示所述第二视频图像的过程之前,所述第一待机恢复流程和所述第二待机恢复流程还包括:
    所述第一电子设备根据所述待机恢复操作,如果在所述无线通信链路处于所述周期性休眠通信状态时接收到所述待机恢复操作,则通过所述无线通信链路向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态;
    所述第一电子设备根据所述待机恢复操作,如果在所述无线通信链路断开时接收到所述待机恢复操作,则通过所述低功耗蓝牙BLE连接向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态。
  13. 根据权利要求12所述的方法,其特征在于,
    在所述第二待机恢复流程中,所述待机恢复操作包括作用于预设位置的触碰操作。
  14. 根据权利要求11所述的方法,其特征在于,
    所述待机控制指令用于指示所述第二电子设备使所述无线通信链路由持续通信状态变为第一周期性休眠通信状态;
    所述方法还包括:所述第一电子设备当所述无线通信链路在所述第一周期性休眠通信状态的持续时长达到第一预设时长时,使所述无线通信链路变为第二周期性通信状态,所述第一周期性休眠通信状态的休眠周期小于所述第二周期性休眠通信状态的休眠周期;
    所述向所述第二电子设备发送待机控制指令之后,所述方法还包括:所述第一电子设备执行第三待机恢复流程或第四待机恢复流程;
    所述第三待机恢复流程和所述第四待机恢复流程均包括所述接收第三用户操作,以及所述根据所述第三用户操作,在所述主界面显示所述第一视频图像的过程;
    在所述第三待机恢复流程中,所述第三用户操作为待机恢复操作;
    所述第四待机恢复流程还包括:所述第一电子设备在所述接收第三用户操作之前,接收待机恢复操作;
    在所述主界面显示所述第一视频图像的过程之前,所述第三待机恢复流程和所述第四待机恢复流程还包括:
    所述第一电子设备根据所述待机恢复操作,通过所述无线通信链路向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态。
  15. 根据权利要求14所述的方法,其特征在于,
    在所述第四待机恢复流程中,所述待机恢复操作为作用于预设位置的触碰操作。
  16. 根据权利要求11至15中任意一项所述的方法,其特征在于,向所述第二电子设备发送待机恢复控制指令的过程之后,所述方法还包括:
    所述第一电子设备根据所述第三用户操作,在预设位置显示过渡图像;
    所述第一电子设备根据所述第三用户操作,在所述主界面显示所述第一视频图像的过程包括:
    所述第一电子设备根据所述第三用户操作,当所述第一电子设备通过恢复至所述持续通信状态的所述无线通信链路接收到来自于所述第二电子设备的所述第一视频图像时,将所述过渡图像替换为所述第一视频图像。
  17. 一种多机位拍摄系统的拍摄装置,其特征在于,应用于第一电子设备,所述第一电子设备为多机位拍摄系统的主机位,所述多机位拍摄系统还包括辅机位,所述装置包括:
    界面显示模块,用于显示主界面,所述主界面包括第一视频图像;
    操作接收模块,用于在视频拍摄模式下接收第一用户操作;
    所述界面显示模块还用于,根据所述第一用户操作,在所述主界面显示第二视频图像,所述第一视频图像来自于主机位或辅机位,所述第二视频图像来自于辅机位;
    所述操作接收模块还用于,接收视频切换操作,所述视频切换操作针对所述第二视频图像;
    视频切换模块,用于根据所述视频切换操作,将所述第一视频图像与所述第二视频图像进行切换。
  18. 根据权利要求17所述的装置,其特征在于,
    所述操作接收模块还用于,接收第二用户操作;
    所述界面显示模块还用于,根据所述第二用户操作,在所述主界面隐藏所述第一视频图像;
    所述操作接收模块还用于,接收第三用户操作;
    所述界面显示模块还用于,根据所述第三用户操作,在所述主界面显示所述第一视频图像。
  19. 根据权利要求18所述的装置,其特征在于,还包括:
    待机控制模块,用于在所述主界面隐藏所述第一视频图像后,且所述第一电子设备未显示来自于所述第二电子设备的视频图像,向所述第二电子设备发送待机控制指令,所述待机控制指令用于指示所述第二电子设备使以下任一部件或任意部件组合关闭或工作于低功耗模式:摄像头模组、图像信号处理器ISP、视频处理器VPU、显示屏以及无线通信链路,所述无线通信链路用于将视频图像从所述第二电子设备传输至所述第一电子设备,所述第二电子设备为所述多机位拍摄系统的一个辅机位,所述当前视频图像为所述第一视频图像或所述第二视频图像。
  20. 根据权利要求19所述的装置,其特征在于,
    所述待机控制指令还用于指示所述第二电子设备使所述无线通信链路由持续通信状态变为周期性休眠通信状态;
    所述装置还包括通信控制模块,用于当所述无线通信链路在所述周期性休眠通信状态的持续时长达到第一预设时长时,建立所述第一电子设备和所述第二电子设备之间的低功耗蓝牙BLE连接,并断开所述无线通信链路;
    所述操作接收模块具体用于,在第一待机恢复流程中接收第三用户操作,或者在第二待机恢恢恢复流程中接收待机恢复操作和第三用户操作,在所述第一待机恢复流程中,所述第三用户操作为待机恢复操作;
    所述待机控制模块还用于,根据所述待机恢复操作,如果在所述无线通信链路处 于所述周期性休眠通信状态时接收到所述待机恢复操作,则通过所述无线通信链路向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态;
    所述待机控制模块还用于,根据所述待机恢复操作,如果在所述无线通信链路断开时接收到所述待机恢复操作,则通过所述低功耗蓝牙BLE连接向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态。
  21. 根据权利要求20所述的装置,其特征在于,
    所述待机控制指令用于指示所述第二电子设备使所述无线通信链路由持续通信状态变为第一周期性休眠通信状态;
    所述装置还包括通信控制模块,用于当所述无线通信链路在所述第一周期性休眠通信状态的持续时长达到第一预设时长时,使所述无线通信链路变为第二周期性通信状态,所述第一周期性休眠通信状态的休眠周期小于所述第二周期性休眠通信状态的休眠周期;
    所述操作接收模块具体用于,在第三待机恢复流程中接收第三用户操作,或者在第四待机恢复流程中接收待机恢复操作和第三用户操作,在所述第三待机恢复流程中,所述第三用户操作为待机恢复操作;
    所述待机控制模块还用于,根据所述待机恢复操作,通过所述无线通信链路向所述第二电子设备发送待机恢复控制指令,所述待机恢复控制指令用于指示所述第二电子设备使所述无线通信链路恢复至所述持续通信状态。
  22. 根据权利要求19至21中任一所述的装置,其特征在于,还包括:
    所述界面显示模块还用于,根据所述第三用户操作,在预设位置显示过渡图像;
    所述界面显示模块还具体用于:根据所述第三用户操作,当所述第一电子设备通过恢复至所述持续通信状态的所述无线通信链路接收到来自于所述第二电子设备的视频图像时,将所述过渡图像替换为所述第一视频图像。
  23. 一种电子设备,其特征在于,包括用于存储计算机程序指令的存储器和用于执行计算机程序指令的处理器,其中,当该计算机程序指令被所述处理器执行时,触发所述电子设备执行权利要求1-16中任一项所述的方法。
  24. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括存储的程序,其中,在所述程序运行时控制所述计算机可读存储介质所在设备执行权利要求1-16中任一项所述的方法。
  25. 一种计算机程序产品,其特征在于,所述计算机程序产品包含可执行指令,当所述可执行指令在计算机上执行时,使得计算机执行权利要求1-16任一项所述的方法。
PCT/CN2023/070822 2022-01-30 2023-01-06 多机位拍摄系统的拍摄方法、设备、存储介质和程序产品 WO2023142959A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202210113987.2 2022-01-30
CN202210113987 2022-01-30
CN202210501226.4A CN116582754A (zh) 2022-01-30 2022-05-09 多机位拍摄系统的拍摄方法、设备、存储介质和程序产品
CN202210501226.4 2022-05-09

Publications (1)

Publication Number Publication Date
WO2023142959A1 true WO2023142959A1 (zh) 2023-08-03

Family

ID=87470575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/070822 WO2023142959A1 (zh) 2022-01-30 2023-01-06 多机位拍摄系统的拍摄方法、设备、存储介质和程序产品

Country Status (1)

Country Link
WO (1) WO2023142959A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110164105A1 (en) * 2010-01-06 2011-07-07 Apple Inc. Automatic video stream selection
CN105872570A (zh) * 2015-12-11 2016-08-17 乐视网信息技术(北京)股份有限公司 一种多机位视频同步播放的实现方法及装置
CN106165430A (zh) * 2016-06-29 2016-11-23 北京小米移动软件有限公司 视频直播方法及装置
CN106791485A (zh) * 2016-11-16 2017-05-31 深圳市异度信息产业有限公司 视频的切换方法及装置
CN106802759A (zh) * 2016-12-21 2017-06-06 华为技术有限公司 视频播放的方法及终端设备
CN107071329A (zh) * 2017-02-27 2017-08-18 努比亚技术有限公司 视频通话过程中自动切换摄像头的方法及装置
CN113596319A (zh) * 2021-06-16 2021-11-02 荣耀终端有限公司 基于画中画的图像处理方法、设备、存储介质和程序产品

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110164105A1 (en) * 2010-01-06 2011-07-07 Apple Inc. Automatic video stream selection
CN105872570A (zh) * 2015-12-11 2016-08-17 乐视网信息技术(北京)股份有限公司 一种多机位视频同步播放的实现方法及装置
CN106165430A (zh) * 2016-06-29 2016-11-23 北京小米移动软件有限公司 视频直播方法及装置
CN106791485A (zh) * 2016-11-16 2017-05-31 深圳市异度信息产业有限公司 视频的切换方法及装置
CN106802759A (zh) * 2016-12-21 2017-06-06 华为技术有限公司 视频播放的方法及终端设备
CN107071329A (zh) * 2017-02-27 2017-08-18 努比亚技术有限公司 视频通话过程中自动切换摄像头的方法及装置
CN113596319A (zh) * 2021-06-16 2021-11-02 荣耀终端有限公司 基于画中画的图像处理方法、设备、存储介质和程序产品

Similar Documents

Publication Publication Date Title
WO2020156269A1 (zh) 一种具有柔性屏幕的电子设备的显示方法及电子设备
WO2020259038A1 (zh) 一种拍摄方法及设备
WO2021052232A1 (zh) 一种延时摄影的拍摄方法及设备
EP3937480A1 (en) Multi-path video recording method and device
WO2021213120A1 (zh) 投屏方法、装置和电子设备
WO2020168965A1 (zh) 一种具有折叠屏的电子设备的控制方法及电子设备
WO2020224449A1 (zh) 一种分屏显示的操作方法及电子设备
US11759143B2 (en) Skin detection method and electronic device
WO2021052214A1 (zh) 一种手势交互方法、装置及终端设备
WO2021052279A1 (zh) 一种折叠屏显示方法及电子设备
US20210203836A1 (en) Camera switching method for terminal, and terminal
WO2021036771A1 (zh) 具有可折叠屏幕的电子设备及显示方法
WO2020221060A1 (zh) 一种卡片处理方法及设备
WO2020168968A1 (zh) 一种具有折叠屏的电子设备的控制方法及电子设备
US20240098174A1 (en) Always on display control method and electronic device
WO2020118490A1 (zh) 自动分屏的方法、图形用户界面及电子设备
WO2022037726A1 (zh) 分屏显示方法和电子设备
CN112860428A (zh) 一种高能效的显示处理方法及设备
WO2023131070A1 (zh) 一种电子设备的管理方法、电子设备及可读存储介质
WO2022267464A1 (zh) 一种对焦的方法及相关设备
WO2023241209A9 (zh) 桌面壁纸配置方法、装置、电子设备及可读存储介质
WO2020221062A1 (zh) 一种导航操作方法及电子设备
WO2021013106A1 (zh) 一种折叠屏照明方法和装置
WO2021042878A1 (zh) 一种拍摄方法及电子设备
CN115016629B (zh) 防误触的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23745844

Country of ref document: EP

Kind code of ref document: A1