WO2022252797A1 - Video presentation method, electronic device, computer storage medium and program product - Google Patents

Abstract

Embodiments of the present disclosure provide a video presentation method, an electronic device, a computer storage medium, and a program product. The method comprises: a client device receives a composite video from a central device, wherein an i-th frame of the composite video is obtained on the basis of i-th frames of videos respectively captured at the same moment by a plurality of image capture devices in a distributed image capture system, and i is any positive integer; on the basis of the composite video, the client device determines a video to be presented, said video being associated with at least one image capture device among the plurality of image capture devices; and the client device presents the video. In the foregoing manner, on the basis of the composite video from the central device, the client device may determine a video to be presented for presentation, so that the presentation at the client device is more flexible and diverse, thereby improving the user experience.

Description

Video presentation method, electronic device, computer storage medium and program product technical field

Embodiments of the present disclosure relate to the field of multimedia processing, and more specifically, to a video presentation method, electronic equipment, computer storage media, and program products.

Background technique

There are more and more application scenarios for collaborative interconnection between multiple different devices. For example, in the scenario where multiple shooting devices are coordinated, multiple channels can be displayed on the same screen, and multiple channels of images can be spliced in real time. Experience with different scenarios on devices. Such a scene where multiple shooting devices form a shooting array may also be called a distributed shooting system.

Images captured by the distributed capture system can be presented on the client, but the current presentation method is relatively simple, resulting in poor user experience.

Contents of the invention

Embodiments of the present disclosure provide a solution for presenting a video to be presented on a client device based on a composite video from a central device.

In a first aspect, a video presentation method is provided. The method includes: the client device receives the composite video from the central device, the i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, and i is any positive An integer; the client device determines a video to be presented based on the composite video, the video to be presented is associated with at least one of the plurality of capture devices; and the client device renders the video to be presented.

In this way, the client device can determine the video to be presented for rendering based on the composite video from the central device, so that the video to be presented is no longer passively received, but determined by the client device, so that the video at the client device The presentation is more flexible and diverse, thereby enhancing the user experience.

In some embodiments of the first aspect, before the client device receives the composite video from the central device, the method further includes: establishing connections between the central device and multiple shooting devices respectively. In some embodiments, the central device establishes a wireless connection with each of the multiple shooting devices, and the central device and the multiple shooting devices are in the same local area network environment.

In some embodiments of the first aspect, the client device determining the video to be presented based on the composite video includes determining each frame of the video to be presented through the following process: the client device determines from the ith frame of the composite video The i-th frame of the video shot by the shooting device, the target shooting device is the shooting device at the target position among the multiple shooting devices; and the client device determines the i-th frame of the video shot by the target shooting device as the i-th frame of the video to be presented frame.

In this way, the client device can determine and present the video shot by the target shooting device based on the composite video, which can simplify user operations.

In some embodiments of the first aspect, the client device determining the video to be presented based on the composite video includes: the client device receives a user input instruction, and the user input instruction indicates a target shooting device; the client device determines the video to be presented through the following process For each frame of the video: determine the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video; and determine the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

In this way, the client device can determine and present the video captured by the target shooting device corresponding to the user input instruction based on the composite video based on the user input instruction, so that the user can view the video of interest as needed, so that the video at the shooting device The presentation can be more diverse, which improves the user experience.

In some embodiments of the first aspect, the method further includes: the client device receives a user's look-around operation for the current frame of the video to be presented; and in response to the look-around operation, the client device presents an The look-around image sequence of .

In this way, the client device can present a look-around image sequence based on the user's look-around viewing operation, so that the user can view the look-around effect more intuitively. Such a variety of presentation methods can improve user experience.

In some embodiments of the first aspect, the client device presenting the look-around image sequence includes: the client device responds to the look-around viewing operation, determining from the composite video a frame corresponding to the current frame of the video to be presented; The determined frame of the composite video corresponding to the current frame of the video to be presented is divided into multiple images respectively corresponding to multiple shooting devices; a surround-view image sequence is obtained based on the multiple images; and the client device presents the surround-view image sequence.

In this way, the look-around image sequence is obtained by using multiple images captured by multiple capture devices, which can make full use of each capture device in the distributed capture system and maximize resource utilization.

In some embodiments of the first aspect, the number of the plurality of images is equal to the number of the plurality of photographing devices.

In some embodiments of the first aspect, the client device obtaining the sequence of surround-view images based on the multiple images includes: the client device arranges the multiple images according to the sequence of positions of the multiple shooting devices to obtain the sequence of surround-view images.

In this way, obtaining the look-around image sequence according to the positions of multiple shooting devices can ensure the presentation effect of the look-around image sequence and avoid errors.

In some embodiments of the first aspect, the client device obtaining the sequence of surround-view images based on the multiple images includes: the client device arranges the multiple images according to the positions of the multiple shooting devices; An intermediate frame is inserted between every two adjacent images of an image to obtain a look-around image sequence.

In this way, by interpolating frames between adjacent images, it is possible to determine the continuity of the look-around, avoid image jumps, ensure the continuity of the effect viewed by the user, and improve user experience.

In some embodiments of the first aspect, the i-th frame of the composite video is obtained by splicing the i-th frames respectively captured by multiple shooting devices at the same moment.

In a second aspect, a video presentation method is provided. The method includes: the central device receives the videos taken by multiple shooting devices in the distributed shooting system; the central device obtains a composite video based on the videos taken by the multiple shooting devices respectively, and the i-th frame of the composite video is based on multiple shooting The i-th frame of the video captured by the devices at the same time, where i is any positive integer; and the central device sends the composite video to the client device.

In some embodiments of the second aspect, obtaining the composite video by the central device includes determining each frame of the composite video through the following process: the central device splices the i-th frame of the video captured by multiple shooting devices at the same time, to get the i-th frame of the composite video.

In some embodiments of the second aspect, it further includes: the central device presenting the video captured by the specific capturing device in the distributed capturing system.

In a third aspect, an apparatus for video presentation is provided. The device includes: a receiving module configured to receive a composite video from a central device, the i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, i is any positive integer; the determination module is configured to determine the video to be presented based on the composite video, and the video to be presented is associated with at least one of the multiple shooting devices; and the presentation module is configured to present the video to be presented.

In some embodiments of the third aspect, the determination module is configured to determine each frame of the video to be presented through the following process: determine the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video , the target shooting device is the shooting device at the target position among the multiple shooting devices; and the i-th frame of the video shot by the target shooting device is determined as the i-th frame of the video to be presented.

In some embodiments of the third aspect, the receiving module is further configured to receive a user input instruction, and the user input instruction indicates a target shooting device. The determination module is configured to determine each frame of the video to be presented through the following process: determine the i-th frame of the video shot by the target shooting device from the i-th frame of the composite video; and determine the i-th frame of the video shot by the target shooting device The i-th frame is determined as the i-th frame of the video to be presented.

In some embodiments of the third aspect, the receiving module is further configured to receive a user's look-around operation on the current frame of the video to be presented; and the presentation module is also configured to present the current frame of the video to be presented in response to the look-around operation The look-around image sequence corresponding to the frame.

In some embodiments of the third aspect, the determination module is configured to: in response to the look-around operation, determine from the composite video the frame corresponding to the current frame of the video to be presented; The frame corresponding to the current frame is divided into multiple images respectively corresponding to the multiple shooting devices; and a surround view image sequence is obtained based on the multiple images.

In some embodiments of the third aspect, the number of the plurality of images is equal to the number of the plurality of photographing devices.

In some embodiments of the third aspect, the determining module is configured to: arrange the multiple images according to the sequence of positions of the multiple shooting devices to obtain a sequence of surround-view images.

In some embodiments of the third aspect, the determination module is configured to: arrange the multiple images according to the order of the positions of the multiple shooting devices; and insert a middle frame between every two adjacent images of the multiple images through frame insertion frames to obtain a sequence of look-around images.

In some embodiments of the third aspect, the i-th frame of the composite video is obtained by splicing the i-th frame respectively captured by multiple shooting devices at the same moment.

In a fourth aspect, an apparatus for video presentation is provided. The device includes: a receiving module configured to receive videos captured by multiple shooting devices in a distributed shooting system; a determining module configured to obtain a composite video based on the videos captured by the multiple shooting devices respectively, and the composite video The i-th frame is obtained based on the i-th frame of the video captured by multiple shooting devices at the same time, where i is any positive integer; and the sending module is configured to send the composite video to the client device.

In some embodiments of the fourth aspect, the determination module is configured to determine each frame of the composite video through the following process: splicing the i-th frame of the video captured by multiple shooting devices at the same time to obtain the composite The i-th frame of the video.

In some embodiments of the fourth aspect, a presentation module is further included, configured to present the video captured by a specific capture device in the distributed capture system.

In a fifth aspect, an electronic device is provided. The electronic device includes a transceiver, a processor, and a memory, and the memory stores instructions executed by the processor. When the instructions are executed by the processor, the electronic device realizes: receiving composite video from the central device via the transceiver, composite video The i-th frame of is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, i is any positive integer; the video to be presented is determined based on the composite video, and the video to be presented and multiple associating with at least one of the shooting devices; and presenting the video to be presented.

In some embodiments of the fifth aspect, the processor executes instructions to enable the electronic device to determine each frame of the video to be presented through the following process: determine the video captured by the target shooting device from the i-th frame of the composite video The i-th frame of the target shooting device is the shooting device at the target position among the multiple shooting devices; and the i-th frame of the video shot by the target shooting device is determined as the i-th frame of the video to be presented.

In some embodiments of the fifth aspect, the processor executes instructions so that the electronic device realizes: receiving a user input instruction via a transceiver, the user input instruction indicating a target shooting device; and determining each of the video to be presented through the following process Frame: determining the i-th frame of the video shot by the target shooting device from the i-th frame of the composite video; and determining the i-th frame of the video shot by the target shooting device as the i-th frame of the video to be presented.

In some embodiments of the fifth aspect, the processor executes instructions so that the electronic device realizes: receiving a user's look-around view operation on the current frame of the video to be presented; and in response to the look-around view operation, presenting The look-around image sequence of .

In some embodiments of the fifth aspect, the processor executes instructions so that the electronic device realizes: in response to the look-around operation, determine from the composite video the frame corresponding to the current frame of the video to be presented; combine the determined composite video with the The frame corresponding to the current frame of the video to be presented is divided into a plurality of images respectively corresponding to the plurality of shooting devices; a surround-view image sequence is obtained based on the plurality of images; and the surround-view image sequence is presented.

In some embodiments of the fifth aspect, the number of the plurality of images is equal to the number of the plurality of capture devices.

In some embodiments of the fifth aspect, the processor executes instructions so that the electronic device implements: arranging multiple images according to the order of positions of the multiple shooting devices to obtain a sequence of surround-view images.

In some embodiments of the fifth aspect, the processor executes instructions so that the electronic device realizes: arranging a plurality of images according to the order of positions of the plurality of shooting devices; Insert in-between frames to obtain a sequence of look-around images.

In some embodiments of the fifth aspect, the i-th frame of the composite video is obtained by splicing the i-th frame of the video captured by multiple shooting devices at the same moment.

In some embodiments of the fifth aspect, the electronic device includes a display screen for presenting the video to be presented or the surround view image sequence.

In a sixth aspect, an electronic device is provided. The electronic device includes a transceiver, a processor, and a memory. The memory stores instructions executed by the processor. When the instructions are executed by the processor, the electronic device realizes: receiving multiple photographs in a distributed photographing system via the transceiver. The videos taken by the devices respectively; based on the videos taken by the multiple shooting devices, the composite video is obtained, and the i-th frame of the composite video is obtained based on the i-th frame of the videos shot by the multiple shooting devices at the same time, i is any positive integer; and sending the composite video to the client device via the transceiver.

In some embodiments of the sixth aspect, the processor executes instructions to enable the electronic device to determine each frame of the composite video through the following process: splicing the i-th frame of the video captured by multiple shooting devices at the same time , to get the i-th frame of the composite video.

In some embodiments of the sixth aspect, the processor executes instructions so that the electronic device implements: presenting the video captured by a specific capture device in the distributed capture system.

In some embodiments of the sixth aspect, the electronic device includes a photographing device.

In a seventh aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned first or second aspect or any implementation manner thereof is implemented. operation of the method described.

In an eighth aspect, a chip or a chip system is provided. The chip or chip system includes a processing circuit configured to perform the operations of the method according to the first aspect or the second aspect or any implementation thereof.

In a ninth aspect, a computer program or computer program product is provided. The computer program or computer program product is tangibly stored on a computer-readable medium and includes computer-executable instructions, which, when run on a computer, cause the computer to perform The operations of the methods described in the manner are implemented.

Description of drawings

The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals indicate the same or similar elements, wherein:

Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

Figure 2 shows a schematic diagram of an example scenario in which embodiments of the present disclosure may be implemented;

Fig. 3 shows a schematic interaction diagram of a video rendering process according to some embodiments of the present disclosure;

FIG. 4 shows a schematic flowchart of a process of determining a composite video according to some embodiments of the present disclosure;

Fig. 5 shows a schematic diagram of a method of determining a composite video according to some embodiments of the present disclosure;

Fig. 6 shows a schematic flowchart of a process of presenting a sequence of surround-view images according to some embodiments of the present disclosure;

Fig. 7 shows a schematic diagram of frame insertion according to some embodiments of the present disclosure;

Fig. 8 shows a schematic flowchart of a video rendering process according to some embodiments of the present disclosure;

Fig. 9 shows a schematic flowchart of a video rendering process according to some embodiments of the present disclosure;

Fig. 10 shows a schematic block diagram of an apparatus for video presentation according to some embodiments of the present disclosure;

FIG. 11 shows another schematic block diagram of an apparatus for video presentation according to some embodiments of the present disclosure; and

Figure 12 shows a schematic block diagram of an example device that may be used to implement embodiments of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein; A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

In the description of the embodiments of the present disclosure, the term "comprising" and its similar expressions should be interpreted as an open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be read as "at least one embodiment". The terms "first", "second", etc. may refer to different or the same object. Other definitions, both express and implied, may also be included below.

The distributed shooting system can include a shooting array composed of at least two shooting devices, the shooting devices can take images or videos, and the shooting devices can be called image acquisition devices, etc. The distributed shooting system can also be called a distributed camera system or Distributed shooting array or distributed image acquisition system, etc. It should be understood that the "image" in the embodiments of the present disclosure may be an image captured by a capture device or may be a frame of a video captured by an image capture device. In addition, video may also be referred to as image stream, frame stream, video stream, media stream, etc., which is not limited in the present disclosure.

At least two shooting devices in the distributed shooting system can shoot at the same time to obtain more visual information, and then can realize multi-channel image display on the same screen and real-time stitching of multiple images through mutual cooperation. A distributed camera system can be implemented in various scenarios. For example, the distributed shooting device system can be implemented as a surround-view shooting array, and multiple shooting devices in the system can be arranged around the target object at a certain angle and distance, and each shooting device is responsible for shooting the target object within a certain field of view, so that When the images captured by each shooting device are played sequentially, it is as if the human eye takes the target object as the center and observes the target object from different angles along an arc in one direction.

The distributed shooting system has also been applied in the webcast. In the scene of webcasting, multiple shooting devices of the distributed shooting system can shoot separately, and the anchor can choose the video to be presented so that customers can view it through the client device. In this process, the content that the customer views is determined by the anchor, that is to say, the client device is only a passive receiver of the video, so that all customers see exactly the same live content from different clients. Even if the anchor does not switch the shooting device, it will cause waste of videos shot by other shooting devices in the distributed shooting system, and the videos shot by multiple shooting devices cannot be fully utilized. In this way, the experience and feelings of the user watching the live broadcast are seriously affected.

In view of this, the present disclosure provides a video presentation solution. The client device can receive the composite video obtained from the videos captured by multiple shooting devices, and then perform local presentation based on the composite video, which can satisfy different users' requirements for presentation. Different needs improve user experience.

FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure may be implemented. In the example environment 100, a central device 110, a distributed camera system 120, a client device 130-1, a client device 130-2, . . . and a client device 130-N are shown. The distributed shooting system 120 includes multiple shooting devices, such as the shooting device 122-1, the shooting device 122-2, and the shooting device 122-3 in FIG. 1 .

For the convenience of the following description, the shooting device 122-1, the shooting device 122-2, and the shooting device 122-3 are collectively referred to as the shooting device 122 in the embodiment of the present disclosure, and the client device 130-1, client device 130-1, and Devices 130 - 2 , . . . and client devices 130 -N are collectively referred to as client devices 130 . And it can be understood that although it is shown in FIG. 1 that the distributed shooting system 120 includes three shooting devices, in practical applications, the number of shooting devices included in the distributed shooting system 120 can be set according to scenarios and the like. The photographing device 122 may be an independent device or may be a peripheral device of other electronic devices, for example, the photographing device 122 may be implemented as an electronic device having an image acquisition function and the like. The shooting device 122 may include a camera, a video camera, a capture device, a mobile phone, a tablet computer, a wearable device, etc., which is not limited in the present disclosure.

As shown in FIG. 1, the central device 110 can interact with the client device 130. In a scene such as a webcast, the central device 110 can be an electronic device that interacts with the host, and the client device 130 can be an electronic device that interacts with the user. Electronic equipment. That is to say, there is a communication connection between the central device 110 and the client device 130 .

In some embodiments, the central device 110 may interact with the client device 130 via a server (eg, a streaming server). In some embodiments, the central device 110 and the client device 130 may be implemented as electronic devices such as smart phones, tablet computers, wearable devices and the like. Embodiments of the present disclosure do not limit the number (N) of client devices. For example, in a live network scenario, the number of client devices may be hundreds, thousands or even larger.

As shown in Figure 1, the central device 110 can interact with the distributed shooting system 120, for example, the images or videos captured by the shooting device 122-1, the shooting device 122-2 and the shooting device 122-3 can be transmitted to the central device 110.

There may be a communication connection between the central device 110 and the photographing device 122, and the embodiment of the present disclosure does not limit the connection manner, for example, the connection is in a wired or wireless manner. Wired methods may include but not limited to optical fiber connections, Universal Serial Bus (Universal Serial Bus, USB) connections, etc. Wireless methods may include but not limited to mobile communication technologies (including but not limited to 2G, 3G, 4G, 5G, 6G, etc., Wi-Fi, Bluetooth (Bluetooth), Point to Point (P2P), etc.

Taking Wi-Fi connection as an example, the central device 110 and the photographing device 122 can be in the same local area network environment, and the central device 110 can discover that they are located in the same local area network environment through its distributed photographing system control module (or connection discovery module or other modules, etc.). and the shooting device 122, and establish a Wi-Fi connection with the shooting device 122, for example, the central device 110 and the shooting device 122 can be connected to the same router. It should be noted that the communication connection modes between the central device 110 and different shooting devices 122 may be the same or different. For example, the connection mode between the central device 110 and the shooting device 122-1 may be different from the connection mode between the central device 110 and the shooting device 122-2.

Although it is shown in FIG. 1 that the central device 110 is a device independent of the distributed photographing system 120, in some embodiments, the central device 110 can be implemented as a part of the distributed photographing system 120, for example, the central device 110 can be a photographing device 122-2 corresponding electronic equipment.

Embodiments of the present disclosure do not limit the arrangement of each photographing device in the distributed photographing system 120 .

In some embodiments, the photographing device 122-1, the photographing device 122-2, and the photographing device 122-3 may be arranged side by side, so that when photographing the target object, the photographing directions of the target object are parallel or substantially consistent.

In some embodiments, the photographing device 122-1, the photographing device 122-2, and the photographing device 122-3 may be arranged around the target object, so that when photographing the target object, the photographing direction of the target object forms a certain angle. Referring to FIG. 2 , it is assumed that the distributed shooting system 120 includes seven shooting devices, namely shooting devices 122 - 1 to 122 - 7 , and the electronic device corresponding to the shooting device 122 - 4 is the central device 110 .

In the scene 200 shown in FIG. 2 , seven photographing devices may be installed on a fixed bracket 201 , and each of the seven photographing devices may capture an image of a target object 202 . In scenarios such as webcasting, the target object 202 may be an item to be displayed by the host.

In FIG. 2 , the fixing bracket 201 is realized as a ring bracket, and a plurality of fixing buckles are arranged on the fixing bracket 201 for fixing a plurality of photographing devices 122 . And when multiple shooting devices 122 are installed on the fixed bracket 201 respectively, the position and angle of each shooting device 122 relative to the center of the fixed bracket 201 (such as the center of the circle where the ring is located) can be fixed. It can be understood that although the plurality of shooting devices 122 in FIG. 2 can shoot towards the center of the fixed bracket 201 , that is to say, the target object 202 is located near the center of the fixed bracket 201 . However, the embodiments of the present disclosure are not limited thereto. For example, multiple shooting devices 122 may also shoot outside the fixed bracket 201 , so that the field of view can be expanded, so as to perform panoramic live broadcast.

In some embodiments, each of the seven shooting devices in FIG. 2 can be implemented as a camera on a smart terminal. For example, in the case where the smart terminal is a mobile phone, the seven mobile phones can be installed on at the corresponding location. In one embodiment, seven shooting devices are installed on the fixed bracket 201 respectively, so that the shooting angles of the seven shooting devices to shoot the target object 202 are fixed, that is, each shooting device cannot be moved or rotated. In some embodiments, the included angle between the centerlines of every two adjacent shooting devices may be fixed, for example, the included angle may be set to 20° or other values.

In an embodiment of the present disclosure, the shooting areas of two adjacent shooting devices in the distributed shooting system 120 may partially overlap. For example, the shooting device 122-1 shoots the target object 202 to obtain a first image, and the shooting device 122-2 shoots the target object 202 to obtain a second image, and the first area in the first image and the second area in the second image are for are the same shooting area of the target object 202 . In one example, the first area occupies 1/4 or more of the first image, and the second area occupies 1/4 or more of the second image.

The embodiments of the present disclosure can be applied to the scene of network live broadcast. For webcasting, the host can prepare and fix various shooting devices 122 in advance to form a distributed shooting system. For example, in the manner shown in FIG. 2 , multiple photographing devices 122 are installed on the fixed bracket 201 . The anchor can also select the central device 110 , for example, set the electronic device corresponding to the shooting device 122 - 4 as the central device 110 . Subsequently, the anchor can create a live broadcast room through the central device 110, for example, connect to a server of the live broadcast platform through the central device 110 to create a live broadcast room. The central device 110 may request a streaming address, such as a Uniform Resource Locator (URL), from the server of the live broadcast platform. Stream push can be a process in which the central device 110 pushes audio and video streams to the server of the live broadcast platform, and the stream push address is an address corresponding to the stream push process, and the format of the stream push address depends on the protocol used. Similarly, the client device 130 can obtain the corresponding audio and video stream from the server of the live broadcast platform through the pull stream address corresponding to the push stream address, where the pull stream can be that the client device 130 pulls the audio and video stream on the server of the live broadcast platform To the local process, the streaming address is the address corresponding to the streaming process, and the format of the streaming address depends on the protocol used. It can be understood that the number of client devices 130 connected to the central device 110 may change as customers enter or exit the live broadcast room.

It can be understood that the client device 130 can establish a communication connection with the central device 110 through the user's operation of entering the live broadcast room. In some embodiments, the central device 110 can send the live room information to the client device 130 . In some embodiments, the client device 130 may send an information request to the live broadcast platform server, and then obtain the live room information from the central device 110 .

Exemplarily, the live room information may include system information of the distributed shooting system. In some embodiments, the system information of the distributed shooting system may include the number of shooting devices included in the distributed shooting system. For example, in the scenario shown in FIG. 2, the number is seven. In some embodiments, the system information of the distributed shooting system may include the size of images captured by each shooting device, such as width and height. For example, if the images captured by each capturing device have the same size, then w and h may be included to represent the width and height of the image captured by a single capturing device, respectively. In some embodiments, the system information of the distributed camera system may include the identification of the camera device associated with the central device 110 . For example, in the scenario shown in FIG. 2 , the central device 110 is an electronic device corresponding to the photographing device 122 - 4 , and the identifier of the photographing device associated with the central device 110 may be 4 . It can be understood that the system information of the distributed shooting system may also include other information, such as the resolution of the shooting device, etc., which will not be listed here.

Exemplarily, the live broadcast room information may also include a streaming address for the client device 130, and then the client device 130 may obtain the video through the streaming address. It can be understood that the information of the live broadcast room may also include other information, such as the address of the live broadcast room, the broadcast time of the live broadcast, etc., which will not be listed here.

The embodiments of the present disclosure will be described in detail below with reference to FIG. 3 to FIG. 7 .

FIG. 3 shows a schematic interaction diagram of a video rendering process 300 according to some embodiments of the present disclosure. Process 300 shown in FIG. 3 involves central device 110 and client device 130 .

In the process 300 , the central device 110 determines 310 a composite video based on the multiple videos respectively captured by the multiple capture devices 122 of the distributed capture system 120 .

Exemplarily, the process of determining the composite video by the central device 110 may refer to FIG. 4 , which shows a schematic flowchart of a process 400 of determining the composite video by the central device 110 .

In process 400 , video capture 410 is performed by capture device 122 . Taking three shooting devices as an example, it can be assumed that the shooting device 122-1 shoots to get video 1, assumes that the shooting device 122-2 shoots to get video 2, and assumes that the shooting device 122-3 shoots to get video 3.

Optionally or additionally, the central device 110 and the shooting device 122 may perform time synchronization 402 . Embodiments of the present disclosure do not limit the specific manner of time synchronization. In some embodiments, through time synchronization, time synchronization information between the local clock of the central device 110 and the local clock of the photographing device 122 can be determined. In some embodiments, after time synchronization, different capturing devices 122 can capture images at the same time. For example, the i-th frame captured by the capturing device 122-1 and the i-th frame captured by the capturing device 122-2 are acquired simultaneously.

In the process 400 , the shooting device 122 sends 420 the captured video to the central device 110 . Taking three shooting devices as an example, the central device 110 may acquire video 1, video 2 and video 3.

Optionally or additionally, the central device 110 may perform preprocessing 422 on the video from the shooting device 122 . In some embodiments, pre-processing may be for some or all of the video. In some embodiments, preprocessing may include, but is not limited to: beautification, watermarking, mosaicing, etc. As an example, watermarking may include adding all or part of the following information to some or all frames of the video: anchor name, information of the target object, identification of the shooting device 122, and the like.

In process 400, central device 110 obtains 430 composite video. Taking three shooting devices as an example, the central device 110 can synthesize video 1, video 2 and video 3 to obtain a composite video.

In the embodiment of the present disclosure, the i-th frame of the composite video may be obtained based on the i-th frame captured by the capturing device 122 . In some embodiments, the i-th frame captured by each shooting device 122 may be combined to obtain the i-th frame of the composite video. i is any positive integer, so that by obtaining each frame of the composite video, the composite video can be obtained.

In some embodiments, according to the order of the shooting devices 122, the i-th frame captured by each shooting device 122 may be spliced to obtain the i-th frame of the composite video. For example, assume that the i-th frame captured by each capturing device 122 has the same size, for example, the width is w and the height is h. Then the width of the i-th frame of the composite video can be equal to the sum of the widths of the i-th frames captured by each shooting device 122, and the height of the i-th frame of the composite video is equal to h. In some embodiments, the order of the photographing devices 122 may be: taking the target object 202 as a reference, the order of the photographing devices arranged clockwise. Referring to FIG. 2 , with the target object 202 as the center point, the clockwise order of the photographing devices 122 is: photographing device 122-1, photographing device 122-2, photographing device 122-3, photographing device 122-4, photographing device 122- 5. The shooting device 122-6 and the shooting device 122-7.

In order to simplify the description, three shooting devices are taken as an example to describe the process of obtaining composite video. Specifically, each frame in the video 1 captured by the shooting device 122-1 is represented as f11, f12, ..., f1n, and each frame in the video 2 captured by the shooting device 122-2 is represented as f21, f22, ... , f2n, denote each frame in the video 3 captured by the shooting device 122-3 as f31, f32, . . . , f3n. Then, as shown in FIG. 5, the first frame of the composite video can be formed by sequentially splicing f11, f21 and f31, ..., and the nth frame of the composite video can be formed by sequentially splicing f1n, f2n and f3n.

In other words, the central device 110 can take the first frames from the corresponding videos in the order of the shooting device 122 from the multiple videos, and after the first frames of all the videos are taken, the multiple first frames are sorted according to The sequences of the shooting devices 122 are spliced as the first frame of the composite video. Then the central device 110 can take the second frames from the corresponding videos in the order of the shooting device 122 from the plurality of videos, and after taking the second frames of all the videos, the multiple second frames can be taken according to the sequence of the shooting device 122 The order of splicing, as the second frame of the composite video. By looping like this, a composite video can be obtained.

It can be understood that, the above embodiments are only illustrative of the way to obtain the composite video, which is not limited by the embodiments of the present disclosure. For example, they may be synthesized according to the reverse order of the photographing devices 122, or may be synthesized according to other predetermined rules. For example, splicing can be performed along the width direction or along the height direction, or can also be spliced in other ways.

In process 300 , central device 110 sends 320 composite video to client device 130 .

In some embodiments, the client device 130 can obtain the composite video via the streaming server by pulling the streaming address.

In some embodiments, the central device 110 may send the composite video to the client device 130 after coding, compressing, encapsulating, and so on. Exemplarily, video compression technologies such as H.264 may be used for encoding and compression. Exemplarily, the video may be encapsulated into a streaming media format such as FLV or TS. In this way, the demand for network bandwidth and the like can be reduced, the transmission rate can be increased, and real-time performance can be guaranteed.

Correspondingly, the client device 130 may determine the composite video through operations such as decapsulation, decoding and decompression. In some embodiments, the client device 130 can obtain the encapsulated video data in FLV or TS format by pulling the stream from the live broadcast platform server, and then obtain encoded and compressed video data through parsing and the like. Further, the client device 130 can perform a decoding operation to restore the composite video.

In process 300 , client device 130 determines 330 a video to present, wherein the video to present is associated with at least one capture device 122 . Further, the client device 130 presents 340 the video to be presented.

In the embodiments of the present disclosure, presenting a video may refer to displaying video frames frame by frame, or may be understood as playing a video.

In some embodiments, the video to be presented may be composite video. Since one frame of the composite video includes images captured by various capture devices in the distributed capture system, the client device 130 can simultaneously present images about the target object 202 captured by multiple capture devices. In this way, the user at the client device 130 can see the images of the target object 202 from various angles at the same time, which can facilitate the user to make subsequent selections, for example, which shooting device to view the video for.

In some embodiments, the video to be presented may be a video shot by a specific shooting device in the distributed shooting system. Specifically, the part shot by a specific shooting device may be separated from each frame of the composite video, so as to determine the video to be presented. In the embodiment of the present disclosure, the specific shooting device may be any of the following: a shooting device located at the target location, a shooting device designated by the user of the client device 130 , and the like.

In some embodiments, the target location may be the central device 110 , and the video to be presented may be a video shot by a shooting device corresponding to the central device 110 . Exemplarily, the photographing device corresponding to the central device 110 may be a photographing device included in the central device 110 .

For brevity, the photographing device corresponding to the central device 110 may be referred to as a central photographing device. In some embodiments, the client device 130 can separate the central shooting device from the composite video based on the number of multiple shooting devices in the distributed shooting system (assumed to be M) and the identity of the central shooting device (assumed to be p). The corresponding video to be presented.

For example, if the composite video is determined in a splicing manner similar to that shown in FIG. 5 . Then, for any frame of the composite video (assumed to be the i-th frame), the part whose width is [(p-1)×w, p×w] can be intercepted from the i-th frame of the composite video, as the video to be presented frame i. For another example, the i-th frame of the composite video can be split into M images, that is, the images captured by M shooting devices can be restored, and then the one shot by the central shooting device can be determined from the M images image.

Since the central device 110 is generally an electronic device operated by the host, in this way, the presentation video at the client device 130 can be consistent with the content on the central device 110 interacted by the host. Especially when the host makes a speech introduction on the target object 202, the user can check the specific details introduced by the host in time.

In some embodiments, the target location may be an intermediate location of multiple shooting devices, and the video to be presented may be a video shot by a shooting device at an intermediate location in a distributed shooting system. Assume that the number of multiple shooting devices in the distributed shooting system is M. Then if M is an odd number, the number of the shooting device at the middle position is (M+1)/2. If M is an even number, the number of the photographing device at the middle position may be M/2 or M/2+1.

In this way, the image of the front face of the target object 202 can be viewed by the user at the client device 130 , so that the user can view more details of the target object 202 .

In some embodiments, the video to be presented may be a video shot by a user-specified shooting device. Specifically, the client device 130 may receive an input instruction from the user, and the input instruction may indicate which shooting device among the multiple shooting devices.

For example, the user may input a shooting device number, such as "2", so that the client device 130 can obtain the input instruction. For example, when the client device 130 is playing a video shot by a certain shooting device (assume that the number is n1), the user can swipe left or right to determine the number of the shooting device. For example, sliding to the left indicates that the shooting device number is reduced by one, that is, the designated shooting device number is n1-1. For example, sliding right indicates that the shooting device number is increased by one, that is, the designated shooting device number is n1+1.

In this way, in the embodiment of the present disclosure, the user at the client device 130 can determine which camera's video is to be presented by inputting instructions, which realizes the switching of the video presented on the client device 130 and improves the user's convenience. Autonomy, better able to meet the needs of customers. In this way, the video presented on the client device 130 does not need to be consistent with the video on the anchor’s electronic device, and it is no longer a passive video receiver. On the contrary, the user can independently select the video of interest without affecting the anchor’s electronic device. devices and other client devices 130 .

In addition, the embodiment of the present disclosure does not limit the video presented on the central device 110, for example, it may be a video captured by the central shooting device.

Alternatively or additionally, the client device 130 may receive 350 a user's look-around operation. Further, the client device 130 may present a sequence of 360 surround view images.

In some embodiments, the user can click a specific area on the interface of the client device 130 to perform a look-around operation, for example, click a "look around" button on the specific area. In some embodiments, the user can operate a specific gesture on the interface of the client device 130 to perform a look-around operation, for example, the specific gesture is drawing a circle or a semi-arc.

FIG. 6 shows a schematic flowchart of a process 600 of presenting a sequence of surround-view images according to some embodiments of the present disclosure.

At block 610, the client device 130 determines a current frame of the composite video corresponding to the current frame of the video to be presented in response to the look-around viewing operation.

Specifically, assuming that the current frame of the video to be presented is the tth frame, then the tth frame of the composite video can be obtained. It can be understood that the tth frame of the composite video includes the images taken by each shooting device in the distributed shooting system image.

At block 620, the client device 130 splits the current frame of the composite video into multiple images.

Specifically, splitting may be performed based on the number of multiple shooting devices, that is to say, the number of multiple images is equal to the number of multiple shooting devices. In some embodiments, the multiple images are images captured by multiple capturing devices respectively.

At block 630, the client device 130 obtains a sequence of surround view images based on the plurality of images.

In some embodiments, the multiple images may be sorted according to the position of the shooting device to obtain a sequence of surround-view images. That is to say, multiple images may be arranged sequentially according to the sequence of positions of multiple shooting devices to obtain a sequence of surround-view images. For example, in the scene shown in FIG. 2 , the image captured by the shooting device 122 - i is located at the ith position of the look-around image sequence, and i is any value from 1 to 7.

In some embodiments, the multiple images may be arranged sequentially according to the position sequence of the multiple shooting devices, and at least one frame may be inserted between every two adjacent images to form a look-around image sequence. It can be understood that, in this embodiment, the number of images in the look-around image sequence is greater than the number of shooting devices.

Specifically, at least one frame may be inserted between two adjacent images through a frame insertion operation. The inserted at least one frame may be referred to as a virtual frame or an intermediate frame, and embodiments of the present disclosure do not limit the manner of frame insertion. Frame interpolation can also be called supplementary frame or animation supplementary frame, and virtual frames can be obtained through algorithms such as local interpolation. In this way, through the frame insertion process, a virtual frame is inserted between two adjacent images, which can ensure the continuity of image changes between the two adjacent images.

For example, assuming that the current frame is the tth frame, the number of multiple shooting devices is m, and the multiple images are images captured by the multiple shooting devices, denoted as f1t, f2t, f3t, . . . , fmt. As shown in FIG. 7 , four virtual frames may be inserted between every two images, so as to obtain a look-around image sequence 700 . In this way, the number of images included in the surround-view image sequence obtained after frame interpolation is: m+4×(m-1).

In this way, the number of images in the look-around image sequence can be expanded, so that the look-around image sequence can be presented more smoothly later.

It should be noted that in the embodiments of the present disclosure, there is no limitation on the number of virtual frames to be inserted during the frame insertion process. In some embodiments, the number of virtual frames inserted between every two adjacent frames may be a preset value, for example, the preset value is 4 in FIG. 7 , and it can be understood that the preset value may also be other values. The preset value can be preset according to the angle between two adjacent shooting devices, the number of shooting devices, and the like. In some embodiments, the number of virtual frames inserted between different adjacent two frames may be equal or unequal, for example, the virtual frames inserted between f1t and f2t have a first number, and the virtual frames inserted between f2t and f3t The virtual frames have a second number, and the first number may or may not be equal to the second number.

At block 640, the client device 130 sequentially presents each image in the sequence of look-around images.

In some embodiments, the client device 130 may also present corresponding images in the look-around image sequence based on the user's left and right sliding operations. In this way, the user can view the look-around effect of the target object 202 according to his own needs.

It can be seen that the embodiments of the present disclosure provide a real-time surround view live broadcast solution based on a distributed shooting system. The client device can receive composite video from the central device, and then the client device can present the video to be presented or the video to be presented according to actual needs or user instructions. Surround effect. In this way, the user at the client device can independently determine the presented content, and the client device is no longer a single passive content receiver, which can greatly improve the user's interactive experience.

FIG. 8 shows a schematic flowchart of a video rendering process 800 according to some embodiments of the present disclosure. Process 800 may be performed by client device 130 as shown in FIG. 1 .

In block 810, the client device 130 receives the composite video from the central device, the i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, i is Any positive integer. At block 820, the client device 130 determines a video to present based on the composite video, the video to present being associated with at least one capture device of the plurality of capture devices. At block 830, client device 130 presents the video to be presented.

In some embodiments, the i-th frame of the composite video is obtained by splicing the i-th frames captured by multiple shooting devices at the same time. For example, at the same moment, multiple shooting devices capture corresponding multi-frames, then the central device may splice the corresponding multi-frames, and use the spliced frames as the composite video corresponding to the moment. frame.

In some embodiments, the client device 130 determining the video to be presented based on the composite video may include determining each frame of the video to be presented through the following process: the client device 130 determines from the ith frame of the composite video The i-th frame of the video shot by the device, the target shooting device is the shooting device at the target position among the multiple shooting devices; and the i-th frame of the video shot by the target shooting device is determined as the i-th frame of the video to be presented. Optionally, the target location may be an intermediate location of multiple shooting devices.

In some embodiments, the client device 130 determining the video to be presented based on the composite video includes: the client device 130 receives a user input instruction, and the user input instruction indicates the target shooting device; Frame: determining the i-th frame of the video shot by the target shooting device from the i-th frame of the composite video; and determining the i-th frame of the video to be presented from the i-th frame of the video shot by the target shooting device. In this way, each frame of the video to be presented can be obtained frame by frame by sequentially setting i as 1, 2, . . . Optionally, the user's input instruction may be based on the user's sliding operation on the interface, and the sliding operation may be left sliding or right sliding to indicate that the target shooting device is determined by moving the position left or right respectively.

For example, for any frame in the composite video, such as the i-th frame, the i-th frame of the video captured by the target shooting device may be determined from the i-th frame of the composite video as the i-th frame of the video to be presented. Generally, the image size of the i-th frame of the video to be presented is smaller than the image size of the i-th frame of the composite video.

Optionally or additionally, as shown in FIG. 8 , at block 840 , the client device 130 receives a user's look-around operation on the current frame of the video to be presented. At block 850, client device 130 presents a sequence of look-around images corresponding to a current frame of video to be presented in response to a look-around viewing operation.

In some embodiments, the client device 130 presenting the look-around image sequence in response to the look-around viewing operation may include: the client device 130 determining from the composite video a frame corresponding to the current frame of the video to be presented in response to the look-around viewing operation; The determined composite video frame corresponding to the current frame of the video to be presented is divided into multiple images respectively corresponding to multiple shooting devices; obtaining a surround view image sequence based on the multiple images; and presenting the surround view image sequence. Exemplarily, the number of multiple images is equal to the number of multiple shooting devices.

In some embodiments, the client device 130 obtaining the sequence of surround-view images based on the multiple images may include: the client device 130 arranging the multiple images according to the order of positions of the multiple shooting devices to obtain the sequence of surround-view images.

In some embodiments, the client device 130 obtaining the surround-view image sequence based on the multiple images includes: the client device 130 arranges the multiple images according to the order of the positions of the multiple shooting devices; Intermediate frames are inserted between adjacent images to obtain a sequence of look-around images.

FIG. 9 shows a schematic flowchart of a video rendering process 900 according to some embodiments of the present disclosure. The process 900 may be executed by the central device 110 as shown in FIG. 1 .

In block 910, the central device 110 receives the videos captured by each of the multiple capture devices in the distributed capture system. In block 920, the central device 110 obtains a composite video based on the video captured by each of the multiple shooting devices, and the i-th frame of the composite video is obtained based on the i-th frame of the video captured by the multiple shooting devices at the same time, i is any positive integer. At block 930, the central device 110 sends the composite video to the client devices.

In some embodiments, obtaining the composite video by the central device 110 may include determining each frame of the composite video through the following process: the central device 110 splices the i-th frame of the video captured by multiple shooting devices at the same time, to Get the i-th frame of the composite video. For example, at the same moment, multiple shooting devices capture corresponding multi-frames respectively, then the central device 110 can splice the corresponding multi-frames, and use the spliced frames as the frames corresponding to the moment in the composite video .

In some embodiments, it may further include: presenting at the central device 110 a video captured by a specific capture device in the distributed capture system. For example, the central device 110 presents the video captured by the target capture device after acquiring the videos captured by the multiple capture devices in the distributed capture system. For example, the target photographing device may be a device interacting with the user in the distributed photographing system, or the target photographing device may be a device at an intermediate position in the distributed photographing system.

Fig. 10 shows a schematic block diagram of an apparatus 1000 for video presentation according to some embodiments of the present disclosure. The apparatus 1000 may be implemented as or included in the client device 130 of FIG. 1 .

Apparatus 1000 may include a plurality of modules for performing corresponding steps in process 800 as discussed in FIG. 8 . As shown in FIG. 10 , the device 1000 includes a receiving module 1010 , a determining module 1020 and a presenting module 1030 . The receiving module 1010 is configured to receive the composite video from the central device, the i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, and i is any positive integer . The determining module 1020 is configured to determine a video to be presented based on the composite video, and the video to be presented is associated with at least one capturing device among the plurality of capturing devices. The presentation module 1030 is configured to present the video to be presented.

In some embodiments, the i-th frame of the composite video is obtained by splicing the i-th frames captured by multiple shooting devices at the same time.

In some embodiments, the determination module 1020 may be configured to determine each frame of the video to be presented through the following process: determine the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video, the target The shooting device is the shooting device located at the target position among the multiple shooting devices; and the i-th frame of the video captured by the target shooting device is determined to be the i-th frame of the video to be presented.

In some embodiments, the receiving module 1010 may also be configured to receive a user input instruction, where the user input instruction indicates the target shooting device. The determining module 1020 may be configured to determine each frame of the video to be presented through the following process: determine the i-th frame of the video shot by the target shooting device from the i-th frame of the composite video; The i-th frame of the video determines the i-th frame of the video to be rendered.

In some embodiments, the receiving module 1010 may also be configured to receive a user's look-around operation on the current frame of the video to be presented. The presenting module 1030 may also be configured to present a surround view image sequence corresponding to the current frame of the video to be presented in response to the surround view operation.

In some embodiments, the determining module 1020 may be configured to: in response to the look-around operation, determine from the composite video a frame corresponding to the current frame of the video to be presented; split the determined frame of the composite video into multiple taking a plurality of images respectively corresponding to the devices; and obtaining a look-around image sequence based on the plurality of images.

In some embodiments, the number of the plurality of images is equal to the number of the plurality of photographing devices.

In some embodiments, the determining module 1020 may be configured to: arrange the multiple images according to the sequence of positions of the multiple shooting devices to obtain a sequence of surround-view images.

In some embodiments, the determination module 1020 may be configured to: arrange the multiple images according to the position order of the multiple shooting devices; and insert an intermediate frame between every two adjacent images of the multiple images through a frame insertion operation, to obtain a look-around image sequence. The number of images in the look-around image sequence is greater than the number of multiple shooting devices.

Exemplarily, the apparatus 1000 in FIG. 10 may be implemented as the client device 130, or may be implemented as a chip or chip system in the client device 130, which is not limited by the embodiment of the present disclosure. The apparatus 1000 in FIG. 10 can be used to implement the processes described above in conjunction with the client device 130 in FIG. 3 to FIG. 9 , and details are not repeated here for brevity.

Fig. 11 shows another schematic block diagram of an apparatus 1100 for video presentation according to some embodiments of the present disclosure. The apparatus 1100 may be implemented as or included in the central device 110 in FIG. 1 .

Apparatus 1100 may include a plurality of modules for performing corresponding steps in process 900 as discussed in FIG. 9 . As shown in FIG. 11 , the device 1100 includes a receiving module 1110 , a determining module 1120 and a sending module 1130 . The receiving module 1110 is configured to receive videos captured by multiple capturing devices in the distributed capturing system. The determining module 1120 is configured to obtain a composite video based on the video captured by each of the multiple shooting devices, the i-th frame of the composite video is obtained based on the i-th frame of the video captured by the multiple shooting devices at the same time, i is any positive integer. The sending module 1130 is configured to send the composite video to the client device.

In some embodiments, the determination module 1120 may be configured to determine each frame of the composite video through the following process: "splicing the i-th frame of the video captured by multiple shooting devices at the same time to obtain the composite video frame i.

In some embodiments, the apparatus 1100 may further include a presentation module configured to present videos captured by specific capture devices in the distributed capture system.

Exemplarily, the apparatus 1100 in FIG. 11 may be implemented as the central device 110 , or may be implemented as a chip or chip system in the central device 110 , which is not limited by the embodiments of the present disclosure. The apparatus 1100 in FIG. 11 can be used to implement the processes described above in conjunction with the central device 110 in FIG. 3 to FIG. 9 , and for the sake of brevity, details are not repeated here.

FIG. 12 shows a schematic block diagram of an example device 1200 that may be used to implement embodiments of the present disclosure. The device 1200 may be implemented as or included in the client device 130 of FIG. 1 , or the device 1200 may be implemented as or included in the central device 110 of FIG. 1 .

As shown in the figure, the device 1200 includes a central processing unit (Central Processing Unit, CPU) 1201, a read-only memory (Read-Only Memory, ROM) 1202, and a random access memory (Random Access Memory, RAM) 1203. The CPU 1201 can perform various appropriate actions and processes according to computer program instructions stored in the RAM 1202 and/or RAM 1203 or loaded from the storage unit 1208 into the ROM 1202 and/or RAM 1203. In the ROM 1202 and/or the RAM 1203, various programs and data required for the operation of the device 1200 can also be stored. The CPU 1201 and the ROM 1202 and/or RAM 1203 are connected to each other via a bus 1204. An input/output (I/O) interface 1205 is also connected to the bus 1204 .

Multiple components in the device 1200 are connected to the I/O interface 1205, including: an input unit 1206, such as a keyboard, a mouse, etc.; an output unit 1207, such as various types of displays, speakers, etc.; a storage unit 1208, such as a magnetic disk, an optical disk, etc. ; and a communication unit 1209, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 1209 allows the device 1200 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

CPU 1201 may be various general and/or special purpose processing components having processing and computing capabilities. Some examples that can be implemented as include, but are not limited to, Graphics Processing Unit (Graphics Processing Unit, GPU), various dedicated artificial intelligence (Artificial Intelligence, AI) computing chips, various computing units that run machine learning model algorithms, digital signal A processor (Digital Signal Processor, DSP), and any suitable processor, controller, microcontroller, etc., may accordingly be referred to as a computing unit. The CPU 1201 executes the various methods and processes described above, such as the process 800 or 900. For example, in some embodiments, process 800 or 900 may be implemented as a computer software program tangibly embodied on a computer-readable medium, such as storage unit 1208 . In some embodiments, part or all of the computer program may be loaded and/or installed on the device 1200 via the ROM 1202 and/or RAM 1203 and/or the communication unit 1209. When a computer program is loaded into ROM 1202 and/or RAM 1203 and executed by CPU 1201, one or more steps of process 800 or 900 described above may be performed. Alternatively, in other embodiments, the CPU 1201 may be configured to execute the process 800 or 900 in any other suitable manner (eg, by means of firmware).

Exemplarily, the device 1200 in FIG. 12 may be implemented as an electronic device (such as the client device 130 or the central device 110), or may be implemented as a chip or a chip system in an electronic device, and embodiments of the present disclosure do not limited.

Embodiments of the present disclosure also provide a chip, which may include an input interface, an output interface, and a processing circuit. In the embodiments of the present disclosure, the above signaling or data interaction may be completed by the input interface and the output interface, and the generation and processing of the signaling or data information may be completed by the processing circuit.

Embodiments of the present disclosure also provide a chip system, including a processor, configured to support the client device 130 or the central device 110 to implement the functions involved in any of the foregoing embodiments. In a possible design, the system-on-a-chip may further include a memory for storing necessary program instructions and data, and when the processor runs the program instructions, the device installed with the system-on-a-chip can implement the program described in any of the above-mentioned embodiments. Methods. The system-on-a-chip may consist of chips, or may include chips and other discrete devices.

Embodiments of the present disclosure also provide a processor, configured to be coupled with a memory, the memory stores instructions, and when the processor executes the instructions, the processor executes any of the above-mentioned embodiments involving the client device 130 or the center. Methods and Functions of Device 110 .

Embodiments of the present disclosure also provide a computer program product containing instructions, which, when run on a computer, cause the computer to execute the methods and functions related to the client device 130 or the central device 110 in any of the above-mentioned embodiments .

Embodiments of the present disclosure also provide a computer-readable storage medium on which computer instructions are stored, and when the processor executes the instructions, the processor executes any of the above-mentioned embodiments involving the client device 130 or the central device. 110 methods and functions.

In general, the various embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor or other computing device. While various aspects of the embodiments of the present disclosure are shown and described as block diagrams, flowcharts, or using some other pictorial representation, it should be understood that the blocks, devices, systems, techniques or methods described herein can be implemented as, without limitation, Exemplary, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof.

The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product comprises computer-executable instructions, eg included in program modules, which are executed in a device on a real or virtual processor of a target to perform the process/method as above with reference to the accompanying drawings. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In various embodiments, the functionality of the program modules may be combined or divided as desired among the program modules. Machine-executable instructions for program modules may be executed within local or distributed devices. In a distributed device, program modules may be located in both local and remote storage media.

Computer program codes for implementing the methods of the present disclosure may be written in one or more programming languages. These computer program codes can be provided to processors of general-purpose computers, special-purpose computers, or other programmable data processing devices, so that when the program codes are executed by the computer or other programmable data processing devices, The functions/operations specified in are implemented. The program code may execute entirely on the computer, partly on the computer, as a stand-alone software package, partly on the computer and partly on a remote computer or entirely on the remote computer or server.

In the context of the present disclosure, computer program code or related data may be carried by any suitable carrier to enable a device, apparatus or processor to perform the various processes and operations described above. Examples of carriers include signals, computer readable media, and the like. Examples of signals may include electrical, optical, radio, sound, or other forms of propagated signals, such as carrier waves, infrared signals, and the like.

A computer readable medium may be any tangible medium that contains or stores a program for or related to an instruction execution system, apparatus, or device. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More detailed examples of computer-readable storage media include electrical connections with one or more wires, portable computer diskettes, hard disks, random storage access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash), optical storage, magnetic storage, or any suitable combination thereof.

In addition, while operations of methods of the present disclosure are depicted in a particular order in the figures, this does not require or imply that operations must be performed in that particular order, or that all illustrated operations must be performed, to achieve desirable results. Conversely, the steps depicted in the flowcharts may be performed in an altered order. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution. It should also be noted that the features and functions of two or more devices according to the present disclosure may be embodied in one device. Conversely, the features and functions of one device described above may be further divided to be embodied by a plurality of devices.

Having described various implementations of the present disclosure, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terminology used herein aims to well explain the principle of each implementation, practical application or improvement to the technology in the market, or to enable other ordinary skilled persons in the technical field to understand the various implementations disclosed herein.

Claims (13)

1. A video presentation method, comprising:

   The client device receives the composite video from the central device, and the i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time, and i is any positive integer;

   The client device determines a video to be presented based on the composite video, the video to be presented is associated with at least one capture device in the plurality of capture devices; and

   The client device presents the video to be presented.
2. The method according to claim 1, wherein the client device determining the video to be presented based on the composite video comprises determining each frame of the video to be presented by the following process:

   The client device determines the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video, and the target shooting device is the shooting device at the target position among the plurality of shooting devices; and

   The client device determines the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.
3. According to the method according to claim 1, the client device determining the video to be presented based on the composite video comprises:

   The client device receives a user input instruction, and the user input instruction indicates a target shooting device;

   The client device determines each frame of the video to be presented through the following process: determining the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video; The i-th frame of the video captured by the shooting device is determined as the i-th frame of the video to be presented.
4. The method according to any one of claims 1 to 3, further comprising:

   The client device receives a user's look-around operation for the current frame of the video to be presented; and

   In response to the look-around operation, the client device presents a sequence of look-around images corresponding to the current frame of the video to be presented.
5. The method of claim 4, wherein the client device presenting the sequence of look-around images based on the look-around viewing operation comprises:

   The client device determines a frame corresponding to a current frame of the video to be presented from the composite video in response to the look-around operation;

   The client device splits the determined frame corresponding to the current frame of the video to be presented into a plurality of images respectively corresponding to the plurality of shooting devices;

   the client device obtains the sequence of look-around images based on the plurality of images; and

   The client device presents the sequence of look-around images.
6. The method of claim 5, wherein said client device obtaining a sequence of surround-view images based on said plurality of images comprises:

   The client device arranges the plurality of images according to the sequence of positions of the plurality of shooting devices to obtain the sequence of look-around images; or,

   The client device arranges the plurality of images according to the sequence of positions of the plurality of shooting devices; and

   The client device inserts intermediate frames between every two adjacent images of the plurality of images, so as to obtain the look-around image sequence.
7. The method according to any one of claims 1 to 6, wherein the i-th frame of the composite video is obtained by splicing the i-th frame of each shooting at the same moment by the plurality of shooting devices.
8. A video presentation method, comprising:

   The central device receives the videos shot by multiple shooting devices in the distributed shooting system;

   The central device obtains a composite video based on the video captured by each of the multiple shooting devices, and the i-th frame of the composite video is based on the i-th frame of the video captured by the multiple shooting devices at the same time. Obtained, i is any positive integer; and

   The central device sends the composite video to client devices.
9. The method according to claim 8, wherein said central device obtaining composite video includes determining each frame of said composite video through the following process:

   The central device splices the i-th frame of the videos captured by the plurality of shooting devices at the same time to obtain the i-th frame of the composite video.
10. The method according to claim 8 or 9, further comprising:

    The central device presents the video shot by a specific shooting device in the distributed shooting system.
11. An electronic device, comprising a processor and a memory, and computer instructions are stored on the memory, and when the computer instructions are executed by the processor, the electronic device executes any one of claims 1 to 7. The method or the method described in any one of claims 8 to 10.
12. A computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method or rights according to any one of claims 1 to 7 are realized The method described in any one of 8 to 10 is required.
13. A computer program product having computer-executable instructions embodied thereon, the computer-executable instructions implementing any of claims 1 to 7 or any of claims 8 to 10 when executed. described method.

Images