WO2018214707A1 - 一种视频画面的输出、查看方法及装置 - Google Patents

一种视频画面的输出、查看方法及装置 Download PDF

Info

Publication number
WO2018214707A1
WO2018214707A1 PCT/CN2018/085134 CN2018085134W WO2018214707A1 WO 2018214707 A1 WO2018214707 A1 WO 2018214707A1 CN 2018085134 W CN2018085134 W CN 2018085134W WO 2018214707 A1 WO2018214707 A1 WO 2018214707A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video picture
user terminal
picture
partial
Prior art date
Application number
PCT/CN2018/085134
Other languages
English (en)
French (fr)
Inventor
苗军
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP18806645.0A priority Critical patent/EP3633998A4/en
Priority to US16/615,401 priority patent/US20200184600A1/en
Publication of WO2018214707A1 publication Critical patent/WO2018214707A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map
    • G06T3/047Fisheye or wide-angle transformations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Definitions

  • the present disclosure relates to, but is not limited to, the field of video technology, and in particular, to a video picture output, viewing method and apparatus.
  • the video captured by the camera has a certain range of viewing angles.
  • the local or remote user can adjust the viewing angle by adjusting the rotation of the pan/tilt connected to the camera. If the video captured by a certain camera is viewed by multiple remote users, the angle of the pan/tilt can only meet the requirements of a certain user, and the different angle requirements for simultaneously watching videos by different users cannot be satisfied.
  • panoramic camera technology came into being.
  • the panoramic camera technology uses multiple cameras and their pan-tilt to cooperate to simultaneously capture video images of different angles, and then stitch the video images of different angles into a panoramic image. At this time, if different users At the same time, you need to watch the video from different angles, and you need to use the ordinary camera to process the panoramic image to see the video image at a certain angle.
  • the techniques known in the art either fail to meet the requirements of different users to view video at different angles at the same time, or need to use multiple cameras together, in particular, require multiple pan/tilt cooperation, and also require the user to view the specific camera by means of a normal camera.
  • the video of the angle is not only inconvenient to operate, but also has poor flexibility and high cost.
  • the present disclosure provides an output, viewing method and apparatus for a video picture.
  • An embodiment of the present disclosure provides a method for outputting a video picture, including:
  • the partial video picture is provided to the user terminal.
  • the method before the providing the partial video picture to the user terminal, the method further includes: merging video images of all views to form a panoramic video picture; and the partial video picture
  • the method further includes: providing the panoramic video screen to the user terminal.
  • the panoramic video picture is provided to the user terminal by providing the panoramic video picture and the partial video picture to the user terminal at the same time; or And providing the panoramic video picture and the partial video picture to the user terminal in two streams.
  • the method when the partial video picture is provided to the user terminal, the method further includes one or two items: providing the user terminal with each of the plurality of viewing angles and the stitching fusion An algorithm parameter, such that the user terminal is capable of scaling, or flattening, or scaling and flattening the partial video picture or the panoramic video picture; providing the intermediate node with shooting parameters and locations of each of the plurality of viewing angles
  • the fused stitching algorithm parameters are enabled to enable the intermediate node to scale, or flatten, or zoom and flatten the local video picture or the panoramic video picture to the user terminal.
  • the method before forming a partial video picture that matches the view information, the method further includes: receiving, by the intermediate node, view information from the user terminal; or, by the intermediate node, the part Providing the video picture or the partial video picture and the panoramic video picture to the user terminal; or receiving perspective information from the user terminal through the intermediate node; and, by the intermediate node, the partial video picture or the A partial video picture and a panoramic video picture are provided to the user terminal.
  • An embodiment of the present disclosure further provides an output device for a video picture, including:
  • the acquisition module is set to: collect video images from multiple perspectives;
  • the splicing module is configured to: fuse the video images of the corresponding viewing angles according to the viewing angle information provided by the user terminal, to form a partial video image that matches the viewing angle information;
  • the first providing module is configured to: provide the partial video picture to the user terminal.
  • the fusion splicing module is further configured to: fuse video images of all views to form a panoramic video frame; and the first providing module is configured to: When the picture is provided to the user terminal, the panoramic video picture is also provided to the user terminal.
  • the first providing module is further configured to: when the partial video picture is provided to the user terminal, perform one or two of: providing a plurality of the user terminal
  • the shooting parameters of each view in the view and the algorithm parameters of the stitching fusion enable the user terminal to zoom, or flatten, or zoom and flatten the partial video picture or the panoramic video picture;
  • the node provides the shooting parameters of each of the plurality of views and the stitching and blending algorithm parameters, so that the intermediate node can zoom, or flatten, or zoom and flatten the partial video or panoramic video
  • the operation is then forwarded to the user terminal.
  • An embodiment of the present disclosure further provides a photographing apparatus, including:
  • An image acquisition device configured to acquire captured images
  • a memory storing a video picture output program
  • the processor is configured to execute the video picture output program to perform the following operations: controlling the image acquisition device to acquire a video image in multiple views; and combining the video images of the corresponding view according to the view information provided by the user terminal to form a device a partial video picture in which the view information is matched; the partial video picture is provided to the user terminal.
  • the processor is further configured to perform the operation of performing the video picture output program: before providing the partial video picture to the user terminal, video images of all views Fusion stitching to form a panoramic video picture; when the partial video picture is provided to the user terminal, the panoramic video picture is provided to the user terminal.
  • the embodiment of the present disclosure further provides a method for viewing a video picture, including:
  • the partial video picture is displayed.
  • the method further includes: receiving a panoramic video screen from the photographing device; and displaying the partial video screen, further comprising: displaying the panoramic video screen.
  • the method before displaying the partial video picture, further includes: performing the partial video according to a shooting parameter of each of the plurality of viewing angles provided by the shooting device and an algorithm parameter of the stitching fusion
  • the picture is zoomed, or flattened, or scaled and flattened, or the local video picture and the panoramic video picture are scaled, or flattened, or scaled and flattened.
  • the method before receiving the partial video picture from the photographing device that matches the view information, or before providing the view information to the photographing device, the method further includes: providing the intermediate node with the The view information is such that the intermediate node is capable of scaling, or flattening, or scaling and flattening a partial video picture or a partial video picture and a panoramic video picture from the photographing device before forwarding.
  • the receiving a partial video picture from the photographing device that matches the view information includes: receiving, from the photographing device, the a partial video picture whose view information matches; or, a partial video picture and a panoramic video picture from the photographing device that match the view information, which are forwarded by the intermediate node.
  • the panoramic video picture and the partial video picture are displayed in such a manner that the panoramic video picture and the partial video picture are displayed in a picture-in-picture format.
  • the method when the displaying the partial video screen, the method further includes: adjusting a display manner according to a user operation on the current display interface; wherein the display manner includes one of the following: a larger screen display The panoramic video screen and the smaller screen display the partial video screen; the larger screen displays the partial video screen, the smaller screen displays the panoramic video screen; and only the partial video screen is displayed.
  • the method when the displaying the partial video screen, the method further includes: re-provisioning the new viewing angle information to the photographing device according to a user operation on the current display interface.
  • the embodiment of the present disclosure further provides a viewing device for a video screen, including:
  • a second providing module configured to: provide viewing angle information to the photographing device
  • a receiving module configured to: receive a partial video picture from the photographing device that matches the view information
  • the display module is configured to: display the partial video screen.
  • the receiving module is further configured to: receive a panoramic video picture from the photographing device; the display module is further configured to: when the partial video screen is displayed, display the Panoramic video footage.
  • the method further includes: a video operation module, configured to: perform the partial video image according to a shooting parameter of each of the plurality of viewing angles provided by the shooting device and an algorithm parameter of the stitching fusion Zooming, or flattening, or scaling and flattening operations, or scaling, or flattening, or zooming and flattening the partial video and panoramic video frames; the receiving module is further configured to: receive The shooting parameters of each of the plurality of viewing angles provided by the photographing device and the algorithm parameters of the stitching fusion.
  • the display module is configured to display the panoramic video picture and the partial video picture in a picture-in-picture format.
  • the embodiment of the present disclosure further provides a user terminal, including:
  • a communication module configured to communicate with a photographing device
  • a memory storing a video screen viewing program
  • a processor configured to execute the video screen viewing program to perform operations of: controlling the communication module to provide viewing angle information to the photographing device, and receiving a portion from the photographing device that matches the viewing angle information a video screen; controlling the display screen to display the partial video screen.
  • the processor is further configured to perform an operation of: receiving a panoramic video picture from the photographing device after providing the viewing angle information to the photographing device when the video screen viewing program is executed; displaying The panoramic video picture is also displayed when the partial video picture is displayed.
  • the processor is further configured to perform the following operations when the video screen viewing program is executed: when the partial video screen is displayed, the display is further adjusted according to a user operation on the current display interface.
  • the method includes: one of the following:
  • the embodiment of the present disclosure further provides a computer readable storage medium, where the video readable storage medium stores a video picture output program, and the video picture output program is executed by the processor to implement the step of the video picture output method.
  • the embodiment of the present disclosure further provides a computer readable storage medium, where the computer readable storage medium stores a video screen viewing program, and the video screen viewing program is executed by the processor to implement the steps of the video screen viewing method.
  • the embodiment of the present disclosure further provides a computer readable storage medium storing computer executable instructions, which are implemented when the computer executable instructions are executed.
  • the video image of the corresponding angle can be provided to the user according to the angle requirement submitted by the user, and the panning angle is not required to adjust the shooting angle, and the user does not need other devices to allow different users to watch the video at different angles at the same time. It is easy to operate, easy to use and flexible, and low in cost.
  • FIG. 1 is a schematic diagram of the influence of a pan/tilt angle on a viewing angle of a screen in the prior art
  • FIG. 2 is a schematic diagram of a system architecture when multiple users view the same video picture in the prior art
  • FIG. 3 is a schematic flow chart of a video picture output method according to the first embodiment
  • FIG. 4 is a schematic structural diagram of a video picture output device of a second embodiment
  • FIG. 5 is a schematic structural diagram of a photographing apparatus of a third embodiment
  • FIG. 6 is a schematic flowchart of a video picture viewing method according to a fourth embodiment
  • FIG. 7 is a schematic structural diagram of a video screen viewing apparatus according to a fifth embodiment.
  • FIG. 8 is a schematic structural diagram of a user terminal according to a sixth embodiment.
  • FIG. 9 is a schematic diagram showing a plurality of lens arrangements of a panoramic camera by taking a 6-eye panoramic camera as an example
  • FIG. 10 is a schematic diagram of a panoramic video screen obtained by the panoramic camera in Example 1.
  • Figure 11a is a schematic diagram of a video screen seen by user A;
  • Figure 11b is a schematic diagram of a video screen seen by user B;
  • Figure 11c is a schematic diagram of a video screen seen by the user C;
  • 12a is a schematic diagram of an adjusted video screen seen by user B;
  • Figure 12b is a schematic diagram of the adjusted video screen seen by the user C;
  • FIG. 13 is a schematic diagram of a connection between a panoramic camera and a plurality of user terminals after accessing an intermediate node in Example 2.
  • FIG. 1 is a schematic diagram of the influence of the pan/tilt angle on the viewing angle of the screen in the prior art.
  • the picture corresponding to the left limit is S1
  • the picture corresponding to the right limit is Sr
  • the picture corresponding to the normal direction is Sm.
  • the camera can only When the picture within the left limit and the right limit range is output, the camera cannot capture the video image within the mechanical limit unreachable area, that is, the angle of view ⁇ .
  • FIG. 2 is a schematic diagram of a system architecture when multiple users view the same video picture in the prior art.
  • the camera in Figure 2 is connected to the video distributor or network through a cable.
  • Users A, B, and C can select the pictures within the left limit and the right limit range of Figure 1 at different times.
  • User A selects the video picture S1 of the left limit, and then users B and C can only view the video picture S1, even if the user B really wants to pay attention to the video picture Sm or the video picture Sr that the user C really cares about.
  • at least three cameras with the aforementioned viewing angle of 60 degrees need to be set up, that is to say, increasing the camera equipment and the cable bandwidth can meet the above requirements.
  • the techniques known in the art either fail to meet the requirements of different users to view video at different angles at the same time, or need to set up a camera array oriented in different orientations, in particular, a plurality of pan/tilt heads that need to be adjusted in orientation, and thereafter The user needs to use the camera to view the video image at a specific angle, which is not only inconvenient to operate, but also has poor flexibility and high cost.
  • the photographing device can form a corresponding partial video image according to the viewing angle information provided by the user terminal, and provide the corresponding partial video image to the user terminal.
  • Each user terminal can obtain the corresponding perspective information by submitting the perspective information to the photographing device.
  • Partial video screen so that different users can watch the video at different angles at the same time, there is no need to adjust the shooting angle in real time to meet the user's needs, and it is not necessary to adjust the shooting orientation through the pan/tilt, which is not only flexible, but also reduces equipment cost.
  • the user terminal can directly display the video screen provided by the shooting device to the user, without the need of other devices, the operation is simple and convenient, and the cost brought by other devices is also saved.
  • a method for outputting a video picture is provided by a photographing device. As shown in FIG. 3, the method may include:
  • Step 301 collecting video images in multiple views
  • Step 302 fused and stitch the video images of the corresponding perspective according to the perspective information provided by the user terminal, to form a partial video image that matches the perspective information.
  • Step 303 Provide the partial video picture to the user terminal.
  • the photographing device can form a corresponding partial video image according to the viewing angle information provided by the user terminal, and provide the same to the user terminal, so that different users can simultaneously watch the video at different angles without adjusting the shooting orientation through the pan/tilt. Flexible to use and lower equipment costs.
  • a video image when acquired by multiple angles, it may be implemented by multiple cameras or devices including multiple cameras, and each camera or camera captures a video image of a specified angle of view.
  • the shooting device may fuse the video images of the corresponding viewing angle according to the viewing angle information carried in the viewing request to form a part matching the viewing angle information.
  • a video picture is provided to the user terminal.
  • the view information is obtained by the user terminal based on the perspective selected by the user. For example, after receiving the viewing request including the viewing angle information sent by the user terminal of the remote user, adjust the fusion splicing mode, and expand the area in the panoramic video picture based on the camera of the remote user's specified viewing angle. The selected camera is not present in the final picture to form a partial video picture of the corresponding view.
  • the photographing device may fuse the video image of the corresponding view according to the view information carried in the view adjustment request, and form a view with the view information.
  • a matching partial video picture is provided to the user terminal.
  • the user terminal may send a viewing angle adjustment request to the shooting device, where the viewing angle adjustment request includes new perspective information, which is obtained by the user terminal based on the perspective selected by the user.
  • video images of all views may be fused and spliced to form a panoramic video picture; and the partial video picture is provided to the user.
  • the terminal may also provide the panoramic video screen to the user terminal. In this way, it is convenient for the user to simultaneously view the video picture of a specific view and the video picture of the panorama.
  • the shooting device may provide a corresponding video picture to the user terminal of the remote user in a default manner.
  • the photographing device can fuse the video images of all views in a default manner to form a panoramic video picture and provide the remote user.
  • the panoramic video picture and the partial video picture may be simultaneously provided to the user terminal; or the panoramic video picture and the partial video picture may be separately provided to the user in two streams. terminal.
  • the shooting device when the shooting device provides the partial video picture to the user terminal, the shooting parameters of each of the plurality of angles of view may also be adopted. And the algorithm parameters of the splicing fusion are provided to the user terminal, so that the user terminal can scale and display the video picture (the partial video picture or the partial video picture + the panoramic video picture) according to the parameters, so that the normal viewing effect is met. Display again.
  • the intermediate node may also provide more The shooting parameters of each view and the stitching and blending algorithm parameters enable the intermediate node to zoom, or flatten, or zoom and flatten the partial video picture or the panoramic video picture Forwarding to the user terminal, the user terminal can directly display the video picture (partial video picture or partial video picture + panoramic video picture) forwarded by the intermediate node.
  • the camera device and the user terminal can also interact through the intermediate nodes.
  • the photographing device may receive the view information from the user terminal through the intermediate node, and provide the corresponding partial video picture or the partial video picture + the panoramic video picture to the user terminal through the intermediate node.
  • the photographing device may distribute a partial video picture or a partial video picture + a panoramic video picture corresponding to the user terminal to each of the plurality of user terminals through the intermediate node.
  • the photographing device may also send the panoramic video screen to the intermediate node, and the intermediate node is responsible for receiving a request (such as a viewing request, a view switching request, etc.) of each of the plurality of user terminals, and then forwarding the video to the photographing device to complete the corresponding video.
  • the stitching of the picture is merged and forwarded to the user terminal.
  • One of the functions of the intermediate node is to flatten the video picture into a video picture conforming to the normal viewing effect according to the request of each user terminal of the plurality of user terminals, and then send it to the user terminal.
  • the imaging device may encode the video picture in a digital form after encoding by using a certain encoding algorithm.
  • the photographing device may be a panoramic camera or the like.
  • An output device for a video picture may include:
  • the acquiring module 41 is configured to: collect video images from multiple perspectives;
  • the merging and splicing module 42 is configured to: fuse the video images of the corresponding viewing angles according to the viewing angle information provided by the user terminal, to form a partial video image that matches the viewing angle information;
  • the first providing module 43 is configured to: provide the partial video picture to the user terminal.
  • the merging and splicing module 42 may be configured to: fused and splicing the video images of all the views to form a panoramic video frame; the first providing module 43 may be It is arranged to provide the panoramic video picture to the user terminal when the partial video picture is provided to the user terminal.
  • the first providing module 43 may be further configured to: when the local video screen is provided to the user terminal, perform the following steps, in order to enable the remote user to view the undistorted and undistorted video image.
  • One or two items 1) providing the user terminal with the shooting parameters of each of the plurality of angles of view and the algorithm parameters of the stitching fusion, so that the user terminal can perform the partial video picture or the panoramic video picture Scaling, or flattening, or scaling and flattening operations; 2) providing intermediate nodes with shooting parameters for each of a plurality of viewing angles and algorithm parameters of the stitching fusion such that the intermediate node is capable of the partial video
  • the picture or panoramic video picture is forwarded to the user terminal after being scaled, or flattened, or scaled and flattened.
  • the output device of the video picture in this embodiment can implement all the details of the method described in the first embodiment.
  • the collection module 41, the fusion splicing module 42, and the first providing module 43 may be software, hardware, or a combination of the two.
  • the output device of the above video screen can be realized by a photographing device or set in a photographing device.
  • the output device of the video frame may be implemented by a panoramic camera.
  • the acquisition module 41 may be a camera array composed of a plurality of cameras in the panoramic camera
  • the fusion splicing module 42 may be a part of the panoramic camera responsible for image processing (eg,
  • the processor, the first providing module 43 may be a part of the panoramic camera responsible for communication.
  • the output device of the above video picture and each part thereof may also be implemented in other forms, and this is not limited herein.
  • a photographing device may include:
  • An image acquisition device 51 configured to acquire a captured image
  • a memory 52 storing a video picture output program
  • the processor 53 is configured to execute the video picture output program to perform the following operations: controlling the image acquisition device to acquire a video image in multiple views; and combining the video images of the corresponding view according to the view information provided by the user terminal to form and The partial video information matching the view information; providing the partial video picture to the user terminal.
  • the photographing apparatus in this embodiment can implement all the details of the method described in the first embodiment.
  • the photographing device may be a panoramic camera or the like.
  • the image capturing device in this embodiment may be a lens array formed by multiple lenses, each lens capturing a video image within a viewing angle or a certain viewing angle range, and the entire lens array can capture a video image of 306 degrees.
  • the image acquisition device may be a camera array formed by a plurality of cameras, each camera capturing a video image within a viewing angle or a range of viewing angles, and the entire camera array may capture a video image of 306 degrees.
  • a method for viewing a video picture can be implemented by a user terminal. As shown in FIG. 6, the method can include:
  • Step 601 providing perspective information to the photographing device
  • Step 602 Receive a partial video picture from the photographing device that matches the view information.
  • Step 603 displaying the partial video picture.
  • each user terminal of the plurality of user terminals can obtain a corresponding partial video picture by submitting its own perspective information to the photographing device, so that different users can simultaneously watch the video at different angles, and the user terminal can directly
  • the user displays the video screen provided by the shooting device, and does not need to use other devices, the operation is simple and convenient, and the cost brought by other devices is also saved.
  • the user terminal may send a viewing request to the shooting device, where the viewing request carries the viewing angle information, and the shooting device fuses and merges the video images of the corresponding viewing angle to form a partial video that matches the viewing angle information.
  • the picture is provided to the user terminal.
  • the perspective information may be obtained by the user terminal based on a perspective selected by the user.
  • the user terminal may send a view adjustment request to the photographing device, where the view adjustment request carries new view information, and the video device merges and stitches the video image according to the new view information according to the new view information.
  • the partial video information matched by the new perspective information is provided to the user terminal.
  • the viewing angle adjustment request may be sent to the shooting device by the user terminal, where the viewing angle adjustment request includes new perspective information, which may be obtained by the user terminal based on the perspective selected by the user. For example, when the partial video screen is displayed, new viewing angle information may be newly provided to the photographing device according to a user operation on the current display interface.
  • the user terminal may further select, according to the shooting parameters of each of the plurality of viewing angles provided by the shooting device, before displaying the partial video image. And stitching the blended algorithm parameters, scaling, or flattening, or zooming and flattening the partial video image, or scaling, or flattening, or zooming and expanding the partial video image and the panoramic video image
  • the flat operation is performed after the normal viewing effect is met.
  • the user terminal may also provide the local video picture that matches the view information from the photographing device or provide the photographing device.
  • the user terminal is forwarded to the user terminal.
  • the user terminal can directly display the video picture (partial video picture or partial video picture + panoramic video picture) forwarded by the intermediate node. In this way, by using the intermediate node, the operation of scaling and flattening the video by the user terminal can be omitted, thereby reducing the device performance requirement for the user terminal.
  • the receiving a partial video picture from the photographing device that matches the view information may include: receiving, by the intermediate node, the image from the photographing device that matches the view information. a partial video picture; or, receiving a partial video picture and a panoramic video picture from the photographing device that are matched by the view information and forwarded by the intermediate node.
  • the panoramic video screen from the photographing device may also be received; when the partial video screen is displayed, the panoramic video screen may also be displayed. In this way, it is convenient for the user to simultaneously view the video picture of a specific view and the video picture of the panorama.
  • the user terminal can display the video images provided by the shooting device by using multiple display modes.
  • the panoramic video picture and the partial video picture may be displayed in a picture-in-picture format.
  • the display mode when the partial video screen is displayed, the display mode may be adjusted according to a user operation on the current display interface.
  • the display mode includes one of the following: 1) displaying the panoramic video screen on a larger screen.
  • the smaller picture displays the partial video picture; 2) the larger picture displays the partial video picture, the smaller picture displays the panoramic video picture; 3) only the partial video picture is displayed.
  • a user command may be provided to the photographing device according to a user operation on the current display interface, so that the photographing device stops providing the panoramic video screen after receiving the user command.
  • the user terminal can display only the partial video picture.
  • the user terminal can be implemented in various forms.
  • the terminal described in this embodiment may include, for example, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a personal digital assistant (PDA), a portable media player (PMP), a navigation device, Mobile terminals such as wearable devices, smart bracelets, pedometers, and fixed terminals such as digital televisions (TVs), desktop computers, and the like.
  • PDA personal digital assistant
  • PMP portable media player
  • TVs digital televisions
  • desktop computers and the like.
  • a viewing device for a video picture may include:
  • the second providing module 71 is configured to: provide viewing angle information to the photographing device;
  • the receiving module 72 is configured to: receive a partial video picture from the photographing device that matches the view information;
  • the display module 73 is configured to: display the partial video screen.
  • the receiving module 72 may be further configured to: receive a panoramic video frame from the photographing device; the display module 73 may be further configured to: when the partial video screen is displayed, display the Panoramic video footage.
  • the viewing device of the video screen may further include: a video operation module 74, configured to: according to the shooting parameters of each of the plurality of viewing angles provided by the shooting device, and the algorithm parameters of the stitching fusion
  • the local video picture is zoomed, or flattened, or scaled and flattened, or the local video picture and the panoramic video picture are scaled, or flattened, or scaled and flattened
  • the receiving module 72 The method may further be configured to: receive a shooting parameter of each of the plurality of viewing angles provided by the shooting device, and an algorithm parameter of the stitching fusion.
  • the display module 73 can display the partial video screen in various manners.
  • the display module 73 may be configured to display the panoramic video picture and the partial video picture in a picture-in-picture format.
  • the viewing device of the video screen in this embodiment can implement all the details of the method described in the fourth embodiment.
  • the second providing module 71, the receiving module 72, the display module 73, and the video operating module 74 may be software, hardware, or a combination of the two.
  • the output device of the above video screen may be implemented by a user terminal or installed in a user terminal.
  • the user terminal can be implemented in various forms.
  • the terminal described in this embodiment may include, for example, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a personal digital assistant (PDA), a portable media player (PMP), a navigation device, Mobile terminals such as wearable devices, smart bracelets, pedometers, and fixed terminals such as digital TVs, desktop computers, and conference television terminals.
  • PDA personal digital assistant
  • PMP portable media player
  • Mobile terminals such as wearable devices, smart bracelets, pedometers
  • fixed terminals such as digital TVs, desktop computers, and conference television terminals.
  • the output device of the video picture can be implemented by using a mobile phone.
  • the second providing module 71 and the receiving module 72 can pass through the processor + communication component of the mobile phone (such as a WIFI (Wireless Fidelity) communication module, RF. (Radio Frequency), cable, etc.
  • the display module 73 and the video operation module 74 can be implemented by the processor + display of the mobile phone.
  • the viewing device of the above video picture and each part thereof may also be implemented in other forms, and this is not limited herein.
  • a user terminal may include:
  • the communication module 81 is configured to communicate with the photographing device
  • a memory 83 storing a video screen viewing program
  • the processor 84 is configured to execute the video screen viewing program to perform operations of: controlling the communication module to provide viewing angle information to the photographing device, and receiving, from the photographing device, the viewing angle information a partial video picture; controlling the display screen to display the partial video picture.
  • the user terminal in this embodiment can implement all the details of the method described in the fourth embodiment.
  • the user terminal can be implemented in various forms.
  • the terminal described in this embodiment may include, for example, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a personal digital assistant (PDA), a portable media player (PMP), a navigation device, Mobile terminals such as wearable devices, smart bracelets, pedometers, and fixed terminals such as digital TVs, desktop computers, and the like.
  • a partial video image screen may refer to a video image including a video image within a certain range of viewing angles
  • the panoramic video image screen may refer to a video image including a video image in a full viewing angle range, for example, a panoramic video image screen. It can contain video images in the range of 360 degrees.
  • the angle of view information in the present disclosure may be a specified angle information (for example, 45 degrees), or may be a specified angle section information (such as the front angle, the front left perspective, the rear left perspective, the rear perspective, and the rear in Example 1). Right view, front right view).
  • the photographing device may splicing and merging the video images in the angular interval corresponding to the angle information to form a partial video image corresponding to the angle information
  • the viewing angle information is information indicating the specified angle interval (eg, In the front view Sf)
  • the photographing device may splicing and blending the video images in the angular interval to form a partial video image corresponding to the angular interval.
  • the viewing angle information may be different depending on the arrangement when the shooting device captures the video image.
  • the panoramic camera is an example of the above-described photographing apparatus, which may include a plurality of lenses, each of which can capture a video image of a specified angle of view.
  • Figure 9 is a schematic illustration of a plurality of lens arrangements of the panoramic camera.
  • the panoramic camera includes six lenses with a viewing angle of 60 degrees, which are sequentially arranged on the circumference at an angle of 60 degrees.
  • the viewing angles corresponding to the video images acquired by the plurality of lenses are, in order, the front view Sf, the front left view Sf_l, the rear left view Sr_l, the back view Sr, the back right view Sr_r, and the front right view Sf_r.
  • the panoramic camera may splicing and merging the video images acquired by the lenses according to the viewing angle information provided by the user terminal to form a corresponding partial video image and output the video image to the user terminal.
  • the panoramic camera can capture video images 360 degrees. Therefore, the panoramic camera can meet the requirements of multiple users (such as users A, B, and C) simultaneously viewing video images of different angles.
  • FIG. 10 is a schematic diagram of a panoramic video frame obtained by a panoramic camera, taking a 6-eye panoramic camera as an example.
  • the output of the panoramic camera includes the image content collected by all the lenses, but can only exist in the same picture in the deformed area block, for example, the video of the 6 lenses, the viewing angle Sr, the rear left viewing angle Sr_l, and the front left viewing angle.
  • Sf_l, front angle of view Sf, front right angle of view Sf_r, rear right angle of view Sr_r, and back angle of view Sr are sequentially arranged.
  • the six images of the original lens can be scaled by long and short sides, and then the scaled video image is passed through the boundary. Fusion and splicing together. If it is a spherical panoramic camera, then not only the long and short side of the zoom processing.
  • FIG. 11 is a schematic diagram showing the display after the panoramic camera synthesizes the video screen, taking a 6-eye panoramic camera and 3 users viewing from different angles as an example.
  • the panoramic camera After receiving the viewing request sent by the user terminal, the panoramic camera adjusts the fusion splicing mode of the panoramic camera to view the lens corresponding to the viewing angle information carried in the request as a reference, and enlarges the area of the video image captured by the lens in the video image.
  • the video image taken for the lens that is not selected for viewing does not appear in the final picture, thereby forming a partial video picture that matches the view information.
  • the user terminals of the remote users A, B, and C respectively send out requests for viewing the back view Sr, the front view Sf, and the front right view Sf_r images respectively.
  • the panoramic camera respectively goes to the remote users A, B, and C.
  • the user terminal outputs a partial video picture including a rear view Sr video image, a partial video picture of a front view Sf video image, and a partial video picture of a front right view Sf_r video image.
  • the panoramic camera can also output a panoramic video picture to the user terminals of the remote users A, B, and C, respectively.
  • the panoramic camera can output the panoramic video picture to a smaller picture, and reduce the partial video picture to a larger picture.
  • the user terminal outputs the panoramic video picture as a smaller picture and a partial video picture. Display in the form of a large screen. Smaller screens can be turned off during display. For example, the smaller screen can be automatically turned off periodically or manually by the user. After receiving the user command to close the smaller screen, the user terminal closes the smaller screen on the display interface.
  • FIG. 11a a schematic diagram of a video screen seen by user A is shown in FIG. 11b as a schematic diagram of a video screen seen by user B.
  • FIG. 11c is a schematic diagram of a video screen seen by user C.
  • the panoramic camera can provide the panoramic video picture and the partial video picture as two streams to the user terminal, and the user terminal determines whether to display a small picture (ie, a panoramic video picture) and how to display according to the user's selection.
  • a small picture ie, a panoramic video picture
  • the picture-in-picture display mode can be manually turned on in the display interface, and then a new angle of view is selected in the panoramic video screen, and the user terminal re-acquires new perspective information according to the user command to the panorama.
  • the camera provides a view adjustment request, and the view adjustment request carries the new view information, and the panoramic camera combines the video images of the corresponding view according to the new view information to form a partial video that matches the new view information.
  • the picture is provided to the user terminal, and the user terminal then displays the partial video picture that matches the new view information to the user.
  • the remote user B sends a request for switching to the back view Sr, as shown in FIG. 12a, and the remote user C issues a request to switch to the front view Sf, as shown in FIG. 12b.
  • an intermediate node may be set between the panoramic camera and the user terminal, as shown in FIG. 13 is a schematic diagram of a connection between the panoramic camera and the plurality of user terminals after accessing the intermediate node.
  • the user terminals of the users A, B, and C are respectively connected to the intermediate nodes, and the intermediate nodes are connected to the panoramic camera.
  • the intermediate node is responsible for receiving the view adjustment request of each user terminal of the plurality of user terminals, and then forwarding the image to the panoramic camera to complete the splicing and merging of the corresponding partial video picture.
  • the approximate function of the intermediate node is to provide the partial video provided by the panoramic camera.
  • the screen is flattened to a video screen conforming to the normal viewing effect according to the request of each user terminal of the plurality of user terminals, and then distributed to the user terminal, and the corresponding remote user sees the selected viewing angle of the remote user. Corresponding partial video picture.
  • an embodiment of the present disclosure further provides a computer readable storage medium, where the computer readable storage medium stores a video picture output program, and the video picture output program is executed by the processor to implement the step of the video picture output method. .
  • the computer readable storage medium can implement all of the details of the method of the first embodiment.
  • an embodiment of the present disclosure further provides another computer readable storage medium, where the computer readable storage medium stores a video screen viewing program, and the video screen viewing program is implemented by the processor to implement the video screen viewing method. step.
  • the computer readable storage medium can implement all the details of the method described in the fourth embodiment.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor performs the method steps of the foregoing embodiments according to the stored program code in the storage medium.
  • the embodiment of the present disclosure further provides a computer readable storage medium storing computer executable instructions, which are implemented when the computer executable instructions are executed.
  • a program to instruct related hardware such as a processor, which may be stored in a computer readable storage medium, such as a read only memory, disk or optical disk. Wait.
  • all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits.
  • the modules/units in the foregoing embodiments may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement their respective functions, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by the processor/ Instructions to achieve their corresponding functions.
  • the present disclosure is not limited to any specific form of combination of hardware and software.
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media include, but are not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), and Electrically Erasable Programmable Read-only Memory (EEPROM). Flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
  • the video image of the corresponding angle can be provided to the user according to the angle requirement submitted by the user, and the panning angle is not required to adjust the shooting angle, and the user does not need other devices to allow different users to watch the video at different angles at the same time. It is easy to operate, easy to use and flexible, and low in cost.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Studio Devices (AREA)

Abstract

一种视频画面的输出方法包括:多视角采集视频图像;根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;将所述局部视频画面提供给所述用户终端。

Description

一种视频画面的输出、查看方法及装置 技术领域
本公开涉及但不限于视频技术领域,尤其是一种视频画面的输出、查看方法及装置。
背景技术
视频通讯或视频监控领域中,摄像机采集到的视频都是有一定视角范围的。本地或远端用户通过调整与摄像机连接云台的转动,以实现查看视角的变动。如果某个摄像机采集到的视频被多个远端用户观看,那么云台的角度只能满足某个用户的要求,对于不同用户同时观看视频的不同角度要求是无法满足的。为此,全景摄像技术应运而生,全景摄像技术是使用多个摄像机及其云台协同配合同时采集不同角度的视频画面,然后将不同角度的视频画面拼接成全景图像,此时,如果不同用户同时需要以不同角度观看视频,还需要再借助普通摄像机对全景图像处理才能查看到特定角度的视频画面。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本领域已知的技术要么不能满足不同用户同时以不同角度观看视频的要求,要么需要多套摄像机配合使用,特别是需要多个云台协同配合,并且还需要用户再借助普通摄像机才能查看到特定角度的视频画面,不仅操作不便,使用灵活性差,而且成本高。
本公开提供了一种视频画面的输出、查看方法及装置。
本公开实施例提供了一种视频画面的输出方法,包括:
多视角采集视频图像;
根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
将所述局部视频画面提供给所述用户终端。
在一种示例性实施方式中,所述将所述局部视频画面提供给所述用户终端之前,还包括:将所有视角的视频图像融合拼接,形成全景视频画面;所述将所述局部视频画面提供给所述用户终端时,还包括:将所述全景视频画面提供给所述用户终端。
在一种示例性实施方式中,通过如下方式之一,将所述全景视频画面提供给所述用户终端:将所述全景视频画面及所述局部视频画面同时提供给所述用户终端;或者,将所述全景视频画面及所述局部视频画面以两路码流分别提供给所述用户终端。
在一种示例性实施方式中,将所述局部视频画面提供给所述用户终端时,还包括如下之一或两项:向所述用户终端提供多个视角中每个视角拍摄参数及拼接融合算法参数,使得所述用户终端能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作;向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端。
在一种示例性实施方式中,形成与所述视角信息相匹配的局部视频画面之前,还包括:通过所述中间节点接收来自用户终端的视角信息;或,通过所述中间节点将所述局部视频画面或所述局部视频画面及全景视频画面提供给所述用户终端;或,通过所述中间节点接收来自用户终端的视角信息;以及,通过所述中间节点将所述局部视频画面或所述局部视频画面及全景视频画面提供给所述用户终端。
本公开实施例还提供了一种视频画面的输出装置,包括:
采集模块,设置为:多视角采集视频图像;
融合拼接模块,设置为:根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
第一提供模块,设置为:将所述局部视频画面提供给所述用户终端。
在一种示例性实施方式中,所述融合拼接模块,还设置为:将所有视角的视频图像融合拼接,形成全景视频画面;所述第一提供模块,是设置为: 在将所述局部视频画面提供给所述用户终端时,还将所述全景视频画面提供给所述用户终端。
在一种示例性实施方式中,所述第一提供模块,还设置为:在将所述局部视频画面提供给所述用户终端时执行如下之一或两项:向所述用户终端提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述用户终端能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作;向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端。
本公开实施例还提供了一种拍摄设备,包括:
配置为采集拍摄图像的图像采集器件;
存储有视频画面输出程序的存储器;
处理器,配置为执行所述视频画面输出程序以执行下述操作:控制所述图像采集器件多视角采集视频图像;根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;将所述局部视频画面提供给所述用户终端。
在一种示例性实施方式中,所述处理器,还配置为执行所述视频画面输出程序时执行下述操作:将所述局部视频画面提供给所述用户终端之前,将所有视角的视频图像融合拼接,形成全景视频画面;将所述局部视频画面提供给所述用户终端时,将所述全景视频画面提供给所述用户终端。
本公开实施例还提供了一种视频画面的查看方法,包括:
向拍摄设备提供视角信息;
接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
显示所述局部视频画面。
在一种示例性实施方式中,向拍摄设备提供视角信息之后,还包括:接收来自所述拍摄设备的全景视频画面;显示所述局部视频画面时,还包括:显示所述全景视频画面。
在一种示例性实施方式中,在显示所述局部视频画面之前,还包括:根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参 数,对所述局部视频画面进行缩放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作。
在一种示例性实施方式中,所述接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面之前或向拍摄设备提供视角信息之前,还包括:向所述中间节点提供所述视角信息,使得所述中间节点能够将来自拍摄设备的局部视频画面或者局部视频画面及全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发。
在一种示例性实施方式中,所述接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面,包括:接收所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;或者,接收由所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面及全景视频画面。
在一种示例性实施方式中,所述全景视频画面及所述局部视频画面按照如下方式进行显示:以画中画的形式显示所述全景视频画面及所述局部视频画面。
在一种示例性实施方式中,所述显示所述局部视频画面时,还包括:根据当前显示界面上的用户操作,调整显示方式;其中,所述显示方式包括如下之一:较大画面显示所述全景视频画面、较小画面显示所述局部视频画面;较大画面显示所述局部视频画面、较小画面显示所述全景视频画面;只显示所述局部视频画面。
在一种示例性实施方式中,所述显示所述局部视频画面时,还包括:根据当前显示界面上的用户操作,向所述拍摄设备重新提供新的视角信息。
本公开实施例还提供了一种视频画面的查看装置,包括:
第二提供模块,设置为:向拍摄设备提供视角信息;
接收模块,设置为:接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
显示模块,设置为:显示所述局部视频画面。
在一种示例性实施方式中,所述接收模块,还设置为:接收来自所述拍摄设备的全景视频画面;所述显示模块,还设置为:在显示所述局部视频画 面时,显示所述全景视频画面。
在一种示例性实施方式中,还包括:视频操作模块,设置为:根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数,对所述局部视频画面进行缩放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作;所述接收模块,还设置为:接收所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数。
在一种示例性实施方式中,所述显示模块,是设置为:以画中画的形式显示所述全景视频画面及所述局部视频画面。
本公开实施例还提供了一种用户终端,包括:
通信模块,配置为与拍摄设备进行通信;
显示屏;
存储有视频画面查看程序的存储器;
处理器,配置为执行所述视频画面查看程序以执行下述操作:控制所述通信模块向所述拍摄设备提供视角信息,并接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;控制所述显示屏显示所述局部视频画面。
在一种示例性实施方式中,所述处理器,还配置为执行所述视频画面查看程序时执行下述操作:向拍摄设备提供视角信息之后,接收来自所述拍摄设备的全景视频画面;显示所述局部视频画面时,还显示所述全景视频画面。
在一种示例性实施方式中,所述处理器,还配置为执行所述视频画面查看程序时执行下述操作:显示所述局部视频画面时,还根据当前显示界面上的用户操作,调整显示方式;其中,所述显示方式包括如下之一:
较大画面显示所述全景视频画面、较小画面显示所述局部视频画面;
较大画面显示所述局部视频画面、较小画面显示所述全景视频画面;
只显示所述局部视频画面。
本公开实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有视频画面输出程序,所述视频画面输出程序被处理器执行时实现上述视频画面输出方法的步骤。
本公开实施例还提供了一种计算机可读存储介质,所述计算机可读存储 介质上存储有视频画面查看程序,所述视频画面查看程序被处理器执行时实现上述视频画面查看方法的步骤。
本公开实施例还提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令被执行时实现上述视频画面的输出方法。
本公开实施例中,可根据用户提交的角度需求向用户提供相应角度的视频画面,无需云台配合调整拍摄角度,也不需要用户再借助其他设备,即可让不同用户同时以不同角度观看视频,操作简便,使用方便灵活,成本也较低。
在阅读并理解了附图和详细描述后,可以明白其他方面。
附图概述
图1为本领域已知技术中云台角度对画面视角影响的示意图;
图2为本领域已知技术中多个用户观看同一视频画面时的系统架构示意图;
图3为第一实施例视频画面输出方法的流程示意图;
图4为第二实施例视频画面输出装置的结构示意图;
图5为第三实施例拍摄设备的结构示意图;
图6为第四实施例视频画面查看方法的流程示意图;
图7为第五实施例视频画面查看装置的结构示意图;
图8为第六实施例用户终端的结构示意图;
图9为实例1中以6眼全景摄像机为例全景摄像机多个镜头排布的示意图;
图10为实例1中全景摄像机得到的全景视频画面示意图。
图11a为用户A看到的视频画面示意图;
图11b为用户B看到的视频画面示意图;
图11c为用户C看到的视频画面示意图;
图12a为用户B看到的调整后的视频画面示意图;
图12b为用户C看到的调整后的视频画面示意图;
图13为实例2中接入中间节点后全景摄像机与多个用户终端之间的连接示意图。
本公开的较佳实施方式
下面结合附图对本公开的实施方式进行描述。
在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行。并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。
图1为本领域已知技术中云台角度对画面视角影响的示意图。以摄像机云台机械限位180度、视角60度为例,左限位对应的画面为Sl,右限位对应的画面为Sr,法线方向对应的画面为Sm,在某个时刻摄像机只能输出左限位和右限位范围之内的画面,摄像机采集不到机械限位不可达区域即视角θ范围内的视频图像。
图2为本领域已知技术中多个用户观看同一视频画面时的系统架构示意图。图2中的摄像机通过线缆连接入视频分配器或网络,用户A、B、C在不同时刻可以选择图1左限位和右限位范围之内的画面,由于图1摄像机的特性,如果用户A选择了左限位的视频画面Sl,那么用户B、C同样也只能看视频画面Sl,即使用户B真正想关注的是视频画面Sm或用户C真正关注的视频画面Sr。这样,在同一地点如果要满足多个用户查看不同角度视频图像的要求,就需要架设朝向不同方位的摄像机阵列。如需满足3个用户查看不同角度视频图像的要求,则至少需要架设3台前述视角60度的摄像机,也就是说增加摄像机设备以及线缆带宽可以满足上述要求。
由上可知,本领域已知技术要么不能满足不同用户同时以不同角度观看视频的要求,要么需要架设朝向不同方位的摄像机阵列,特别是还需要配合使用调整方位的多个云台,这之后仍需要用户再借助摄像机才能查看到特定角度的视频画面,不仅操作不便,使用灵活性差,而且成本高。
本公开提出如下技术方案,拍摄设备可根据用户终端提供的视角信息形成相应的局部视频画面,并提供给用户终端,每个用户终端则可以通过向拍摄设备提交自己的视角信息即可获得相应的局部视频画面,这样,即可让不 同用户同时以不同角度观看视频,不需要为了满足用户的需求实时调整拍摄角度,也就无需通过云台调整拍摄方位,不仅使用灵活,而且降低了设备成本。此外,用户终端可直接向用户显示拍摄设备提供的视频画面,不需要再借助其他设备,操作简洁方便,也省去了其他设备带来的成本。
第一实施例
提供一种视频画面的输出方法,可通过拍摄设备实现,如图3所示,该方法可包括:
步骤301,多视角采集视频图像;
步骤302,根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
步骤303,将所述局部视频画面提供给所述用户终端。
本实施例中,拍摄设备可根据用户终端提供的视角信息形成相应的局部视频画面,并提供给用户终端,这样,可让不同用户同时以不同角度观看视频,无需通过云台调整拍摄方位,不仅使用灵活,而且降低了设备成本。
本实施例中,多视角采集视频图像时可通过多个摄像机或包含多个摄像头的设备来实现,每个摄像机或摄像头采集指定视角的视频图像。
一种可选实现方式中,拍摄设备可以在接收到来自用户终端的查看请求后,根据查看请求中携带的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面并提供给所述用户终端。这里,所述视角信息由用户终端基于用户选择的视角得到。例如,在收到远端用户的用户终端发送的包含视角信息的查看请求后,调整其融合拼接方式,以远端用户指定视角的摄像机为基准,扩大其在全景视频画面中的面积,对于没有选中观看的摄像机则不在最终的画面中出现,来形成相应视角的局部视频画面。
另一种可选实现方式中,拍摄设备可以在接收到来自用户终端的视角调整请求后,根据视角调整请求中携带的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面并提供给所述用户终端。例如,用户需要切换视角时,可以通过用户终端向拍摄设备发送视角调整请 求,该视角调整请求中包含新的视角信息,该新的视角信息由用户终端基于用户重新选择的视角得到。
一种可选实现方式中,将所述局部视频画面提供给所述用户终端之前,还可以将所有视角的视频图像融合拼接,形成全景视频画面;在将所述局部视频画面提供给所述用户终端时,还可以将所述全景视频画面提供给所述用户终端。如此,方便用户同时观看特定视角的视频画面和全景的视频画面。
实际应用中,如果远端用户没有提供视角信息,那么拍摄设备可以以默认方式向该远端用户的用户终端提供相应的视频画面。例如,如果用户终端没有提交任何请求,拍摄设备可以以默认的方式将所有视角的视频图像融合拼接,形成全景视频画面并提供该远端用户。
这里,提供局部视频画面和全景视频画面的方式可以有多种。例如,可以将所述全景视频画面及所述局部视频画面同时提供给所述用户终端;或者,还可以将所述全景视频画面及所述局部视频画面以两路码流分别提供给所述用户终端。
为了使远端用户能够观看到无畸变无扭曲的视频画面,本实施例中,拍摄设备将所述局部视频画面提供给所述用户终端时,还可以将多个视角中每个视角的拍摄参数以及拼接融合的算法参数提供给用户终端,以便用户终端可以根据这些参数对视频画面(局部视频画面,或者局部视频画面+全景视频画面)进行缩放、展平等操作,使之符合正常的观看效果之后再进行显示。
除上述方式之外,为了使远端用户能够观看到无畸变无扭曲的视频画面,本实施例中,拍摄设备将所述局部视频画面提供给所述用户终端时,还可以向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端,用户终端接收中间节点转发的视频画面(局部视频画面,或者局部视频画面+全景视频画面)即可直接显示。
实际应用中,拍摄设备与用户终端之间也可以通过中间节点交互。可选地,拍摄设备可以通过中间节点接收来自用户终端的视角信息,并通过中间节点将相应的局部视频画面或者局部视频画面+全景视频画面提供给用户终 端。这里,拍摄设备可通过中间节点向多个用户终端中每个用户终端分发与该用户终端对应的局部视频画面或局部视频画面+全景视频画面。
这里,拍摄设备还可以把全景视频画面送到中间节点,该中间节点负责接收多个用户终端中每个用户终端的请求(如查看请求,视角切换请求等),然后转发给拍摄设备完成相应视频画面的拼接融合再转发给该用户终端。中间节点的作用之一是把视频画面按照多个用户终端中每个用户终端的请求展平为符合正常观看效果的视频画面,然后送给该用户终端。采用中间节点,可以省去用户终端缩放、展平视频的操作,从而降低对用户终端的设备性能要求。
为了提高抗干扰能力,本实施例中,在提供视频画面(局部视频画面或局部视频画面+全景视频画面)时,拍摄设备可采用一定的编码算法编码之后以数字形式输出视频画面。
本实施例中,拍摄设备可以是全景摄像机或其他类似设备。
第二实施例
一种视频画面的输出装置,如图4所示,可包括:
采集模块41,设置为:多视角采集视频图像;
融合拼接模块42,设置为:根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
第一提供模块43,设置为:将所述局部视频画面提供给所述用户终端。
为方便用户同时查看全景视频画面和特定视角的视频画面,本实施例中,融合拼接模块42还可设置为:将所有视角的视频图像融合拼接,形成全景视频画面;第一提供模块43可以是设置为:在将所述局部视频画面提供给所述用户终端时,还将所述全景视频画面提供给所述用户终端。
为了使远端用户能够观看到无畸变无扭曲的视频画面,本实施例中,所述第一提供模块43,还可设置为:在将所述局部视频画面提供给所述用户终端时执行如下之一或两项:1)向所述用户终端提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述用户终端能够对所述局部视频 画面或全景视频画面进行缩放、或展平、或缩放和展平的操作;2)向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端。
本实施例中视频画面的输出装置可实现第一实施例所述方法的所有细节。本实施例中,采集模块41、融合拼接模块42、第一提供模块43分别可以是软件、硬件或两者的结合。上述视频画面的输出装置可以通过拍摄设备实现,或者设置于拍摄设备之中。例如,视频画面的输出装置可以通过全景摄像机实现,此时,采集模块41可以是该全景摄像机中多个摄像机组成的摄像机阵列,融合拼接模块42可以为该全景摄像机中负责图像处理的部分(如处理器),第一提供模块43可以为全景摄像机中负责通信的部分。实际应用中,上述视频画面的输出装置及其每个部分还可通过其他形式实现,对此,本文不作限制。
第三实施例
一种拍摄设备,如图5所示,可包括:
配置为采集拍摄图像的图像采集器件51;
存储有视频画面输出程序的存储器52;
处理器53,配置为执行所述视频画面输出程序以执行下述操作:控制所述图像采集器件多视角采集视频图像;根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;将所述局部视频画面提供给所述用户终端。
本实施例中的拍摄设备可实现第一实施例所述方法的所有细节。本实施例中,拍摄设备可以是全景摄像机或其他类似设备。
实际应用中,本实施例中图像采集器件可以是多个镜头形成的镜头阵列,每个镜头拍摄一个视角或一定视角范围内的视频图像,整个镜头阵列可拍摄306度的视频图像。或者,图像采集器件可以是多个摄像机形成的摄像机阵列,每个摄像机拍摄一个视角或一定视角范围内的视频图像,整个摄像机阵 列可拍摄306度的视频图像。
第四实施例
一种视频画面的查看方法,可通过用户终端实现,如图6所示,该方法可包括:
步骤601,向拍摄设备提供视角信息;
步骤602,接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
步骤603,显示所述局部视频画面。
本实施例中,多个用户终端中每个用户终端通过向拍摄设备提交自己的视角信息即可获得相应的局部视频画面,这样,不同用户可同时以不同角度观看视频,而且用户终端可直接向用户显示拍摄设备提供的视频画面,不需要再借助其他设备,操作简洁方便,也省去了其他设备带来的成本。
一种可选实现方式中,用户终端可以向拍摄设备发送查看请求,所述查看请求中携带视角信息,由拍摄设备将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面并提供给所述用户终端。这里,所述视角信息可由用户终端基于用户选择的视角得到。
另一种可选实现方式中,用户终端可以向拍摄设备发送视角调整请求,所述视角调整请求携带新的视角信息,由拍摄设备根据新的视角信息,相应视角的视频图像融合拼接,形成与所述新的视角信息相匹配的局部视频画面并提供给所述用户终端。这里,用户需要切换视角时,可以通过用户终端向拍摄设备发送所述视角调整请求,该视角调整请求中包含新的视角信息,该新的视角信息可由用户终端基于用户重新选择的视角得到。例如,可以在显示所述局部视频画面时,根据当前显示界面上的用户操作,向所述拍摄设备重新提供新的视角信息。
为了使远端用户能够观看到无畸变无扭曲的画面,本实施例中,用户终端还可以在显示所述局部视频画面之前,根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数,对所述局部视频画面进行缩 放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作,使之符合正常的观看效果之后再进行显示。
为了使远端用户能够观看到无畸变无扭曲的画面,本实施例中,用户终端还可以在接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面之前或向拍摄设备提供视角信息之前,向所述中间节点提供所述视角信息,使得所述中间节点能够将来自拍摄设备的局部视频画面或者局部视频画面及全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端,此时,用户终端接收中间节点转发的视频画面(局部视频画面,或者局部视频画面+全景视频画面)即可直接显示。如此,采用中间节点,可以省去用户终端缩放、展平视频的操作,从而降低对用户终端的设备性能要求。
相应地,所述接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面,可以包括:接收所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;或者,接收由所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面及全景视频画面。
本实施例中,向拍摄设备提供视角信息之后,还可以接收来自所述拍摄设备的全景视频画面;显示所述局部视频画面时,还可以显示所述全景视频画面。如此,方便用户同时观看特定视角的视频画面和全景的视频画面。
本实施例中,用户终端可以采用多种显示方式来显示拍摄设备提供的视频画面。例如,可以以画中画的形式显示所述全景视频画面及所述局部视频画面。
本实施例中,显示所述局部视频画面时,还可以根据当前显示界面上的用户操作,调整显示方式;其中,所述显示方式包括如下之一:1)较大画面显示所述全景视频画面、较小画面显示所述局部视频画面;2)较大画面显示所述局部视频画面、较小画面显示所述全景视频画面;3)只显示所述局部视频画面。
这里,所述显示所述局部视频画面时,可以根据当前显示界面上的用户操作,向拍摄设备提供用户命令,使得所述拍摄设备在收到所述用户命令之 后停止提供所述全景视频画面。这样,用户终端可以只显示所述局部视频画面。
本实施例中,用户终端可以以各种形式来实施。例如,本实施例中描述的终端可以包括诸如手机、平板电脑、笔记本电脑、掌上电脑、个人数字助理(Personal Digital Assistant,PDA)、便捷式媒体播放器(Portable Media Player,PMP)、导航装置、可穿戴设备、智能手环、计步器等移动终端,以及诸如数字电视(Television,TV)、台式计算机等固定终端。
第五实施例
一种视频画面的查看装置,如图7所示,可包括:
第二提供模块71,设置为:向拍摄设备提供视角信息;
接收模块72,设置为:接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
显示模块73,设置为:显示所述局部视频画面。
本实施例中,所述接收模块72,还可设置为:接收来自所述拍摄设备的全景视频画面;所述显示模块73,还可设置为:在显示所述局部视频画面时,显示所述全景视频画面。
本实施例中,上述视频画面的查看装置还可以包括:视频操作模块74,设置为:根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数,对所述局部视频画面进行缩放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作;所述接收模块72,还可设置为:接收所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数。
本实施例中,显示模块73可以采用多种方式显示所述局部视频画面。例如,所述显示模块73,可以是设置为:以画中画的形式显示所述全景视频画面及所述局部视频画面。
本实施例中视频画面的查看装置可实现第四实施例所述方法的所有细节。本实施例中,第二提供模块71、接收模块72、显示模块73以及视频操 作模块74分别可以是软件、硬件或两者的结合。上述视频画面的输出装置可以通过用户终端实现,或者设置于用户终端之中。
本实施例中,用户终端可以以各种形式来实施。例如,本实施例中描述的终端可以包括诸如手机、平板电脑、笔记本电脑、掌上电脑、个人数字助理(Personal Digital Assistant,PDA)、便捷式媒体播放器(Portable Media Player,PMP)、导航装置、可穿戴设备、智能手环、计步器等移动终端,以及诸如数字TV、台式计算机、会议电视终端等固定终端。
例如,上述视频画面的输出装置可以通过手机实现,此时,第二提供模块71、接收模块72可以通过该手机的处理器+通信组件(如WIFI(Wireless Fidelity,无线保真)通信模块、RF(Radio Frequency,射频)单元、有线电缆等)实现,显示模块73和视频操作模块74可以通过该手机的处理器+显示屏实现。实际应用中,上述视频画面的查看装置及其每个部分还可通过其他形式实现,对此,本文不作限制。
第六实施例
一种用户终端,如图8所示,可包括:
通信模块81,配置为与拍摄设备进行通信;
显示屏82;
存储有视频画面查看程序的存储器83;
处理器84,配置为执行所述视频画面查看程序以执行下述操作:控制所述通信模块向所述拍摄设备提供视角信息,并接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;控制所述显示屏显示所述局部视频画面。
本实施例中用户终端可实现第四实施例所述方法的所有细节。本实施例中,用户终端可以以各种形式来实施。例如,本实施例中描述的终端可以包括诸如手机、平板电脑、笔记本电脑、掌上电脑、个人数字助理(Personal Digital Assistant,PDA)、便捷式媒体播放器(Portable Media Player,PMP)、导航装置、可穿戴设备、智能手环、计步器等移动终端,以及诸如数字TV、 台式计算机等固定终端。
值得说明的是,本公开中局部视频图像画面可以是指包含一定视角范围内视频图像的视频画面,全景视频图像画面可以是指包含全视角范围内视频图像的视频画面,例如,全景视频图像画面可以包含360度范围内的视频图像。本公开中的视角信息可以是表示指定的角度信息(如45度),也可以是表示指定的角度区间信息(如下文实例1中的前视角、前左视角、后左视角、后视角、后右视角、前右视角)。在视角信息是表示指定的角度信息时,拍摄设备可以将该角度信息所对应角度区间内的视频图像进行拼接融合形成该角度信息对应的局部视频画面,视角信息是表示指定的角度区间信息(如前视角Sf)时,拍摄设备可以将该角度区间内的视频图像进行拼接融合形成该角度区间对应的局部视频画面。实际应用中,视角信息可以因拍摄设备采集视频图像时的排布而不同。
下面对本公开上述实施例的可选实现方式进行举例说明。
实例1
本实例中,全景摄像机为上文所述拍摄设备的一个示例,该全景摄像机可包含多个镜头,每个镜头可拍摄指定视角的视频图像。
图9是所述全景摄像机多个镜头排布的示意图。
如图9所示,所述全景摄像机包括6支视角60度的镜头,分别按60度夹角依次排列在圆周上。多个镜头获取的视频图像所对应的视角依次是前视角Sf、前左视角Sf_l、后左视角Sr_l、后视角Sr、后右视角Sr_r、前右视角Sf_r。全景摄像机可以根据用户终端提供的视角信息,采用预定的拼接融合算法将这些镜头获取的视频图像拼接融合后形成相应的局部视频画面并输出给该用户终端。
本实例中,全景摄像机可以360度采集视频图像,因此,全景摄像机可以满足如多个用户(如用户A、B、C)同时查看不同角度视频图像的要求。
图10是全景摄像机得到全景视频画面示意图,以6眼全景摄像机为例。如图10所示,全景摄像机的输出包含全部镜头采集的图像内容,不过只能以 变形的区域块存在于同一画面中,例如6支镜头的视频以后视角Sr、后左视角Sr_l、前左视角Sf_l、前视角Sf、前右视角Sf_r、后右视角Sr_r、后视角Sr依次排列,6支镜头原先采集到视频图像都可以做长短边的缩放处理,然后再对缩放处理后的视频图像通过边界融合而拼接起来。如果是球形全景摄像机,那么不仅仅是长短边的缩放处理了。
图11是全景摄像机合成视频画面之后的显示示意图,以6眼全景摄像机拍摄、3个用户从不同角度观看为例。
全景摄像机在收到用户终端发送的查看请求后,调整全景摄像机的融合拼接方式,以查看请求中携带的视角信息所对应的镜头为基准,扩大该镜头所拍摄视频图像在视频画面中的面积,对于没有选中观看的镜头所拍摄视频图像则不在最终的画面中出现,以此,形成与所述视角信息相匹配的局部视频画面。
远端用户A、B、C的用户终端分别发出分别查看后视角Sr、前视角Sf、前右视角Sf_r图像的请求,全景摄像机接收到这些请求后,分别向远端用户A、B、C的用户终端输出包含后视角Sr视频图像的局部视频画面、前视角Sf视频图像的局部视频画面、前右视角Sf_r视频图像的局部视频画面。此外,全景摄像机还可以分别向远端用户A、B、C的用户终端输出全景视频画面。
例如,全景摄像机可以将全景视频画面缩成较小画面、将局部视频画面缩成较大画面的画中画形式输出给用户终端,用户终端以全景视频画面为较小画面、局部视频画面为较大画面的形式进行显示。显示过程中,较小画面可以关闭。比如,较小画面可以定时自动关闭,也可以由用户手动关闭,用户终端在收到关闭较小画面的用户命令之后,将显示界面上的较小画面关闭。如图11a所示为用户A看到的视频画面示意图,如图11b所示为用户B看到的视频画面示意图,如图11c所示为用户C看到的视频画面示意图。
再例如,全景摄像机可以将全景视频画面、局部视频画面作为两路码流提供给用户终端,用户终端根据用户的选择来决定是否显示较小画面(即全景视频画面)、以及以何种方式显示全景视频画面和局部视频画面。
再例如,用户如果想要调整观看的角度,可以在显示界面手动开启画中画显示模式,再在全景视频画面中选择新的视角,用户终端根据这个用户命 令重新得到新的视角信息,向全景摄像机提供视角调整请求,所述视角调整请求携带所述新的视角信息,全景摄像机根据新的视角信息,将相应视角的视频图像进行融合拼接,形成与所述新的视角信息相匹配的局部视频画面并提供给所述用户终端,用户终端再向用户显示与所述新的视角信息相匹配的局部视频画面。远端用户B发出切换到后视角Sr的请求,如图12a所示为用户B看到的调整后的视频画面示意图,远端用户C发出切换到前视角Sf的请求,如图12b所示为用户C看到的调整后的视频画面示意图。
实例2
本实例中,在全景摄像机与用户终端之间可以设置中间节点,如图13为接入中间节点之后全景摄像机与多个用户终端之间连接的示意图。如图13所示,用户A、B、C的用户终端分别连接中间节点,中间节点再连接全景摄像机。
本实例中,中间节点负责接收多个用户终端中每个用户终端的视角调整请求,然后转发给全景摄像机以完成相应局部视频画面的拼接融合,中间节点的大致作用是把全景摄像机提供的局部视频画面按照多个用户终端中每个用户终端的请求展平为符合正常观看效果的视频画面之后再分发给该用户终端,此时相应的远端用户看到的是该远端用户所选择视角所对应的局部视频画面。通过中间节点,就可以省去远端用户缩放、展平视频画面的操作,对设备的要求降低了不少。
此外,本公开实施例还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有视频画面输出程序,所述视频画面输出程序被处理器执行时实现上述视频画面输出方法的步骤。可选地,该计算机可读存储介质可实现实施例一所述方法的所有细节。
此外,本公开实施例还提供另一种计算机可读存储介质,所述计算机可读存储介质上存储有视频画面查看程序,所述视频画面查看程序被处理器执行时实现上述视频画面查看方法的步骤。可选地,该计算机可读存储介质可实现第四实施例所述方法的所有细节。
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access  Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行上述实施例的方法步骤。
可选地,本实施例中的可选示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。
本公开实施例还提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令被执行时实现上述视频画面的输出方法。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序来指令相关硬件(例如处理器)完成,所述程序可以存储于计算机可读存储介质中,如只读存储器、磁盘或光盘等。可选地,上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现。相应地,上述实施例中的模块/单元可以采用硬件的形式实现,例如通过集成电路来实现其相应功能,也可以采用软件功能模块的形式实现,例如通过处理器执行存储于存储器中的程序/指令来实现其相应功能。本公开不限制于任何特定形式的硬件和软件的结合。
本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中,在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分;例如,一个物理组件可以具有多个功能,或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器,如数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于随机存取存储器(RAM,Random Access Memory)、只读存储器(ROM,Read-Only Memory)、电可擦除只读存储器(EEPROM,Electrically Erasable Programmable Read-only  Memory)、闪存或其他存储器技术、光盘只读存储器(CD-ROM,Compact Disc Read-Only Memory)、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。
本领域的普通技术人员可以理解,可以对本公开的技术方案进行修改或者等同替换,而不脱离本公开技术方案的精神和范围,均应涵盖在本公开的权利要求范围当中。
工业实用性
本公开实施例中,可根据用户提交的角度需求向用户提供相应角度的视频画面,无需云台配合调整拍摄角度,也不需要用户再借助其他设备,即可让不同用户同时以不同角度观看视频,操作简便,使用方便灵活,成本也较低。

Claims (27)

  1. 一种视频画面的输出方法,包括:
    多视角采集视频图像;
    根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
    将所述局部视频画面提供给所述用户终端。
  2. 根据权利要求1所述的输出方法,
    所述将所述局部视频画面提供给所述用户终端之前,还包括:将所有视角的视频图像融合拼接,形成全景视频画面;
    所述将所述局部视频画面提供给所述用户终端时,还包括:将所述全景视频画面提供给所述用户终端。
  3. 根据权利要求2所述的输出方法,其中,通过如下方式之一,将所述全景视频画面提供给所述用户终端:
    将所述全景视频画面及所述局部视频画面同时提供给所述用户终端;
    将所述全景视频画面及所述局部视频画面以两路码流分别提供给所述用户终端。
  4. 根据权利要求1至3任一项所述的输出方法,将所述局部视频画面提供给所述用户终端时,还包括如下之一或两项:
    向所述用户终端提供多个视角中每个视角拍摄参数及拼接融合算法参数,使得所述用户终端能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作;
    向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端。
  5. 根据权利要求4所述的输出方法,
    形成与所述视角信息相匹配的局部视频画面之前,还包括:通过所述中间节点接收来自用户终端的视角信息;或,
    通过所述中间节点将所述局部视频画面或所述局部视频画面及全景视频画面提供给所述用户终端;或,
    通过所述中间节点接收来自用户终端的视角信息;以及,通过所述中间节点将所述局部视频画面或所述局部视频画面及全景视频画面提供给所述用户终端。
  6. 一种视频画面的输出装置,包括:
    采集模块,设置为:多视角采集视频图像;
    融合拼接模块,设置为:根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;
    第一提供模块,设置为:将所述局部视频画面提供给所述用户终端。
  7. 根据权利要求6所述的输出装置,其中,
    所述融合拼接模块,还设置为:将所有视角的视频图像融合拼接,形成全景视频画面;
    所述第一提供模块,是设置为:在将所述局部视频画面提供给所述用户终端时,还将所述全景视频画面提供给所述用户终端。
  8. 根据权利要求6或7所述的输出装置,
    所述第一提供模块,还设置为:在将所述局部视频画面提供给所述用户终端时执行如下之一或两项:
    向所述用户终端提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述用户终端能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作;
    向中间节点提供多个视角中每个视角的拍摄参数及所述拼接融合的算法参数,使得所述中间节点能够对所述局部视频画面或全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发给所述用户终端。
  9. 一种拍摄设备,包括:
    配置为采集拍摄图像的图像采集器件;
    存储有视频画面输出程序的存储器;
    处理器,配置为执行所述视频画面输出程序以执行下述操作:控制所述图像采集器件多视角采集视频图像;根据用户终端提供的视角信息,将相应视角的视频图像融合拼接,形成与所述视角信息相匹配的局部视频画面;将所述局部视频画面提供给所述用户终端。
  10. 根据权利要求9所述的拍摄设备,所述处理器,还配置为执行所述视频画面输出程序时执行下述操作:
    将所述局部视频画面提供给所述用户终端之前,将所有视角的视频图像融合拼接,形成全景视频画面;
    将所述局部视频画面提供给所述用户终端时,将所述全景视频画面提供给所述用户终端。
  11. 一种视频画面的查看方法,包括:
    向拍摄设备提供视角信息;
    接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
    显示所述局部视频画面。
  12. 根据权利要求11所述的查看方法,
    向拍摄设备提供视角信息之后,还包括:接收来自所述拍摄设备的全景视频画面;
    显示所述局部视频画面时,还包括:显示所述全景视频画面。
  13. 根据权利要求11或12所述的查看方法,
    在显示所述局部视频画面之前,还包括:根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数,对所述局部视频画面进行缩放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作。
  14. 根据权利要求11或12所述的方法,所述接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面之前或向拍摄设备提供视角信息之前,还包括:
    向所述中间节点提供所述视角信息,使得所述中间节点能够将来自拍摄 设备的局部视频画面或者局部视频画面及全景视频画面进行缩放、或展平、或缩放和展平的操作之后再转发。
  15. 根据权利要求14所述的方法,其中,所述接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面,包括:
    接收所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;或者,接收由所述中间节点转发的来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面及全景视频画面。
  16. 根据权利要求12所述的查看方法,其中,所述全景视频画面及所述局部视频画面按照如下方式进行显示:
    以画中画的形式显示所述全景视频画面及所述局部视频画面。
  17. 根据权利要求11、12或16所述的方法,
    所述显示所述局部视频画面时,还包括:根据当前显示界面上的用户操作,调整显示方式;
    其中,所述显示方式包括如下之一:
    较大画面显示所述全景视频画面、较小画面显示所述局部视频画面;
    较大画面显示所述局部视频画面、较小画面显示所述全景视频画面;
    只显示所述局部视频画面。
  18. 根据权利要求11、12或16所述的方法,
    所述显示所述局部视频画面时,还包括:根据当前显示界面上的用户操作,向所述拍摄设备重新提供新的视角信息。
  19. 一种视频画面的查看装置,包括:
    第二提供模块,设置为:向拍摄设备提供视角信息;
    接收模块,设置为:接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;
    显示模块,设置为:显示所述局部视频画面。
  20. 根据权利要求19所述的查看装置,其中,
    所述接收模块,还设置为:接收来自所述拍摄设备的全景视频画面;
    所述显示模块,还设置为:在显示所述局部视频画面时,显示所述全景视频画面。
  21. 根据权利要求19或20所述的查看装置,
    还包括:视频操作模块,设置为根据所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数,对所述局部视频画面进行缩放、或展平、或缩放和展平的操作,或者对所述局部视频画面和全景视频画面进行缩放、或展平、或缩放和展平的操作;
    所述接收模块,还设置为:接收所述拍摄设备提供的多个视角中每个视角的拍摄参数及拼接融合的算法参数。
  22. 根据权利要求20所述的查看装置,其中,
    所述显示模块,是设置为:以画中画的形式显示所述全景视频画面及所述局部视频画面。
  23. 一种用户终端,包括:
    通信模块,配置为与拍摄设备进行通信;
    显示屏;
    存储有视频画面查看程序的存储器;
    处理器,配置为执行所述视频画面查看程序以执行下述操作:控制所述通信模块向所述拍摄设备提供视角信息,并接收来自所述拍摄设备的、与所述视角信息相匹配的局部视频画面;控制所述显示屏显示所述局部视频画面。
  24. 根据权利要求23所述的用户终端,所述处理器,还配置为执行所述视频画面查看程序时执行下述操作:
    向拍摄设备提供视角信息之后,接收来自所述拍摄设备的全景视频画面;
    显示所述局部视频画面时,还显示所述全景视频画面。
  25. 根据权利要求23所述的用户终端,所述处理器,还配置为执行所述视频画面查看程序时执行下述操作:
    显示所述局部视频画面时,还根据当前显示界面上的用户操作,调整显示方式;
    其中,所述显示方式包括如下之一:
    较大画面显示所述全景视频画面、较小画面显示所述局部视频画面;
    较大画面显示所述局部视频画面、较小画面显示所述全景视频画面;
    只显示所述局部视频画面。
  26. 一种计算机可读存储介质,所述计算机可读存储介质上存储有视频画面输出程序,所述视频画面输出程序被处理器执行时实现如权利要求1至5中任一项所述视频画面输出方法的步骤。
  27. 一种计算机可读存储介质,所述计算机可读存储介质上存储有视频画面查看程序,所述视频画面查看程序被处理器执行时实现如权利要求11至18中任一项所述视频画面查看方法的步骤。
PCT/CN2018/085134 2017-05-25 2018-04-28 一种视频画面的输出、查看方法及装置 WO2018214707A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18806645.0A EP3633998A4 (en) 2017-05-25 2018-04-28 METHOD AND DEVICE FOR PRODUCING AND EXAMINING A VIDEO FRAME
US16/615,401 US20200184600A1 (en) 2017-05-25 2018-04-28 Method and device for outputting and examining a video frame

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710381050.2 2017-05-25
CN201710381050.2A CN108933920B (zh) 2017-05-25 2017-05-25 一种视频画面的输出、查看方法及装置

Publications (1)

Publication Number Publication Date
WO2018214707A1 true WO2018214707A1 (zh) 2018-11-29

Family

ID=64396221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/085134 WO2018214707A1 (zh) 2017-05-25 2018-04-28 一种视频画面的输出、查看方法及装置

Country Status (4)

Country Link
US (1) US20200184600A1 (zh)
EP (1) EP3633998A4 (zh)
CN (1) CN108933920B (zh)
WO (1) WO2018214707A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688328A (zh) * 2018-12-20 2019-04-26 北京伊神华虹系统工程技术有限公司 一种基于不同点位摄像机的视频拼接融合及分割的方法和装置
CN110675354A (zh) * 2019-09-11 2020-01-10 北京大学 发育生物学的图像处理方法、系统及存储介质
CN111371985A (zh) * 2019-09-17 2020-07-03 杭州海康威视系统技术有限公司 视频播放方法、装置、电子设备及存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110166764B (zh) * 2018-02-14 2022-03-01 阿里巴巴集团控股有限公司 虚拟现实vr直播中的视角同步方法及装置
CN111327823A (zh) * 2020-02-28 2020-06-23 深圳看到科技有限公司 视频生成方法、装置及对应的存储介质
CN113726465B (zh) * 2020-05-26 2022-12-27 华为技术有限公司 时间戳同步方法和设备
CN111654676B (zh) * 2020-06-10 2021-11-19 上海趣人文化传播有限公司 一种协作拍摄系统及其拍摄方法
CN111741274B (zh) * 2020-08-25 2020-12-29 北京中联合超高清协同技术中心有限公司 一种支持画面局部放大和漫游的超高清视频监看方法
CN112954452B (zh) * 2021-02-08 2023-07-18 广州酷狗计算机科技有限公司 视频生成方法、装置、终端及存储介质
CN113113128A (zh) * 2021-04-15 2021-07-13 王小娟 基于vr、算法和5g技术的医疗手术辅助系统以及方法
CN113938651A (zh) * 2021-10-12 2022-01-14 北京天玛智控科技股份有限公司 全景视频交互的监控方法、监控系统、装置及存储介质
CN115379122B (zh) * 2022-10-18 2023-01-31 鹰驾科技(深圳)有限公司 一种视频内容动态拼接方法、系统及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685445A (zh) * 2012-04-27 2012-09-19 华为技术有限公司 网真视频图像输送方法、设备及网真系统
US20150181258A1 (en) * 2013-12-19 2015-06-25 Electronics And Telecommunications Research Institute Apparatus and method for providing multi-angle viewing service
CN105991992A (zh) * 2016-06-21 2016-10-05 浩云科技股份有限公司 全空间同步监控摄像系统
CN106534716A (zh) * 2016-11-17 2017-03-22 三星电子(中国)研发中心 一种全景视频的传输和显示方法

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101841694A (zh) * 2009-03-19 2010-09-22 新奥特硅谷视频技术有限责任公司 一种法庭庭审全景视频图像转播方法
CN101841695A (zh) * 2009-03-19 2010-09-22 新奥特硅谷视频技术有限责任公司 一种全景视频的法庭庭审转播监督系统
CN101521745B (zh) * 2009-04-14 2011-04-13 王广生 一组多镜头光心重合式全方位摄像装置及全景摄像、转播的方法
US9766089B2 (en) * 2009-12-14 2017-09-19 Nokia Technologies Oy Method and apparatus for correlating and navigating between a live image and a prerecorded panoramic image
ES2675802T3 (es) * 2011-02-18 2018-07-12 Alcatel Lucent Procedimiento y aparato para transmitir y recibir un flujo de video panorámico
EP2645713A1 (en) * 2012-03-30 2013-10-02 Alcatel Lucent Method and apparatus for encoding a selected spatial portion of a video stream
WO2016024892A1 (en) * 2014-08-13 2016-02-18 Telefonaktiebolaget L M Ericsson (Publ) Immersive video
CN104243920B (zh) * 2014-09-04 2017-09-26 浙江宇视科技有限公司 一种基于基本流视频数据封装的图像拼接方法及装置
US20160277772A1 (en) * 2014-09-30 2016-09-22 Telefonaktiebolaget L M Ericsson (Publ) Reduced bit rate immersive video
SE538494C2 (sv) * 2014-11-07 2016-08-02 BAE Systems Hägglunds AB Omvärldsuppfattningssystem och förfarande för omvärldsuppfattning i stridsfordon
EP3222042B1 (en) * 2014-11-17 2022-07-27 Yanmar Power Technology Co., Ltd. Display system for remote control of working machine
CN104539896B (zh) * 2014-12-25 2018-07-10 桂林远望智能通信科技有限公司 一种全景监控与热点特写的智能监控系统及方法
CN104735464A (zh) * 2015-03-31 2015-06-24 华为技术有限公司 一种全景视频交互传输方法、服务器和客户端
US10003740B2 (en) * 2015-07-13 2018-06-19 Futurewei Technologies, Inc. Increasing spatial resolution of panoramic video captured by a camera array
CN105335932B (zh) * 2015-12-14 2018-05-18 北京奇虎科技有限公司 多路图像采集拼合方法及系统
CN105916036A (zh) * 2015-12-18 2016-08-31 乐视云计算有限公司 视频画面切换方法和装置
CN105635675B (zh) * 2015-12-29 2019-02-22 北京奇艺世纪科技有限公司 一种全景播放方法和装置
CN105491353B (zh) * 2016-01-15 2018-12-18 广东小天才科技有限公司 一种远程监控方法和装置
CN105791882B (zh) * 2016-03-22 2018-09-18 腾讯科技(深圳)有限公司 视频编码方法及装置
CN105916060A (zh) * 2016-04-26 2016-08-31 乐视控股(北京)有限公司 数据传输的方法、装置及系统
CN106254916A (zh) * 2016-08-09 2016-12-21 乐视控股(北京)有限公司 直播播放方法及装置
CN106210703B (zh) * 2016-09-08 2018-06-08 北京美吉克科技发展有限公司 Vr环境中特写镜头的运用及显示方法和系统
CN106383576B (zh) * 2016-09-08 2019-06-14 北京美吉克科技发展有限公司 Vr环境中显示体验者身体局部的方法及系统
CN106412669B (zh) * 2016-09-13 2019-11-15 微鲸科技有限公司 一种全景视频渲染的方法和设备
CN106534780A (zh) * 2016-11-11 2017-03-22 广西师范大学 三维全景视频监控装置及其视频图像处理方法
CN106686397A (zh) * 2016-12-31 2017-05-17 北京星辰美豆文化传播有限公司 一种多人网络直播方法、装置及其电子设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685445A (zh) * 2012-04-27 2012-09-19 华为技术有限公司 网真视频图像输送方法、设备及网真系统
US20150181258A1 (en) * 2013-12-19 2015-06-25 Electronics And Telecommunications Research Institute Apparatus and method for providing multi-angle viewing service
CN105991992A (zh) * 2016-06-21 2016-10-05 浩云科技股份有限公司 全空间同步监控摄像系统
CN106534716A (zh) * 2016-11-17 2017-03-22 三星电子(中国)研发中心 一种全景视频的传输和显示方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3633998A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688328A (zh) * 2018-12-20 2019-04-26 北京伊神华虹系统工程技术有限公司 一种基于不同点位摄像机的视频拼接融合及分割的方法和装置
CN110675354A (zh) * 2019-09-11 2020-01-10 北京大学 发育生物学的图像处理方法、系统及存储介质
CN110675354B (zh) * 2019-09-11 2022-03-22 北京大学 发育生物学的图像处理方法、系统及存储介质
CN111371985A (zh) * 2019-09-17 2020-07-03 杭州海康威视系统技术有限公司 视频播放方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN108933920B (zh) 2023-02-17
EP3633998A4 (en) 2020-11-18
EP3633998A1 (en) 2020-04-08
CN108933920A (zh) 2018-12-04
US20200184600A1 (en) 2020-06-11

Similar Documents

Publication Publication Date Title
WO2018214707A1 (zh) 一种视频画面的输出、查看方法及装置
US9313400B2 (en) Linking-up photographing system and control method for linked-up cameras thereof
EP3367662B1 (en) Control device, camera system, and program
US20140244858A1 (en) Communication system and relaying device
US20100045773A1 (en) Panoramic adapter system and method with spherical field-of-view coverage
CN111726520B (zh) 摄影装置、摄影系统、图像处理方法
KR20130112574A (ko) 확대된 영상의 화질을 개선하기 위한 장치 및 방법
CN106296589B (zh) 全景图像的处理方法及装置
US8830264B2 (en) Method and apparatus for providing image to device
KR20130037998A (ko) 디스플레이 장치 및 그 디스플레이 방법
CN105554372A (zh) 一种拍摄方法以及装置
WO2022237287A1 (zh) 一种图像的显示方法及电子设备
CN105812640A (zh) 球型全景摄像装置及其视频图像传输方法
JP4583717B2 (ja) 撮像装置及び方法、画像情報提供システム、プログラム、並びに制御装置
JP2010034652A (ja) 多方位カメラ搭載型携帯端末装置
KR102108246B1 (ko) 휴대 단말에서의 영상 제공 방법 및 그 장치
CN111061123B (zh) 一种旅游景观展示的旋转全景成像系统及使用方法
JPH08336128A (ja) 映像視聴装置
JP4001233B2 (ja) パノラマ撮影方法およびその方法を利用可能な画像処理装置と画像撮像装置
WO2020238312A1 (zh) 一种拍摄方法及装置、存储介质、电子装置
JP2012034099A (ja) データ送信装置
KR101193129B1 (ko) 다자 동시 제어를 허용하는 실시간 원격 360도 전방향 영상 감시 시스템
JPH11243508A (ja) 画像表示装置
TWI832597B (zh) 可執行多鏡頭智能切換之電子裝置及其多鏡頭智能切換方法
CN110875998A (zh) 全景照相装置及其影像映射结合方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18806645

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2018806645

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2018806645

Country of ref document: EP

Effective date: 20200102