WO2021170123A1 - Video generation method and device, and corresponding storage medium - Google Patents

Video generation method and device, and corresponding storage medium Download PDF

Info

Publication number
WO2021170123A1
WO2021170123A1 PCT/CN2021/078311 CN2021078311W WO2021170123A1 WO 2021170123 A1 WO2021170123 A1 WO 2021170123A1 CN 2021078311 W CN2021078311 W CN 2021078311W WO 2021170123 A1 WO2021170123 A1 WO 2021170123A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
screen
flat screen
parameters
flat
Prior art date
Application number
PCT/CN2021/078311
Other languages
French (fr)
Chinese (zh)
Inventor
陈丹
邢冬逢
Original Assignee
深圳看到科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳看到科技有限公司 filed Critical 深圳看到科技有限公司
Publication of WO2021170123A1 publication Critical patent/WO2021170123A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Definitions

  • the present invention relates to the field of image processing technology, in particular to a video generation method, device and corresponding storage medium.
  • the picture taken by the existing panoramic camera is a panoramic picture, and some users only need to watch the flat picture of a part of the area, so the panoramic camera is required to transmit the panoramic picture to the editing terminal for panoramic picture editing to generate the corresponding plane The screen is then shared to the corresponding user terminal.
  • the existing panoramic camera cannot generate the corresponding flat image in real time, resulting in low image editing efficiency of the existing panoramic camera, and cannot meet the user's demand for viewing the panoramic editing image in real time.
  • the embodiments of the present invention provide a video generation method and a video generation device that can improve the screen editing efficiency of a panoramic camera and meet the needs of users for viewing panoramic editing screens in real time; to solve the problem of relatively low screen editing efficiency of the existing video generation methods and video generation devices , Can not meet the technical problem of the user's need to watch the panoramic editing screen in real time.
  • the embodiment of the present invention provides a video generation method for a panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, and a rear camera arranged on the rear side of the body.
  • the preview display screen is used to display the corresponding flat screen video; wherein the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameter;
  • the embodiment of the present invention also provides a video generating device, which is set in a panoramic camera, and is used for the panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, A rear panoramic camera arranged on the rear side of the body and a preview display screen arranged on the rear side of the body, wherein the video generating device includes:
  • a photographing module configured to use the front panoramic camera and the rear panoramic camera to take a panoramic picture video
  • the display module is configured to use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; wherein the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, and projection mode Parameters and screen display ratio parameters;
  • the adjustment module is used to receive a user’s flat screen video parameter adjustment instruction, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and use the preview display screen to display the adjusted flat screen video;
  • the start recording module is configured to receive a video shooting start instruction, and start recording the flat screen video of the preview display screen according to the video shooting start instruction;
  • the end recording module is configured to receive a video shooting end instruction, and end recording the flat screen video of the preview display screen according to the video shooting end instruction.
  • the video generating device further includes:
  • the video sending module is used to send the flat screen video to other terminals; or synthesize the flat screen video and the panoramic screen video into a picture-in-picture video and send it to other terminals.
  • the adjustment module is specifically configured to display the field of view parameters, the field of view parameters, and the screen display of the flat screen video based on the user's touch screen adjustment operation on the preview display screen.
  • Scale parameters are adjusted; wherein the touch screen adjustment operations include screen drag operations, screen zoom operations, and screen setting operations.
  • the adjustment module is further configured to determine at least two tracking objects in the panoramic image video based on the user's selection operation of the image objects on the preview display screen, and to predict Set the flat screen video parameter or the adjusted video parameter to display any flat screen video of the tracked object;
  • the start recording module is further configured to start recording at least two flat screen videos of the tracking object according to the video shooting start instruction;
  • the end recording module is further configured to end recording of at least two flat screen videos of the tracking object according to the video shooting start instruction.
  • the adjustment module is further configured to switch the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction.
  • the video generating device further includes:
  • the video sending module is used to synthesize at least two flat screen videos of tracking objects and the panoramic screen video into picture-in-picture videos and send them to other terminals.
  • the start recording module is further configured to: when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; obtain the rear panoramic screen video shot by the rear panoramic camera Mirror image video in, wherein the viewing angle parameters of the plane image video and the mirror image video differ by 180 degrees; start recording the plane image video of the preview display screen and the corresponding mirror image video according to the video shooting start instruction;
  • the end recording module is further configured to end recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
  • the video generating device further includes:
  • the video sending module is used to send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video, and Send to other terminals.
  • An embodiment of the present invention also provides a computer-readable storage medium, which stores processor-executable instructions, and the instructions are loaded by one or more processors to execute any of the foregoing video generation methods.
  • the video generation method and the video generation device of the present invention can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera can shoot the panoramic screen video at the same time.
  • Generate the corresponding flat screen video improve the screen editing efficiency of the panoramic camera, and meet the needs of users to watch the panoramic editing screen in real time; effectively solve the problem of the low editing efficiency of the existing video generation methods and video generation devices, which cannot satisfy users Real-time viewing of the technical problem of the demand for panoramic editing screens.
  • Fig. 1a is a front view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention
  • FIG. 1b is a side view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention
  • Fig. 1c is a rear view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention
  • Figure 2 is a video generation flowchart of the first embodiment of the video generation method of the present invention.
  • Fig. 3 is a video generation flowchart of the second embodiment of the video generation method of the present invention.
  • FIG. 4 is a video generation flowchart of the third embodiment of the video generation method of the present invention.
  • FIG. 5 is a schematic structural diagram of the first embodiment of the video generating device of the present invention.
  • Fig. 6 is a schematic structural diagram of a second embodiment of a video generating device of the present invention.
  • Fig. 7 is a schematic structural diagram of a third embodiment of a video generating device of the present invention.
  • FIG. 8 is a flowchart of a specific embodiment of the video generation method and video generation device of the present invention.
  • FIGS 9a-9e are schematic diagrams of specific embodiments of the video generation method and video generation device of the present invention.
  • FIG. 10 is a schematic diagram of the working environment structure of the electronic device where the video generating apparatus of the present invention is located.
  • the video generation method and the video generation device of the present invention are set in the panoramic camera, and are used to edit the panoramic screen video shot by the panoramic camera to generate the corresponding flat screen video, so that the panoramic camera generates the corresponding flat screen while shooting the panoramic screen video.
  • the screen video improves the screen editing efficiency of the panoramic camera and meets the needs of users to watch the panoramic editing screen in real time.
  • FIG. 1a is a front view of a panoramic camera corresponding to an embodiment of a video generation method of the present invention
  • FIG. 1b is a side view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention
  • Fig. 1c is a rear view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention.
  • the panoramic camera 10 corresponding to the video generation method of this embodiment includes a body 11, a front panoramic camera 12 arranged on the front side of the body 11, a rear panoramic camera 13 arranged on the rear side of the body 11, and a preview display screen arranged on the rear side of the body 11. 14. And a panoramic camera control key 15 arranged on the rear side of the body 11.
  • the front panoramic camera 12 is used to shoot the front panoramic screen video of at least 180 degrees on the front side of the body
  • the rear panoramic camera 13 is used to shoot the rear panoramic screen video of at least 180 degrees on the back of the body.
  • the front panoramic screen video and the rear panoramic screen video can be combined. Become a 360-degree panoramic screen video.
  • the preview display screen 14 is used to preview part of the flat screen video in the panoramic screen video
  • the panoramic camera control key 15 is used to control the panoramic camera to shoot the panoramic screen video and edit the flat screen video.
  • FIG. 2 is a video generation flowchart of the first embodiment of the video generation method of the present invention.
  • the video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
  • Step S201 using the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video
  • Step S202 using the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; wherein the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
  • Step S203 receiving the user's flat screen video parameter adjustment instruction, adjusting the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and displaying the adjusted flat screen video using the preview display screen;
  • Step S204 receiving a video shooting start instruction, and starting to record the flat screen video of the preview display screen according to the video shooting start instruction;
  • Step S205 receiving a video shooting end instruction, and ending the recording of the flat screen video on the preview display screen according to the video shooting end instruction;
  • Step S206 Send the flat screen video to other terminals; or synthesize the flat screen video and the panoramic screen video into a picture-in-picture video, and send it to other terminals.
  • step S201 the video generating device (ie, panoramic camera, etc.) uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
  • the video generating device ie, panoramic camera, etc.
  • step S202 the video generating device obtains preset flat screen video parameters, the flat screen video parameters are used to generate the corresponding flat screen video, the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
  • the angle of view adjustment indicates the display angle of the flat screen video, such as a flat screen video with a 60-degree field of view or a flat screen video with a 120-degree field of view in a 360-degree panoramic screen video.
  • the viewing angle adjustment indicates the display viewing angle range of the flat screen video, such as a flat screen video ranging from 0 degrees to 60 degrees or a flat screen video ranging from 61 degrees to 120 degrees in a 360-degree panoramic screen video.
  • Object tracking refers to an object used for tracking in a flat screen video, and the object can be a person or an object in the panoramic screen video.
  • the projection mode represents the display mode of the flat screen video.
  • the display mode can be perspective projection mode, cylindrical projection mode, asteroid projection mode, and equi-angle projection (Equi projection).
  • the screen display ratio parameter indicates the screen display ratio of the flat screen video, such as 4:3 or 9:16, so that other terminals can play the flat screen video with compatibility.
  • the video generating device uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
  • the preset flat screen video parameters are that the field of view parameter is 120 degrees, the viewing angle parameter is 1 to 120 degrees, the projection mode parameter is the perspective projection mode, and the screen display ratio is 3:4. Then, the preview display screen directly uses the perspective projection mode to convert the panoramic image video with the angle of view from 1 degree to 120 degrees in the panoramic image video into a flat image video with an image display ratio of 3:4.
  • the preset flat screen video parameter is the field of view parameter of 120 degrees
  • the tracking object is a red ball
  • the projection mode parameter is the perspective projection mode
  • the screen display ratio is 3:4. Then, the preview display screen directly converts the panoramic image video in the panoramic image video in the area of the 120-degree field of view centered on the red ball into the flat image video with the image display ratio of 3:4 in the perspective projection mode.
  • the video generating device may receive the user's instruction for adjusting the flat screen video parameters through the preview display screen or the panoramic camera control key.
  • the flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
  • the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Then the video generating device uses the preview display plane to display the adjusted flat screen video.
  • the video generating device may adjust the video parameters of the flat screen video based on the user's touch screen adjustment operation on the preview display screen.
  • the touch screen adjustment operation can be a screen drag operation, a screen zoom operation, and a screen setting operation of the user on the preview display screen.
  • the screen drag operation means that the user drags the 360-degree flat screen video corresponding to the panoramic screen video on the preview display screen to adjust the viewing angle parameters of the flat screen video, such as changing the area from 1 to 120 degrees in the panoramic screen video
  • the corresponding flat screen video is adjusted to the flat screen video corresponding to the 121 degree to 240 degree area in the panoramic screen video.
  • the screen zoom operation means that the user performs a zoom operation on the 360-degree flat screen video corresponding to the panoramic screen video on the preview display screen to adjust the area size of the flat screen video that can be displayed on the preview display screen, that is, adjust the field of view of the flat screen video Angle parameters.
  • the flat screen video corresponding to the 120-degree area of the panoramic screen video is adjusted to the flat screen video corresponding to the 180-degree area of the panoramic screen video.
  • the screen setting operation is a setting operation for the user to directly set the field of view parameter, the angle of view parameter, or the screen display ratio parameter of the flat screen video on the preview display screen.
  • the user can directly select the corresponding field angle parameter, angle of view parameter or screen display scale parameter on the preview display screen.
  • step S204 when the video parameters of the flat screen video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generation device can start recording the flat screen video of the preview display screen according to the video shooting start instruction .
  • step S205 when the shooting of the flat screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of the flat screen video on the preview display screen according to the video shooting end instruction.
  • step S206 the video generating device sends the flat screen video generated in step S205 to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
  • the video generating device may also synthesize the flat screen video generated in step S205 and the panoramic screen video shot in step S201 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S206 and the 360-degree flat screen video are synthesized, and the flat screen video generated in step S206 is set as the 360-degree flat screen video.
  • the internal video of the video such as setting the flat screen video generated in step S206 in the lower right corner or the upper right corner of the 360-degree flat screen video, etc.
  • the video generating device sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic picture video.
  • the video generation method of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; it improves the screen editing efficiency of the panoramic camera and satisfies The user needs to watch the panoramic editing screen in real time.
  • FIG. 3 is a flow chart of video generation of the second embodiment of the video generation method of the present invention.
  • the video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
  • Step S301 using the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video
  • Step S302 Use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters;
  • the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
  • Step S303 Determine at least two tracking objects in the panoramic image video based on the user's selection operation of the screen object on the preview display screen, and display the flat screen of any tracking object with preset flat screen video parameters or adjusted video parameters video;
  • Step S304 receiving a tracking object switching instruction, and switching the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction;
  • Step S305 receiving a video shooting start instruction, and starting to record at least two flat screen videos of the tracking object according to the video shooting start instruction;
  • Step S306 receiving a video shooting end instruction, and ending recording of at least two flat screen videos of the tracking object according to the video shooting start instruction;
  • step S307 the flat screen video and the panoramic screen video of the at least two tracking objects are synthesized into a picture-in-picture video and sent to other terminals.
  • step S301 the video generating device uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
  • step S302 the video generating device obtains a preset flat screen video parameter, which is used to generate a corresponding flat screen video, and the preset flat screen video parameter includes a field of view parameter, a viewing angle parameter, an object tracking parameter, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
  • the video generating device uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
  • step S303 the video generation device acquires the user's screen object selection operation on the preview display screen.
  • the screen object selection operation can be a user's click operation or long press operation on a specific object on the preview display screen, so that the video generation device will The specific object in this area is distinguished from the background area in the panoramic image video, and the method for determining the area of the specific object can use the existing image object recognition method, which will not be elaborated here.
  • the user can determine at least two tracking objects (specific objects) in the panoramic image video through the screen object selection operation.
  • the video generation device can use the preview display screen to display any tracking object in the form of a flat screen video, and map the plane
  • the video parameter of the screen video is set to the preset flat screen video parameter or the video parameter adjusted by the user.
  • the video generating device may obtain the user's tracking object switching instruction on the panoramic camera (issued through the preview display screen or the panoramic camera control key). Subsequently, the video generating device switches the tracking objects in the flat screen video displayed on the preview display screen according to the tracking object switching instruction, so that the user can watch multiple flat screen videos with tracking objects in real time.
  • step S305 when the video parameters of the flat screen video and the corresponding tracking objects are set, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generating device can start recording at least two video recordings according to the video shooting start instruction.
  • step S306 when the shooting of the flat screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of at least two flat screen videos of the tracking object according to the video shooting end instruction.
  • step S307 the video generating device synthesizes the flat screen video generated in step S306 and the panoramic screen video shot in step S301 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S306 is synthesized with the 360-degree flat screen video, and the flat screen video generated in step S306 is set to the 360-degree flat screen video.
  • Video internal screen such as setting multiple flat screen videos generated in step S306 in the lower right corner and upper right corner of a 360-degree flat screen video at the same time, or setting multiple flat screen videos generated in step S306 on a 360-degree flat screen Carousel in the lower right or upper right corner of the video.
  • the video generating device sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic picture video.
  • the video generation method of this embodiment can adjust the video parameters of the flat-screen video through the preview display screen, and can simultaneously select multiple tracking objects through the flat-screen video, and form multiple corresponding flat-screen videos. Therefore, the panoramic camera generates multiple corresponding flat screen videos while shooting the panoramic screen video, which improves the screen editing efficiency of the panoramic camera and satisfies the user's demand for viewing the panoramic editing screen in real time.
  • FIG. 4 is a video generation flowchart of the third embodiment of the video generation method of the present invention.
  • the video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
  • Step S401 using the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video
  • Step S402 Use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters;
  • the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
  • Step S403 receiving the user's flat screen video parameter adjustment instruction, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and display the adjusted flat screen video using the preview display screen;
  • Step S404 when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; acquire the mirror image video in the rear panoramic screen video shot by the rear panoramic camera, where the angle parameters of the flat screen video and the mirror image video differ by 180 degrees;
  • Step S405 Receive a video shooting start instruction, and start recording the flat screen video of the preview display screen and the corresponding mirror image video according to the video shooting start instruction;
  • Step S406 receiving a video shooting end instruction, and ending the recording of the flat screen video of the preview display screen and the corresponding mirror image video according to the video shooting end instruction;
  • Step S407 Send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video and send it to other terminals.
  • step S401 the video generating device uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
  • step S402 the video generating device obtains a preset flat screen video parameter, the flat screen video parameter is used to generate a corresponding flat screen video, and the preset flat screen video parameter includes a field of view parameter, a viewing angle parameter, an object tracking parameter, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
  • the video generating device may receive the user's instruction for adjusting the flat screen video parameters through the preview display screen or the panoramic camera control key.
  • the flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
  • the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Then the video generating device uses the preview display plane to display the adjusted flat screen video.
  • step S404 since the panoramic camera of this embodiment is a portable handheld camera, the front panoramic camera of the panoramic camera is generally used to capture the scenery or people in front of the user, and the rear panoramic camera of the panoramic camera is generally used to capture the user's selfie. .
  • the angle of view parameters of the area where the shooting target is captured by the front panoramic camera and the angle of view parameters of the user's observation area captured by the rear panoramic camera are generally different by 180 degrees, so that the panoramic camera can save the shooting target captured by the front panoramic camera and the rear panoramic camera at the same time. Of users shoot emoticons.
  • the video generation device When the flat screen video determined in step S403 belongs to the front panoramic screen video shot by the front panoramic camera (such as the scene screen video or the character screen video), the video generation device will simultaneously acquire the mirror image video in the rear panoramic screen video shot by the rear panoramic camera.
  • the viewing angle parameters of the flat screen video and the mirror screen video differ by 180 degrees.
  • step S405 when the video parameters of the flat screen video and the corresponding mirror image video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generating device can start recording and previewing according to the video shooting start instruction
  • step S406 when the shooting of the flat screen video and the mirrored screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of the flat screen video on the preview display screen according to the video shooting end instruction .
  • step S407 the video generating device sends the flat screen video generated in step S406 and the corresponding mirror screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
  • the video generating device may also synthesize the flat screen video generated in step S406 and the corresponding mirror screen video with the panoramic screen video shot in step S401 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S406 and the corresponding mirror image video are synthesized with the 360-degree flat screen video, and the flat screen video generated in step S406 and the corresponding The mirror image video is set to the video internal image of the 360-degree flat-screen video, for example, the flat-screen video generated in step S406 and the corresponding mirror-image video are set at the lower right and upper right corners of the 360-degree flat-screen video at the same time, or The flat screen video generated in step S406 and the corresponding mirrored screen video are set in the lower right corner or the upper right corner of the 360-degree flat screen video for carousel.
  • the video generation method of this embodiment can simultaneously track the user's shooting target and the user's facial image through the flat screen video and the mirrored screen video, so that the user can watch the user shooting target in the flat screen video At the same time, you can also view the user's facial images and facial expressions in the mirror image video. It further improves the multi-picture editing efficiency of the panoramic camera, and meets the needs of users to watch multiple panoramic editing pictures.
  • the present invention also provides a video generating device.
  • FIG. 5 is a schematic structural diagram of the first embodiment of the video generating device of the present invention.
  • the video generation device of this embodiment can be implemented using the first embodiment of the above-mentioned video generation method.
  • the video generation device 50 of this embodiment includes a shooting module 51, a display module 52, an adjustment module 53, a start recording module 54, and an end recording Module 55 and video sending module 56.
  • the photographing module 51 is used to use the front panoramic camera and the rear panoramic camera to take panoramic picture videos; the display module 52 is used to display the corresponding flat picture video using the preview display screen according to the preset flat picture video parameters; wherein the preset flat picture video
  • the parameters include field of view parameters, viewing angle parameters, object tracking parameters, projection mode parameters, and screen display scale parameters;
  • the adjustment module 53 is used to receive the user's flat screen video parameter adjustment instruction, and adjust the flat screen video according to the flat screen video parameter adjustment instruction Adjust the video parameters of the preview display screen, and use the preview display screen to display the adjusted flat screen video;
  • the start recording module 54 is used to receive the video shooting start instruction, and start recording the flat screen video of the preview display screen according to the video shooting start instruction; end the recording module 55 is used to receive the video shooting end instruction, and according to the video shooting end instruction to end the recording of the flat screen video on the preview display screen;
  • the video sending module 56 is used to send the flat screen video to other terminals; or combine the flat screen video and the panoramic screen
  • the shooting module 51 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
  • the display module 52 obtains the preset flat screen video parameters, which are used to generate the corresponding flat screen video.
  • the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
  • the display module 52 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
  • the adjustment module 53 can receive the user's flat screen video parameter adjustment instruction through the preview display screen or the panoramic camera control key.
  • the flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
  • the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user.
  • the adjustment module 53 uses the preview display plane to perform a display operation on the adjusted flat screen video.
  • the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the recording start module 54 can start recording the flat screen video on the preview display screen according to the video shooting start instruction.
  • the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 55 can end recording the flat screen video on the preview display screen according to the video shooting end instruction.
  • the video sending module 56 sends the generated flat screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
  • the video sending module 56 can also synthesize the generated flat screen video and the panoramic screen video to form a picture-in-picture video. Subsequently, the video sending module 56 sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic image video.
  • the specific working principle of the video generating apparatus in this embodiment is the same as or similar to the specific description in the first embodiment of the foregoing video generating method.
  • the video generating device of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; the screen editing efficiency of the panoramic camera is improved and satisfies The user needs to watch the panoramic editing screen in real time.
  • FIG. 6 is a schematic structural diagram of a second embodiment of a video generating device of the present invention.
  • the video generation device of this embodiment can be implemented using the second embodiment of the above-mentioned video generation method.
  • the video generation device 60 of this embodiment includes a shooting module 61, a display module 62, an adjustment module 63, a start recording module 64, and an end recording Module 65 and video sending module 66.
  • the adjustment module 63 of the video generating device 60 of this embodiment is further configured to determine at least two tracking objects in the panoramic image video based on the user's screen object selection operation on the preview display screen, and Display the flat screen video of any tracking object with preset flat screen video parameters or adjusted video parameters; and switch the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction.
  • the recording start module 64 is further configured to start recording the flat screen video of at least two tracking objects according to the video shooting start instruction.
  • the end recording module 65 is further configured to end recording the flat screen video of at least two tracking objects according to the video shooting start instruction.
  • the video sending module 66 is also used to synthesize the flat screen video and the panoramic screen video of at least two tracking objects into a picture-in-picture video, and send it to other terminals.
  • the shooting module 61 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video based on the panoramic screen video.
  • the display module 62 then obtains the preset flat screen video parameters, the flat screen video parameters are used to generate the corresponding flat screen video, the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
  • the display module 62 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
  • the adjustment module 63 obtains the user's screen object selection operation on the preview display screen.
  • the screen object selection operation can be a user's click operation or long press operation on a specific object on the preview display screen, so that the video generation device 60 can select the area
  • the specific object is distinguished from the background area in the panoramic image video, and the method for determining the area of the specific object can use the existing image object recognition method, which will not be elaborated here.
  • the user can determine at least two tracking objects (specific objects) in the panoramic image video through the screen object selection operation.
  • the adjustment module 63 can use the preview display screen to display any tracking object in the form of a flat screen video, and set the plane
  • the video parameter of the screen video is set to the preset flat screen video parameter or the video parameter adjusted by the user.
  • the adjustment module 63 can obtain the user's tracking object switching instruction on the panoramic camera (issued through the preview display screen or the panoramic camera control key). Subsequently, the adjustment module 63 switches the tracking objects in the flat screen video displayed on the preview display screen according to the tracking object switching instruction, so that the user can watch multiple flat screen videos with tracking objects in real time.
  • the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, and the start recording module 64 can start recording at least two tracking objects according to the video shooting start instruction.
  • Flat screen video When the video parameters of the flat screen video and the corresponding tracking objects are set, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, and the start recording module 64 can start recording at least two tracking objects according to the video shooting start instruction.
  • the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 65 can end the recording of at least two flat screen videos of tracking objects according to the video shooting end instruction.
  • the video sending module 66 synthesizes the generated flat screen video and the shot panoramic screen video to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the generated flat screen video is synthesized with the 360-degree flat screen video, and the generated flat screen video is set to the internal video of the 360-degree flat screen video. For example, set the generated multiple flat screen videos in the lower right corner and upper right corner of the 360-degree flat screen video at the same time, or set the generated multiple flat screen videos in the lower right or upper right corner of the 360-degree flat screen video. Carousel.
  • the video sending module 66 sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic image video.
  • the video generating device of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, and can simultaneously select multiple tracking objects through the flat screen video, and form multiple corresponding flat screen videos. Therefore, the panoramic camera generates multiple corresponding flat screen videos while shooting the panoramic screen video, which improves the screen editing efficiency of the panoramic camera and satisfies the user's demand for viewing the panoramic editing screen in real time.
  • FIG. 7 is a schematic structural diagram of a third embodiment of a video generating device of the present invention.
  • the video birth device of this embodiment can be implemented using the third embodiment of the above-mentioned video generation method.
  • the video generation device 70 of this embodiment includes a shooting module 71, a display module 72, an adjustment module 73, a start recording module 74, and an end recording Module 75 and video sending module 76.
  • the start recording module 74 of the video generating device 70 of this embodiment is also used for when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; to obtain the rear panoramic screen video shot by the rear panoramic camera In the mirror image video in, the angle of view parameters of the plane image video and the mirror image video differ by 180 degrees; according to the video shooting start instruction, start to record the plane image video of the preview display screen and the corresponding mirror image video.
  • the end recording module 75 is further configured to end recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
  • the video sending module 76 is used to send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video, and send it to other terminals.
  • the shooting module 71 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
  • the display module 72 then obtains the preset flat screen video parameters, which are used to generate the corresponding flat screen video.
  • the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
  • the display module 72 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
  • the adjustment module 73 can receive the user's flat screen video parameter adjustment instruction through the preview display screen or the panoramic camera control key.
  • the flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
  • the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user.
  • the adjustment module 73 uses the preview display plane to perform a display operation on the adjusted flat screen video.
  • the panoramic camera of this embodiment is a portable handheld camera
  • the front panoramic camera of the panoramic camera is generally used to photograph the scenery or people in front of the user
  • the rear panoramic camera of the panoramic camera is generally used to photograph the user's selfie.
  • the angle of view parameters of the area where the shooting target is captured by the front panoramic camera and the angle of view parameters of the user's observation area captured by the rear panoramic camera are generally different by 180 degrees, so that the panoramic camera can save the shooting target captured by the front panoramic camera and the rear panoramic camera at the same time. Of users shoot emoticons.
  • the start recording module 74 will simultaneously obtain the mirror image video in the rear panoramic screen video shot by the rear panoramic camera.
  • the viewing angle parameters of the flat screen video and the mirror screen video differ by 180 degrees.
  • the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, and the start recording module 74 can start recording the flat screen of the preview display screen according to the video shooting start instruction Video and corresponding mirror image video
  • the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 75 can end recording the flat screen video on the preview display screen according to the video shooting end instruction.
  • the video sending module 76 sends the generated flat screen video and the corresponding mirrored screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
  • the video sending module 76 may also synthesize the generated flat screen video and the corresponding mirror screen video with the captured panoramic screen video to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the generated flat screen video and the corresponding mirrored screen video are synthesized with the 360-degree flat screen video, and the generated flat screen video and the corresponding mirrored screen video are set
  • the internal video of the 360-degree flat-screen video, such as the generated flat-screen video and the corresponding mirror image video are set at the lower right and upper right corners of the 360-degree flat-screen video at the same time, or the flat-screen video that will be generated
  • the corresponding mirror image video is set in the lower right corner or upper right corner of the 360-degree flat screen video for carousel.
  • the video generation device of this embodiment can simultaneously track the user's shooting target and the user's facial image through the flat screen video and the mirror image video, so that the user can watch the user's shooting target in the flat screen video. At the same time, you can also view the user's facial images and facial expressions in the mirror image video. It further improves the multi-picture editing efficiency of the panoramic camera, and meets the needs of users to watch multiple panoramic editing pictures.
  • Figure 8 is a flow chart of specific embodiments of the video generation method and video generation device of the present invention
  • Figures 9a-9e are schematic diagrams of specific embodiments of the video generation method and video generation device of the present invention.
  • the video generating device of this embodiment is set on the portable handheld panoramic camera as shown in Fig. 1a to Fig. 1c.
  • the process of generating the corresponding flat screen video by the portable handheld panoramic camera (referred to as the panoramic camera) includes:
  • Step S801 the panoramic camera uses the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video;
  • Step S802 the panoramic camera uses the preview display screen to display the corresponding flat screen video 91 (the panoramic screen video corresponds to the 360-degree flat screen video 92) according to the preset flat screen video parameters.
  • the panoramic camera sets the flat screen
  • the field of view corresponding to the video is 120 degrees, and the angle of view is 31 degrees to 150 degrees, that is, the range of angle of view directly in front of the panoramic camera.
  • the projection mode is perspective projection mode, and the screen display ratio is 3:4. The details can be shown in Figure 9a.
  • step S803 the user can perform a touch screen adjustment operation on the flat screen video on the preview display screen, so as to adjust the video parameters of the flat screen video.
  • the display area of the flat screen video in the preview display screen can be dragged by the screen drag operation to adjust the viewing angle range of the flat screen video. For example, it can be dragged from the range of 31 degrees to 150 degrees to the range of 1 degree to 120 degrees. , As shown in Figure 9b.
  • the panoramic camera can also determine multiple tracking objects through the user's screen object selection operation on the preview display screen. For example, the user long-presses and clicks a specific object on the preview display screen as the tracking object, such as As shown in Figure 9c, the user can select tracking object A and tracking object B through the preview display screen, and then the panoramic camera will preset the flat screen video parameters (such as field of view parameters or projection mode parameters, etc., field of view parameters and object The setting of tracking parameters is invalid at this time) Generate flat screen video corresponding to tracking object A and tracking object B. In this way, the panoramic camera can simultaneously set up multiple images of tracking objects, as shown by the dashed box in Figure 9c.
  • the panoramic camera can simultaneously set up multiple images of tracking objects, as shown by the dashed box in Figure 9c.
  • the panoramic camera can also simultaneously obtain the mirror image video in the rear panoramic screen video shot by the rear panoramic camera. , As shown in Figure 9d.
  • the panoramic camera can simultaneously record the subject video 93 in the front panoramic image video and the user's face video 94 in the rear panoramic image video, as shown by the dashed box in FIG. 9d.
  • Step S804 the panoramic camera receives the video shooting start instruction, and according to the video shooting start instruction, starts to record the flat screen video of the set video parameters of the preview display screen, the flat screen video of multiple tracking objects, and the flat screen of the set video parameters. Video and the corresponding mirror image video.
  • step S805 the panoramic camera receives the video shooting end instruction, and according to the video shooting end instruction, ends the recording of a flat screen video with set video parameters on the preview display screen, flat screen videos with multiple tracking objects, and a flat screen set with video parameters Video and the corresponding mirror image video.
  • step S806 the panoramic camera synthesizes the above-mentioned flat screen video and the corresponding mirror image video and the 360-degree panoramic screen video into a corresponding picture-in-picture video, and sends it to other terminals.
  • the flat screen video 96 and the mirrored screen video 97 generated in step S805 can be located in the upper right corner and/or the lower right corner of the 360-degree flat screen video 95 converted from the panoramic image video, so that users of other terminals can view the video at the same time.
  • the flat screen video 96, the mirrored screen video 97, and the 360-degree flat screen video 95 of the set area are selected for viewing.
  • the video generation method and the video generation device of the present invention can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; improving the screen editing efficiency of the panoramic camera , To meet the needs of users to watch the panoramic editing screen in real time; effectively solve the technical problem that the existing video generation methods and video generation devices have relatively low screen editing efficiency and cannot meet the needs of users to watch the panoramic editing screen in real time.
  • a component may be, but is not limited to, a process, a processor, an object, an executable application, a thread of execution, a program, and/or a computer running on a processor.
  • a component may be, but is not limited to, a process, a processor, an object, an executable application, a thread of execution, a program, and/or a computer running on a processor.
  • the application running on the controller and the controller can be components.
  • One or more components may exist in an executing process and/or thread, and the components may be located on one computer and/or distributed between two or more computers.
  • Example electronic devices 1012 include, but are not limited to, wearable devices, head-mounted devices, medical and health platforms, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players) Etc.), multi-processor systems, consumer electronic devices, small computers, large computers, distributed computing environments including any of the above systems or devices, etc.
  • Computer readable instructions can be distributed via computer readable media (discussed below).
  • Computer readable instructions can be implemented as program modules, such as functions, objects, application programming interfaces (APIs), data structures, etc. that perform specific tasks or implement specific abstract data types.
  • program modules such as functions, objects, application programming interfaces (APIs), data structures, etc. that perform specific tasks or implement specific abstract data types.
  • APIs application programming interfaces
  • data structures such as lists, etc. that perform specific tasks or implement specific abstract data types.
  • the functions of the computer-readable instructions can be freely combined or distributed in various environments.
  • FIG. 10 illustrates an example of an electronic device 1012 including one or more embodiments in the video generating apparatus of the present invention.
  • the electronic device 1012 includes at least one processing unit 1016 and a memory 1018.
  • the memory 1018 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This configuration is illustrated by the dashed line 1014 in FIG. 10.
  • the electronic device 1012 may include additional features and/or functions.
  • the device 1012 may also include additional storage devices (for example, removable and/or non-removable), including but not limited to magnetic storage devices, optical storage devices, and so on.
  • additional storage devices for example, removable and/or non-removable
  • Such an additional storage device is illustrated by the storage device 1020 in FIG. 10.
  • computer readable instructions for implementing one or more embodiments provided herein may be in the storage device 1020.
  • the storage device 1020 may also store other computer-readable instructions for implementing an operating system, application programs, and the like.
  • the computer readable instructions can be loaded into the memory 1018 and executed by the processing unit 1016, for example.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions or other data.
  • the memory 1018 and the storage device 1020 are examples of computer storage media.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical storage devices, cassette tapes, magnetic tapes, disk storage devices or other magnetic storage devices, Or any other medium that can be used to store desired information and can be accessed by the electronic device 1012. Any such computer storage medium may be part of the electronic device 1012.
  • the electronic device 1012 may also include a communication connection 1026 that allows the electronic device 1012 to communicate with other devices.
  • the communication connection 1026 may include, but is not limited to, a modem, a network interface card (NIC), an integrated network interface, a radio frequency transmitter/receiver, an infrared port, a USB connection, or other interfaces for connecting the electronic device 1012 to other electronic devices.
  • the communication connection 1026 may include a wired connection or a wireless connection.
  • the communication connection 1026 can transmit and/or receive communication media.
  • Computer-readable medium may include communication media.
  • Communication media typically contain computer-readable instructions or other data in a “modulated data signal” such as a carrier wave or other transmission mechanism, and include any information delivery media.
  • modulated data signal may include a signal in which one or more of the characteristics of the signal is set or changed in a manner that encodes information into the signal.
  • the electronic device 1012 may include an input device 1024, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, and/or any other input device.
  • the device 1012 may also include an output device 1022, such as one or more displays, speakers, printers, and/or any other output devices.
  • the input device 1024 and the output device 1022 may be connected to the electronic device 1012 via a wired connection, a wireless connection, or any combination thereof. In one embodiment, an input device or output device from another electronic device may be used as the input device 1024 or output device 1022 of the electronic device 1012.
  • the components of the electronic device 1012 may be connected through various interconnections (such as buses). Such interconnections may include Peripheral Component Interconnect (PCI) (such as PCI Express), Universal Serial Bus (USB), FireWire (IEEE 1394), optical bus structure, and so on.
  • PCI Peripheral Component Interconnect
  • USB Universal Serial Bus
  • FireWire IEEE 1394
  • optical bus structure and so on.
  • the components of the electronic device 1012 may be interconnected through a network.
  • the memory 1018 may be composed of multiple physical memory units located in different physical locations and interconnected by a network.
  • storage devices used to store computer-readable instructions can be distributed across a network.
  • the electronic device 1030 accessible via the network 1028 may store computer-readable instructions for implementing one or more embodiments provided by the present invention.
  • the electronic device 1012 can access the electronic device 1030 and download part or all of the computer-readable instructions for execution.
  • the electronic device 1012 may download multiple computer-readable instructions as needed, or some instructions may be executed at the electronic device 1012 and some instructions may be executed at the electronic device 1030.
  • the one or more operations described may constitute one or more computer-readable instructions stored on a computer-readable medium, which, when executed by an electronic device, will cause the computing device to perform the operations. Describing the order of some or all operations should not be interpreted as implying that these operations must be order-dependent. Those skilled in the art will understand alternative rankings that have the benefit of this description. Moreover, it should be understood that not all operations are necessarily present in every embodiment provided herein.
  • the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.
  • the aforementioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
  • Each of the above-mentioned devices or systems can execute the methods in the corresponding method embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The present invention provides a video generation method, comprising: recording a panoramic picture video by using a front panoramic camera and a rear panoramic camera; displaying a corresponding plane picture video by using a preview display screen; receiving a plane picture video parameter adjustment instruction of a user, adjusting video parameters of the plane picture video, and displaying the adjusted plane picture video by using a preview display screen; receiving a video recording starting instruction, and starting to record a plane picture video on the preview display screen; and receiving a video recording ending instruction, and ending the recording of the plane picture video on the preview display screen. The present invention further provides a video generation device.

Description

视频生成方法、装置及对应的存储介质Video generation method, device and corresponding storage medium 技术领域Technical field
本发明涉及图像处理技术领域,特别是涉及一种视频生成方法、装置及对应的存储介质。The present invention relates to the field of image processing technology, in particular to a video generation method, device and corresponding storage medium.
背景技术Background technique
随着科技的发展,人们对视频图像的要求越来越高,因此一些公司研发出了各种全景相机以满足人们对高品质视频画面的要求。With the development of technology, people have higher and higher requirements for video images. Therefore, some companies have developed various panoramic cameras to meet people's requirements for high-quality video images.
技术问题technical problem
但是现有的全景相机拍摄的画面为全景画面,而部分用户仅仅需要对部分区域的平面画面进行观看,这样就需要全景相机将该全景画面传送至编辑终端进行全景画面编辑,以生成对应的平面画面再分享至相应的用户终端。However, the picture taken by the existing panoramic camera is a panoramic picture, and some users only need to watch the flat picture of a part of the area, so the panoramic camera is required to transmit the panoramic picture to the editing terminal for panoramic picture editing to generate the corresponding plane The screen is then shared to the corresponding user terminal.
由于需要编辑终端对全景画面进行编辑,现有的全景相机不能实时生成对应的平面画面,导致现有的全景相机的画面编辑效率较为低下,不能满足用户实时观看全景编辑画面的需求。Due to the need for an editing terminal to edit the panoramic image, the existing panoramic camera cannot generate the corresponding flat image in real time, resulting in low image editing efficiency of the existing panoramic camera, and cannot meet the user's demand for viewing the panoramic editing image in real time.
故,有必要提供一种视频生成方法及视频生成装置,以解决现有技术所存在的问题。Therefore, it is necessary to provide a video generation method and a video generation device to solve the problems existing in the prior art.
技术解决方案Technical solutions
本发明实施例提供可提高全景相机的画面编辑效率,且满足用户实时观看全景编辑画面需求的视频生成方法及视频生成装置;以解决现有的视频生成方法及视频生成装置的画面编辑效率较为低下,不能满足用户实时观看全景编辑画面的需求的技术问题。The embodiments of the present invention provide a video generation method and a video generation device that can improve the screen editing efficiency of a panoramic camera and meet the needs of users for viewing panoramic editing screens in real time; to solve the problem of relatively low screen editing efficiency of the existing video generation methods and video generation devices , Can not meet the technical problem of the user's need to watch the panoramic editing screen in real time.
本发明实施例提供一种视频生成方法,用于全景相机生成对应平面画面视频,其中所述全景相机包括机体、设置在所述机体前侧的前全景摄像头、设置在所述机体后侧的后全景摄像头以及设置在所述机体后侧的预览显示屏幕,其中所述视频生成方法包括:The embodiment of the present invention provides a video generation method for a panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, and a rear camera arranged on the rear side of the body. A panoramic camera and a preview display screen arranged on the rear side of the body, wherein the video generation method includes:
使用所述前全景摄像头和所述后全景摄像头拍摄全景画面视频;Use the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video;
根据预设平面画面视频参数,使用所述预览显示屏幕显示对应的平面画面视频;其中所述预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;According to the preset flat screen video parameters, the preview display screen is used to display the corresponding flat screen video; wherein the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameter;
接收用户的平面画面视频参数调整指令,并根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整,并使用所述预览显示屏幕显示调整后的平面画面视频;Receiving a flat screen video parameter adjustment instruction from a user, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and display the adjusted flat screen video using the preview display screen;
接收视频拍摄开始指令,并根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频;Receiving a video shooting start instruction, and starting to record the flat screen video of the preview display screen according to the video shooting start instruction;
接收视频拍摄结束指令,并根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频。Receiving a video shooting end instruction, and ending recording of the flat screen video of the preview display screen according to the video shooting end instruction.
本发明实施例还提供一种视频生成装置,设置在全景相机中,用于所述全景相机生成对应平面画面视频,其中所述全景相机包括机体、设置在所述机体前侧的前全景摄像头、设置在所述机体后侧的后全景摄像头以及设置在所述机体后侧的预览显示屏幕,其中所述视频生成装置包括:The embodiment of the present invention also provides a video generating device, which is set in a panoramic camera, and is used for the panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, A rear panoramic camera arranged on the rear side of the body and a preview display screen arranged on the rear side of the body, wherein the video generating device includes:
拍摄模块,用于使用所述前全景摄像头和所述后全景摄像头拍摄全景画面视频;A photographing module, configured to use the front panoramic camera and the rear panoramic camera to take a panoramic picture video;
显示模块,用于根据预设平面画面视频参数,使用所述预览显示屏幕显示对应的平面画面视频;其中所述预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;The display module is configured to use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; wherein the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, and projection mode Parameters and screen display ratio parameters;
调整模块,用于接收用户的平面画面视频参数调整指令,并根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整,并使用所述预览显示屏幕显示调整后的平面画面视频;The adjustment module is used to receive a user’s flat screen video parameter adjustment instruction, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and use the preview display screen to display the adjusted flat screen video;
开始记录模块,用于接收视频拍摄开始指令,并根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频;The start recording module is configured to receive a video shooting start instruction, and start recording the flat screen video of the preview display screen according to the video shooting start instruction;
结束记录模块,用于接收视频拍摄结束指令,并根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频。The end recording module is configured to receive a video shooting end instruction, and end recording the flat screen video of the preview display screen according to the video shooting end instruction.
在本发明所述的视频生成装置中,所述视频生成装置还包括:In the video generating device of the present invention, the video generating device further includes:
视频发送模块,用于将所述平面画面视频发送给其他终端;或将所述平面画面视频与所述全景画面视频合成为画中画视频,并发送给其他终端。The video sending module is used to send the flat screen video to other terminals; or synthesize the flat screen video and the panoramic screen video into a picture-in-picture video and send it to other terminals.
在本发明所述的视频生成装置中,所述调整模块具体用于基于用户在所述预览显示屏幕上的触摸画面调整操作,对所述平面画面视频的视场角参数、视角参数以及画面显示比例参数进行调整;其中所述触摸画面调整操作包括画面拖动操作,画面缩放操作以及画面设定操作。In the video generation device of the present invention, the adjustment module is specifically configured to display the field of view parameters, the field of view parameters, and the screen display of the flat screen video based on the user's touch screen adjustment operation on the preview display screen. Scale parameters are adjusted; wherein the touch screen adjustment operations include screen drag operations, screen zoom operations, and screen setting operations.
在本发明所述的视频生成装置中,所述调整模块还用于基于用户在所述预览显示屏幕上的画面物体选择操作,确定所述全景画面视频中的至少两个追踪物体,并以预设平面画面视频参数或调整后的视频参数显示任一所述追踪物体的平面画面视频;In the video generation device of the present invention, the adjustment module is further configured to determine at least two tracking objects in the panoramic image video based on the user's selection operation of the image objects on the preview display screen, and to predict Set the flat screen video parameter or the adjusted video parameter to display any flat screen video of the tracked object;
所述开始记录模块还用于根据所述视频拍摄开始指令开始记录至少两个所述追踪物体的平面画面视频;The start recording module is further configured to start recording at least two flat screen videos of the tracking object according to the video shooting start instruction;
所述结束记录模块还用于根据所述视频拍摄开始指令结束记录至少两个所述追踪物体的平面画面视频。The end recording module is further configured to end recording of at least two flat screen videos of the tracking object according to the video shooting start instruction.
在本发明所述的视频生成装置中,所述调整模块还用于根据追踪物体切换指令,对所述预览显示屏幕显示的平面画面视频中的追踪物体进行切换。In the video generating device of the present invention, the adjustment module is further configured to switch the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction.
在本发明所述的视频生成装置中,所述视频生成装置还包括:In the video generating device of the present invention, the video generating device further includes:
视频发送模块,用于将至少两个追踪物体的平面画面视频以及所述全景画面视频合成为画中画视频,并发送给其他终端。The video sending module is used to synthesize at least two flat screen videos of tracking objects and the panoramic screen video into picture-in-picture videos and send them to other terminals.
在本发明所述的视频生成装置中,所述开始记录模块还用于当所述平面画面视频属于所述前全景摄像头拍摄的前全景画面视频;获取所述后全景摄像头拍摄的后全景画面视频中的镜像画面视频,其中所述平面画面视频与镜像画面视频的视角参数相差180度;根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频;In the video generating device of the present invention, the start recording module is further configured to: when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; obtain the rear panoramic screen video shot by the rear panoramic camera Mirror image video in, wherein the viewing angle parameters of the plane image video and the mirror image video differ by 180 degrees; start recording the plane image video of the preview display screen and the corresponding mirror image video according to the video shooting start instruction;
所述结束记录模块还用于根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频。The end recording module is further configured to end recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
在本发明所述的视频生成装置中,所述视频生成装置还包括:In the video generating device of the present invention, the video generating device further includes:
视频发送模块,用于将所述平面画面视频以及相应的镜像画面视频发送给其他终端;或将所述平面画面视频、所述镜像画面视频以及所述全景画面视频合成为画中画视频,并发送给其他终端。The video sending module is used to send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video, and Send to other terminals.
本发明实施例还提供一种计算机可读存储介质,其内存储有处理器可执行指令,所述指令由一个或一个以上处理器加载,以执行上述任一视频生成方法。An embodiment of the present invention also provides a computer-readable storage medium, which stores processor-executable instructions, and the instructions are loaded by one or more processors to execute any of the foregoing video generation methods.
有益效果Beneficial effect
相较于现有技术的视频生成方法及视频生成装置,本发明的视频生成方法及视频生成装置可通过预览显示屏幕对平面画面视频的视频参数进行调整,以便全景相机在拍摄全景画面视频的同时生成对应的平面画面视频;提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求;有效解决了现有的视频生成方法及视频生成装置的画面编辑效率较为低下,不能满足用户实时观看全景编辑画面的需求的技术问题。Compared with the video generation method and the video generation device of the prior art, the video generation method and the video generation device of the present invention can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera can shoot the panoramic screen video at the same time. Generate the corresponding flat screen video; improve the screen editing efficiency of the panoramic camera, and meet the needs of users to watch the panoramic editing screen in real time; effectively solve the problem of the low editing efficiency of the existing video generation methods and video generation devices, which cannot satisfy users Real-time viewing of the technical problem of the demand for panoramic editing screens.
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面对实施例中所需要使用的附图作简单的介绍,下面描述中的附图仅为本发明的部分实施例相应的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the drawings that need to be used in the embodiments. The drawings in the following description are only corresponding to some embodiments of the present invention.的图。 The attached drawings.
图1a为本发明的视频生成方法的一实施例对应的全景相机的主视图;Fig. 1a is a front view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention;
图1b为本发明的视频生成方法的一实施例对应的全景相机的侧视图;FIG. 1b is a side view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention;
图1c为本发明的视频生成方法的一实施例对应的全景相机的后视图;Fig. 1c is a rear view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention;
图2为本发明的视频生成方法的第一实施例的视频生成流程图;Figure 2 is a video generation flowchart of the first embodiment of the video generation method of the present invention;
图3为本发明的视频生成方法的第二实施例的视频生成流程图;Fig. 3 is a video generation flowchart of the second embodiment of the video generation method of the present invention;
图4为本发明的视频生成方法的第三实施例的视频生成流程图;FIG. 4 is a video generation flowchart of the third embodiment of the video generation method of the present invention;
图5为本发明的视频生成装置的第一实施例的结构示意图;FIG. 5 is a schematic structural diagram of the first embodiment of the video generating device of the present invention;
图6为本发明的视频生成装置的第二实施例的结构示意图;Fig. 6 is a schematic structural diagram of a second embodiment of a video generating device of the present invention;
图7为本发明的视频生成装置的第三实施例的结构示意图;Fig. 7 is a schematic structural diagram of a third embodiment of a video generating device of the present invention;
图8为本发明的视频生成方法及视频生成装置的具体实施例的流程图;FIG. 8 is a flowchart of a specific embodiment of the video generation method and video generation device of the present invention;
图9a-9e为本发明的视频生成方法及视频生成装置的具体实施例的示意图;Figures 9a-9e are schematic diagrams of specific embodiments of the video generation method and video generation device of the present invention;
图10为本发明的视频生成装置所在的电子设备的工作环境结构示意图。FIG. 10 is a schematic diagram of the working environment structure of the electronic device where the video generating apparatus of the present invention is located.
本发明的最佳实施方式The best mode of the present invention
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present invention.
本发明的视频生成方法及视频生成装置设置在全景相机中,用于对全景相机拍摄的全景画面视频进行编辑,生成对应的平面画面视频,以便全景相机在拍摄全景画面视频的同时生成对应的平面画面视频,提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求。The video generation method and the video generation device of the present invention are set in the panoramic camera, and are used to edit the panoramic screen video shot by the panoramic camera to generate the corresponding flat screen video, so that the panoramic camera generates the corresponding flat screen while shooting the panoramic screen video. The screen video improves the screen editing efficiency of the panoramic camera and meets the needs of users to watch the panoramic editing screen in real time.
请参照图1a至图1c,图1a为本发明的视频生成方法的一实施例对应的全景相机的主视图,图1b为本发明的视频生成方法的一实施例对应的全景相机的侧视图,图1c为本发明的视频生成方法的一实施例对应的全景相机的后视图。Please refer to FIGS. 1a to 1c. FIG. 1a is a front view of a panoramic camera corresponding to an embodiment of a video generation method of the present invention, and FIG. 1b is a side view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention. Fig. 1c is a rear view of a panoramic camera corresponding to an embodiment of the video generation method of the present invention.
本实施例的视频生成方法对应的全景相机10包括机体11、设置在机体11前侧的前全景摄像头12、设置在机体11后侧的后全景摄像头13、设置在机体11后侧的预览显示屏幕14、以及设置在机体11后侧的全景相机控制键15。The panoramic camera 10 corresponding to the video generation method of this embodiment includes a body 11, a front panoramic camera 12 arranged on the front side of the body 11, a rear panoramic camera 13 arranged on the rear side of the body 11, and a preview display screen arranged on the rear side of the body 11. 14. And a panoramic camera control key 15 arranged on the rear side of the body 11.
其中前全景摄像头12用于拍摄机体前侧至少180度的前全景画面视频,后全景摄像头13用于拍摄机体后侧至少180度的后全景画面视频,前全景画面视频以及后全景画面视频可合并成为360度的全景画面视频。The front panoramic camera 12 is used to shoot the front panoramic screen video of at least 180 degrees on the front side of the body, and the rear panoramic camera 13 is used to shoot the rear panoramic screen video of at least 180 degrees on the back of the body. The front panoramic screen video and the rear panoramic screen video can be combined. Become a 360-degree panoramic screen video.
预览显示屏幕14用于对全景画面视频中的部分平面画面视频进行预览,全景相机控制键15用于控制全景相机进行全景画面视频的拍摄以及平面画面视频的编辑操作。The preview display screen 14 is used to preview part of the flat screen video in the panoramic screen video, and the panoramic camera control key 15 is used to control the panoramic camera to shoot the panoramic screen video and edit the flat screen video.
请参照图2,图2为本发明的视频生成方法的第一实施例的视频生成流程图。本实施例的视频生成方法可使用上述的全景相机进行实施,本实施例的视频生成方法包括:Please refer to FIG. 2, which is a video generation flowchart of the first embodiment of the video generation method of the present invention. The video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
步骤S201,使用前全景摄像头和后全景摄像头拍摄全景画面视频;Step S201, using the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video;
步骤S202,根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频;其中预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;Step S202, using the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; wherein the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
步骤S203,接收用户的平面画面视频参数调整指令,并根据平面画面视频参数调整指令对平面画面视频的视频参数进行调整,并使用预览显示屏幕显示调整后的平面画面视频;Step S203, receiving the user's flat screen video parameter adjustment instruction, adjusting the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and displaying the adjusted flat screen video using the preview display screen;
步骤S204,接收视频拍摄开始指令,并根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频;Step S204, receiving a video shooting start instruction, and starting to record the flat screen video of the preview display screen according to the video shooting start instruction;
步骤S205,接收视频拍摄结束指令,并根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频;Step S205, receiving a video shooting end instruction, and ending the recording of the flat screen video on the preview display screen according to the video shooting end instruction;
步骤S206,将平面画面视频发送给其他终端;或将平面画面视频与全景画面视频合成为画中画视频,并发送给其他终端。Step S206: Send the flat screen video to other terminals; or synthesize the flat screen video and the panoramic screen video into a picture-in-picture video, and send it to other terminals.
下面详细说明本实施例的视频生成方法的平面画面视频的生成流程。The process of generating a flat screen video in the video generating method of this embodiment will be described in detail below.
在步骤S201中,视频生成装置(即全景相机等)使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。In step S201, the video generating device (ie, panoramic camera, etc.) uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
在步骤S202中,视频生成装置获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。In step S202, the video generating device obtains preset flat screen video parameters, the flat screen video parameters are used to generate the corresponding flat screen video, the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
视场角调整表示平面画面视频的展示视角,如可展示360度的全景画面视频中的60度视场角的平面画面视频或120度视场角的平面画面视频。The angle of view adjustment indicates the display angle of the flat screen video, such as a flat screen video with a 60-degree field of view or a flat screen video with a 120-degree field of view in a 360-degree panoramic screen video.
视角调整表示平面画面视频的展示视角范围,如可展示360度的全景画面视频中的0度至60度范围的平面画面视频或61度至120度范围的平面画面视频。The viewing angle adjustment indicates the display viewing angle range of the flat screen video, such as a flat screen video ranging from 0 degrees to 60 degrees or a flat screen video ranging from 61 degrees to 120 degrees in a 360-degree panoramic screen video.
物体追踪表示平面画面视频用于追踪的某个物体,该物体可为全景画面视频中的某个人或某个物等。Object tracking refers to an object used for tracking in a flat screen video, and the object can be a person or an object in the panoramic screen video.
投影模式表示平面画面视频的展示模式,该展示模式可为透视投影模式、圆柱投影模式、小行星投影模式以及等角投影(Equi投影)等。The projection mode represents the display mode of the flat screen video. The display mode can be perspective projection mode, cylindrical projection mode, asteroid projection mode, and equi-angle projection (Equi projection).
画面显示比例参数表示平面画面视频的画面显示比例,如4:3或9:16等,以便其他终端可对该平面画面视频进行兼容性的播放。The screen display ratio parameter indicates the screen display ratio of the flat screen video, such as 4:3 or 9:16, so that other terminals can play the flat screen video with compatibility.
随后视频生成装置根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频。Then, the video generating device uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
如预设平面画面视频参数为视场角参数为120度,视角参数为1度至120度,投影模式参数为透视投影模式,画面显示比例为3:4。则预览显示屏幕则直接以透视投影模式将全景画面视频中视角为1度至120度区域的全景画面视频转换为画面显示比例为3:4的平面画面视频。For example, the preset flat screen video parameters are that the field of view parameter is 120 degrees, the viewing angle parameter is 1 to 120 degrees, the projection mode parameter is the perspective projection mode, and the screen display ratio is 3:4. Then, the preview display screen directly uses the perspective projection mode to convert the panoramic image video with the angle of view from 1 degree to 120 degrees in the panoramic image video into a flat image video with an image display ratio of 3:4.
如预设平面画面视频参数为视场角参数为120度,追踪物体为红色的球,投影模式参数为透视投影模式,画面显示比例为3:4。则预览显示屏幕直接以透视投影模式将全景画面视频中以红色的球为中心的视场角120度范围区域的全景画面视频转换为画面显示比例为3:4的平面画面视频。For example, the preset flat screen video parameter is the field of view parameter of 120 degrees, the tracking object is a red ball, the projection mode parameter is the perspective projection mode, and the screen display ratio is 3:4. Then, the preview display screen directly converts the panoramic image video in the panoramic image video in the area of the 120-degree field of view centered on the red ball into the flat image video with the image display ratio of 3:4 in the perspective projection mode.
这样即完成了平面画面视频的视频参数的预设操作。In this way, the preset operation of the video parameters of the flat screen video is completed.
在步骤S203中,视频生成装置可通过预览显示屏幕或全景相机控制键接收用户的平面画面视频参数调整指令。该平面画面视频参数调整指令为用户对平面画面视频的视频参数进行调整的指令。In step S203, the video generating device may receive the user's instruction for adjusting the flat screen video parameters through the preview display screen or the panoramic camera control key. The flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
如用户可通过平面画面视频参数调整指令对平面画面视频的视场角参数、视角参数、追踪物体参数、投影模式参数以及画面显示比例参数进行调整,以得到用户想要的平面画面视频。随后视频生成装置使用预览显示平面对调整后的平面画面视频进行展示操作。For example, the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Then the video generating device uses the preview display plane to display the adjusted flat screen video.
具体的,视频生成装置可基于用户在预览显示屏幕上的触摸画面调整操作对平面画面视频的视频参数进行调整。该触摸画面调整操作可为用户在预览显示屏幕上的画面拖动操作、画面缩放操作以及画面设定操作等。Specifically, the video generating device may adjust the video parameters of the flat screen video based on the user's touch screen adjustment operation on the preview display screen. The touch screen adjustment operation can be a screen drag operation, a screen zoom operation, and a screen setting operation of the user on the preview display screen.
其中画面拖动操作为用户在预览显示屏幕上对全景画面视频对应的360度的平面画面视频进行拖动操作,以调整平面画面视频的视角参数,如将全景画面视频中1度至120度区域对应的平面画面视频调整到全景画面视频中121度至240度区域对应的平面画面视频。The screen drag operation means that the user drags the 360-degree flat screen video corresponding to the panoramic screen video on the preview display screen to adjust the viewing angle parameters of the flat screen video, such as changing the area from 1 to 120 degrees in the panoramic screen video The corresponding flat screen video is adjusted to the flat screen video corresponding to the 121 degree to 240 degree area in the panoramic screen video.
其中画面缩放操作为用户在预览显示屏幕上对全景画面视频对应的360度的平面画面视频进行缩放操作,以调整预览显示屏幕可显示的平面画面视频的区域大小,即调整平面画面视频的视场角参数。如显示全景画面视频的120度区域对应的平面画面视频调整到显示全景画面视频的180度区域对应的平面画面视频。The screen zoom operation means that the user performs a zoom operation on the 360-degree flat screen video corresponding to the panoramic screen video on the preview display screen to adjust the area size of the flat screen video that can be displayed on the preview display screen, that is, adjust the field of view of the flat screen video Angle parameters. For example, the flat screen video corresponding to the 120-degree area of the panoramic screen video is adjusted to the flat screen video corresponding to the 180-degree area of the panoramic screen video.
其中画面设定操作为用户在预览显示屏幕上直接设置平面画面视频的视场角参数、视角参数或画面显示比例参数的设定操作。用户可直接在预览显示屏幕上选定对应的视场角参数、视角参数或画面显示比例参数。The screen setting operation is a setting operation for the user to directly set the field of view parameter, the angle of view parameter, or the screen display ratio parameter of the flat screen video on the preview display screen. The user can directly select the corresponding field angle parameter, angle of view parameter or screen display scale parameter on the preview display screen.
在步骤S204中,当平面画面视频的视频参数调整完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,这样视频生成装置可根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频。In step S204, when the video parameters of the flat screen video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generation device can start recording the flat screen video of the preview display screen according to the video shooting start instruction .
在步骤S205中,当平面画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,视频生成装置可根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频。In step S205, when the shooting of the flat screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of the flat screen video on the preview display screen according to the video shooting end instruction.
在步骤S206中,视频生成装置将步骤S205生成的平面画面视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。In step S206, the video generating device sends the flat screen video generated in step S205 to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
进一步的,视频生成装置还可将步骤S205生成的平面画面视频与步骤S201拍摄的全景画面视频进行合成,以形成画中画视频。即将全景画面视频转换为360度的平面画面视频,随后将步骤S206生成的平面画面视频和360度的平面画面视频进行合成,将步骤S206生成的平面画面视频设定为360度的平面画面视频的视频内部画面,如将步骤S206生成的平面画面视频设置在360度的平面画面视频的右下角或右上角等。Further, the video generating device may also synthesize the flat screen video generated in step S205 and the panoramic screen video shot in step S201 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S206 and the 360-degree flat screen video are synthesized, and the flat screen video generated in step S206 is set as the 360-degree flat screen video. The internal video of the video, such as setting the flat screen video generated in step S206 in the lower right corner or the upper right corner of the 360-degree flat screen video, etc.
随后视频生成装置将合成的画中画视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Then the video generating device sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic picture video.
这样即完成了本实施例的视频生成方法的对全景画面视频实时编辑,以生成平面画面视频,并实施进行分享的过程。In this way, the real-time editing of the panoramic screen video of the video generation method of this embodiment is completed to generate a flat screen video, and the process of sharing is implemented.
本实施例的视频生成方法可通过预览显示屏幕对平面画面视频的视频参数进行调整,以便全景相机在拍摄全景画面视频的同时生成对应的平面画面视频;提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求。The video generation method of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; it improves the screen editing efficiency of the panoramic camera and satisfies The user needs to watch the panoramic editing screen in real time.
请参照图3,图3为本发明的视频生成方法的第二实施例的视频生成流程图。本实施例的视频生成方法可使用上述的全景相机进行实施,本实施例的视频生成方法包括:Please refer to FIG. 3, which is a flow chart of video generation of the second embodiment of the video generation method of the present invention. The video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
步骤S301,使用前全景摄像头和后全景摄像头拍摄全景画面视频;Step S301, using the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video;
步骤S302,根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频;其中预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;Step S302: Use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
步骤S303,基于用户在预览显示屏幕上的画面物体选择操作,确定全景画面视频中的至少两个追踪物体,并以预设平面画面视频参数或调整后的视频参数显示任一追踪物体的平面画面视频;Step S303: Determine at least two tracking objects in the panoramic image video based on the user's selection operation of the screen object on the preview display screen, and display the flat screen of any tracking object with preset flat screen video parameters or adjusted video parameters video;
步骤S304,接收追踪物体切换指令,根据追踪物体切换指令,对预览显示屏幕显示的平面画面视频中的追踪物体进行切换;Step S304, receiving a tracking object switching instruction, and switching the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction;
步骤S305,接收视频拍摄开始指令,根据视频拍摄开始指令开始记录至少两个所述追踪物体的平面画面视频;Step S305, receiving a video shooting start instruction, and starting to record at least two flat screen videos of the tracking object according to the video shooting start instruction;
步骤S306,接收视频拍摄结束指令,根据所述视频拍摄开始指令结束记录至少两个所述追踪物体的平面画面视频;Step S306, receiving a video shooting end instruction, and ending recording of at least two flat screen videos of the tracking object according to the video shooting start instruction;
步骤S307,将至少两个追踪物体的平面画面视频以及全景画面视频合成为画中画视频,并发送给其他终端。In step S307, the flat screen video and the panoramic screen video of the at least two tracking objects are synthesized into a picture-in-picture video and sent to other terminals.
下面详细说明本实施例的视频生成方法的平面画面视频的生成流程。The process of generating a flat screen video in the video generating method of this embodiment will be described in detail below.
在步骤S301中,视频生成装置使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。In step S301, the video generating device uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
在步骤S302中,视频生成装置获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。In step S302, the video generating device obtains a preset flat screen video parameter, which is used to generate a corresponding flat screen video, and the preset flat screen video parameter includes a field of view parameter, a viewing angle parameter, an object tracking parameter, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
随后视频生成装置根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频。Then, the video generating device uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
在步骤S303中,视频生成装置获取用户在预览显示屏幕上的画面物体选择操作,该画面物体选择操作可为用户在预览显示屏幕上对特定物体的点击操作或长按操作,以便视频生成装置将该区域的特定物体与全景画面视频中的背景区域区分开来,该特定物体的区域的确定方法可使用现有的图像物体识别方法,在这里不做详细阐述。In step S303, the video generation device acquires the user's screen object selection operation on the preview display screen. The screen object selection operation can be a user's click operation or long press operation on a specific object on the preview display screen, so that the video generation device will The specific object in this area is distinguished from the background area in the panoramic image video, and the method for determining the area of the specific object can use the existing image object recognition method, which will not be elaborated here.
用户可通过画面物体选择操作,确定全景画面视频中的至少两个追踪物体(特定物体),这时视频生成装置可使用预览显示屏幕以平面画面视频的方式显示任一追踪物体,并将该平面画面视频的视频参数设置为预设平面画面视频参数或用户调整后的视频参数。The user can determine at least two tracking objects (specific objects) in the panoramic image video through the screen object selection operation. At this time, the video generation device can use the preview display screen to display any tracking object in the form of a flat screen video, and map the plane The video parameter of the screen video is set to the preset flat screen video parameter or the video parameter adjusted by the user.
在步骤S304中,视频生成装置可获取用户在全景相机上的追踪物体切换指令(通过预览显示屏幕或全景相机控制键发出)。随后视频生成装置根据该追踪物体切换指令,对预览显示屏幕显示的平面画面视频中的追踪物体进行切换,以便用户对多个具有追踪物体的平面画面视频进行实时观看。In step S304, the video generating device may obtain the user's tracking object switching instruction on the panoramic camera (issued through the preview display screen or the panoramic camera control key). Subsequently, the video generating device switches the tracking objects in the flat screen video displayed on the preview display screen according to the tracking object switching instruction, so that the user can watch multiple flat screen videos with tracking objects in real time.
在步骤S305中,当平面画面视频的视频参数以及对应的追踪物体设置完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,这样视频生成装置可根据视频拍摄开始指令开始记录至少两个追踪物体的平面画面视频。In step S305, when the video parameters of the flat screen video and the corresponding tracking objects are set, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generating device can start recording at least two video recordings according to the video shooting start instruction. A flat screen video of tracking objects.
在步骤S306中,当平面画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,视频生成装置可根据视频拍摄结束指令结束记录至少两个追踪物体的平面画面视频。In step S306, when the shooting of the flat screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of at least two flat screen videos of the tracking object according to the video shooting end instruction.
在步骤S307中,视频生成装置将步骤S306生成的平面画面视频与步骤S301拍摄的全景画面视频进行合成,以形成画中画视频。即将全景画面视频转换为360度的平面画面视频,随后将步骤S306生成的平面画面视频与360度的平面画面视频进行合成,将步骤S306生成的平面画面视频设定为360度的平面画面视频的视频内部画面,如将步骤S306生成的多个平面画面视频同时设置在360度的平面画面视频的右下角和右上角等、或将步骤S306生成的多个平面画面视频设置在360度的平面画面视频的右下角或右上角进行轮播。In step S307, the video generating device synthesizes the flat screen video generated in step S306 and the panoramic screen video shot in step S301 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S306 is synthesized with the 360-degree flat screen video, and the flat screen video generated in step S306 is set to the 360-degree flat screen video. Video internal screen, such as setting multiple flat screen videos generated in step S306 in the lower right corner and upper right corner of a 360-degree flat screen video at the same time, or setting multiple flat screen videos generated in step S306 on a 360-degree flat screen Carousel in the lower right or upper right corner of the video.
随后视频生成装置将合成的画中画视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Then the video generating device sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic picture video.
本实施例的视频生成方法可通过预览显示屏幕对平面画面视频的视频参数进行调整,并可通过平面画面视频同时选择多个追踪物体,并形成多个对应的平面画面视频。从而全景相机在拍摄全景画面视频的同时生成了多个对应的平面画面视频,提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求。The video generation method of this embodiment can adjust the video parameters of the flat-screen video through the preview display screen, and can simultaneously select multiple tracking objects through the flat-screen video, and form multiple corresponding flat-screen videos. Therefore, the panoramic camera generates multiple corresponding flat screen videos while shooting the panoramic screen video, which improves the screen editing efficiency of the panoramic camera and satisfies the user's demand for viewing the panoramic editing screen in real time.
请参照图4,图4为本发明的视频生成方法的第三实施例的视频生成流程图。本实施例的视频生成方法可使用上述的全景相机进行实施,本实施例的视频生成方法包括:Please refer to FIG. 4, which is a video generation flowchart of the third embodiment of the video generation method of the present invention. The video generation method of this embodiment can be implemented using the aforementioned panoramic camera, and the video generation method of this embodiment includes:
步骤S401,使用前全景摄像头和后全景摄像头拍摄全景画面视频;Step S401, using the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video;
步骤S402,根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频;其中预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;Step S402: Use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameters ;
步骤S403,接收用户的平面画面视频参数调整指令,并根据平面画面视频参数调整指令对平面画面视频的视频参数进行调整,并使用预览显示屏幕显示调整后的平面画面视频;Step S403, receiving the user's flat screen video parameter adjustment instruction, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and display the adjusted flat screen video using the preview display screen;
步骤S404,当平面画面视频属于前全景摄像头拍摄的前全景画面视频;获取后全景摄像头拍摄的后全景画面视频中的镜像画面视频,其中平面画面视频与镜像画面视频的视角参数相差180度;Step S404, when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; acquire the mirror image video in the rear panoramic screen video shot by the rear panoramic camera, where the angle parameters of the flat screen video and the mirror image video differ by 180 degrees;
步骤S405,接收视频拍摄开始指令,根据所述视频拍摄开始指令开始记录预览显示屏幕的平面画面视频以及对应的镜像画面视频;Step S405: Receive a video shooting start instruction, and start recording the flat screen video of the preview display screen and the corresponding mirror image video according to the video shooting start instruction;
步骤S406,接收视频拍摄结束指令,并根据所述视频拍摄结束指令结束记录预览显示屏幕的平面画面视频以及对应的镜像画面视频;Step S406, receiving a video shooting end instruction, and ending the recording of the flat screen video of the preview display screen and the corresponding mirror image video according to the video shooting end instruction;
步骤S407,将平面画面视频以及相应的镜像画面视频发送给其他终端;或将平面画面视频、镜像画面视频以及全景画面视频合成为画中画视频,并发送给其他终端。Step S407: Send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video and send it to other terminals.
下面详细说明本实施例的视频生成方法的平面画面视频的生成流程。The process of generating a flat screen video in the video generating method of this embodiment will be described in detail below.
在步骤S401中,视频生成装置使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。In step S401, the video generating device uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
在步骤S402中,视频生成装置获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。In step S402, the video generating device obtains a preset flat screen video parameter, the flat screen video parameter is used to generate a corresponding flat screen video, and the preset flat screen video parameter includes a field of view parameter, a viewing angle parameter, an object tracking parameter, At least part of the parameters of the projection mode parameter and the screen display scale parameter.
在步骤S403中,视频生成装置可通过预览显示屏幕或全景相机控制键接收用户的平面画面视频参数调整指令。该平面画面视频参数调整指令为用户对平面画面视频的视频参数进行调整的指令。In step S403, the video generating device may receive the user's instruction for adjusting the flat screen video parameters through the preview display screen or the panoramic camera control key. The flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
如用户可通过平面画面视频参数调整指令对平面画面视频的视场角参数、视角参数、追踪物体参数、投影模式参数以及画面显示比例参数进行调整,以得到用户想要的平面画面视频。随后视频生成装置使用预览显示平面对调整后的平面画面视频进行展示操作。For example, the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Then the video generating device uses the preview display plane to display the adjusted flat screen video.
在步骤S404中,由于本实施例的全景相机为便携式手持相机,该全景相机的前全景摄像头一般用于拍摄用户面前的景色或人物,该全景相机的后全景摄像头一般用于拍摄用户的自拍照。且前全景摄像头拍摄的拍摄目标所在区域的视角参数与后全景摄像头拍摄的用户的观察区域的视角参数一般相差180度,为了使得全景相机可以同时保存前全景摄像头拍摄的拍摄目标以及后全景摄像头拍摄的用户拍摄表情。In step S404, since the panoramic camera of this embodiment is a portable handheld camera, the front panoramic camera of the panoramic camera is generally used to capture the scenery or people in front of the user, and the rear panoramic camera of the panoramic camera is generally used to capture the user's selfie. . In addition, the angle of view parameters of the area where the shooting target is captured by the front panoramic camera and the angle of view parameters of the user's observation area captured by the rear panoramic camera are generally different by 180 degrees, so that the panoramic camera can save the shooting target captured by the front panoramic camera and the rear panoramic camera at the same time. Of users shoot emoticons.
当步骤S403确定的平面画面视频属于前全景摄像头拍摄的前全景画面视频(如景色画面视频或人物画面视频),视频生成装置会同时获取后全景摄像头拍摄的后全景画面视频中的镜像画面视频,该平面画面视频与镜像画面视频的视角参数相差180度。When the flat screen video determined in step S403 belongs to the front panoramic screen video shot by the front panoramic camera (such as the scene screen video or the character screen video), the video generation device will simultaneously acquire the mirror image video in the rear panoramic screen video shot by the rear panoramic camera. The viewing angle parameters of the flat screen video and the mirror screen video differ by 180 degrees.
在步骤S405中,当平面画面视频以及对应的镜像画面视频的视频参数调整完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,这样视频生成装置可根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频以及对应的镜像画面视频In step S405, when the video parameters of the flat screen video and the corresponding mirror image video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the video generating device can start recording and previewing according to the video shooting start instruction The flat screen video of the display screen and the corresponding mirrored screen video
在步骤S406中,当平面画面视频以及镜像画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,视频生成装置可根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频。In step S406, when the shooting of the flat screen video and the mirrored screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the video generating device can end the recording of the flat screen video on the preview display screen according to the video shooting end instruction .
在步骤S407中,视频生成装置将步骤S406生成的平面画面视频以及相应的镜像画面视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。In step S407, the video generating device sends the flat screen video generated in step S406 and the corresponding mirror screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
进一步的,视频生成装置还可将步骤S406生成的平面画面视频以及相应的镜像画面视频、与步骤S401拍摄的全景画面视频进行合成,以形成画中画视频。即将全景画面视频转换为360度的平面画面视频,随后将步骤S406生成的平面画面视频以及相应的镜像画面视频、与360度的平面画面视频进行合成,将步骤S406生成的平面画面视频以及相应的镜像画面视频设定为360度的平面画面视频的视频内部画面,如将步骤S406生成的平面画面视频以及相应的镜像画面视频同时设置在360度的平面画面视频的右下角和右上角等、或将步骤S406生成的平面画面视频以及相应的镜像画面视频设置在360度的平面画面视频的右下角或右上角进行轮播。Further, the video generating device may also synthesize the flat screen video generated in step S406 and the corresponding mirror screen video with the panoramic screen video shot in step S401 to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the flat screen video generated in step S406 and the corresponding mirror image video are synthesized with the 360-degree flat screen video, and the flat screen video generated in step S406 and the corresponding The mirror image video is set to the video internal image of the 360-degree flat-screen video, for example, the flat-screen video generated in step S406 and the corresponding mirror-image video are set at the lower right and upper right corners of the 360-degree flat-screen video at the same time, or The flat screen video generated in step S406 and the corresponding mirrored screen video are set in the lower right corner or the upper right corner of the 360-degree flat screen video for carousel.
在第一实施例的基础上,本实施例的视频生成方法可通过平面画面视频以及镜像画面视频同时追踪用户拍摄目标以及用户拍摄面部画面,从而可使得用户在观看平面画面视频中的用户拍摄目标的同时,还可查看镜像画面视频中的用户拍摄面部画面以及面部表情。进一步提高了全景相机的多画面编辑效率,满足了用户观看多个全景编辑画面的需求。On the basis of the first embodiment, the video generation method of this embodiment can simultaneously track the user's shooting target and the user's facial image through the flat screen video and the mirrored screen video, so that the user can watch the user shooting target in the flat screen video At the same time, you can also view the user's facial images and facial expressions in the mirror image video. It further improves the multi-picture editing efficiency of the panoramic camera, and meets the needs of users to watch multiple panoramic editing pictures.
本发明还提供一种视频生成装置,请参照图5,图5为本发明的视频生成装置的第一实施例的结构示意图。本实施例的视频生成装置可使用上述的视频生成方法的第一实施例进行实施,本实施例的视频生成装置50包括拍摄模块51、显示模块52、调整模块53、开始记录模块54、结束记录模块55以及视频发送模块56。The present invention also provides a video generating device. Please refer to FIG. 5, which is a schematic structural diagram of the first embodiment of the video generating device of the present invention. The video generation device of this embodiment can be implemented using the first embodiment of the above-mentioned video generation method. The video generation device 50 of this embodiment includes a shooting module 51, a display module 52, an adjustment module 53, a start recording module 54, and an end recording Module 55 and video sending module 56.
拍摄模块51用于使用前全景摄像头和所述后全景摄像头拍摄全景画面视频;显示模块52用于根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频;其中预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;调整模块53用于接收用户的平面画面视频参数调整指令,并根据平面画面视频参数调整指令对平面画面视频的视频参数进行调整,并使用预览显示屏幕显示调整后的平面画面视频;开始记录模块54用于接收视频拍摄开始指令,并根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频;结束记录模块55用于接收视频拍摄结束指令,并根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频;视频发送模块56用于将平面画面视频发送给其他终端;或将平面画面视频与全景画面视频合成为画中画视频,并发送给其他终端。The photographing module 51 is used to use the front panoramic camera and the rear panoramic camera to take panoramic picture videos; the display module 52 is used to display the corresponding flat picture video using the preview display screen according to the preset flat picture video parameters; wherein the preset flat picture video The parameters include field of view parameters, viewing angle parameters, object tracking parameters, projection mode parameters, and screen display scale parameters; the adjustment module 53 is used to receive the user's flat screen video parameter adjustment instruction, and adjust the flat screen video according to the flat screen video parameter adjustment instruction Adjust the video parameters of the preview display screen, and use the preview display screen to display the adjusted flat screen video; the start recording module 54 is used to receive the video shooting start instruction, and start recording the flat screen video of the preview display screen according to the video shooting start instruction; end the recording module 55 is used to receive the video shooting end instruction, and according to the video shooting end instruction to end the recording of the flat screen video on the preview display screen; the video sending module 56 is used to send the flat screen video to other terminals; or combine the flat screen video and the panoramic screen video It is a picture-in-picture video and sent to other terminals.
本实施例的视频生成装置50使用时,首先拍摄模块51使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。When the video generating device 50 of this embodiment is used, the shooting module 51 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
随后显示模块52获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。Then the display module 52 obtains the preset flat screen video parameters, which are used to generate the corresponding flat screen video. The preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
然后显示模块52根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频。Then, the display module 52 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
然后调整模块53可通过预览显示屏幕或全景相机控制键接收用户的平面画面视频参数调整指令。该平面画面视频参数调整指令为用户对平面画面视频的视频参数进行调整的指令。Then, the adjustment module 53 can receive the user's flat screen video parameter adjustment instruction through the preview display screen or the panoramic camera control key. The flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
如用户可通过平面画面视频参数调整指令对平面画面视频的视场角参数、视角参数、追踪物体参数、投影模式参数以及画面显示比例参数进行调整,以得到用户想要的平面画面视频。随后调整模块53使用预览显示平面对调整后的平面画面视频进行展示操作。For example, the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Subsequently, the adjustment module 53 uses the preview display plane to perform a display operation on the adjusted flat screen video.
当平面画面视频的视频参数调整完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,这样开始记录模块54可根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频。When the video parameters of the flat screen video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, so that the recording start module 54 can start recording the flat screen video on the preview display screen according to the video shooting start instruction.
当平面画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,结束记录模块55可根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频。When the flat screen video has been shot, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 55 can end recording the flat screen video on the preview display screen according to the video shooting end instruction.
最后视频发送模块56将生成的平面画面视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Finally, the video sending module 56 sends the generated flat screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
进一步的,视频发送模块56还可将生成的平面画面视频与全景画面视频进行合成,以形成画中画视频。随后视频发送模块56将合成的画中画视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Further, the video sending module 56 can also synthesize the generated flat screen video and the panoramic screen video to form a picture-in-picture video. Subsequently, the video sending module 56 sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic image video.
这样即完成了本实施例的视频生成装置50的对全景画面视频实时编辑,以生成平面画面视频,并实施进行分享的过程。In this way, the real-time editing of the panoramic screen video of the video generating device 50 of this embodiment is completed to generate a flat screen video, and the process of sharing is implemented.
本实施例的视频生成装置的具体工作原理与上述的视频生成方法的第一实施例中的具体描述相同或相似,具体请参见上述视频生成方法的第一实施例的相关描述。The specific working principle of the video generating apparatus in this embodiment is the same as or similar to the specific description in the first embodiment of the foregoing video generating method. For details, please refer to the relevant description of the first embodiment of the foregoing video generating method.
本实施例的视频生成装置可通过预览显示屏幕对平面画面视频的视频参数进行调整,以便全景相机在拍摄全景画面视频的同时生成对应的平面画面视频;提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求。The video generating device of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; the screen editing efficiency of the panoramic camera is improved and satisfies The user needs to watch the panoramic editing screen in real time.
请参照图6,图6为本发明的视频生成装置的第二实施例的结构示意图。本实施例的视频生成装置可使用上述的视频生成方法的第二实施例进行实施,本实施例的视频生成装置60包括拍摄模块61、显示模块62、调整模块63、开始记录模块64、结束记录模块65以及视频发送模块66。Please refer to FIG. 6, which is a schematic structural diagram of a second embodiment of a video generating device of the present invention. The video generation device of this embodiment can be implemented using the second embodiment of the above-mentioned video generation method. The video generation device 60 of this embodiment includes a shooting module 61, a display module 62, an adjustment module 63, a start recording module 64, and an end recording Module 65 and video sending module 66.
在第一实施例的基础上,本实施例的视频生成装置60的调整模块63还用于基于用户在预览显示屏幕上的画面物体选择操作,确定全景画面视频中的至少两个追踪物体,并以预设平面画面视频参数或调整后的视频参数显示任一追踪物体的平面画面视频;以及根据追踪物体切换指令,对预览显示屏幕显示的平面画面视频中的追踪物体进行切换。On the basis of the first embodiment, the adjustment module 63 of the video generating device 60 of this embodiment is further configured to determine at least two tracking objects in the panoramic image video based on the user's screen object selection operation on the preview display screen, and Display the flat screen video of any tracking object with preset flat screen video parameters or adjusted video parameters; and switch the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction.
开始记录模块64还用于根据视频拍摄开始指令开始记录至少两个追踪物体的平面画面视频。The recording start module 64 is further configured to start recording the flat screen video of at least two tracking objects according to the video shooting start instruction.
结束记录模块65还用于根据视频拍摄开始指令结束记录至少两个追踪物体的平面画面视频。The end recording module 65 is further configured to end recording the flat screen video of at least two tracking objects according to the video shooting start instruction.
视频发送模块66还用于将至少两个追踪物体的平面画面视频以及全景画面视频合成为画中画视频,并发送给其他终端。The video sending module 66 is also used to synthesize the flat screen video and the panoramic screen video of at least two tracking objects into a picture-in-picture video, and send it to other terminals.
本实施例的视频生成装置60使用时,首先拍摄模块61使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。When the video generating device 60 of this embodiment is used, the shooting module 61 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video based on the panoramic screen video.
随后显示模块62获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。The display module 62 then obtains the preset flat screen video parameters, the flat screen video parameters are used to generate the corresponding flat screen video, the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
随后显示模块62根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频。Subsequently, the display module 62 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
然后调整模块63获取用户在预览显示屏幕上的画面物体选择操作,该画面物体选择操作可为用户在预览显示屏幕上对特定物体的点击操作或长按操作,以便视频生成装置60将该区域的特定物体与全景画面视频中的背景区域区分开来,该特定物体的区域的确定方法可使用现有的图像物体识别方法,在这里不做详细阐述。Then the adjustment module 63 obtains the user's screen object selection operation on the preview display screen. The screen object selection operation can be a user's click operation or long press operation on a specific object on the preview display screen, so that the video generation device 60 can select the area The specific object is distinguished from the background area in the panoramic image video, and the method for determining the area of the specific object can use the existing image object recognition method, which will not be elaborated here.
用户可通过画面物体选择操作,确定全景画面视频中的至少两个追踪物体(特定物体),这时调整模块63可使用预览显示屏幕以平面画面视频的方式显示任一追踪物体,并将该平面画面视频的视频参数设置为预设平面画面视频参数或用户调整后的视频参数。The user can determine at least two tracking objects (specific objects) in the panoramic image video through the screen object selection operation. At this time, the adjustment module 63 can use the preview display screen to display any tracking object in the form of a flat screen video, and set the plane The video parameter of the screen video is set to the preset flat screen video parameter or the video parameter adjusted by the user.
随后调整模块63可获取用户在全景相机上的追踪物体切换指令(通过预览显示屏幕或全景相机控制键发出)。随后调整模块63根据该追踪物体切换指令,对预览显示屏幕显示的平面画面视频中的追踪物体进行切换,以便用户对多个具有追踪物体的平面画面视频进行实时观看。Subsequently, the adjustment module 63 can obtain the user's tracking object switching instruction on the panoramic camera (issued through the preview display screen or the panoramic camera control key). Subsequently, the adjustment module 63 switches the tracking objects in the flat screen video displayed on the preview display screen according to the tracking object switching instruction, so that the user can watch multiple flat screen videos with tracking objects in real time.
当平面画面视频的视频参数以及对应的追踪物体设置完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,这开始记录模块64可根据视频拍摄开始指令开始记录至少两个追踪物体的平面画面视频。When the video parameters of the flat screen video and the corresponding tracking objects are set, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, and the start recording module 64 can start recording at least two tracking objects according to the video shooting start instruction. Flat screen video.
当平面画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,结束记录模块65可根据视频拍摄结束指令结束记录至少两个追踪物体的平面画面视频。When the shooting of the flat screen video is completed, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 65 can end the recording of at least two flat screen videos of tracking objects according to the video shooting end instruction.
最后视频发送模块66将生成的平面画面视频与拍摄的全景画面视频进行合成,以形成画中画视频。即将全景画面视频转换为360度的平面画面视频,随后将生成的平面画面视频与360度的平面画面视频进行合成,将生成的平面画面视频设定为360度的平面画面视频的视频内部画面,如将生成的多个平面画面视频同时设置在360度的平面画面视频的右下角和右上角等、或将生成的多个平面画面视频设置在360度的平面画面视频的右下角或右上角进行轮播。Finally, the video sending module 66 synthesizes the generated flat screen video and the shot panoramic screen video to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the generated flat screen video is synthesized with the 360-degree flat screen video, and the generated flat screen video is set to the internal video of the 360-degree flat screen video. For example, set the generated multiple flat screen videos in the lower right corner and upper right corner of the 360-degree flat screen video at the same time, or set the generated multiple flat screen videos in the lower right or upper right corner of the 360-degree flat screen video. Carousel.
随后视频发送模块66将合成的画中画视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Subsequently, the video sending module 66 sends the synthesized picture-in-picture video to other terminals, realizing real-time editing and real-time sharing of the panoramic image video.
本实施例的视频生成装置可通过预览显示屏幕对平面画面视频的视频参数进行调整,并可通过平面画面视频同时选择多个追踪物体,并形成多个对应的平面画面视频。从而全景相机在拍摄全景画面视频的同时生成了多个对应的平面画面视频,提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求。The video generating device of this embodiment can adjust the video parameters of the flat screen video through the preview display screen, and can simultaneously select multiple tracking objects through the flat screen video, and form multiple corresponding flat screen videos. Therefore, the panoramic camera generates multiple corresponding flat screen videos while shooting the panoramic screen video, which improves the screen editing efficiency of the panoramic camera and satisfies the user's demand for viewing the panoramic editing screen in real time.
请参照图7,图7为本发明的视频生成装置的第三实施例的结构示意图。本实施例的视频生辰装置可使用上述的视频生成方法的第三实施例进行实施,本实施例的视频生成装置70包括拍摄模块71、显示模块72、调整模块73、开始记录模块74、结束记录模块75以及视频发送模块76。Please refer to FIG. 7, which is a schematic structural diagram of a third embodiment of a video generating device of the present invention. The video birth device of this embodiment can be implemented using the third embodiment of the above-mentioned video generation method. The video generation device 70 of this embodiment includes a shooting module 71, a display module 72, an adjustment module 73, a start recording module 74, and an end recording Module 75 and video sending module 76.
在第一实施例的基础上,本实施例的视频生成装置70的开始记录模块74还用于当平面画面视频属于前全景摄像头拍摄的前全景画面视频;获取后全景摄像头拍摄的后全景画面视频中的镜像画面视频,其中平面画面视频与镜像画面视频的视角参数相差180度;根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频以及对应的镜像画面视频。On the basis of the first embodiment, the start recording module 74 of the video generating device 70 of this embodiment is also used for when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; to obtain the rear panoramic screen video shot by the rear panoramic camera In the mirror image video in, the angle of view parameters of the plane image video and the mirror image video differ by 180 degrees; according to the video shooting start instruction, start to record the plane image video of the preview display screen and the corresponding mirror image video.
结束记录模块75还用于根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频以及对应的镜像画面视频。The end recording module 75 is further configured to end recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
视频发送模块76用于将平面画面视频以及相应的镜像画面视频发送给其他终端;或将平面画面视频、镜像画面视频以及全景画面视频合成为画中画视频,并发送给其他终端。The video sending module 76 is used to send the flat screen video and the corresponding mirrored screen video to other terminals; or synthesize the flat screen video, the mirrored screen video, and the panoramic screen video into a picture-in-picture video, and send it to other terminals.
本实施例的视频生成装置70使用时,首先拍摄模块71使用前全景摄像头和后全景摄像头拍摄全景画面视频,以便后续根据全景画面视频生成对应的平面画面视频。When the video generating device 70 of this embodiment is used, the shooting module 71 first uses the front panoramic camera and the rear panoramic camera to shoot a panoramic screen video, so as to subsequently generate a corresponding flat screen video according to the panoramic screen video.
随后显示模块72获取预设平面画面视频参数,该平面画面视频参数用于生成对应的平面画面视频,该预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数中至少部分参数。The display module 72 then obtains the preset flat screen video parameters, which are used to generate the corresponding flat screen video. The preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, projection mode parameters, and The screen displays at least part of the scale parameters.
随后显示模块72根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频。Subsequently, the display module 72 uses the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters.
然后调整模块73可通过预览显示屏幕或全景相机控制键接收用户的平面画面视频参数调整指令。该平面画面视频参数调整指令为用户对平面画面视频的视频参数进行调整的指令。Then, the adjustment module 73 can receive the user's flat screen video parameter adjustment instruction through the preview display screen or the panoramic camera control key. The flat screen video parameter adjustment instruction is an instruction for the user to adjust the video parameters of the flat screen video.
如用户可通过平面画面视频参数调整指令对平面画面视频的视场角参数、视角参数、追踪物体参数、投影模式参数以及画面显示比例参数进行调整,以得到用户想要的平面画面视频。随后调整模块73使用预览显示平面对调整后的平面画面视频进行展示操作。For example, the user can adjust the field of view parameters, viewing angle parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video through the flat screen video parameter adjustment instructions to obtain the flat screen video desired by the user. Subsequently, the adjustment module 73 uses the preview display plane to perform a display operation on the adjusted flat screen video.
由于本实施例的全景相机为便携式手持相机,该全景相机的前全景摄像头一般用于拍摄用户面前的景色或人物,该全景相机的后全景摄像头一般用于拍摄用户的自拍照。且前全景摄像头拍摄的拍摄目标所在区域的视角参数与后全景摄像头拍摄的用户的观察区域的视角参数一般相差180度,为了使得全景相机可以同时保存前全景摄像头拍摄的拍摄目标以及后全景摄像头拍摄的用户拍摄表情。Since the panoramic camera of this embodiment is a portable handheld camera, the front panoramic camera of the panoramic camera is generally used to photograph the scenery or people in front of the user, and the rear panoramic camera of the panoramic camera is generally used to photograph the user's selfie. In addition, the angle of view parameters of the area where the shooting target is captured by the front panoramic camera and the angle of view parameters of the user's observation area captured by the rear panoramic camera are generally different by 180 degrees, so that the panoramic camera can save the shooting target captured by the front panoramic camera and the rear panoramic camera at the same time. Of users shoot emoticons.
当确定的平面画面视频属于前全景摄像头拍摄的前全景画面视频(如景色画面视频或人物画面视频),开始记录模块74会同时获取后全景摄像头拍摄的后全景画面视频中的镜像画面视频,该平面画面视频与镜像画面视频的视角参数相差180度。When the determined flat screen video belongs to the front panoramic screen video shot by the front panoramic camera (such as the scene screen video or the character screen video), the start recording module 74 will simultaneously obtain the mirror image video in the rear panoramic screen video shot by the rear panoramic camera. The viewing angle parameters of the flat screen video and the mirror screen video differ by 180 degrees.
当平面画面视频以及对应的镜像画面视频的视频参数调整完毕,用户可通过全景相机控制键对全景相机发送视频拍摄开始指令,开始记录模块74可根据视频拍摄开始指令开始记录预览显示屏幕的平面画面视频以及对应的镜像画面视频When the video parameters of the flat screen video and the corresponding mirrored screen video are adjusted, the user can send a video shooting start instruction to the panoramic camera through the panoramic camera control key, and the start recording module 74 can start recording the flat screen of the preview display screen according to the video shooting start instruction Video and corresponding mirror image video
当平面画面视频以及镜像画面视频拍摄完毕,用户可通过全景相机控制键对全景相机发送视频拍摄结束指令,结束记录模块75可根据视频拍摄结束指令结束记录预览显示屏幕的平面画面视频。When the flat screen video and the mirrored screen video have been shot, the user can send a video shooting end instruction to the panoramic camera through the panoramic camera control key, and the end recording module 75 can end recording the flat screen video on the preview display screen according to the video shooting end instruction.
最后视频发送模块76将生成的平面画面视频以及相应的镜像画面视频发送给其他终端,实现了全景画面视频的实时编辑以及实时分享。Finally, the video sending module 76 sends the generated flat screen video and the corresponding mirrored screen video to other terminals, realizing real-time editing and real-time sharing of the panoramic screen video.
进一步的,视频发送模块76还可将生成的平面画面视频以及相应的镜像画面视频、与拍摄的全景画面视频进行合成,以形成画中画视频。即将全景画面视频转换为360度的平面画面视频,随后将生成的平面画面视频以及相应的镜像画面视频、与360度的平面画面视频进行合成,将生成的平面画面视频以及相应的镜像画面视频设定为360度的平面画面视频的视频内部画面,如将生成的平面画面视频以及相应的镜像画面视频同时设置在360度的平面画面视频的右下角和右上角等、或将生成的平面画面视频以及相应的镜像画面视频设置在360度的平面画面视频的右下角或右上角进行轮播。Further, the video sending module 76 may also synthesize the generated flat screen video and the corresponding mirror screen video with the captured panoramic screen video to form a picture-in-picture video. That is, the panoramic screen video is converted into a 360-degree flat screen video, and then the generated flat screen video and the corresponding mirrored screen video are synthesized with the 360-degree flat screen video, and the generated flat screen video and the corresponding mirrored screen video are set The internal video of the 360-degree flat-screen video, such as the generated flat-screen video and the corresponding mirror image video are set at the lower right and upper right corners of the 360-degree flat-screen video at the same time, or the flat-screen video that will be generated And the corresponding mirror image video is set in the lower right corner or upper right corner of the 360-degree flat screen video for carousel.
在第一实施例的基础上,本实施例的视频生成装置可通过平面画面视频以及镜像画面视频同时追踪用户拍摄目标以及用户拍摄面部画面,从而可使得用户在观看平面画面视频中的用户拍摄目标的同时,还可查看镜像画面视频中的用户拍摄面部画面以及面部表情。进一步提高了全景相机的多画面编辑效率,满足了用户观看多个全景编辑画面的需求。On the basis of the first embodiment, the video generation device of this embodiment can simultaneously track the user's shooting target and the user's facial image through the flat screen video and the mirror image video, so that the user can watch the user's shooting target in the flat screen video. At the same time, you can also view the user's facial images and facial expressions in the mirror image video. It further improves the multi-picture editing efficiency of the panoramic camera, and meets the needs of users to watch multiple panoramic editing pictures.
下面通过一具体实施例说明本发明的视频生成方法以及视频生成装置的具体工作原理,请参照图8、9a-9e,图8为本发明的视频生成方法及视频生成装置的具体实施例的流程图,图9a-9e为本发明的视频生成方法及视频生成装置的具体实施例的示意图。Hereinafter, a specific embodiment is used to illustrate the specific working principle of the video generation method and the video generation device of the present invention. Please refer to Figures 8, 9a-9e. Figure 8 is a flow chart of specific embodiments of the video generation method and video generation device of the present invention Figures 9a-9e are schematic diagrams of specific embodiments of the video generation method and video generation device of the present invention.
本实施例的视频生成装置设置在如图1a至图1c所示的便携式手持全景相机上,本便携式手持全景相机(简称全景相机)生成对应的平面画面视频的流程包括:The video generating device of this embodiment is set on the portable handheld panoramic camera as shown in Fig. 1a to Fig. 1c. The process of generating the corresponding flat screen video by the portable handheld panoramic camera (referred to as the panoramic camera) includes:
步骤S801,全景相机使用前全景摄像头和后全景摄像头拍摄全景画面视频;Step S801, the panoramic camera uses the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video;
步骤S802,全景相机根据预设平面画面视频参数,使用预览显示屏幕显示对应的平面画面视频91(其中全景画面视频对应360度的平面画面视频92),在本实施例中,全景相机设置平面画面视频对应的视场角为120度,视角为31度至150度,即全景相机正前方的视角范围,投影模式为透视投影模式,画面显示比例为3:4。具体可如图9a所示。Step S802, the panoramic camera uses the preview display screen to display the corresponding flat screen video 91 (the panoramic screen video corresponds to the 360-degree flat screen video 92) according to the preset flat screen video parameters. In this embodiment, the panoramic camera sets the flat screen The field of view corresponding to the video is 120 degrees, and the angle of view is 31 degrees to 150 degrees, that is, the range of angle of view directly in front of the panoramic camera. The projection mode is perspective projection mode, and the screen display ratio is 3:4. The details can be shown in Figure 9a.
步骤S803,用户可对预览显示屏幕上的平面画面视频进行触摸画面调整操作,以便对平面画面视频的视频参数进行调整。In step S803, the user can perform a touch screen adjustment operation on the flat screen video on the preview display screen, so as to adjust the video parameters of the flat screen video.
如可通过画面拖动操作拖动平面画面视频在预览显示屏幕中的显示区域,以调整平面画面视频的视角范围,如可从31度至150度的范围拖动到1度至120度的范围,如图9b所示。For example, the display area of the flat screen video in the preview display screen can be dragged by the screen drag operation to adjust the viewing angle range of the flat screen video. For example, it can be dragged from the range of 31 degrees to 150 degrees to the range of 1 degree to 120 degrees. , As shown in Figure 9b.
还可通过画面缩放操作调整预览显示屏幕上显示平面画面视频的区域大小,以调整平面画面视频的视场角参数,如可从显示全景画面视频的120度区域对应的平面画面视频调整到显示全景画面视频的180度区域对应的平面画面视频,如图9c所示。You can also adjust the area size of the flat screen video displayed on the preview display screen through the screen zoom operation to adjust the field of view parameters of the flat screen video. For example, you can adjust the flat screen video corresponding to the 120-degree area of the panoramic screen video to display the panorama The flat screen video corresponding to the 180-degree area of the screen video is shown in Figure 9c.
或可直接通过画面设定操作在预览显示屏幕上直接设置平面画面视频的视场角参数、视角参数、追踪物体参数、投影模式参数以及画面显示比例参数(即在预览显示屏幕上直接输入对应的视频参数)。Or you can directly set the field of view parameters, angle of view parameters, tracking object parameters, projection mode parameters, and screen display scale parameters of the flat screen video on the preview display screen through the screen setting operation (that is, directly enter the corresponding parameters on the preview display screen). Video parameters).
可选的,在本步骤中,全景相机还可通过用户在预览显示屏幕上的画面物体选择操作确定多个追踪物体,如用户在预览显示屏幕上长按点击特定物体,以作为追踪物体,如图9c所示,用户可通过预览显示屏幕选定追踪物体A和追踪物体B,随后全景相机会以预设平面画面视频参数(比如视场角参数或投影模式参数等,视场角参数以及物体追踪参数此时设定失效)生成追踪物体A和追踪物体B对应的平面画面视频。这样全景相机可同时设置多个追踪物体的画面视频,如图9c中的虚线框所示。Optionally, in this step, the panoramic camera can also determine multiple tracking objects through the user's screen object selection operation on the preview display screen. For example, the user long-presses and clicks a specific object on the preview display screen as the tracking object, such as As shown in Figure 9c, the user can select tracking object A and tracking object B through the preview display screen, and then the panoramic camera will preset the flat screen video parameters (such as field of view parameters or projection mode parameters, etc., field of view parameters and object The setting of tracking parameters is invalid at this time) Generate flat screen video corresponding to tracking object A and tracking object B. In this way, the panoramic camera can simultaneously set up multiple images of tracking objects, as shown by the dashed box in Figure 9c.
可选的,在本步骤中,全景相机如判断用户设置的平面画面视频为前全景摄像头拍摄的前全景画面视频,全景相机还可同时获取后全景摄像头拍摄的后全景画面视频中的镜像画面视频,如图9d所示。这样全景相机可同时记录前全景画面视频中的拍摄物体视频93以及后全景画面视频中的用户面部视频94,如图9d中的虚线框所示。Optionally, in this step, if the panoramic camera determines that the flat screen video set by the user is the front panoramic screen video shot by the front panoramic camera, the panoramic camera can also simultaneously obtain the mirror image video in the rear panoramic screen video shot by the rear panoramic camera. , As shown in Figure 9d. In this way, the panoramic camera can simultaneously record the subject video 93 in the front panoramic image video and the user's face video 94 in the rear panoramic image video, as shown by the dashed box in FIG. 9d.
步骤S804,全景相机接收视频拍摄开始指令,并根据该视频拍摄开始指令开始记录预览显示屏幕的设定视频参数的平面画面视频、多个追踪物体的平面画面视频、以及设定视频参数的平面画面视频以及对应的镜像画面视频。Step S804, the panoramic camera receives the video shooting start instruction, and according to the video shooting start instruction, starts to record the flat screen video of the set video parameters of the preview display screen, the flat screen video of multiple tracking objects, and the flat screen of the set video parameters. Video and the corresponding mirror image video.
步骤S805,全景相机接收视频拍摄结束指令,并根据该视频拍摄结束指令结束记录预览显示屏幕的设定视频参数的平面画面视频、多个追踪物体的平面画面视频、以及设定视频参数的平面画面视频以及对应的镜像画面视频。In step S805, the panoramic camera receives the video shooting end instruction, and according to the video shooting end instruction, ends the recording of a flat screen video with set video parameters on the preview display screen, flat screen videos with multiple tracking objects, and a flat screen set with video parameters Video and the corresponding mirror image video.
步骤S806,全景相机将上述平面画面视频以及对应的镜像画面视频与360度的全景画面视频合成为对应的画中画视频,并发送至其他终端。In step S806, the panoramic camera synthesizes the above-mentioned flat screen video and the corresponding mirror image video and the 360-degree panoramic screen video into a corresponding picture-in-picture video, and sends it to other terminals.
如图9e所示,步骤S805生成的平面画面视频96以及镜像画面视频97可位于全景画面视频转换的360度的平面画面视频95的右上角和/或右下角,以便其他终端的用户可同时对设定区域的平面画面视频96、镜像画面视频97以及360度的平面画面视频95进行选择观看。As shown in FIG. 9e, the flat screen video 96 and the mirrored screen video 97 generated in step S805 can be located in the upper right corner and/or the lower right corner of the 360-degree flat screen video 95 converted from the panoramic image video, so that users of other terminals can view the video at the same time. The flat screen video 96, the mirrored screen video 97, and the 360-degree flat screen video 95 of the set area are selected for viewing.
本发明的视频生成方法及视频生成装置可通过预览显示屏幕对平面画面视频的视频参数进行调整,以便全景相机在拍摄全景画面视频的同时生成对应的平面画面视频;提高了全景相机的画面编辑效率,满足了用户实时观看全景编辑画面的需求;有效解决了现有的视频生成方法及视频生成装置的画面编辑效率较为低下,不能满足用户实时观看全景编辑画面的需求的技术问题。The video generation method and the video generation device of the present invention can adjust the video parameters of the flat screen video through the preview display screen, so that the panoramic camera generates the corresponding flat screen video while shooting the panoramic screen video; improving the screen editing efficiency of the panoramic camera , To meet the needs of users to watch the panoramic editing screen in real time; effectively solve the technical problem that the existing video generation methods and video generation devices have relatively low screen editing efficiency and cannot meet the needs of users to watch the panoramic editing screen in real time.
如本申请所使用的术语“组件”、“模块”、“系统”、“接口”、“进程”等等一般地旨在指计算机相关实体:硬件、硬件和软件的组合、软件或执行中的软件。例如,组件可以是但不限于是运行在处理器上的进程、处理器、对象、可执行应用、执行的线程、程序和/或计算机。通过图示,运行在控制器上的应用和该控制器二者都可以是组件。一个或多个组件可以有在于执行的进程和/或线程内,并且组件可以位于一个计算机上和/或分布在两个或更多计算机之间。As used in this application, the terms “component”, “module”, “system”, “interface”, “process”, etc., are generally intended to refer to computer-related entities: hardware, a combination of hardware and software, software or components in execution software. For example, a component may be, but is not limited to, a process, a processor, an object, an executable application, a thread of execution, a program, and/or a computer running on a processor. By way of illustration, both the application running on the controller and the controller can be components. One or more components may exist in an executing process and/or thread, and the components may be located on one computer and/or distributed between two or more computers.
图10和随后的讨论提供了对实现本发明所述的视频生成装置所在的电子设备的工作环境的简短、概括的描述。图10的工作环境仅仅是适当的工作环境的一个实例并且不旨在建议关于工作环境的用途或功能的范围的任何限制。实例电子设备1012包括但不限于可穿戴设备、头戴设备、医疗健康平台、个人计算机、服务器计算机、手持式或膝上型设备、移动设备(比如移动电话、个人数字助理(PDA)、媒体播放器等等)、多处理器系统、消费型电子设备、小型计算机、大型计算机、包括上述任意系统或设备的分布式计算环境,等等。Figure 10 and the subsequent discussion provide a brief and general description of the working environment of the electronic device in which the video generation apparatus of the present invention is implemented. The working environment of FIG. 10 is only an example of a suitable working environment and is not intended to suggest any limitation on the scope of the use or function of the working environment. Example electronic devices 1012 include, but are not limited to, wearable devices, head-mounted devices, medical and health platforms, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players) Etc.), multi-processor systems, consumer electronic devices, small computers, large computers, distributed computing environments including any of the above systems or devices, etc.
尽管没有要求,但是在“计算机可读指令”被一个或多个电子设备执行的通用背景下描述实施例。计算机可读指令可以经由计算机可读介质来分布(下文讨论)。计算机可读指令可以实现为程序模块,比如执行特定任务或实现特定抽象数据类型的功能、对象、应用编程接口(API)、数据结构等等。典型地,该计算机可读指令的功能可以在各种环境中随意组合或分布。Although not required, the embodiments are described in the general context of "computer-readable instructions" being executed by one or more electronic devices. Computer readable instructions can be distributed via computer readable media (discussed below). Computer readable instructions can be implemented as program modules, such as functions, objects, application programming interfaces (APIs), data structures, etc. that perform specific tasks or implement specific abstract data types. Typically, the functions of the computer-readable instructions can be freely combined or distributed in various environments.
图10图示了包括本发明的视频生成装置中的一个或多个实施例的电子设备1012的实例。在一种配置中,电子设备1012包括至少一个处理单元1016和存储器1018。根据电子设备的确切配置和类型,存储器1018可以是易失性的(比如RAM)、非易失性的(比如ROM、闪存等)或二者的某种组合。该配置在图10中由虚线1014图示。FIG. 10 illustrates an example of an electronic device 1012 including one or more embodiments in the video generating apparatus of the present invention. In one configuration, the electronic device 1012 includes at least one processing unit 1016 and a memory 1018. Depending on the exact configuration and type of the electronic device, the memory 1018 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This configuration is illustrated by the dashed line 1014 in FIG. 10.
在其他实施例中,电子设备1012可以包括附加特征和/或功能。例如,设备1012还可以包括附加的存储装置(例如可移除和/或不可移除的),其包括但不限于磁存储装置、光存储装置等等。这种附加存储装置在图10中由存储装置1020图示。在一个实施例中,用于实现本文所提供的一个或多个实施例的计算机可读指令可以在存储装置1020中。存储装置1020还可以存储用于实现操作系统、应用程序等的其他计算机可读指令。计算机可读指令可以载入存储器1018中由例如处理单元1016执行。In other embodiments, the electronic device 1012 may include additional features and/or functions. For example, the device 1012 may also include additional storage devices (for example, removable and/or non-removable), including but not limited to magnetic storage devices, optical storage devices, and so on. Such an additional storage device is illustrated by the storage device 1020 in FIG. 10. In one embodiment, computer readable instructions for implementing one or more embodiments provided herein may be in the storage device 1020. The storage device 1020 may also store other computer-readable instructions for implementing an operating system, application programs, and the like. The computer readable instructions can be loaded into the memory 1018 and executed by the processing unit 1016, for example.
本文所使用的术语“计算机可读介质”包括计算机存储介质。计算机存储介质包括以用于存储诸如计算机可读指令或其他数据之类的信息的任何方法或技术实现的易失性和非易失性、可移除和不可移除介质。存储器1018和存储装置1020是计算机存储介质的实例。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字通用盘(DVD)或其他光存储装置、盒式磁带、磁带、磁盘存储装置或其他磁存储设备、或可以用于存储期望信息并可以被电子设备1012访问的任何其他介质。任意这样的计算机存储介质可以是电子设备1012的一部分。The term "computer-readable medium" as used herein includes computer storage media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions or other data. The memory 1018 and the storage device 1020 are examples of computer storage media. Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical storage devices, cassette tapes, magnetic tapes, disk storage devices or other magnetic storage devices, Or any other medium that can be used to store desired information and can be accessed by the electronic device 1012. Any such computer storage medium may be part of the electronic device 1012.
电子设备1012还可以包括允许电子设备1012与其他设备通信的通信连接1026。通信连接1026可以包括但不限于调制解调器、网络接口卡(NIC)、集成网络接口、射频发射器/接收器、红外端口、USB连接或用于将电子设备1012连接到其他电子设备的其他接口。通信连接1026可以包括有线连接或无线连接。通信连接1026可以发射和/或接收通信媒体。The electronic device 1012 may also include a communication connection 1026 that allows the electronic device 1012 to communicate with other devices. The communication connection 1026 may include, but is not limited to, a modem, a network interface card (NIC), an integrated network interface, a radio frequency transmitter/receiver, an infrared port, a USB connection, or other interfaces for connecting the electronic device 1012 to other electronic devices. The communication connection 1026 may include a wired connection or a wireless connection. The communication connection 1026 can transmit and/or receive communication media.
术语“计算机可读介质”可以包括通信介质。通信介质典型地包含计算机可读指令或诸如载波或其他传输机构之类的“己调制数据信号”中的其他数据,并且包括任何信息递送介质。术语“己调制数据信号”可以包括这样的信号:该信号特性中的一个或多个按照将信息编码到信号中的方式来设置或改变。The term "computer-readable medium" may include communication media. Communication media typically contain computer-readable instructions or other data in a "modulated data signal" such as a carrier wave or other transmission mechanism, and include any information delivery media. The term "modulated data signal" may include a signal in which one or more of the characteristics of the signal is set or changed in a manner that encodes information into the signal.
电子设备1012可以包括输入设备1024,比如键盘、鼠标、笔、语音输入设备、触摸输入设备、红外相机、视频输入设备和/或任何其他输入设备。设备1012中也可以包括输出设备1022,比如一个或多个显示器、扬声器、打印机和/或任意其他输出设备。输入设备1024和输出设备1022可以经由有线连接、无线连接或其任意组合连接到电子设备1012。在一个实施例中,来自另一个电子设备的输入设备或输出设备可以被用作电子设备1012的输入设备1024或输出设备1022。The electronic device 1012 may include an input device 1024, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, and/or any other input device. The device 1012 may also include an output device 1022, such as one or more displays, speakers, printers, and/or any other output devices. The input device 1024 and the output device 1022 may be connected to the electronic device 1012 via a wired connection, a wireless connection, or any combination thereof. In one embodiment, an input device or output device from another electronic device may be used as the input device 1024 or output device 1022 of the electronic device 1012.
电子设备1012的组件可以通过各种互连(比如总线)连接。这样的互连可以包括外围组件互连(PCI)(比如快速PCI)、通用串行总线(USB)、火线(IEEE 1394)、光学总线结构等等。在另一个实施例中,电子设备1012的组件可以通过网络互连。例如,存储器1018可以由位于不同物理位置中的、通过网络互连的多个物理存储器单元构成。The components of the electronic device 1012 may be connected through various interconnections (such as buses). Such interconnections may include Peripheral Component Interconnect (PCI) (such as PCI Express), Universal Serial Bus (USB), FireWire (IEEE 1394), optical bus structure, and so on. In another embodiment, the components of the electronic device 1012 may be interconnected through a network. For example, the memory 1018 may be composed of multiple physical memory units located in different physical locations and interconnected by a network.
本领域技术人员将认识到,用于存储计算机可读指令的存储设备可以跨越网络分布。例如,可经由网络1028访问的电子设备1030可以存储用于实现本发明所提供的一个或多个实施例的计算机可读指令。电子设备1012可以访问电子设备1030并且下载计算机可读指令的一部分或所有以供执行。可替代地,电子设备1012可以按需要下载多条计算机可读指令,或者一些指令可以在电子设备1012处执行并且一些指令可以在电子设备1030处执行。Those skilled in the art will recognize that storage devices used to store computer-readable instructions can be distributed across a network. For example, the electronic device 1030 accessible via the network 1028 may store computer-readable instructions for implementing one or more embodiments provided by the present invention. The electronic device 1012 can access the electronic device 1030 and download part or all of the computer-readable instructions for execution. Alternatively, the electronic device 1012 may download multiple computer-readable instructions as needed, or some instructions may be executed at the electronic device 1012 and some instructions may be executed at the electronic device 1030.
本文提供了实施例的各种操作。在一个实施例中,所述的一个或多个操作可以构成一个或多个计算机可读介质上存储的计算机可读指令,其在被电子设备执行时将使得计算设备执行所述操作。描述一些或所有操作的顺序不应当被解释为暗示这些操作必需是顺序相关的。本领域技术人员将理解具有本说明书的益处的可替代的排序。而且,应当理解,不是所有操作必需在本文所提供的每个实施例中存在。This document provides various operations of the embodiment. In an embodiment, the one or more operations described may constitute one or more computer-readable instructions stored on a computer-readable medium, which, when executed by an electronic device, will cause the computing device to perform the operations. Describing the order of some or all operations should not be interpreted as implying that these operations must be order-dependent. Those skilled in the art will understand alternative rankings that have the benefit of this description. Moreover, it should be understood that not all operations are necessarily present in every embodiment provided herein.
而且,尽管已经相对于一个或多个实现方式示出并描述了本公开,但是本领域技术人员基于对本说明书和附图的阅读和理解将会想到等价变型和修改。本公开包括所有这样的修改和变型,并且仅由所附权利要求的范围限制。特别地关于由上述组件(例如元件、资源等)执行的各种功能,用于描述这样的组件的术语旨在对应于执行所述组件的指定功能(例如其在功能上是等价的)的任意组件(除非另外指示),即使在结构上与执行本文所示的本公开的示范性实现方式中的功能的公开结构不等同。此外,尽管本公开的特定特征已经相对于若干实现方式中的仅一个被公开,但是这种特征可以与如可以对给定或特定应用而言是期望和有利的其他实现方式的一个或多个其他特征组合。而且,就术语“包括”、“具有”、“含有”或其变形被用在具体实施方式或权利要求中而言,这样的术语旨在以与术语“包含”相似的方式包括。Moreover, although the present disclosure has been shown and described with respect to one or more implementation manners, those skilled in the art will conceive equivalent variations and modifications based on the reading and understanding of the specification and the drawings. The present disclosure includes all such modifications and variations, and is limited only by the scope of the appended claims. Particularly with regard to the various functions performed by the above-mentioned components (such as elements, resources, etc.), the terms used to describe such components are intended to correspond to the functions that perform the specified functions of the components (for example, they are functionally equivalent) Any component (unless otherwise indicated), even if it is not structurally equivalent to the disclosed structure that performs the function in the exemplary implementation of the present disclosure shown herein. In addition, although a specific feature of the present disclosure has been disclosed with respect to only one of several implementations, this feature can be combined with one or more of other implementations that may be desirable and advantageous for a given or specific application. Other feature combinations. Moreover, as far as the terms "including", "having", "containing" or their variants are used in specific embodiments or claims, such terms are intended to be included in a similar manner to the term "comprising".
本发明实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。上述提到的存储介质可以是只读存储器,磁盘或光盘等。上述的各装置或系统,可以执行相应方法实施例中的方法。The functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium. The aforementioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc. Each of the above-mentioned devices or systems can execute the methods in the corresponding method embodiments.
综上所述,虽然本发明已以实施例揭露如上,实施例前的序号仅为描述方便而使用,对本发明各实施例的顺序不造成限制。并且,上述实施例并非用以限制本发明,本领域的普通技术人员,在不脱离本发明的精神和范围内,均可作各种更动与润饰,因此本发明的保护范围以权利要求界定的范围为准。To sum up, although the present invention has been disclosed above in embodiments, the sequence numbers before the embodiments are used only for convenience of description, and do not limit the order of the embodiments of the present invention. Moreover, the above-mentioned embodiments are not intended to limit the present invention. Those of ordinary skill in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention is defined by the claims. The range shall prevail.

Claims (15)

  1. 一种视频生成方法,用于全景相机生成对应平面画面视频,其中所述全景相机包括机体、设置在所述机体前侧的前全景摄像头、设置在所述机体后侧的后全景摄像头以及设置在所述机体后侧的预览显示屏幕,其中所述视频生成方法包括:A video generation method is used for a panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, a rear panoramic camera arranged on the rear side of the body, and The preview display screen on the rear side of the body, wherein the video generation method includes:
    使用所述前全景摄像头和所述后全景摄像头拍摄全景画面视频;Use the front panoramic camera and the rear panoramic camera to shoot a panoramic picture video;
    根据预设平面画面视频参数,使用所述预览显示屏幕显示对应的平面画面视频;其中所述预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;According to the preset flat screen video parameters, the preview display screen is used to display the corresponding flat screen video; wherein the preset flat screen video parameters include field of view parameters, angle of view parameters, object tracking parameters, projection mode parameters, and screen display scale parameter;
    接收用户的平面画面视频参数调整指令,并根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整,并使用所述预览显示屏幕显示调整后的平面画面视频;Receiving a flat screen video parameter adjustment instruction from a user, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and display the adjusted flat screen video using the preview display screen;
    接收视频拍摄开始指令,并根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频;Receiving a video shooting start instruction, and starting to record the flat screen video of the preview display screen according to the video shooting start instruction;
    接收视频拍摄结束指令,并根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频。Receiving a video shooting end instruction, and ending recording of the flat screen video of the preview display screen according to the video shooting end instruction.
  2. 根据权利要求1所述的视频生成方法,其中所述视频生成方法还包括:The video generation method according to claim 1, wherein the video generation method further comprises:
    将所述平面画面视频发送给其他终端;或Sending the flat screen video to other terminals; or
    将所述平面画面视频与所述全景画面视频合成为画中画视频,并发送给其他终端。The flat screen video and the panoramic screen video are synthesized into a picture-in-picture video and sent to other terminals.
  3. 根据权利要求1所述的视频生成方法,其中所述根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整的步骤包括:The video generation method according to claim 1, wherein the step of adjusting the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction comprises:
    基于用户在所述预览显示屏幕上的触摸画面调整操作,对所述平面画面视频的视场角参数、视角参数以及画面显示比例参数进行调整;其中所述触摸画面调整操作包括画面拖动操作,画面缩放操作以及画面设定操作。Based on the user's touch screen adjustment operation on the preview display screen, the field of view parameters, angle of view parameters, and screen display scale parameters of the flat screen video are adjusted; wherein the touch screen adjustment operation includes a screen drag operation, Screen zoom operation and screen setting operation.
  4. 根据权利要求3所述的视频生成方法,其中所述根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整的步骤包括:The video generation method according to claim 3, wherein the step of adjusting the video parameters of the flat-screen video according to the flat-screen video parameter adjustment instruction comprises:
    基于用户在所述预览显示屏幕上的画面物体选择操作,确定所述全景画面视频中的至少两个追踪物体,并以预设平面画面视频参数或调整后的视频参数显示任一所述追踪物体的平面画面视频;Based on the user's screen object selection operation on the preview display screen, at least two tracking objects in the panoramic screen video are determined, and any one of the tracking objects is displayed with preset flat screen video parameters or adjusted video parameters The flat screen video;
    所述根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频的步骤包括:The step of starting to record the flat screen video of the preview display screen according to the video shooting start instruction includes:
    根据所述视频拍摄开始指令开始记录至少两个所述追踪物体的平面画面视频;Start recording at least two flat screen videos of the tracking object according to the video shooting start instruction;
    所述根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频的步骤包括:The step of ending recording of the flat screen video of the preview display screen according to the video shooting end instruction includes:
    根据所述视频拍摄开始指令结束记录至少两个所述追踪物体的平面画面视频。End recording of at least two flat screen videos of the tracking object according to the video shooting start instruction.
  5. 根据权利要求4所述的视频生成方法,其中所述视频生成方法还包括:The video generation method according to claim 4, wherein the video generation method further comprises:
    根据追踪物体切换指令,对所述预览显示屏幕显示的平面画面视频中的追踪物体进行切换。According to the tracking object switching instruction, the tracking object in the flat screen video displayed on the preview display screen is switched.
  6. 根据权利要求4所述的视频生成方法,其中所述视频生成方法还包括:The video generation method according to claim 4, wherein the video generation method further comprises:
    将至少两个追踪物体的平面画面视频以及所述全景画面视频合成为画中画视频,并发送给其他终端。The flat screen video of at least two tracking objects and the panoramic screen video are synthesized into a picture-in-picture video and sent to other terminals.
  7. 根据权利要求1所述的视频生成方法,其中所述根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频的步骤包括:The video generation method according to claim 1, wherein the step of starting to record the flat screen video of the preview display screen according to the video shooting start instruction comprises:
    当所述平面画面视频属于所述前全景摄像头拍摄的前全景画面视频;获取所述后全景摄像头拍摄的后全景画面视频中的镜像画面视频,其中所述平面画面视频与镜像画面视频的视角参数相差180度;When the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; acquire the mirrored screen video in the rear panoramic screen video shot by the rear panoramic camera, wherein the angle parameters of the flat screen video and the mirrored screen video 180 degrees difference;
    根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频;Start recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting start instruction;
    所述根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频的步骤包括:The step of ending recording of the flat screen video of the preview display screen according to the video shooting end instruction includes:
    根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频。End recording of the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
  8. 根据权利要求7所述的视频生成方法,其中所述视频生成方法还包括:8. The video generation method according to claim 7, wherein the video generation method further comprises:
    将所述平面画面视频以及相应的镜像画面视频发送给其他终端;或Sending the flat screen video and the corresponding mirror screen video to other terminals; or
    将所述平面画面视频、所述镜像画面视频以及所述全景画面视频合成为画中画视频,并发送给其他终端。The flat screen video, the mirrored screen video, and the panoramic screen video are synthesized into a picture-in-picture video and sent to other terminals.
  9. 一种视频生成装置,设置在全景相机中,用于所述全景相机生成对应平面画面视频,其中所述全景相机包括机体、设置在所述机体前侧的前全景摄像头、设置在所述机体后侧的后全景摄像头以及设置在所述机体后侧的预览显示屏幕,其中所述视频生成装置包括:A video generating device is provided in a panoramic camera and used for the panoramic camera to generate a corresponding flat screen video, wherein the panoramic camera includes a body, a front panoramic camera arranged on the front side of the body, and a front panoramic camera arranged behind the body A rear panoramic camera on the side and a preview display screen arranged on the rear side of the body, wherein the video generating device includes:
    拍摄模块,用于使用所述前全景摄像头和所述后全景摄像头拍摄全景画面视频;A photographing module, configured to use the front panoramic camera and the rear panoramic camera to take a panoramic picture video;
    显示模块,用于根据预设平面画面视频参数,使用所述预览显示屏幕显示对应的平面画面视频;其中所述预设平面画面视频参数包括视场角参数、视角参数、物体追踪参数、投影模式参数以及画面显示比例参数;The display module is configured to use the preview display screen to display the corresponding flat screen video according to the preset flat screen video parameters; wherein the preset flat screen video parameters include field angle parameters, angle of view parameters, object tracking parameters, and projection mode Parameters and screen display ratio parameters;
    调整模块,用于接收用户的平面画面视频参数调整指令,并根据所述平面画面视频参数调整指令对所述平面画面视频的视频参数进行调整,并使用所述预览显示屏幕显示调整后的平面画面视频;The adjustment module is used to receive a user’s flat screen video parameter adjustment instruction, adjust the video parameters of the flat screen video according to the flat screen video parameter adjustment instruction, and use the preview display screen to display the adjusted flat screen video;
    开始记录模块,用于接收视频拍摄开始指令,并根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频;The start recording module is configured to receive a video shooting start instruction, and start recording the flat screen video of the preview display screen according to the video shooting start instruction;
    结束记录模块,用于接收视频拍摄结束指令,并根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频。The end recording module is configured to receive a video shooting end instruction, and end recording the flat screen video of the preview display screen according to the video shooting end instruction.
  10. 根据权利要求9所述的视频生成装置,其中视频发送模块,用于将所述平面画面视频发送给其他终端;或将所述平面画面视频与所述全景画面视频合成为画中画视频,并发送给其他终端。The video generating device according to claim 9, wherein the video sending module is configured to send the flat screen video to other terminals; or synthesize the flat screen video and the panoramic screen video into a picture-in-picture video, and Send to other terminals.
  11. 根据权利要求9所述的视频生成装置,其中所述调整模块用于基于用户在所述预览显示屏幕上的触摸画面调整操作,对所述平面画面视频的视场角参数、视角参数以及画面显示比例参数进行调整;其中所述触摸画面调整操作包括画面拖动操作,画面缩放操作以及画面设定操作。The video generation device according to claim 9, wherein the adjustment module is configured to display the field angle parameters, the angle of view parameters, and the screen display of the flat screen video based on the user's touch screen adjustment operation on the preview display screen. Scale parameters are adjusted; wherein the touch screen adjustment operations include screen drag operations, screen zoom operations, and screen setting operations.
  12. 根据权利要求9所述的视频生成装置,其中所述调整模块用于基于用户在所述预览显示屏幕上的画面物体选择操作,确定所述全景画面视频中的至少两个追踪物体,并以预设平面画面视频参数或调整后的视频参数显示任一所述追踪物体的平面画面视频;The video generating device according to claim 9, wherein the adjustment module is configured to determine at least two tracking objects in the panoramic image video based on the user's selection operation of the image object on the preview display screen, and to predict Set the flat screen video parameter or the adjusted video parameter to display any flat screen video of the tracked object;
    所述开始记录模块用于根据所述视频拍摄开始指令开始记录至少两个所述追踪物体的平面画面视频;The start recording module is configured to start recording at least two flat screen videos of the tracking object according to the video shooting start instruction;
    所述结束记录模块用于根据所述视频拍摄开始指令结束记录至少两个所述追踪物体的平面画面视频。The end recording module is configured to end recording of at least two flat screen videos of the tracking object according to the video shooting start instruction.
  13. 根据权利要求12所述的视频生成装置,其中所述调整模块用于根据追踪物体切换指令,对所述预览显示屏幕显示的平面画面视频中的追踪物体进行切换。The video generating device according to claim 12, wherein the adjustment module is configured to switch the tracking object in the flat screen video displayed on the preview display screen according to the tracking object switching instruction.
  14. 根据权利要求9所述的视频生成装置,其中所述开始记录模块还用于当所述平面画面视频属于所述前全景摄像头拍摄的前全景画面视频;获取所述后全景摄像头拍摄的后全景画面视频中的镜像画面视频,其中所述平面画面视频与镜像画面视频的视角参数相差180度;根据所述视频拍摄开始指令开始记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频;The video generating device according to claim 9, wherein the start recording module is further configured to: when the flat screen video belongs to the front panoramic screen video shot by the front panoramic camera; obtain the rear panoramic screen shot by the rear panoramic camera The mirror image video in the video, wherein the viewing angle parameters of the plane image video and the mirror image video differ by 180 degrees; start recording the plane image video of the preview display screen and the corresponding mirror image video according to the video shooting start instruction;
    所述结束记录模块还用于根据所述视频拍摄结束指令结束记录所述预览显示屏幕的平面画面视频以及对应的镜像画面视频。The end recording module is further configured to end recording the flat screen video and the corresponding mirror image video of the preview display screen according to the video shooting end instruction.
  15. 一种计算机可读存储介质,其内存储有处理器可执行指令,所述指令由一个或一个以上处理器加载,以执行上述权利要求1中的视频生成方法。A computer-readable storage medium storing processor-executable instructions, and the instructions are loaded by one or more processors to execute the video generation method in claim 1.
PCT/CN2021/078311 2020-02-28 2021-02-27 Video generation method and device, and corresponding storage medium WO2021170123A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010126786.7A CN111327823A (en) 2020-02-28 2020-02-28 Video generation method and device and corresponding storage medium
CN202010126786.7 2020-02-28

Publications (1)

Publication Number Publication Date
WO2021170123A1 true WO2021170123A1 (en) 2021-09-02

Family

ID=71171151

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078311 WO2021170123A1 (en) 2020-02-28 2021-02-27 Video generation method and device, and corresponding storage medium

Country Status (2)

Country Link
CN (1) CN111327823A (en)
WO (1) WO2021170123A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023125358A1 (en) * 2021-12-27 2023-07-06 影石创新科技股份有限公司 Video processing method and apparatus, computer device, and storage medium
WO2023226699A1 (en) * 2022-05-25 2023-11-30 荣耀终端有限公司 Video recording method and apparatus, and storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111327823A (en) * 2020-02-28 2020-06-23 深圳看到科技有限公司 Video generation method and device and corresponding storage medium
CN113497894B (en) * 2021-05-28 2023-08-22 影石创新科技股份有限公司 Video shooting method, device, terminal and storage medium
CN115914589A (en) * 2021-09-29 2023-04-04 杭州海康威视系统技术有限公司 Video projection method and device, electronic equipment and storage medium
CN116112781B (en) * 2022-05-25 2023-12-01 荣耀终端有限公司 Video recording method, device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1247996A (en) * 1998-08-28 2000-03-22 朗迅科技公司 Two-piece mirror full views picture display
CN105376471A (en) * 2015-12-21 2016-03-02 景好 Panorama shooting system based on moving platform and method
CN105843541A (en) * 2016-03-22 2016-08-10 乐视网信息技术(北京)股份有限公司 Target tracking and displaying method and device in panoramic video
CN106385587A (en) * 2016-09-14 2017-02-08 三星电子(中国)研发中心 Method, device and system for sharing virtual reality view angle
CN106445437A (en) * 2016-09-08 2017-02-22 深圳市金立通信设备有限公司 Terminal and view angle switching method thereof
CN108933920A (en) * 2017-05-25 2018-12-04 中兴通讯股份有限公司 A kind of output of video pictures, inspection method and device
CN111327823A (en) * 2020-02-28 2020-06-23 深圳看到科技有限公司 Video generation method and device and corresponding storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106165430B (en) * 2016-06-29 2019-11-08 北京小米移动软件有限公司 Net cast method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1247996A (en) * 1998-08-28 2000-03-22 朗迅科技公司 Two-piece mirror full views picture display
CN105376471A (en) * 2015-12-21 2016-03-02 景好 Panorama shooting system based on moving platform and method
CN105843541A (en) * 2016-03-22 2016-08-10 乐视网信息技术(北京)股份有限公司 Target tracking and displaying method and device in panoramic video
CN106445437A (en) * 2016-09-08 2017-02-22 深圳市金立通信设备有限公司 Terminal and view angle switching method thereof
CN106385587A (en) * 2016-09-14 2017-02-08 三星电子(中国)研发中心 Method, device and system for sharing virtual reality view angle
CN108933920A (en) * 2017-05-25 2018-12-04 中兴通讯股份有限公司 A kind of output of video pictures, inspection method and device
CN111327823A (en) * 2020-02-28 2020-06-23 深圳看到科技有限公司 Video generation method and device and corresponding storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023125358A1 (en) * 2021-12-27 2023-07-06 影石创新科技股份有限公司 Video processing method and apparatus, computer device, and storage medium
WO2023226699A1 (en) * 2022-05-25 2023-11-30 荣耀终端有限公司 Video recording method and apparatus, and storage medium

Also Published As

Publication number Publication date
CN111327823A (en) 2020-06-23

Similar Documents

Publication Publication Date Title
WO2021170123A1 (en) Video generation method and device, and corresponding storage medium
JP7322940B2 (en) Image communication system, image communication terminal, image communication method, program, and recording medium
CN110012209B (en) Panoramic image generation method, device, storage medium and electronic device
US10437545B2 (en) Apparatus, system, and method for controlling display, and recording medium
CN108495032B (en) Image processing method, image processing device, storage medium and electronic equipment
CN106210547A (en) Method, device and system for panoramic shooting
CN110636276B (en) Video shooting method and device, storage medium and electronic equipment
JP7205386B2 (en) IMAGING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM
CN108632543B (en) Image display method, image display device, storage medium and electronic equipment
WO2020143728A1 (en) Picture rendering method and device, terminal, and corresponding storage medium
WO2018166069A1 (en) Photographing preview method, graphical user interface, and terminal
CN106470313B (en) Image generation system and image generation method
JP7424076B2 (en) Image processing device, image processing system, imaging device, image processing method and program
CN114339072A (en) Image processing circuit, method and electronic device
CN114338874A (en) Image display method of electronic device, image processing circuit and electronic device
CN110673811B (en) Panoramic picture display method and device based on sound information positioning and storage medium
US10147160B2 (en) Image management apparatus and system, and method for controlling display of captured image
US20110187841A1 (en) Method for transmitting image data & display apparatus and display method using the same
CN114241127A (en) Panoramic image generation method and device, electronic equipment and medium
WO2019184498A1 (en) Video interactive method, computer device and storage medium
WO2021238942A1 (en) Anti-shake method, anti-shake apparatus, and electronic device
CN108920598B (en) Panorama browsing method and device, terminal equipment, server and storage medium
CN111311477B (en) Image editing method and device and corresponding storage medium
CN115426444A (en) Shooting method and device
WO2023130543A1 (en) Three-dimensional scene interactive video creation method and creation device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21761409

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21761409

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20-02-2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21761409

Country of ref document: EP

Kind code of ref document: A1