WO2021170122A1 - 图像编辑方法、装置及对应的存储介质 - Google Patents

图像编辑方法、装置及对应的存储介质 Download PDF

Info

Publication number
WO2021170122A1
WO2021170122A1 PCT/CN2021/078310 CN2021078310W WO2021170122A1 WO 2021170122 A1 WO2021170122 A1 WO 2021170122A1 CN 2021078310 W CN2021078310 W CN 2021078310W WO 2021170122 A1 WO2021170122 A1 WO 2021170122A1
Authority
WO
WIPO (PCT)
Prior art keywords
editing
video
image
editing operation
image editing
Prior art date
Application number
PCT/CN2021/078310
Other languages
English (en)
French (fr)
Inventor
陈丹
邢冬逢
Original Assignee
深圳看到科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳看到科技有限公司 filed Critical 深圳看到科技有限公司
Publication of WO2021170122A1 publication Critical patent/WO2021170122A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining

Definitions

  • the present invention relates to the field of image processing technology, in particular to an image editing method, device and corresponding storage medium.
  • the embodiment of the present invention provides an image editing method and an image editing device that can edit the 8k panoramic picture of a VR camera in real time through a mobile terminal, so that the VR camera can share the edited picture with others in time, so as to solve the existing problem.
  • the difficulty of image editing for the VR camera is relatively high, which leads to the technical problem of poor portability of the VR camera.
  • the embodiment of the present invention provides an image editing method, which includes:
  • the editing operation file receives an editing operation file corresponding to the edited video from the editing terminal; the editing operation file records the image editing operation of the editing terminal user on the editing video at the editing terminal;
  • the steps of the record editing terminal user's image editing operation of the edited video on the editing terminal include:
  • the image editing operation includes at least one of viewing angle adjustment, viewing angle adjustment, playback speed conversion, object tracking, and projection mode conversion;
  • the result of the image editing operation is recorded as the editing operation file, where the editing operation file includes editing video number, editing video playback time frame, and editing video playback parameters.
  • the step of using the editing operation file to perform an image editing operation on the displayed video includes:
  • the display video is a panoramic screen video
  • the display video after the image editing operation is a flat screen video
  • the method includes: recording the editing operation file in the form of a character string.
  • the step of performing an image editing operation on the edited video includes:
  • the image editing method further includes:
  • the pre-editing operation and the post-image editing operation corresponding to the designated area of the edited video after the image editing operation are saved as the preset image pre-editing operation instruction group.
  • the pre-editing operation and post-image editing operation corresponding to the designated area of the edited video after the image editing operation are saved as the preset image pre-editing operation instruction group
  • the steps include:
  • the image editing operation with a larger usage weight is set as the preset image pre-editing operation instruction group.
  • the pre-editing operation and post-image editing operation corresponding to the designated area of the edited video after the image editing operation are saved as the preset image pre-editing operation instruction group
  • the steps include:
  • a part of the image editing operation selected by the user in the displayed image editing operation is set as the preset image pre-editing operation instruction group.
  • the present invention also provides an image editing device, which includes:
  • the editing video sending module is used to convert the display video to the editing video and send the editing video to the editing terminal; wherein the video image resolution of the editing video is smaller than the video image resolution of the display video;
  • the editing operation file receiving module is configured to receive the editing operation file corresponding to the edited video from the editing terminal; the editing operation file records the image editing operation of the editing terminal user on the editing video on the editing terminal; and
  • the image editing module is used to perform an image editing operation on the display video using the editing operation file.
  • An embodiment of the present invention also provides a computer-readable storage medium, in which processor-executable instructions are stored, and the instructions are loaded by one or more processors to execute any of the above-mentioned image editing methods.
  • the image editing method and image editing device of the present invention send the edited video with a smaller video image resolution to the editing terminal for image editing, so that the VR camera can be edited based on Operate the file to perform image editing operations on the displayed video, so that the VR camera can edit the 8k panoramic image in real time, and share the edited image with others in time, reducing the difficulty of image editing of the VR camera; effectively solving the existing VR It is difficult for the camera to perform image editing, which leads to the technical problem of poor portability of the VR camera.
  • FIG. 1 is a flowchart of an embodiment of the image editing method of the present invention
  • FIG. 2 is a flowchart of an image editing operation performed by an editing terminal of an embodiment of the image editing method of the present invention
  • FIG. 3 is a flowchart of performing an image editing operation on a displayed video according to an embodiment of the image editing method of the present invention
  • FIG. 4 is a flowchart of performing an image editing operation on an edited video in an embodiment of the image editing method of the present invention
  • FIG. 5 is a schematic structural diagram of an embodiment of the image editing device of the present invention.
  • FIG. 6 is a flowchart of the image editing method and the image editing device of the present invention editing a panoramic screen video into a corresponding flat screen video;
  • FIG. 7 is a schematic diagram of the image editing method and image editing device of the present invention performing image editing operations on edited videos;
  • FIG. 8 is a schematic diagram of the working environment structure of the electronic equipment where the image editing apparatus of the present invention is located.
  • the image editing method and image editing device of the present invention are used for electronic equipment for real-time editing of panoramic images.
  • the electronic equipment includes but is not limited to wearable devices, head-mounted devices, medical and health platforms, personal computers, server computers, handheld or Laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players, etc.), multi-processor systems, consumer electronic devices, small computers, large computers, including any of the above-mentioned systems or devices Formula computing environment, etc.
  • the electronic device is preferably a panoramic VR camera or an electronic terminal used in conjunction with a panoramic VR camera, so as to edit the panoramic screen video shot by the VR camera in real time, which reduces the difficulty of image editing by the VR camera and improves the portability of the VR camera.
  • FIG. 1 is a flowchart of an embodiment of an image editing method of the present invention.
  • the image editing method of this embodiment can be implemented using the above-mentioned electronic equipment, especially a VR camera.
  • the image editing method of this embodiment includes the following steps:
  • Step S101 Convert the display video to the edited video, and send the edited video to the editing terminal; wherein the video image resolution of the edited video is smaller than the video image resolution of the displayed video;
  • Step S102 receiving an editing operation file corresponding to the edited video from the editing terminal;
  • the editing operation file records the image editing operation of the editing terminal user on the editing video on the editing terminal;
  • Step S103 using the editing operation file to perform an image editing operation on the displayed video.
  • an image editing device such as a VR camera captures a display video, that is, a panoramic screen video.
  • the display video of the VR camera is generally a panoramic picture video with a resolution of 8k, so sending the display video to the editing terminal will involve the transmission of large data traffic and high-quality picture processing and editing The question of the request.
  • the image editing device converts the display video into an edited video.
  • the video image resolution of the edited video is smaller than the video image resolution of the displayed video.
  • the video image resolution of the edited video is 4k, so that the editing terminal can perform the editing video Edit operation.
  • the image editing device sends the edited video to the editing terminal via wifi or USB.
  • step S102 the editing terminal receives the edited video, and then the editing terminal user performs an image editing operation on the edited video at the editing terminal.
  • FIG. 2 is a flowchart of the image editing operation performed by the editing terminal in an embodiment of the image editing method of the present invention. The process of this image editing operation includes:
  • step S201 the editing terminal displays the received edited video, so that the editing terminal can perform an image editing operation on the edited video.
  • step S202 the editing terminal performs an image editing operation on the edited video.
  • Specific image editing operations include field angle adjustment, angle of view adjustment, playback speed conversion, object tracking, and projection mode conversion.
  • the angle of view adjustment means the display angle of view of the edited video after the image editing operation, for example, it can display the edited video with a 60-degree field of view or the edited video with a 120-degree field of view in a 360-degree panoramic screen video.
  • the viewing angle adjustment indicates the display viewing angle range of the edited video after the image editing operation, for example, it can display the edited video in the range of 0 to 60 degrees or the edited video in the range of 61 degrees to 120 degrees in the 360-degree panoramic screen video.
  • the playback speed conversion indicates the playback speed of the edited video after the image editing operation, such as playing the edited video at a rate of 0.5 times, or playing the edited video at a rate of 2 times.
  • Object tracking refers to an object tracked in the edited video after the image editing operation, and the object can be a certain person or an object in the edited video after the image editing operation.
  • the projection mode represents the display mode of the edited video after the image editing operation.
  • the display mode can be perspective projection mode, cylindrical projection mode, asteroid projection mode, and equi-angle projection (Equi projection).
  • step S203 the editing terminal records the result of the image editing operation in step S202 as an editing operation file.
  • the editing operation file includes the editing video number, the editing video playback time frame, and the editing video playback parameters.
  • the editing video number is used to indicate the editing video corresponding to the editing operation file and the corresponding display video;
  • the editing video playback time frame is used to indicate the frame of the editing video corresponding to the image editing operation;
  • the editing video playback parameter is used to indicate the image Edit operation content corresponding to the edit operation.
  • the editing operation file can effectively record the image editing operation of the editing terminal user on the editing terminal.
  • the editing operation file can be saved in the form of a character string.
  • start_time “1000”: end_time “2000”: speed “1.0”: FOV "120”: type “1”: view “1-120”: object “red” means the edited video numbered 0001 In the 1000th frame to the 2000th frame, the angle of view is 120 degrees, the angle of view is the range of 0 degrees to 120 degrees of the panoramic image, the playback speed of the edited video after the image editing operation is 1.0, and the video after the image editing operation
  • the projection mode of the edited video is the mode corresponding to No. 1.
  • the edited video after the image editing operation will track the red object set in the edited video. In this way, the image editing device can perform an image editing operation on the displayed video based on the editing operation file.
  • the editing terminal sends the editing operation file to the image editing device via wifi or usb.
  • step S103 the image editing apparatus uses the editing operation file obtained in step S102 to perform an image editing operation on the displayed video.
  • FIG. 3 is a flowchart of an image editing operation on a displayed video according to an embodiment of the image editing method of the present invention.
  • the image editing operation process includes:
  • Step S301 the image editing device obtains the corresponding display video according to the editing video number of the editing operation file
  • Step S302 The image editing device performs an image editing operation on the display video (that is, performing a video rendering operation) according to the editing video playback time frame of the editing operation file and the editing video playback parameters, that is, performing field angle adjustment, viewing angle adjustment, and playback of the displayed video Editing operations such as speed adjustment, object tracking, and projection mode conversion to obtain the display video after the image editing operation.
  • the display video after the image editing operation is generally a high-quality flat screen video to represent part of the panorama in the panoramic screen video. Picture.
  • the image editing device can then send the flat screen video to other electronic terminals for sharing and display.
  • the image editing method of this embodiment sends the edited video with a smaller video image resolution to the editing terminal for image editing, so that the VR camera can perform image editing operations on the displayed video based on the editing operation file, so that the VR camera instantly performs 8k panoramic images Perform real-time editing and share the edited picture with others in time, reducing the difficulty of image editing for VR cameras.
  • FIG. 4 is a flowchart of the image editing operation on the edited video in an embodiment of the image editing method of the present invention.
  • the process of this image editing operation includes:
  • Step S401 the editing terminal obtains and displays the edited video
  • the editing terminal sets the pre-editing area of the edited video.
  • the pre-editing area here refers to the area in the edited video that needs to be processed in advance by the user. Fast, to facilitate image editing operations on other areas of the edited video. If you need to perform an image editing operation on a specific person, you can set the editing expectations that do not include the specific person in the edited video as a pre-editing area, and delete the pre-editing area.
  • the pre-editing area may also be the entire editing video area, such as adjusting the overall angle of view of the edited video in advance, and then performing post-image editing operations on the adjusted edited video, thereby improving the efficiency of image editing.
  • Step S403 The editing terminal uses at least one preset image pre-editing operation instruction group to perform a pre-editing operation on the pre-editing area of the edited video.
  • the preset image pre-editing operation instruction set here is a set of pre-editing operation instructions preset by the user, such as directly selecting the intro and end of the edited video for acceleration operation, or directly selecting the entire editing video area for the field of view Adjustment operation. Since this image editing pre-operation may be repeated on multiple different editing videos, the editing terminal can set an image editing operation or a collection of multiple image editing operations as the preset image pre-editing operation instruction group, thereby improving The efficiency of pre-editing operations in the pre-editing area of certain edited videos.
  • Step S404 After the editing terminal performs the pre-editing operation on the pre-editing area of the edited video, the editing terminal may perform a post-image editing operation on the edited video after the pre-editing operation, where the post-image editing operation is based on the user's editing video Personalized image editing operations for specific content.
  • the image editing operation in this embodiment is divided into a pre-editing operation and a post-image editing operation, the overall efficiency of the image editing operation is effectively improved.
  • the editing terminal of this embodiment can generate the corresponding preset image pre-editing operation instruction group in a variety of ways.
  • the editing terminal can directly save the pre-editing operation and the post-image editing operation corresponding to the designated area of the edited video after the image editing operation as a preset image pre-editing operation instruction group.
  • one type of image editing operation here refers to improving the editing video playback corresponding to all editing video playback time frames corresponding to the designated area.
  • the parameters are the same.
  • the image editing operation corresponding to the designated area is directly set as a preset image pre-editing operation instruction group.
  • the designated area of the edited video after the image editing operation corresponds to multiple different image editing operations.
  • the first half of the video in the designated area corresponds to 60 degrees
  • the second half of the video in the designated area corresponds to 120 degrees. It can be considered that the designated area of the edited video after the image editing operation corresponds to different image editing operations.
  • the editing terminal may set an image editing operation with a larger usage weight as a preset image pre-editing operation instruction group.
  • the larger weight here means that the area in the specified area corresponding to the corresponding image editing operation is larger. For example, one-third of the specified area of the video corresponds to a field of view of 60 degrees, and the other two-thirds of the specified area If the field of view corresponding to the video is 120 degrees, the image editing operation corresponding to the area with the field of view angle of 120 degrees in the designated area can be set as a preset image and editing operation instruction group.
  • the designated area of the edited video after the image editing operation includes many different image editing operations.
  • the editing terminal can also display the image editing operation of the designated area of the edited video after the image editing operation, such as displaying the field of view, angle of view, playback speed, display object, and projection mode corresponding to the image editing operation.
  • the editing terminal user can select part of the image editing operations to be set as the preset image pre-editing operation instruction group in the displayed image editing operations.
  • editing terminal users can directly set the image editing operation of the specified area as the preset image pre-editing operation instruction group, set the image editing operation of the part of the specified area as the preset image pre-editing operation instruction group, and specify Part of the image editing operation of the region is set as a preset image pre-editing operation instruction group, so that the efficiency of the editing terminal's image editing operation for editing videos can be effectively improved through the preset image pre-editing operation instruction group.
  • FIG. 5 is a schematic structural diagram of an embodiment of the image editing device of the present invention.
  • the image editing device of this embodiment can be implemented using the above-mentioned image editing method.
  • the image editing device 50 of this embodiment includes an editing video sending module 51, an editing operation file receiving module 52, and an image editing module 53.
  • the edited video sending module 51 is used to convert the display video into an edited video and send the edited video to the editing terminal 51; the video image resolution of the edited video is smaller than the video image resolution of the displayed video; the editing operation file receiving module 52 is used to The editing operation file corresponding to the edited video is received from the editing terminal 51; the editing operation file records the image editing operation of the editing terminal user on the editing video at the editing terminal 51; the image editing module 53 is used to perform image editing operations on the displayed video using the editing operation file.
  • the video sending module 51 first edits the display video captured by the video sending module 51, that is, the panoramic image video.
  • the display video of the VR camera is generally a panoramic picture video with a resolution of 8k, so sending the display video to the editing terminal will involve the transmission of large data traffic and high-quality picture processing and editing The question of the request.
  • the edited video sending module 51 converts the display video into an edited video.
  • the video image resolution of the edited video is smaller than the video image resolution of the displayed video. Edit the video for editing operations. Then the edited video sending module 51 sends the edited video to the editing terminal 51.
  • the editing terminal 51 receives the edited video, and then the editing terminal user performs an image editing operation on the edited video on the editing terminal 51, and the image editing operation flow includes:
  • the editing terminal 51 displays the received edited video, so that the editing terminal 51 can perform an image editing operation on the edited video.
  • the editing terminal 51 performs image editing operations on the edited video, and specific image editing operations include field of view angle adjustment, angle of view adjustment, playback speed conversion, object tracking, projection mode conversion, and the like.
  • the angle of view adjustment means the display angle of view of the edited video after the image editing operation, for example, it can display the edited video with a 60-degree field of view or the edited video with a 120-degree field of view in a 360-degree panoramic screen video.
  • the viewing angle adjustment indicates the display viewing angle range of the edited video after the image editing operation, for example, it can display the edited video in the range of 0 to 60 degrees or the edited video in the range of 61 degrees to 120 degrees in the 360-degree panoramic screen video.
  • the playback speed conversion indicates the playback speed of the edited video after the image editing operation, such as playing the edited video at a rate of 0.5 times, or playing the edited video at a rate of 2 times.
  • Object tracking refers to an object tracked in the edited video after the image editing operation, and the object can be a certain person or an object in the edited video after the image editing operation.
  • the projection mode represents the display mode of the edited video after the image editing operation.
  • the display mode can be perspective projection mode, cylindrical projection mode, asteroid projection mode, and equi-angle projection (Equi projection).
  • the editing terminal 51 records the result of the image editing operation as an editing operation file, and the editing operation file includes the edited video number, the edited video playback time frame, and the edited video playback parameters.
  • the editing video number is used to indicate the editing video corresponding to the editing operation file and the corresponding display video;
  • the editing video playback time frame is used to indicate the frame of the editing video corresponding to the image editing operation;
  • the editing video playback parameter is used to indicate the image Edit operation content corresponding to the edit operation.
  • the editing operation file can effectively record the image editing operation of the editing terminal user on the edited video at the editing terminal, and the image editing device 50 can perform the image editing operation on the displayed video based on the editing operation file.
  • the editing terminal 51 sends the editing operation file to the editing operation file receiving module 52 of the image editing device 50.
  • the image editing module 53 uses the acquired editing operation file to perform an image editing operation on the displayed video.
  • the specific process includes:
  • the image editing module 53 obtains the corresponding display video according to the editing video number of the editing operation file.
  • the image editing module 53 performs image editing operations on the display video according to the editing video playback time frame and editing video playback parameters of the editing operation file, that is, adjusting the viewing angle, viewing angle, playback speed, object tracking, and projection mode conversion of the displayed video. Wait for editing operations to obtain a display video after the image editing operation.
  • the display video after the image editing operation is generally a flat screen video to represent a part of the panoramic screen in the panoramic screen video.
  • the image editing device of this embodiment sends the edited video with a smaller video image resolution to the editing terminal for image editing, so that the VR camera can perform image editing operations on the displayed video based on the editing operation file, so that the VR camera instantly performs 8k panoramic images Perform real-time editing and share the edited picture with others in time, reducing the difficulty of image editing for VR cameras.
  • FIG. 6 is a flowchart of the image editing method and image editing device of the present invention editing a panoramic screen video into a corresponding flat image video
  • FIG. 7 is a flowchart of the image editing method and image editing device of the present invention.
  • the image editing device of this specific embodiment is set in a VR camera, which generates a corresponding editing operation file by sending the panoramic screen video to the user editing terminal for processing, and then performs an image editing operation on the panoramic screen video by editing the operation file.
  • the process of performing an image editing operation on a panoramic image video in this embodiment includes:
  • step S601 the VR camera converts the captured display video with a video image resolution of 8k into an edited video with a video image resolution of 4k.
  • step S602 the VR camera sends the edited video to the user editing terminal.
  • step S603 the user editing terminal displays the edited video.
  • the image editing frame includes the edited video frame 701 (not fully displayed in the editing terminal, only the part displayed in the edited video display frame 702 is displayed) , Edit video display box 702, edit video playback time frame selection box 703, angle of view adjustment box 704, angle of view adjustment box 705, playback speed adjustment box 706, object tracking box 707, projection mode conversion box 708, preset image pre-editing The operation instruction group loading box 709 and the preset image pre-editing operation instruction group saving box 710.
  • step S604 the editing terminal may perform an image editing operation on the edited video.
  • the editing terminal can select the pre-editing area corresponding to the editing video through the editing video playback time frame selection box 703, such as the designated area from the 1000th frame to the 2000th frame of the editing video in FIG. 7.
  • the editing terminal can load a preset image pre-editing operation instruction group through the preset image pre-editing operation instruction group loading box 709.
  • the preset image pre-editing operation instruction group in FIG. 7 directly sets the field of view angle to 120 degrees, the angle of view is 1 to 120 degrees (the angle of view should correspond to the field of view), and the projection mode is projection mode 1. This completes the pre-editing operation of the pre-editing area of the edited video.
  • the user performs post-image editing operations on the pre-edited edited video through the editing terminal.
  • the selected playback speed is 1.0
  • the selected tracking object is the red object in the screen. If the tracking object cannot be determined, the user can select the corresponding tracking object by touching the editing video screen on the display screen of the editing terminal. And the user can further adjust the field of view and angle of view by dragging the control bars in the field of view adjustment frame 704 and the field of view adjustment frame 705. Of course, they can also control other adjustment frames to edit other edited videos. Adjust the playback parameters.
  • the user can adjust the viewing angle range of the edited video by dragging the position of the edited video frame 701 in the edit video display frame 702 (for example, from a range of 1 degree to 120 degrees to a range of 181 degrees to 300 degrees) ,
  • the angle of view of the edited video can be adjusted by adjusting the size of the edited video frame 701 in the edit video display frame 702 (for example, by adjusting the distance between two touch points) (for example, adjusting the angle of view from 120 degrees to 180 degrees, the size of the corresponding edited video frame 701 in the edited video display frame 702 becomes smaller, so that more content in the edited video frame 701 is displayed in the edited video display frame 702). This completes the post-image editing operation of the edited video.
  • step S605 the user can save the image editing operations (pre-editing operations and post-image editing operations) of the currently edited video as a new preset image pre-editing operation instruction group through the preset image pre-editing operation instruction group save box 710.
  • the designated area of the edited video selected by the user has multiple different image editing operations, only the image editing operations with a higher weight will be displayed or the user can be prompted with a number of different image editing operation parameters through a dotted line, as shown in Figure 7
  • the selected playback speed is shown in 2.0.
  • Step S606 The editing terminal records the result of the image editing operation as an editing operation file, and sends the editing operation file to the VR camera.
  • step S607 the VR camera uses the editing operation file to perform an image editing operation on the displayed video, that is, converts the panoramic screen video shot by the VR camera into a corresponding flat screen video, and can share the converted flat screen video to the corresponding electronic terminal.
  • the image editing method and image editing device of the present invention send the edited video with a smaller video image resolution to the editing terminal for image editing, so that the VR camera can perform image editing operations on the displayed video based on the editing operation file, so that the VR camera instantly
  • the 8k panoramic image is edited in real time, and the edited image is shared with others in time, which reduces the difficulty of image editing of the VR camera; effectively solves the difficulty of image editing with the existing VR camera, which leads to the portable use of the VR camera Poor technical problems.
  • a component may be, but is not limited to, a process, a processor, an object, an executable application, a thread of execution, a program, and/or a computer running on a processor.
  • a component may be, but is not limited to, a process, a processor, an object, an executable application, a thread of execution, a program, and/or a computer running on a processor.
  • the application running on the controller and the controller can be components.
  • One or more components may exist in an executing process and/or thread, and the components may be located on one computer and/or distributed between two or more computers.
  • Example electronic devices 812 include, but are not limited to, wearable devices, head-mounted devices, medical and health platforms, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players) Etc.), multi-processor systems, consumer electronic devices, small computers, large computers, distributed computing environments including any of the above systems or devices, etc.
  • Computer readable instructions can be distributed via computer readable media (discussed below).
  • Computer readable instructions can be implemented as program modules, such as functions, objects, application programming interfaces (APIs), data structures, etc. that perform specific tasks or implement specific abstract data types.
  • program modules such as functions, objects, application programming interfaces (APIs), data structures, etc. that perform specific tasks or implement specific abstract data types.
  • APIs application programming interfaces
  • data structures such as lists, etc. that perform specific tasks or implement specific abstract data types.
  • the functions of the computer-readable instructions can be freely combined or distributed in various environments.
  • FIG. 8 illustrates an example of an electronic device 812 including one or more embodiments in the image editing apparatus of the present invention.
  • the electronic device 812 includes at least one processing unit 816 and a memory 818.
  • the memory 818 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This configuration is illustrated by the dashed line 814 in FIG. 8.
  • the electronic device 812 may include additional features and/or functions.
  • the device 812 may also include additional storage devices (for example, removable and/or non-removable), including but not limited to magnetic storage devices, optical storage devices, and the like.
  • additional storage devices for example, removable and/or non-removable
  • Such an additional storage device is illustrated by the storage device 820 in FIG. 8.
  • computer-readable instructions for implementing one or more embodiments provided herein may be in the storage device 820.
  • the storage device 820 may also store other computer-readable instructions for implementing an operating system, application programs, and the like.
  • the computer-readable instructions can be loaded into the memory 818 and executed by the processing unit 816, for example.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions or other data.
  • the memory 818 and the storage device 820 are examples of computer storage media.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical storage devices, cassette tapes, magnetic tapes, disk storage devices or other magnetic storage devices, Or any other medium that can be used to store desired information and can be accessed by the electronic device 812. Any such computer storage medium may be part of the electronic device 812.
  • the electronic device 812 may also include a communication connection 826 that allows the electronic device 812 to communicate with other devices.
  • the communication connection 826 may include, but is not limited to, a modem, a network interface card (NIC), an integrated network interface, a radio frequency transmitter/receiver, an infrared port, a USB connection, or other interfaces for connecting the electronic device 812 to other electronic devices.
  • the communication connection 826 may include a wired connection or a wireless connection.
  • the communication connection 826 can transmit and/or receive communication media.
  • Computer-readable medium may include communication media.
  • Communication media typically contain computer-readable instructions or other data in a “modulated data signal” such as a carrier wave or other transmission mechanism, and include any information delivery media.
  • modulated data signal may include a signal in which one or more of the characteristics of the signal is set or changed in a manner that encodes information into the signal.
  • the electronic device 812 may include an input device 824, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, and/or any other input device.
  • the device 812 may also include an output device 822, such as one or more displays, speakers, printers, and/or any other output devices.
  • the input device 824 and the output device 822 may be connected to the electronic device 812 via a wired connection, a wireless connection, or any combination thereof. In one embodiment, an input device or output device from another electronic device may be used as the input device 824 or output device 822 of the electronic device 812.
  • the components of the electronic device 812 may be connected through various interconnections (such as buses). Such interconnections may include Peripheral Component Interconnect (PCI) (such as PCI Express), Universal Serial Bus (USB), FireWire (IEEE 1394), optical bus structure, and so on.
  • PCI Peripheral Component Interconnect
  • USB Universal Serial Bus
  • FireWire IEEE 1394
  • optical bus structure and so on.
  • the components of the electronic device 812 may be interconnected via a network.
  • the memory 818 may be composed of multiple physical memory units located in different physical locations and interconnected by a network.
  • storage devices used to store computer-readable instructions can be distributed across a network.
  • the electronic device 830 accessible via the network 828 may store computer-readable instructions for implementing one or more embodiments provided by the present invention.
  • the electronic device 812 can access the electronic device 830 and download part or all of the computer-readable instructions for execution.
  • the electronic device 812 may download multiple computer-readable instructions as needed, or some instructions may be executed at the electronic device 812 and some instructions may be executed at the electronic device 830.
  • the one or more operations described may constitute one or more computer-readable instructions stored on a computer-readable medium, which, when executed by an electronic device, will cause the computing device to perform the operations. Describing the order of some or all operations should not be interpreted as implying that these operations must be order-dependent. Those skilled in the art will understand alternative rankings that have the benefit of this description. Moreover, it should be understood that not all operations are necessarily present in every embodiment provided herein.
  • the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.
  • the aforementioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
  • Each of the above-mentioned devices or systems can execute the methods in the corresponding method embodiments.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本发明提供一种图像编辑方法，其包括：将显示视频转换为编辑视频，并将编辑视频发送至编辑终端；其中编辑视频的视频图像分辨率小于显示视频的视频图像分辨率；从编辑终端接收编辑视频对应的编辑操作文件；编辑操作文件记录编辑终端用户在编辑终端对编辑视频的图像编辑操作；使用编辑操作文件对显示视频进行图像编辑操作。本发明还提供一种图像编辑装置。

Description

图像编辑方法、装置及对应的存储介质 技术领域
本发明涉及图像处理技术领域，特别是涉及一种图像编辑方法、装置及对应的存储介质。
 背景技术
随着科技的发展，用户对视频图像的要求越来越高，如希望能够有较高的图像分辨率，较小的存储空间、较快的传输速度以及便于对视频图像进行编辑操作等。
 技术问题
现有的VR相机可以拍摄8k的全景画面，但是由于相机终端和便携移动终端均不能对8k全景画面进行实时显示，导致需要将8k的全景画面输出至固定终端电脑上使用专门的编辑软件才能进行编辑操作。而VR相机的用户则希望能够对8k全景画面实时进行观看以及编辑，并将编辑后的画面及时分享给其他人，从而提高VR相机的使用便携性。
故，有必要提供一种图像编辑方法及图像编辑装置，以解决现有技术所存在的问题。
 技术解决方案
本发明实施例提供一种可通过移动终端对VR相机的8k全景画面进行实时编辑，以使得VR相机可将编辑后的画面及时分享给其他人的图像编辑方法及图像编辑装置，以解决现有的VR相机进行图像编辑的难度较大，导致VR相机的使用便携性较差的技术问题。
本发明实施例提供一种图像编辑方法，其包括：
将显示视频转换为编辑视频，并将所述编辑视频发送至编辑终端；其中所述编辑视频的视频图像分辨率小于所述显示视频的视频图像分辨率；
从所述编辑终端接收所述编辑视频对应的编辑操作文件；所述编辑操作文件记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作；以及
使用所述编辑操作文件对所述显示视频进行图像编辑操作。
在本发明所述的图像编辑方法中，所述记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作的步骤包括：
展示所述编辑视频；
对所述编辑视频进行图像编辑操作，其中所述图像编辑操作包括视场角调整、视角调整、播放速度变换、物体追踪以及投影模式变换中至少一种；以及
将图像编辑操作的结果记录为所述编辑操作文件，其中所述编辑操作文件包括编辑视频编号、编辑视频播放时间帧以及编辑视频播放参数。
在本发明所述的图像编辑方法中，所述使用所述编辑操作文件对显示视频进行图像编辑操作的步骤包括：
根据所述编辑操作文件的编辑视频编号，获取相应的显示视频；
根据所述编辑操作文件的编辑视频播放时间帧以及编辑视频播放参数对所述显示视频进行图像编辑操作。
在本发明所述的图像编辑方法中，所述显示视频为全景画面视频，所述图像编辑操作后的显示视频为平面画面视频。
在本发明所述的图像编辑方法中，所述方法包括：以字符串的形式记录所述编辑操作文件。
在本发明所述的图像编辑方法中，所述对所述编辑视频进行图像编辑操作的步骤包括：
设定所述编辑视频的预编辑区域；使用至少一个预设图像预编辑操作指令组对所述编辑视频的预编辑区域进行预编辑操作；对预编辑操作后的编辑视频进行后图像编辑操作。
在本发明所述的图像编辑方法中，所述图像编辑方法还包括：
将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存。
在本发明所述的图像编辑方法中，所述将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存的步骤包括：
如所述图像编辑操作后的编辑视频的指定区域对应多个不同的图像编辑操作，则将使用权重较大的图像编辑操作设定为所述预设图像预编辑操作指令组。
在本发明所述的图像编辑方法中，所述将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存的步骤包括：
对所述图像编辑操作后的编辑视频的指定区域的图像编辑操作进行展示；
将用户在展示的图像编辑操作中选定的部分图像编辑操作设定为所述预设图像预编辑操作指令组。
本发明还提供一种图像编辑装置，其包括：
编辑视频发送模块，用于将显示视频转换为编辑视频，并将所述编辑视频发送至编辑终端；其中所述编辑视频的视频图像分辨率小于所述显示视频的视频图像分辨率；
编辑操作文件接收模块，用于从所述编辑终端接收所述编辑视频对应的编辑操作文件；所述编辑操作文件记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作；以及
图像编辑模块，用于使用所述编辑操作文件对所述显示视频进行图像编辑操作。
本发明实施例还提供一种计算机可读存储介质，其内存储有处理器可执行指令，所述指令由一个或一个以上处理器加载，以执行上述任一图像编辑方法。
 有益效果
相较于现有技术的图像编辑方法及图像编辑装置，本发明的图像编辑方法及图像编辑装置将视频图像分辨率较小的编辑视频发送至编辑终端进行图像编辑，以使得VR相机可基于编辑操作文件对显示视频进行图像编辑操作，这样VR相机即时对8k全景画面进行实时编辑，并将编辑后的画面及时分享给其他人，降低了VR相机的图像编辑难度；有效解决了现有的VR相机进行图像编辑的难度较大，导致VR相机的使用便携行较差的技术问题。
 附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面对实施例中所需要使用的附图作简单的介绍，下面描述中的附图仅为本发明的部分实施例相应的附图。
图1为本发明的图像编辑方法的一实施例的流程图；
图2为本发明的图像编辑方法的一实施例的编辑终端进行图像编辑操作的流程图；
图3为本发明的图像编辑方法的一实施例的对显示视频进行图像编辑操作的流程图；
图4为本发明的图像编辑方法的一实施例中对编辑视频进行图像编辑操作的流程图；
图5为本发明的图像编辑装置的一实施例的结构示意图；
图6为本发明的图像编辑方法及图像编辑装置将全景画面视频编辑为对应的平面画面视频的流程图；
图7为本发明的图像编辑方法及图像编辑装置对编辑视频进行图像编辑操作的示意图；
图8为本发明的图像编辑装置所在的电子设备的工作环境结构示意图。
 本发明的最佳实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明的图像编辑方法及图像编辑装置用于对全景画面进行实时编辑的电子设备，该电子设备包括但不限于可穿戴设备、头戴设备、医疗健康平台、个人计算机、服务器计算机、手持式或膝上型设备、移动设备(比如移动电话、个人数字助理(PDA)、媒体播放器等等）、多处理器系统、消费型电子设备、小型计算机、大型计算机、包括上述任意系统或设备的分布式计算环境，等等。该电子设备优选为全景VR相机或与全景VR相机配套使用的电子终端，以便对VR相机拍摄的全景画面视频进行实时编辑，降低了VR相机进行图像编辑的难度，提高了VR相机使用便携性。
请参照图1，图1为本发明的图像编辑方法的一实施例的流程图。本实施例的图像编辑方法可使用上述的电子设备，尤其是VR相机进行实施。本实施例的图像编辑方法包括以下步骤：
步骤S101，将显示视频转换为编辑视频，并将编辑视频发送至编辑终端；其中编辑视频的视频图像分辨率小于显示视频的视频图像分辨率；
步骤S102，从编辑终端接收编辑视频对应的编辑操作文件；该编辑操作文件记录编辑终端用户在编辑终端对编辑视频的图像编辑操作；
步骤S103，使用编辑操作文件对显示视频进行图像编辑操作。
下面详细说明本实施例的图像编辑方法的各步骤的具体流程。
在步骤S101中，图像编辑装置（如VR相机）拍摄到显示视频，即全景画面视频。由于为了保证后期编辑后视频的图像质量，VR相机的显示视频一般是分辨率为8k的全景画面视频，因此将该显示视频发送给编辑终端会涉及到大数据流量的传输以及高质量画面处理编辑的要求的问题。
因此图像编辑装置将该显示视频转换为编辑视频，该编辑视频的视频图像分辨率小于显示视频的视频图像分辨率，比如该编辑视频的视频图像分辨率为4k，以便编辑终端对该编辑视频进行编辑操作。
随后图像编辑装置将该编辑视频通过wifi或USB发送至编辑终端。
在步骤S102中，编辑终端接收到编辑视频，随后编辑终端用户在编辑终端对编辑视频进行图像编辑操作。该图像编辑操作的过程请参照图2，图2为本发明的图像编辑方法的一实施例的编辑终端进行图像编辑操作的流程图。该图像编辑操作的流程包括：
步骤S201，编辑终端对接收到的编辑视频进行展示，以便编辑终端对编辑视频进行图像编辑操作。
步骤S202，编辑终端对编辑视频进行图像编辑操作，具体的图像编辑操作包括视场角调整、视角调整、播放速度变换、物体追踪以及投影模式变换等。
视场角调整表示图像编辑操作后的编辑视频的展示视角，如可展示360度的全景画面视频中的60度视场角的编辑视频或120度视场角的编辑视频。
视角调整表示图像编辑操作后的编辑视频的展示视角范围，如可展示360度的全景画面视频中的0度至60度范围的编辑视频或61度至120度范围的编辑视频。
播放速度变换表示图像编辑操作后的编辑视频的播放速度，如以0.5倍的速率对编辑视频进行播放，或以2倍的速率对编辑视频进行播放。
物体追踪表示图像编辑操作后的编辑视频中追踪的某个物体，该物体可为图像编辑操作后的编辑视频中的某个人或某个物等。
投影模式表示图像编辑操作后的编辑视频的展示模式，该展示模式可为透视投影模式、圆柱投影模式、小行星投影模式以及等角投影（Equi投影）等。
步骤S203，编辑终端将步骤S202中图像编辑操作的结果记录为编辑操作文件，该编辑操作文件包括编辑视频编号、编辑视频播放时间帧以及编辑视频播放参数。
其中编辑视频编号用于表示该编辑操作文件对应的编辑视频以及相应的显示视频；编辑视频播放时间帧用于表示该图像编辑操作对应的编辑视频的画面帧；编辑视频播放参数用于表示该图像编辑操作对应的编辑操作内容。
编辑操作文件可有效记录下编辑终端用户在编辑终端对编辑视频的图像编辑操作，具体的，编辑操作文件可以字符串的形式进行保存。比如（No“0001”start_time“1000”：end_time“2000”：speed“1.0”：FOV“120”：type“1”：view“1-120”：object“red”）表示编号为0001的编辑视频中的第1000帧画面至第2000帧画面选取视场角为120度，视角为全景画面的0度至120度的范围，图像编辑操作后的编辑视频的播放速度为1.0，图像编辑操作后的编辑视频的投影模式为1号对应的模式，图像编辑操作后的编辑视频会追踪编辑视频中设定的红色物体。这样图像编辑装置可基于该编辑操作文件对显示视频进行图像编辑操作。
随后编辑终端将该编辑操作文件通过wifi或usb发送至图像编辑装置。
步骤S103，图像编辑装置使用步骤S102获取的编辑操作文件对显示视频进行图像编辑操作。具体请参照图3，图3为本发明的图像编辑方法的一实施例的对显示视频进行图像编辑操作的流程图。该图像编辑操作流程包括：
步骤S301，图像编辑装置根据编辑操作文件的编辑视频编号，获取到对应的显示视频；
步骤S302，图像编辑装置根据编辑操作文件的编辑视频播放时间帧以及编辑视频播放参数对显示视频进行图像编辑操作（即进行视频渲染操作），即对显示视频进行视场角调整、视角调整、播放速度调整、物体追踪以及投影模式变换等编辑操作，以得到图像编辑操作后的显示视频，该图像编辑操作后的显示视频一般为高画质的平面画面视频，以表示全景画面视频中的部分全景画面。
随后图像编辑装置可将该平面画面视频发送至其他电子终端，用于分享展示。
这样即完成了本实施例的图像编辑方法的全景画面的图像编辑过程。
本实施例的图像编辑方法将视频图像分辨率较小的编辑视频发送至编辑终端进行图像编辑，以使得VR相机可基于编辑操作文件对显示视频进行图像编辑操作，这样VR相机即时对8k全景画面进行实时编辑，并将编辑后的画面及时分享给其他人，降低了VR相机的图像编辑难度。
下面详细说明编辑终端如何对编辑视频进行图像编辑操作，请参照图4，图4为本发明的图像编辑方法的一实施例中对编辑视频进行图像编辑操作的流程图。该图像编辑操作的流程包括：
步骤S401，编辑终端获取并展示编辑视频；
步骤S402，编辑终端设定编辑视频的预编辑区域，这里的预编辑区域是指编辑视频中需要用户进行预先处理的区域，如为了加快编辑速度，先将编辑视频的片头片尾部分的播放速度调快，以方便对编辑视频的其他区域进行图像编辑操作。如需对特定人物进行图像编辑操作，则可将编辑视频中不包括该特定人物的编辑预期设定为预编辑区域，对该预编辑区域进行删除操作。
当然该预编辑区域也可以是整个编辑视频区域，如预先对编辑视频进行整体的视场角调整，然后在对调整后的编辑视频进行后图像编辑操作，从而提高了图像编辑的效率。
步骤S403，编辑终端使用至少一个预设图像预编辑操作指令组对编辑视频的预编辑区域进行预编辑操作。这里的预设图像预编辑操作指令组为用户预设好的预编辑操作指令集合，如直接选定编辑视频的片头部分和片尾部分进行加速操作，或直接选定整个编辑视频区域进行视场角调整操作。由于这种图像编辑预操作可能会在多个不同的编辑视频上重复进行，因此编辑终端可设定一个图像编辑操作或多个图像编辑操作的集合作为预设图像预编辑操作指令组，从而提高对某些编辑视频的预编辑区域的预编辑操作效率。
步骤S404，在编辑终端对编辑视频的预编辑区域进行预编辑操作之后，编辑终端可对预编辑操作后的编辑视频进行后图像编辑操作，这里的后图像编辑操作则为用户基于该编辑视频的具体内容进行的个性化的图像编辑操作。
由于本实施例的图像编辑操作划分为预编辑操作以及后图像编辑操作，从而有效的提高了图像编辑操作的整体效率。
进一步的，本实施例的编辑终端可通过多种方式生成对应的预设图像预编辑操作指令组。如编辑终端可直接将图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为预设图像预编辑操作指令组进行保存。
具体的，如该图像编辑操作后的编辑视频的指定区域只对应了一种图像编辑操作，这里的一种图像编辑操作是指改进该指定区域对应的所有编辑视频播放时间帧对应的编辑视频播放参数均相同。则直接将该指定区域对应的图像编辑操作设定为一预设图像预编辑操作指令组。
如该图像编辑操作后的编辑视频的指定区域对应了多个不同的图像编辑操作，如指定区域的前半视频对应的视场角为60度，指定区域的后半视频对应的视场角为120度，则可认为该图像编辑操作后的编辑视频的指定区域对应了不同的图像编辑操作。
这里编辑终端可将使用权重较大的图像编辑操作设定为预设图像预编辑操作指令组。这里的权重较大是指对应的图像编辑操作对应的指定区域中的区域较大，如指定区域的三分之一的视频对应的视场角为60度，指定区域的另外三分之二的视频对应的视场角为120度，则可将指定区域的该视场角为120度的区域对应的图像编辑操作设定为预设图像与编辑操作指令组。
进一步的，如图像编辑操作后的编辑视频的指定区域包括有较多不同的图像编辑操作。编辑终端还可对图像编辑操作后的编辑视频的指定区域的图像编辑操作进行展示，如展示该图像编辑操作对应的视场角、视角、播放速度、展示物体以及投影模式等。
这样编辑终端用户可在展示的图像编辑操作中选定部分图像编辑操作设定为预设图像预编辑操作指令组。
因此编辑终端用户可通过直接将指定区域的图像编辑操作设定为预设图像预编辑操作指令组、将指定区域的部分区域的图像编辑操作设定为预设图像预编辑操作指令组、以及指定区域的部分图像编辑操作设定为预设图像预编辑操作指令组，从而可通过预设图像预编辑操作指令组有效的提高编辑终端对编辑视频的图像编辑操作的效率。
本发明还提供一种图像编辑装置，请参照图5，图5为本发明的图像编辑装置的一实施例的结构示意图。本实施例的图像编辑装置可使用上述的图像编辑方法进行实施，本实施例的图像编辑装置50包括编辑视频发送模块51、编辑操作文件接收模块52以及图像编辑模块53。
编辑视频发送模块51用于将显示视频转换为编辑视频，并将编辑视频发送至编辑终端51；其中编辑视频的视频图像分辨率小于显示视频的视频图像分辨率；编辑操作文件接收模块52用于从编辑终端51接收编辑视频对应的编辑操作文件；编辑操作文件记录编辑终端用户在编辑终端51对编辑视频的图像编辑操作；图像编辑模块53用于使用编辑操作文件对显示视频进行图像编辑操作。
本实施例的图像编辑装置50使用时，首先编辑视频发送模块51拍摄到显示视频，即全景画面视频。由于为了保证后期编辑后视频的图像质量，VR相机的显示视频一般是分辨率为8k的全景画面视频，因此将该显示视频发送给编辑终端会涉及到大数据流量的传输以及高质量画面处理编辑的要求的问题。
因此编辑视频发送模块51将该显示视频转换为编辑视频，该编辑视频的视频图像分辨率小于显示视频的视频图像分辨率，比如该编辑视频的视频图像分辨率为4k，以便编辑终端51对该编辑视频进行编辑操作。随后编辑视频发送模块51将该编辑视频发送至编辑终端51。
然后编辑终端51接收到编辑视频，随后编辑终端用户在编辑终端51对编辑视频进行图像编辑操作，该图像编辑操作的流程包括：
编辑终端51对接收到的编辑视频进行展示，以便编辑终端51对编辑视频进行图像编辑操作。
编辑终端51对编辑视频进行图像编辑操作，具体的图像编辑操作包括视场角调整、视角调整、播放速度变换、物体追踪以及投影模式变换等。视场角调整表示图像编辑操作后的编辑视频的展示视角，如可展示360度的全景画面视频中的60度视场角的编辑视频或120度视场角的编辑视频。视角调整表示图像编辑操作后的编辑视频的展示视角范围，如可展示360度的全景画面视频中的0度至60度范围的编辑视频或61度至120度范围的编辑视频。播放速度变换表示图像编辑操作后的编辑视频的播放速度，如以0.5倍的速率对编辑视频进行播放，或以2倍的速率对编辑视频进行播放。物体追踪表示图像编辑操作后的编辑视频中追踪的某个物体，该物体可为图像编辑操作后的编辑视频中的某个人或某个物等。投影模式表示图像编辑操作后的编辑视频的展示模式，该展示模式可为透视投影模式、圆柱投影模式、小行星投影模式以及等角投影（Equi投影）等。
编辑终端51将图像编辑操作的结果记录为编辑操作文件，该编辑操作文件包括编辑视频编号、编辑视频播放时间帧以及编辑视频播放参数。其中编辑视频编号用于表示该编辑操作文件对应的编辑视频以及相应的显示视频；编辑视频播放时间帧用于表示该图像编辑操作对应的编辑视频的画面帧；编辑视频播放参数用于表示该图像编辑操作对应的编辑操作内容。这样编辑操作文件可有效记录下编辑终端用户在编辑终端对编辑视频的图像编辑操作，图像编辑装置50可基于该编辑操作文件对显示视频进行图像编辑操作。
随后编辑终端51将该编辑操作文件发送至图像编辑装置50的编辑操作文件接收模块52。
随后图像编辑模块53使用获取的编辑操作文件对显示视频进行图像编辑操作。具体流程包括：
图像编辑模块53根据编辑操作文件的编辑视频编号，获取到对应的显示视频。
图像编辑模块53根据编辑操作文件的编辑视频播放时间帧以及编辑视频播放参数对显示视频进行图像编辑操作，即对显示视频进行视场角调整、视角调整、播放速度调整、物体追踪以及投影模式变换等编辑操作，以得到图像编辑操作后的显示视频，该图像编辑操作后的显示视频一般为平面画面视频，以表示全景画面视频中的部分全景画面。
这样即完成了本实施例的图像编辑装置50的全景画面的图像编辑过程。
本实施例的图像编辑装置将视频图像分辨率较小的编辑视频发送至编辑终端进行图像编辑，以使得VR相机可基于编辑操作文件对显示视频进行图像编辑操作，这样VR相机即时对8k全景画面进行实时编辑，并将编辑后的画面及时分享给其他人，降低了VR相机的图像编辑难度。
下面通过一具体实施例说明本发明的图像编辑方法及图像编辑装置的具体工作原理。请参照图6和图7，图6为本发明的图像编辑方法及图像编辑装置将全景画面视频编辑为对应的平面画面视频的流程图，图7为本发明的图像编辑方法及图像编辑装置对编辑视频进行图像编辑操作的示意图。本具体实施例的图像编辑装置设置在VR相机中，其通过将全景画面视频发送至用户编辑终端进行处理生成对应的编辑操作文件，进而通过编辑操作文件来对全景画面视频进行图像编辑操作。本实施例对全景画面视频进行图像编辑操作的流程包括：
步骤S601，VR相机将拍摄的视频图像分辨率为8k的显示视频转换为视频图像分辨率为4k的编辑视频。
步骤S602，VR相机将该编辑视频发送至用户编辑终端。
步骤S603，用户编辑终端对该编辑视频进行展示，具体可参照图7，其中该图像编辑框包括编辑视频画面帧701（在编辑终端未完全显示，仅显示编辑视频显示框702中展示的部分）、编辑视频显示框702、编辑视频播放时间帧选择框703、视场角调整框704、视角调整框705、播放速度调整框706、物体追踪框707、投影模式变换框708、预设图像预编辑操作指令组载入框709以及预设图像预编辑操作指令组保存框710。
步骤S604，编辑终端可对编辑视频进行图像编辑操作。首先编辑终端可通过编辑视频播放时间帧选择框703选择编辑视频对应的预编辑区域，如图7中的编辑视频的第1000帧至第2000帧的指定区域。
随后编辑终端可通过预设图像预编辑操作指令组载入框709载入某个预设图像预编辑操作指令组。该图7中的预设图像预编辑操作指令组直接设定视场角为120度，视角为1度至120度（该视角应与视场角对应），投影模式为投影模式1。这样即完成了对编辑视频的预编辑区域的预编辑操作。
然后用户通过编辑终端对预编辑后的编辑视频进行后图像编辑操作，如图7所示，选定播放速度为1.0，选定追踪物体为画面中的红色物体等。如无法确定追踪物体时，用户可通过触摸编辑终端的显示屏中编辑视频画面来选定对应的追踪物体。并且用户可通过拖拉视场角调整框704以及视角调整框705中的控制条对视场角以及视角进行进一步的调整，当然也可以通过对其他调整框进行控制，以对编辑视频的其他编辑视频播放参数进行调整。
进一步的，用户可通过拖动编辑视频画面帧701在编辑视频显示框702中的位置对编辑视频的视角范围进行调整（如从1度到120度的范围调整到181度到300度的范围），可通过调整编辑视频画面帧701在编辑视频显示框702中的大小尺寸（如通过两个触摸点的距离调整）对编辑视频的视场角进行调整（如将视场角从120度调整到180度，对应的编辑视频画面帧701在编辑视频显示框702中的尺寸变小，以便在编辑视频显示框702中显示编辑视频画面帧701中更多的内容）。这样即完成了对编辑视频的后图像编辑操作。
步骤S605，用户可通过预设图像预编辑操作指令组保存框710对当前编辑视频的图像编辑操作（预编辑操作以及后图像编辑操作）保存为一个新的预设图像预编辑操作指令组。
如用户选择的编辑视频的指定区域具有多个不同的图像编辑操作，则仅展示使用权重较大的图像编辑操作或可通过虚线的方式提示用户多个不同图像编辑操作参数，具体如图7中的选定播放速度2.0所示。
步骤S606，编辑终端将图像编辑操作的结果记录为编辑操作文件，并将该编辑操作文件发送至VR相机。
步骤S607，VR相机使用编辑操作文件对显示视频进行图像编辑操作，即将VR相机拍摄的全景画面视频转换为对应的平面画面视频，并可将转换后的平面画面视频分享给对应的电子终端。
这样即完成了本具体实施例的图像编辑方法及图像编辑装置对全景画面视频进行图像编辑操作的流程。
本发明的图像编辑方法及图像编辑装置将视频图像分辨率较小的编辑视频发送至编辑终端进行图像编辑，以使得VR相机可基于编辑操作文件对显示视频进行图像编辑操作，这样VR相机即时对8k全景画面进行实时编辑，并将编辑后的画面及时分享给其他人，降低了VR相机的图像编辑难度；有效解决了现有的VR相机进行图像编辑的难度较大，导致VR相机的使用便携行较差的技术问题。
如本申请所使用的术语“组件”、“模块”、“系统”、“接口”、“进程”等等一般地旨在指计算机相关实体：硬件、硬件和软件的组合、软件或执行中的软件。例如，组件可以是但不限于是运行在处理器上的进程、处理器、对象、可执行应用、执行的线程、程序和／或计算机。通过图示，运行在控制器上的应用和该控制器二者都可以是组件。一个或多个组件可以有在于执行的进程和／或线程内，并且组件可以位于一个计算机上和／或分布在两个或更多计算机之间。
图8和随后的讨论提供了对实现本发明所述的图像编辑装置所在的电子设备的工作环境的简短、概括的描述。图8的工作环境仅仅是适当的工作环境的一个实例并且不旨在建议关于工作环境的用途或功能的范围的任何限制。实例电子设备812包括但不限于可穿戴设备、头戴设备、医疗健康平台、个人计算机、服务器计算机、手持式或膝上型设备、移动设备(比如移动电话、个人数字助理(PDA)、媒体播放器等等）、多处理器系统、消费型电子设备、小型计算机、大型计算机、包括上述任意系统或设备的分布式计算环境，等等。
尽管没有要求，但是在“计算机可读指令”被一个或多个电子设备执行的通用背景下描述实施例。计算机可读指令可以经由计算机可读介质来分布（下文讨论）。计算机可读指令可以实现为程序模块，比如执行特定任务或实现特定抽象数据类型的功能、对象、应用编程接口(API)、数据结构等等。典型地，该计算机可读指令的功能可以在各种环境中随意组合或分布。
图8图示了包括本发明的图像编辑装置中的一个或多个实施例的电子设备812的实例。在一种配置中，电子设备812包括至少一个处理单元816和存储器818。根据电子设备的确切配置和类型，存储器818可以是易失性的(比如RAM)、非易失性的（比如ROM、闪存等）或二者的某种组合。该配置在图8中由虚线814图示。
在其他实施例中，电子设备812可以包括附加特征和／或功能。例如，设备812还可以包括附加的存储装置（例如可移除和／或不可移除的），其包括但不限于磁存储装置、光存储装置等等。这种附加存储装置在图8中由存储装置820图示。在一个实施例中，用于实现本文所提供的一个或多个实施例的计算机可读指令可以在存储装置820中。存储装置820还可以存储用于实现操作系统、应用程序等的其他计算机可读指令。计算机可读指令可以载入存储器818中由例如处理单元816执行。
本文所使用的术语“计算机可读介质”包括计算机存储介质。计算机存储介质包括以用于存储诸如计算机可读指令或其他数据之类的信息的任何方法或技术实现的易失性和非易失性、可移除和不可移除介质。存储器818和存储装置820是计算机存储介质的实例。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字通用盘(DVD)或其他光存储装置、盒式磁带、磁带、磁盘存储装置或其他磁存储设备、或可以用于存储期望信息并可以被电子设备812访问的任何其他介质。任意这样的计算机存储介质可以是电子设备812的一部分。
电子设备812还可以包括允许电子设备812与其他设备通信的通信连接826。通信连接826可以包括但不限于调制解调器、网络接口卡(NIC)、集成网络接口、射频发射器／接收器、红外端口、USB连接或用于将电子设备812连接到其他电子设备的其他接口。通信连接826可以包括有线连接或无线连接。通信连接826可以发射和／或接收通信媒体。
术语“计算机可读介质”可以包括通信介质。通信介质典型地包含计算机可读指令或诸如载波或其他传输机构之类的“己调制数据信号”中的其他数据，并且包括任何信息递送介质。术语“己调制数据信号”可以包括这样的信号：该信号特性中的一个或多个按照将信息编码到信号中的方式来设置或改变。
电子设备812可以包括输入设备824，比如键盘、鼠标、笔、语音输入设备、触摸输入设备、红外相机、视频输入设备和／或任何其他输入设备。设备812中也可以包括输出设备822，比如一个或多个显示器、扬声器、打印机和／或任意其他输出设备。输入设备824和输出设备822可以经由有线连接、无线连接或其任意组合连接到电子设备812。在一个实施例中，来自另一个电子设备的输入设备或输出设备可以被用作电子设备812的输入设备824或输出设备822。
电子设备812的组件可以通过各种互连（比如总线）连接。这样的互连可以包括外围组件互连(PCI)(比如快速PCI)、通用串行总线(USB)、火线(IEEE 1394)、光学总线结构等等。在另一个实施例中，电子设备812的组件可以通过网络互连。例如，存储器818可以由位于不同物理位置中的、通过网络互连的多个物理存储器单元构成。
本领域技术人员将认识到，用于存储计算机可读指令的存储设备可以跨越网络分布。例如，可经由网络828访问的电子设备830可以存储用于实现本发明所提供的一个或多个实施例的计算机可读指令。电子设备812可以访问电子设备830并且下载计算机可读指令的一部分或所有以供执行。可替代地，电子设备812可以按需要下载多条计算机可读指令，或者一些指令可以在电子设备812处执行并且一些指令可以在电子设备830处执行。
本文提供了实施例的各种操作。在一个实施例中，所述的一个或多个操作可以构成一个或多个计算机可读介质上存储的计算机可读指令，其在被电子设备执行时将使得计算设备执行所述操作。描述一些或所有操作的顺序不应当被解释为暗示这些操作必需是顺序相关的。本领域技术人员将理解具有本说明书的益处的可替代的排序。而且，应当理解，不是所有操作必需在本文所提供的每个实施例中存在。
而且，尽管已经相对于一个或多个实现方式示出并描述了本公开，但是本领域技术人员基于对本说明书和附图的阅读和理解将会想到等价变型和修改。本公开包括所有这样的修改和变型，并且仅由所附权利要求的范围限制。特别地关于由上述组件（例如元件、资源等）执行的各种功能，用于描述这样的组件的术语旨在对应于执行所述组件的指定功能（例如其在功能上是等价的）的任意组件（除非另外指示），即使在结构上与执行本文所示的本公开的示范性实现方式中的功能的公开结构不等同。此外，尽管本公开的特定特征已经相对于若干实现方式中的仅一个被公开，但是这种特征可以与如可以对给定或特定应用而言是期望和有利的其他实现方式的一个或多个其他特征组合。而且，就术语“包括”、“具有”、“含有”或其变形被用在具体实施方式或权利要求中而言，这样的术语旨在以与术语“包含”相似的方式包括。
本发明实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。上述提到的存储介质可以是只读存储器，磁盘或光盘等。上述的各装置或系统，可以执行相应方法实施例中的方法。
综上所述，虽然本发明已以实施例揭露如上，实施例前的序号仅为描述方便而使用，对本发明各实施例的顺序不造成限制。并且，上述实施例并非用以限制本发明，本领域的普通技术人员，在不脱离本发明的精神和范围内，均可作各种更动与润饰，因此本发明的保护范围以权利要求界定的范围为准。

Claims (10)

  1. 一种图像编辑方法，其包括：
    将显示视频转换为编辑视频，并将所述编辑视频发送至编辑终端；其中所述编辑视频的视频图像分辨率小于所述显示视频的视频图像分辨率；
    从所述编辑终端接收所述编辑视频对应的编辑操作文件；所述编辑操作文件记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作；以及
    使用所述编辑操作文件对所述显示视频进行图像编辑操作。
  2. 根据权利要求1所述的图像编辑方法，其中所述记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作的步骤包括：
    展示所述编辑视频；
    对所述编辑视频进行图像编辑操作，其中所述图像编辑操作包括视场角调整、视角调整、播放速度变换、物体追踪以及投影模式变换中至少一种；以及
    将图像编辑操作的结果记录为所述编辑操作文件，其中所述编辑操作文件包括编辑视频编号、编辑视频播放时间帧以及编辑视频播放参数。
  3. 根据权利要求2所述的图像编辑方法，其中所述使用所述编辑操作文件对显示视频进行图像编辑操作的步骤包括：
    根据所述编辑操作文件的编辑视频编号，获取相应的显示视频；
    根据所述编辑操作文件的编辑视频播放时间帧以及编辑视频播放参数对所述显示视频进行图像编辑操作。
  4. 根据权利要求1所述的图像编辑方法，其中所述显示视频为全景画面视频，所述图像编辑操作后的显示视频为平面画面视频。
  5. 根据权利要求2所述的图像编辑方法，其中所述对所述编辑视频进行图像编辑操作的步骤包括：
    设定所述编辑视频的预编辑区域；
    使用至少一个预设图像预编辑操作指令组对所述编辑视频的预编辑区域进行预编辑操作；
    对预编辑操作后的编辑视频进行后图像编辑操作。
  6. 根据权利要求5所述的图像编辑方法，其中所述图像编辑方法还包括：
    将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存。
  7. 根据权利要求6所述的图像编辑方法，其中所述将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存的步骤包括：
    如所述图像编辑操作后的编辑视频的指定区域对应多个不同的图像编辑操作，则将使用权重较大的图像编辑操作设定为所述预设图像预编辑操作指令组。
  8. 根据权利要求6所述的图像编辑方法，其中所述将所述图像编辑操作后的编辑视频的指定区域对应的预编辑操作以及后图像编辑操作，作为所述预设图像预编辑操作指令组进行保存的步骤包括：
    对所述图像编辑操作后的编辑视频的指定区域的图像编辑操作进行展示；
    将用户在展示的图像编辑操作中选定的部分图像编辑操作设定为所述预设图像预编辑操作指令组。
  9. 一种图像编辑装置，其包括：
    编辑视频发送模块，用于将显示视频转换为编辑视频，并将所述编辑视频发送至编辑终端；其中所述编辑视频的视频图像分辨率小于所述显示视频的视频图像分辨率；
    编辑操作文件接收模块，用于从所述编辑终端接收所述编辑视频对应的编辑操作文件；所述编辑操作文件记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作；以及
    图像编辑模块，用于使用所述编辑操作文件对所述显示视频进行图像编辑操作；
    其中所述记录编辑终端用户在所述编辑终端对所述编辑视频的图像编辑操作的步骤包括：
    展示所述编辑视频；
    对所述编辑视频进行图像编辑操作，其中所述图像编辑操作包括视场角调整、视角调整、播放速度变换、物体追踪以及投影模式变换中至少一种；以及
    将图像编辑操作的结果记录为所述编辑操作文件，其中所述编辑操作文件包括编辑视频编号、编辑视频播放时间帧以及编辑视频播放参数；
    其中所述使用所述编辑操作文件对显示视频进行图像编辑操作的步骤包括：
    根据所述编辑操作文件的编辑视频编号，获取相应的显示视频；
    根据所述编辑操作文件的编辑视频播放时间帧以及编辑视频播放参数对所述显示视频进行图像编辑操作；
    所述对所述编辑视频进行图像编辑操作的步骤包括：
    设定所述编辑视频的预编辑区域；
    使用至少一个预设图像预编辑操作指令组对所述编辑视频的预编辑区域进行预编辑操作；
    对预编辑操作后的编辑视频进行后图像编辑操作。
  10. 一种计算机可读存储介质，其内存储有处理器可执行指令，所述指令由一个或一个以上处理器加载，以执行上述权利要求1中的图像编辑方法。
PCT/CN2021/078310 2020-02-28 2021-02-27 图像编辑方法、装置及对应的存储介质 WO2021170122A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010126763.6 2020-02-28
CN202010126763.6A CN111311477B (zh) 2020-02-28 2020-02-28 图像编辑方法、装置及对应的存储介质

Publications (1)

Publication Number Publication Date
WO2021170122A1 true WO2021170122A1 (zh) 2021-09-02

Family

ID=71159328

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078310 WO2021170122A1 (zh) 2020-02-28 2021-02-27 图像编辑方法、装置及对应的存储介质

Country Status (2)

Country Link
CN (1) CN111311477B (zh)
WO (1) WO2021170122A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311477B (zh) * 2020-02-28 2024-05-07 深圳看到科技有限公司 图像编辑方法、装置及对应的存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8237856B2 (en) * 2008-11-07 2012-08-07 Looxcie, Inc. Timeshifting video recording camera
CN106993093A (zh) * 2017-03-30 2017-07-28 努比亚技术有限公司 一种图像处理装置及方法
CN107005624A (zh) * 2014-12-14 2017-08-01 深圳市大疆创新科技有限公司 视频处理的方法和系统
CN111311477A (zh) * 2020-02-28 2020-06-19 深圳看到科技有限公司 图像编辑方法、装置及对应的存储介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11103441A (ja) * 1997-09-26 1999-04-13 Matsushita Electric Ind Co Ltd クリップ表示方法とその表示装置
JP2007049252A (ja) * 2005-08-08 2007-02-22 Ricoh Co Ltd 画像処理装置，画像出力方法，プログラム，および記録媒体
JP5324108B2 (ja) * 2008-02-25 2013-10-23 株式会社スプラシア コンピュータシステム、動画像編集方法、プログラム、動画像編集端末
CN102916984B (zh) * 2011-08-01 2016-10-26 腾讯科技（深圳）有限公司 一种图片编辑动作共享的方法及系统
JP2014165763A (ja) * 2013-02-26 2014-09-08 Ricoh Co Ltd 編集装置、編集方法、及び編集プログラム
WO2016030879A1 (en) * 2014-08-26 2016-03-03 Mobli Technologies 2010 Ltd. Distribution of visual content editing function

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8237856B2 (en) * 2008-11-07 2012-08-07 Looxcie, Inc. Timeshifting video recording camera
CN107005624A (zh) * 2014-12-14 2017-08-01 深圳市大疆创新科技有限公司 视频处理的方法和系统
CN106993093A (zh) * 2017-03-30 2017-07-28 努比亚技术有限公司 一种图像处理装置及方法
CN111311477A (zh) * 2020-02-28 2020-06-19 深圳看到科技有限公司 图像编辑方法、装置及对应的存储介质

Also Published As

Publication number Publication date
CN111311477B (zh) 2024-05-07
CN111311477A (zh) 2020-06-19

Similar Documents

Publication Publication Date Title
KR102122476B1 (ko) 화면의 회전을 컨트롤할 수 있는 전자 장치 및 방법
WO2018099277A1 (zh) 视频直播方法及直播装置、存储介质
US8635656B2 (en) Real-time video transmission system and method
WO2020140976A1 (zh) 图像获取方法、装置、点读设备、电子设备及存储介质
WO2018228330A1 (zh) 实现人脸清晰的对焦方法、装置和计算机设备
WO2021170123A1 (zh) 视频生成方法、装置及对应的存储介质
US11683583B2 (en) Picture focusing method, apparatus, terminal, and corresponding storage medium
CN110070496B (zh) 图像特效的生成方法、装置和硬件装置
CN103475572A (zh) 在即时通信应用中发送多张图片的方法、装置及系统
US11776209B2 (en) Image processing method and apparatus, electronic device, and storage medium
WO2020077914A1 (zh) 图像处理方法、装置、硬件装置
US20140195589A1 (en) Cloud-based rendering
WO2020147698A1 (zh) 画面优化方法、装置、终端及对应的存储介质
WO2021169863A1 (zh) 多媒体会议数据处理方法、装置和电子设备
WO2019201197A1 (zh) 图像脱敏方法、电子设备及存储介质
JP2023519372A (ja) 三次元ビデオの処理方法、装置、可読記憶媒体及び電子機器
TW201525936A (zh) 用於處理與裁切圖像的使用者體驗
WO2022143060A1 (zh) 一种屏幕采集方法、终端及存储介质
WO2022088974A1 (zh) 一种遥控方法、电子设备及系统
WO2021170122A1 (zh) 图像编辑方法、装置及对应的存储介质
WO2023130543A1 (zh) 三维场景互动视频创建方法及创建装置
US20150063778A1 (en) Method for processing an image and electronic device thereof
JP2018525744A (ja) アプリケーション及びデータをタッチスクリーンコンピュータ間で相互共有する方法並びにこの方法を実施するコンピュータプログラム
WO2023226845A1 (zh) 图像数据传输方法、装置和电子设备
WO2023193598A1 (zh) 一种图像处理方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21761116

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.02.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21761116

Country of ref document: EP

Kind code of ref document: A1