WO2021134375A1 - Video processing method and apparatus, and control terminal, system and storage medium - Google Patents

Video processing method and apparatus, and control terminal, system and storage medium Download PDF

Info

Publication number
WO2021134375A1
WO2021134375A1 PCT/CN2019/130216 CN2019130216W WO2021134375A1 WO 2021134375 A1 WO2021134375 A1 WO 2021134375A1 CN 2019130216 W CN2019130216 W CN 2019130216W WO 2021134375 A1 WO2021134375 A1 WO 2021134375A1
Authority
WO
WIPO (PCT)
Prior art keywords
view video
processing
person view
control terminal
rotation
Prior art date
Application number
PCT/CN2019/130216
Other languages
French (fr)
Chinese (zh)
Inventor
黄敏
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980067328.6A priority Critical patent/CN112997508B/en
Priority to PCT/CN2019/130216 priority patent/WO2021134375A1/en
Publication of WO2021134375A1 publication Critical patent/WO2021134375A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Definitions

  • This application relates to the field of video processing technology, and in particular to a video processing method, device, control terminal, system, and storage medium.
  • drone aerial photography Take drone aerial photography as an example.
  • drone aerial photography it is based on the perspective of the viewer. The focus is on aerial composition and lens movement. Because the drone lens is stabilized by the gimbal, the aerial video image is very Stable; but at the same time, it also restricts the flying attitude and speed of the drone.
  • the aerial shot is single and rigid, and it cannot be shot with a greater degree of freedom. For example, it cannot be shot at high speed against the sea surface and surrounding buildings. Any circling and other "immersive" effect videos. Therefore, the filmed video is too monotonous, and the sense of presence is not strong.
  • the present application provides a video processing method, device, control terminal, system, and storage medium to achieve rich and varied video playback and enhance the sense of presence.
  • this application provides a video processing method applied to a control terminal, and the method includes:
  • the preset processing includes a first processing, a second processing, a third processing, and a fourth processing.
  • the first processing is used to accelerate the playback of the first-person view video;
  • the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred;
  • the third processing is used to change the viewing angle direction of the first-person view video;
  • the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
  • the present application also provides a video processing device, the video processing device including a memory and a processor;
  • the memory is used to store a computer program
  • the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
  • the preset processing includes a first processing, a second processing, a third processing, and a fourth processing.
  • the first processing is used to accelerate the playback of the first-person view video;
  • the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred;
  • the third processing is used to change the viewing angle direction of the first-person view video;
  • the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
  • this application also provides a control terminal, the control terminal:
  • a display panel provided in the housing; and;
  • the present application also provides a video processing system, the video processing system includes the above-mentioned control terminal, and a movable platform communicatively connected with the control terminal, the movable platform:
  • a power system is provided in the body, and the power system is used to provide power to the movable platform so that a camera mounted on the movable platform can shoot the first-person view video.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above-mentioned video processing method .
  • the video processing method, video processing device, control terminal, video processing system, and computer-readable storage medium disclosed in this application display first-person view video on the display interface of the control terminal, and respond to the first-person view based on the user’s operation on the control terminal.
  • the viewing angle video is subjected to preset processing.
  • the preset processing includes at least one of the first processing, the second processing, the third processing and the fourth processing.
  • the first processing is used to accelerate the playback of the first-person view video
  • the second processing It is used to make at least part of the picture in at least one frame of the first-person view video blurry
  • the third process is used to change the direction of the view of the first-person view video
  • the fourth process is used to make at least one frame of the first-person view video occur.
  • the first-person view video playback shows acceleration, blurring, rotation, and viewing angle changes according to the user's operation. The effect realizes the rich and varied video playback and enhances the sense of presence.
  • Fig. 1 is a schematic block diagram of a video processing system provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of steps of a video processing method provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a display interface of a control terminal provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of another display interface of a control terminal provided by an embodiment of the present application.
  • FIG. 5 is a schematic block diagram of a video processing device provided by an embodiment of the present application.
  • Fig. 6 is a schematic block diagram of a control terminal provided by an embodiment of the present application.
  • the traversing aircraft can be close to speeding racing cars and extreme sportsmen for follow-up, and it is flexible in flight, and can perform various aerobatic effects such as tumbling and rotation.
  • the lens is "hard-hung" on the fuselage, the lens can rotate with the posture of the traversing machine, so it can shoot with a more free angle of view. For example, when the fuselage tilts or dives, the image captured by the lens is also tilted and dived; when the user watches the aerial video of the traversing aircraft through FPV (First Person View) glasses, it is as if they are sitting in person.
  • FPV First Person View
  • the cockpit tilts and dives along with the aircraft, and has a strong sense of presence, giving users an "immersive" visual effect.
  • the embodiments of the present application provide a video processing method, device, control terminal, system, and storage medium, which are used to implement rich and varied video playback, improve the sense of presence, and enable users to watch non-traveling aerial video. Achieve an "immersive" visual effect like watching an aerial video of a passing plane.
  • FIG. 1 is a schematic block diagram of a video processing system according to an embodiment of the application.
  • the video processing system 1000 includes a control terminal 100 and a movable platform 200, and the control terminal 100 and the movable platform 200 are in communication connection.
  • control terminal 100 includes, but is not limited to, a remote control device, a ground control platform, a mobile phone, a tablet computer, a notebook computer, a PC computer, and the like.
  • the movable platform 200 includes, but is not limited to, unmanned aerial vehicles, unmanned vehicles, and the like.
  • control terminal 100 has a built-in gyroscope sensor, and the rotation and movement of the control terminal 100 are detected by the gyroscope sensor.
  • the movable platform 200 includes a body 210 and a power system 220.
  • the power system 220 is provided in the body 210, and the power system 220 is used to provide power for the movable platform 200.
  • the movable platform 200 is equipped with a photographing device (not shown in the figure).
  • the photographing device includes but is not limited to a camera, a camera, etc., and images and videos are captured by the photographing device.
  • the captured video includes a first-person perspective (FPV, First Person View) video.
  • the movable platform 200 transmits the captured video to the control terminal 100, and the control terminal 100 receives and acquires the video transmitted back by the movable platform 200.
  • the control terminal 100 displays the first-person view video on its display interface, and obtains the user's operation on the control terminal 100, according to the user's control
  • the operation of the terminal 100 is to perform preset processing on the first-person view video, where the preset processing includes but is not limited to at least one of the first processing, the second processing, the third processing, and the fourth processing; the terminal 100 is controlled to execute The first processing makes the first-person view video play faster; the control terminal 100 executes the second processing to make at least part of the image in at least one frame of the first-person view video blurry; the control terminal 100 executes the third processing so that the direction of the first-person view video’s angle of view occurs Change; the control terminal 100 performs the fourth process to make at least one frame of the first-person view video rotate.
  • various first-person view videos with various immersive effects such as rapid skimming, diving, blurring, and rotation are obtained.
  • control terminal 100 saves the preset first-person view video, so that subsequent users can directly view and use the preset first-person view video without having to perform the above-mentioned preset processing again.
  • the user when the user wants to perform preset processing on the first-person view video, the user can perform corresponding touch operations on the display interface of the control terminal 100, where the touch operations include but are not limited to clicking, sliding operations, etc.; the user It is also possible to directly perform corresponding operations on the control terminal 100, including but not limited to moving, rotating operations, etc., to make the control terminal 100 move.
  • the control terminal 100 obtains the user's touch operation on the display interface, and/or obtains the user's operation on the control terminal, and performs the first-person view video according to the user's touch operation on the display interface and/or the user's operation on the control terminal Preset processing.
  • a control icon is displayed on the display interface of the control terminal 100.
  • the control icon is used to indicate the program identifier for pre-processing the first-person view video; the control icon includes but is not limited to acceleration At least one of an icon, a blur filter icon, an angle setting icon, and a rotation icon.
  • the user wants to perform preset processing on the first-person view video, the user can perform corresponding operations on the control icons displayed on the display interface, including but not limited to the first touch operation on the acceleration icon, and the second operation on the blur filter icon. Touch operation, the third touch operation on the viewing angle setting icon, the fourth touch operation on the rotating icon, etc.
  • the control terminal 100 obtains the user's operation on the control icon, and performs preset processing on the first-person view video according to the operation on the control icon.
  • first processing is performed on the first-person view video according to the first touch operation, so that the first-person view video is played at an accelerated rate.
  • the control terminal 100 acquires the user's second touch operation on the blur filter icon
  • the second touch operation is performed on the first-person view video according to the second touch operation, so that at least part of the image in at least one frame of the first-person view video is blurry.
  • the control terminal 100 acquires the user's third touch operation on the viewing angle setting icon, it performs a third process on the first-person view video according to the third touch operation, so that the viewing angle direction of the first-person view video is changed.
  • the control terminal 100 obtains the user's fourth touch operation on the rotation icon
  • the fourth processing is performed on the first-person view video according to the fourth touch operation, so that at least one frame of the first-person view video is rotated.
  • control terminal 100 increases the corresponding playback frame rate of the first-person view video according to the first touch operation, for example, increases the frame rate from 30 frames/sec to 50 frames/sec to increase Frame rate for video playback, so as to achieve accelerated playback of first-person view video.
  • control terminal 100 performs frame skipping playback of the first-person view video according to the first touch operation, thereby achieving accelerated playback of the first-person view video.
  • the control terminal 100 determines the corresponding acceleration factor according to the first touch operation, and then increases the playback speed of the first-person view video according to the acceleration factor, that is, the first touch operation performed by the user If the touch parameters are different, such as touch duration, touch trajectory and other touch parameters, the playback speed of the corresponding first-person view video is also different, thereby further improving the flexibility of the video playback mode.
  • control terminal 100 accelerates the playback of the first-person view video according to the first touch operation, and also restores the playback speed of the first-person view video before the acceleration according to the first touch operation.
  • control terminal 100 monitors the first touch operation, and when the first touch operation ends, the control terminal 100 controls to restore the playback speed of the first-person view video.
  • control terminal 100 when the control terminal 100 performs the second processing on the first-person view video according to the second touch operation, first, according to the second touch operation, determine the blur parameters corresponding to the second processing, that is, the blur processing, where the blur parameters Including but not limited to fuzzy area, granularity and other parameters.
  • the control terminal 100 performs blur processing on at least a part of the image in at least one frame of the first-person view video according to the determined blur parameter. For example, according to the determined blurred area, blur the picture corresponding to the blurred area in at least one frame of the first-person view video; for another example, according to the determined granularity, perform the blur processing on at least one frame of the first-person view video.
  • the partial picture is subjected to blurring processing with the degree of blurring corresponding to the granularity.
  • control terminal 100 may also automatically perform the second processing on the first-person view video according to the screen information of the first-person view video.
  • control terminal 100 determines the viewing angle direction of the first-person view video according to the image frame composition information of the first-person view video, and then determines the corresponding blur area according to the viewing angle direction of the first-person view video, and controls The terminal 100 performs blur processing on a picture corresponding to the blurry region in at least one frame of image of the first-person view video according to the determined blurry region.
  • control terminal 100 determines the foreground area corresponding to the image frame of the first-person view video according to the image frame composition information of the first-person view video, uses the foreground area as the blurred area of the image frame, and controls the terminal 100 to The image corresponding to the foreground area in the image frame of the one-person view video is blurred.
  • the control terminal 100 may also automatically perform the second processing on the first-person view video when the corresponding conditions are met.
  • the control terminal 100 blurs at least a part of the image in at least one frame of the first-person view video, that is, when the first-person view video is played When the playback speed becomes faster, the picture is blurred, so as to achieve the effect of the user's immersive viewing experience from the first perspective.
  • the user may perform a movement operation on the control terminal 100 to cause the control terminal 100 to move in one of the directions, such as movement in the forward direction, movement in the backward direction, movement in the left direction, and movement in the right direction. and many more.
  • the control terminal 100 obtains the movement operation of the user, and performs preset processing on the first-person view video according to the direction in which the control terminal 100 moves.
  • the process of controlling the terminal 100 to change the view direction of the first-person view video is to intercept partial images of the image frames of the first-person view video, and perform the intercepted partial images.
  • the moving direction of the control terminal 100 is the left direction
  • the left partial image of the image frame of the first-person view video is intercepted, and the intercepted left partial image is enlarged and then displayed and played.
  • the moving direction of the control terminal 100 is the right direction
  • the right partial image of the image frame of the first-person view video is intercepted, and the intercepted right partial image is enlarged and then displayed and played.
  • the user may also perform a rotation operation on the control terminal 100 to make the control terminal 100 rotate, for example, rotation around an axis parallel to the display interface of the control terminal 100, rotation around an axis passing through the display interface of the control terminal 100, etc. .
  • the control terminal 100 obtains the user's rotation operation.
  • the control terminal 100 uses a built-in gyroscope sensor to detect the rotation movement, and performs preset processing on the first-person view video according to the rotation movement of the control terminal 100.
  • the upper and lower viewing angle directions of the first-person view video are adjusted.
  • control terminal 100 rotates clockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video upward; if the control terminal 100 rotates counterclockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video. Downward.
  • control terminal 100 if the control terminal 100 rotates clockwise around the axis of the parallel display interface, the control terminal 100 intercepts the upper partial image of the image frame of the first-person view video, and enlarges the intercepted upper partial image for display and playback, thereby achieving Adjust the angle of view of the first-person view video to the upper side; if the control terminal 100 rotates counterclockwise around the axis parallel to the display interface, the control terminal 100 will capture the lower part of the image frame of the first-person view video, and perform the capture of the lower part of the image. After zooming in, it is displayed and played, so that the viewing angle of the first-person view video is adjusted downward.
  • control terminal 100 obtains the user's rotation operation, and performs rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal 100.
  • control terminal 100 when controlling the rotation of the terminal 100 to control the terminal 100 to rotate around an axis passing through the display interface, perform rotation processing on at least one frame of the first-person view video.
  • the control terminal 100 determines a corresponding rotation parameter according to the rotation movement, where the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed. Further, perform rotation processing on at least one frame of the first-person view video according to the determined rotation parameter, that is, if the rotation parameters for controlling the rotation of the terminal 100 are different, the rotation processing on at least one frame of the first-person view video is also different. This makes the video playback method more abundant and flexible.
  • the control terminal 100 determines the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal.
  • a mapping relationship between the rotation parameter corresponding to the rotation movement of the control terminal and the rotation parameter corresponding to the rotation processing is preset, and the rotation parameter corresponding to the rotation movement parameter of the rotation movement of the control terminal is determined according to the mapping relationship, and then according to the determination
  • the rotation parameter of performs rotation processing on at least one frame of the first-person view video.
  • the control terminal 100 first performs image enlargement processing on at least one frame of the first-person view video, and then performs image enlargement processing on the first-person view after the image enlargement processing. At least one frame of the view video is rotated.
  • multiple playback modes of video playback are configured, including but not limited to normal playback mode, preset playback mode, etc.
  • the user can select the corresponding playback mode according to his needs. If the user selects the preset play mode, after the preset play mode is activated, the first-person view video is displayed on the display interface of the control terminal 100; and if the user selects the normal play mode, after the normal play mode is activated, the control terminal 100 will The video is played in the usual way.
  • the first-person view video is displayed on the display interface of the control terminal 100, and the first-person view video is preset according to the user's operation on the control terminal 100, so that the first-person view video presents a video acceleration and screen
  • various effects such as blurring, picture rotation, and viewing angle changes
  • the user watching the first-person view video is just like watching an aerial video of a traversing plane, achieving an "immersive" visual effect.
  • the video processing method provided by the embodiment of the present application will be introduced in detail based on the video processing system, the control terminal in the video processing system, and the movable platform in the video processing system. It should be understood that the video processing system in FIG. 1 does not constitute a limitation on the application scenario of the video processing method.
  • FIG. 2 is a schematic flowchart of a video processing method provided by an embodiment of the present application. This method can be used in any of the control terminals provided in the above embodiments to realize rich and varied video playback and enhance the sense of presence.
  • the video processing method specifically includes steps S101 to S103.
  • a first-person view (FPV) video is displayed on the display interface of the control terminal, where the first-person view video is compared to Ordinary video, users can get a variety of immersive viewing experiences such as rapid skimming, swooping, blurring, and rotating.
  • the first-person view video is a video shot by a camera mounted on a movable platform, where the movable platform includes but is not limited to drones, unmanned vehicles, etc., and the camera includes but is not limited to a camera.
  • the first-person view video displayed on the display interface of the control terminal includes:
  • the first-person view video is displayed on the display interface of the control terminal.
  • the control terminal When the user wants to watch the video through the control terminal, if the user selects the normal play mode, after the normal play mode is started, the control terminal will play the video in the normal normal mode.
  • the control terminal When the user wants to obtain a first-person viewing experience with an immersive effect, the user selects a preset playback mode, and after starting the preset playback mode, the first-person view video is displayed on the display interface of the control terminal.
  • the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. At least one of the processing; the first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated.
  • the control terminal displays the first-person view video on its display interface, and monitors the user's operations on the control terminal in real time, including but not limited to movement and rotation operations on the control terminal, and touch operations on the display interface of the control terminal.
  • the preset processing includes, but is not limited to, the first processing, the second processing, the third processing, and At least one of the fourth processing; control the terminal to perform the first processing to accelerate the playback of the first-person view video; control the terminal to perform the second processing to make at least part of the image in at least one frame of the first-person view video blurry; control the terminal to perform the third
  • the processing causes the viewing angle direction of the first-person view video to be changed; the control terminal performs the fourth processing to cause at least one frame of the first-person view video to rotate.
  • the obtaining the operation of the user on the control terminal includes:
  • the user can perform corresponding touch operations on the display interface of the control terminal, including but not limited to clicking, sliding operations, etc.; the user can also perform corresponding operations directly on the control terminal, including but not limited to moving and rotating operations. And so on to make the control terminal 100 move.
  • the control terminal obtains the user's touch operation on the display interface, and/or obtains the user's operation on the control terminal, and performs a preview of the first-person view video based on the user's touch operation on the display interface and/or the user's operation on the control terminal. Set up processing.
  • the video processing method further includes:
  • control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
  • the acquiring the user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation includes:
  • the control icon is displayed on the display interface of the control terminal.
  • the control icon is used to indicate the program identification for the preset processing of the first-person view video, including but not limited to the acceleration icon, the blur filter icon, and the viewing angle. Set at least one of the icon and the rotation icon.
  • the user wants to perform preset processing on the first-person view video, the user can perform corresponding operations on the control icons displayed on the display interface, including but not limited to the first touch operation on the acceleration icon, and the second operation on the blur filter icon. Touch operation, the third touch operation on the viewing angle setting icon, the fourth touch operation on the rotating icon, etc.
  • the control terminal obtains the user's operation on the control icon, and performs preset processing on the first-person view video according to the operation on the control icon.
  • the acquiring the user's operation on the control icon and performing the preset processing on the first-person view video according to the operation on the control icon includes:
  • the control terminal When the control terminal acquires the user's first touch operation on the acceleration icon, it performs first processing on the first-person view video according to the first touch operation, so that the first-person view video is played at an accelerated rate.
  • the control terminal acquires the user's second touch operation on the blur filter icon, it performs a second process on the first-person view video according to the second touch operation, so that at least part of the image in at least one frame of the first-person view video is blurred .
  • the control terminal taking the control terminal as a mobile phone as an example, the blur filter icon 10 is displayed on the display interface of the control terminal.
  • the second touch operation performs second processing on the first-person view video, so that at least a part of the image in at least one frame of the first-person view video is blurred.
  • the control terminal acquires the user's third touch operation on the viewing angle setting icon, it performs third processing on the first-person view video according to the third touch operation, so that the viewing angle direction of the first-person view video is changed.
  • the control terminal acquires the user's fourth touch operation on the rotation icon, the fourth processing is performed on the first-person view video according to the fourth touch operation, so that at least one frame of the first-person view video is rotated. For example, as shown in FIG.
  • the rotation icon 20 is displayed on the display interface of the control terminal.
  • the control terminal obtains the user's fourth touch operation on the rotation icon 20, according to the fourth touch operation
  • the touch operation performs the fourth processing on the first-person view video, so that at least one frame of the first-person view video is rotated.
  • the control terminal acquires the counterclockwise rotation operation of the rotation icon 20 by the user, and the control terminal performs counterclockwise rotation processing on at least one frame of the first-person view video according to the operation.
  • the performing the first processing on the first-person view video according to the first touch operation includes:
  • the frame rate corresponding to the first-person view video is increased, and the video is played at the increased frame rate;
  • the first-person view video is played by skipping frames.
  • the control terminal increases the corresponding playback frame rate of the first-person view video according to the user's first touch operation, for example, the frame rate is changed from 30 frames/sec. Increase to 50 frames per second, and play video at an increased frame rate, so as to achieve accelerated playback of first-person view video.
  • control terminal performs frame skipping playback of the first-person view video according to the user's first touch operation, so as to achieve accelerated playback of the first-person view video.
  • the performing the first processing on the first-person view video according to the first touch operation includes:
  • the playback speed of the first-person view video is increased.
  • the control terminal determines the corresponding acceleration factor according to the user's first touch operation, and then increases the playback speed of the first-person view video according to the acceleration factor, that is, the touch of the first touch operation performed by the user
  • the acceleration factor that is, the touch of the first touch operation performed by the user
  • Different parameters such as different touch parameters such as touch duration and touch trajectory, will have different playback speeds corresponding to the first-person view video, thereby further improving the flexibility of the video playback mode.
  • the mapping relationship between the touch parameters and the acceleration multiples is preset, and the corresponding acceleration multiples are determined according to the touch parameters of the first touch operation, and then the playback speed of the first-person view video is increased according to the determined acceleration multiples.
  • the method when acquiring the user's first touch operation on the acceleration icon, after performing the first processing on the first-person view video according to the first touch operation, the method further includes:
  • control terminal monitors the user's first touch operation, and when the first touch operation ends, the control terminal controls to restore the playback speed of the first-person view video. Therefore, when the user performs the first touch operation, the first-person view video is played at an accelerated rate, and when the user does not perform the first touch operation, the first-person view video is played at a normal speed.
  • the performing the second processing on the first-person view video according to the second touch operation includes:
  • blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  • the control terminal When the control terminal performs the second processing on the first-person view video according to the second touch operation, optionally, it first determines the blur parameters corresponding to the second processing, that is, the blur processing, according to the second touch operation, where the blur parameters include But it is not limited to parameters such as fuzzy area and granularity.
  • the control terminal performs blur processing on at least a part of the image in at least one frame of the first-person view video according to the determined blur parameter. For example, according to the determined blurred area, blur the picture corresponding to the blurred area in at least one frame of the first-person view video; for another example, according to the determined granularity, perform the blur processing on at least one frame of the first-person view video.
  • the partial picture is subjected to blurring processing with the degree of blurring corresponding to the granularity.
  • the control terminal in addition to performing the second processing on the first-person view video according to the second touch operation, can also automatically perform the second processing on the first-person view video according to the screen information of the first-person view video. For example, the control terminal determines the viewing angle direction of the first-person view video based on the image frame composition information of the first-person view video, and then determines the corresponding blurred area according to the viewing angle direction of the first-person view video, and controls the terminal to determine the first-person view based on the determined blurred area.
  • the picture corresponding to the blurred area in at least one frame of the one-person view video is blurred. For example, as shown in FIG. 3, based on the image frame of the first-person view video shown in FIG.
  • the control terminal determines that the corresponding blurred area is the lower left corner area of the image frame according to the composition information of the image frame, and then the control terminal uses the image
  • the lower left corner area of the frame is determined as the blurred area, and the picture corresponding to the lower left corner area in the image frame of the first-person view video is blurred, and the blur processing effect is shown in FIG. 3.
  • control terminal determines the foreground area corresponding to the image frame of the first-person view video according to the image frame composition information of the first-person view video, uses the foreground area as the blurred area of the image frame, and controls the terminal to control the image frame of the first-person view video. Blur processing is performed on the picture corresponding to the foreground area.
  • the video processing method further includes:
  • blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  • the control terminal can also automatically perform the second processing on the first-person view video when the playback speed reaches the corresponding condition.
  • configure a preset speed threshold corresponding to the video playback speed and when the control terminal detects that the playback speed of the first-person view video reaches the preset speed threshold, blur at least part of the image in at least one frame of the first-person view video Processing, that is, when the playback speed of the first-person perspective video becomes faster, the screen is blurred, so as to achieve the effect of the user's immersive viewing experience from the first perspective.
  • the acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation includes:
  • the user can move the control terminal to make the control terminal move in one of the directions, such as forward movement, backward movement, leftward movement, rightward movement, and so on.
  • the control terminal obtains the user's movement operation, and performs preset processing on the first-person view video according to the direction in which the control terminal moves.
  • the first-person view video is played at an accelerated rate; if the direction of the control terminal movement is the backward direction, the playback speed of the first-person view video is restored; if the direction of the control terminal movement is controlled For the left direction, the viewing angle of the first-person view video is shifted to the left; if the direction of the control terminal movement is the right direction, the viewing angle of the first-person view video is shifted to the right.
  • the process of controlling the terminal to change the view direction of the first-person view video is to capture a partial image of the image frame of the first-person view video, and enlarge the captured partial image After processing, display and play are performed, so as to achieve the effect of changing the viewing angle of the first-person view video.
  • the moving direction of the control terminal is the left direction
  • the left partial image of the image frame of the first-person view video is intercepted, and the intercepted left partial image is enlarged and then displayed and played.
  • the moving direction of the control terminal is the right direction
  • the right partial image of the image frame of the first-person view video is intercepted, and the intercepted right partial image is enlarged and then displayed and played.
  • the acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation includes:
  • the user can also perform a rotation operation on the control terminal to make the control terminal rotate, for example, rotation around an axis parallel to the display interface of the control terminal, rotation around an axis passing through the display interface of the control terminal, and so on.
  • the control terminal acquires the user's rotation operation.
  • the control terminal uses a built-in gyroscope sensor to detect the rotation movement, and performs preset processing on the first-person view video according to the rotation movement of the control terminal.
  • the viewing angle of the one-person view video is biased upward; if the control terminal rotates counterclockwise around the axis parallel to the display interface, the control terminal will intercept the lower partial image of the image frame of the first-person view video, and enlarge the intercepted lower partial image before proceeding. Display playback, so as to adjust the viewing angle of the first-person view video to shift downward.
  • control terminal obtains the user's rotation operation, and performs rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal.
  • the performing rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal includes:
  • rotation processing is performed on at least one frame of the first-person view video.
  • the performing rotation processing on at least one frame of the first-person view video includes:
  • the control terminal determines the corresponding rotation parameter according to the rotation movement, where the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed. Furthermore, at least one frame of image of the first-person view video is rotated according to the determined rotation parameter. That is, if the rotation parameter that controls the rotation of the terminal is different, the rotation process of at least one frame of the first-person view video is also different accordingly. Makes the video playback method more abundant and flexible.
  • the determining the rotation parameter corresponding to the rotation processing includes:
  • the mapping relationship between the rotary motion parameters corresponding to the rotary motion of the control terminal and the rotary parameters corresponding to the rotation processing is preset.
  • the rotary motion parameters corresponding to the rotary motion include but are not limited to motion direction, motion angle, motion speed, etc., and the rotation processing corresponds to
  • the rotation parameter includes at least one of the rotation direction, the rotation angle, and the rotation speed as described above.
  • the control terminal obtain the rotation movement parameter corresponding to the rotation movement of the control terminal, and determine the rotation movement parameter corresponding to the rotation movement of the control terminal according to the mapping relationship between the rotation movement parameter corresponding to the rotation movement and the rotation parameter corresponding to the rotation processing According to the determined rotation parameter, at least one frame of image of the first-person view video is rotated according to the determined rotation parameter.
  • the method before performing the rotation processing on at least one frame of the first-person view video, the method further includes:
  • the performing rotation processing on at least one frame of the first-person view video includes:
  • the control terminal In order to avoid the black borders of the first-person view video when rotating, the control terminal first performs image enlargement processing on at least one frame of the first-person view video, and then at least one of the first-person view video after the image enlargement processing.
  • the frame image is rotated, so that there will be no black borders during the image rotation of the first-person view video, which further improves the user's viewing experience.
  • the control terminal After performing the foregoing preset processing on the first-person view video, the control terminal saves the first-person view video after the preset processing.
  • the preset first-person view video can be saved on the control terminal side, or the preset first-person view video can be saved on the corresponding server side, and the preset first-person view video can also be saved on the corresponding server side.
  • the above embodiment displays the first-person view video on the display interface of the control terminal, and performs preset processing on the first-person view video according to the user's operation on the control terminal.
  • the preset processing includes the first processing, the second processing, and the third processing.
  • at least one of the fourth processing wherein the first processing is used to accelerate the playback of the first-person view video, the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred, and the third processing is used
  • the fourth processing is used to rotate at least one frame of the first-person view video and save the first-person view video after the preset processing.
  • the first-person view video playback presents various effects such as acceleration, picture blurring, picture rotation, viewing angle change, etc. according to the user's operation, which realizes the rich and varied video playback and enhances the sense of presence.
  • FIG. 5 is a schematic block diagram of a video processing apparatus provided by an embodiment of the present application.
  • the video processing device 110 includes a processor 111 and a memory 112, and the processor 111 and the memory 112 are connected by a bus, such as an I2C (Inter-integrated Circuit) bus.
  • I2C Inter-integrated Circuit
  • the processor 111 may be a micro-controller unit (MCU), a central processing unit (CPU), a digital signal processor (Digital Signal Processor, DSP), or the like.
  • MCU micro-controller unit
  • CPU central processing unit
  • DSP Digital Signal Processor
  • the memory 112 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
  • the processor is used to run a computer program stored in a memory, and implement the following steps when executing the computer program:
  • the preset processing includes a first processing, a second processing, a third processing, and a fourth processing.
  • the first processing is used to accelerate the playback of the first-person view video;
  • the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred;
  • the third processing is used to change the viewing angle direction of the first-person view video;
  • the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
  • the processor when the processor implements the acquisition of the user's operation on the control terminal, it specifically implements:
  • the processor further implements when executing the computer program:
  • control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
  • the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
  • the first-person view video is a video shot by a camera mounted on a movable platform.
  • the movable platform is a drone or an unmanned vehicle.
  • control icon includes at least one of an acceleration icon, a blur filter icon, a viewing angle setting icon, and a rotation icon.
  • the fourth processing is performed on the first-person view video according to the fourth touch operation.
  • the processor when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
  • the first-person view video is played by skipping frames.
  • the processor when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
  • the playback speed of the first-person view video is increased.
  • the processor when the processor implements the second processing of the first-person view video according to the second touch operation, it specifically implements:
  • blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  • the processor further implements when executing the computer program:
  • blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  • the processor when the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
  • the processor when the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
  • the processor when the processor implements the preset processing of the first-person view video according to the rotational movement of the control terminal, it specifically implements:
  • the processor when the processor implements the rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal, it specifically implements:
  • rotation processing is performed on at least one frame of the first-person view video.
  • control terminal has a built-in gyroscope sensor, and the gyroscope sensor is used to detect the rotational movement of the control terminal.
  • the processor when the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
  • the processor when the processor implements the determination of the rotation parameter corresponding to the rotation processing, it specifically implements:
  • the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed.
  • the processor before implementing the rotation processing on at least one frame of the first-person view video, the processor further implements:
  • the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
  • the processor when the processor implements the first-person view video to be displayed on the display interface of the control terminal, it specifically implements:
  • the first-person view video is displayed on the display interface of the control terminal.
  • FIG. 6 is a schematic block diagram of a control terminal according to an embodiment of the present application.
  • the control terminal 100 includes the video processing device 110 in the above embodiment, a casing (not shown in the figure), and a display panel 120 provided in the casing.
  • the control terminal 100 displays the first-person view video on the display interface through the display panel 120, and the video processing device 110 performs preset processing on the first-person view video according to the user's operation on the terminal, and saves the preset first-person view For the video, the specific operation can refer to the steps of the video processing method provided in the embodiment of the present application, which will not be repeated here.
  • An embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes program instructions, and a processor executes the program instructions to implement the embodiments of the present application. Provides the steps of the video processing method.
  • the computer-readable storage medium may be the internal storage unit of the video processing device or the control terminal described in the foregoing embodiment, for example, the hard disk or memory of the video processing device or the control terminal.
  • the computer-readable storage medium may also be an external storage device of the video processing device or the control terminal, for example, a plug-in hard disk or a smart memory card (Smart Media Card, SMC) equipped on the video processing device or the control terminal. , Secure Digital (SD) card, Flash Card (Flash Card), etc.
  • SD Secure Digital
  • Flash Card Flash Card

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A video processing method and apparatus, and a control terminal, a system and a storage medium. The method is applied to a control terminal, and comprises: displaying a first-person view video on a display interface of a control terminal; acquiring a user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation, wherein the preset processing comprises at least one of first processing, second processing, third processing and fourth processing, the first processing is used for accelerating the playing of the first-person view video, the second processing is used for blurring at least part of a picture in at least one frame of image of the first-person view video, the third processing is used for changing the viewing direction of the first-person view video, and the fourth processing is used for rotating the at least one frame of image of the first-person view video; and storing the first-person view video after same is subjected to preset processing. Therefore, the richness and diversification of video playing are realized, and the sense of presence is improved.

Description

视频处理方法、装置、控制终端、系统及存储介质Video processing method, device, control terminal, system and storage medium 技术领域Technical field
本申请涉及视频处理技术领域,尤其涉及一种视频处理方法、装置、控制终端、系统及存储介质。This application relates to the field of video processing technology, and in particular to a video processing method, device, control terminal, system, and storage medium.
背景技术Background technique
随着科技的发展,采用手机、无人机等设备进行视频拍摄已经成为人们生活中的日常行为。以无人机航拍为例,在采用无人机航拍时,是以一个观看者的角度,关注点在于航拍构图、运镜,由于无人机镜头是靠云台增稳,航拍视频的画面非常平稳;但同时,也使得无人机的飞行姿态和速度受到限制,航拍镜头单一、呆板,不能以更大自由度的视角去拍摄,例如,无法航拍出贴着海面极速掠过,围绕建筑物任意盘旋等“身临其境”效果的视频。因此,拍摄出来的视频过于单调,临场感不强。With the development of technology, the use of mobile phones, drones and other equipment for video shooting has become a daily behavior in people's lives. Take drone aerial photography as an example. When using drone aerial photography, it is based on the perspective of the viewer. The focus is on aerial composition and lens movement. Because the drone lens is stabilized by the gimbal, the aerial video image is very Stable; but at the same time, it also restricts the flying attitude and speed of the drone. The aerial shot is single and rigid, and it cannot be shot with a greater degree of freedom. For example, it cannot be shot at high speed against the sea surface and surrounding buildings. Any circling and other "immersive" effect videos. Therefore, the filmed video is too monotonous, and the sense of presence is not strong.
发明内容Summary of the invention
基于此,本申请提供了一种视频处理方法、装置、控制终端、系统及存储介质,以实现视频播放的丰富多变化,提升临场感。Based on this, the present application provides a video processing method, device, control terminal, system, and storage medium to achieve rich and varied video playback and enhance the sense of presence.
第一方面,本申请提供了一种视频处理方法,应用于一控制终端,所述方法包括:In the first aspect, this application provides a video processing method applied to a control terminal, and the method includes:
在所述控制终端的显示界面显示第一人称视角视频;Displaying a first-person view video on the display interface of the control terminal;
获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放;所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转;Acquire the user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. The first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; the first The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
保存经过所述预设处理后的所述第一人称视角视频。Save the first-person view video after the preset processing.
第二方面,本申请还提供了一种视频处理装置,所述所述视频处理装置包括存储器和处理器;In a second aspect, the present application also provides a video processing device, the video processing device including a memory and a processor;
所述存储器用于存储计算机程序;The memory is used to store a computer program;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现如下步骤:The processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
在所述控制终端的显示界面显示第一人称视角视频;Displaying a first-person view video on the display interface of the control terminal;
获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放;所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转;Acquire the user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. The first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; the first The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
保存经过所述预设处理后的所述第一人称视角视频。Save the first-person view video after the preset processing.
第三方面,本申请还提供了一种控制终端,所述控制终端:In the third aspect, this application also provides a control terminal, the control terminal:
外壳;shell;
设于所述外壳的显示面板;以及;A display panel provided in the housing; and;
如上述的视频处理装置。Such as the above-mentioned video processing device.
第四方面,本申请还提供了一种视频处理系统,所述视频处理系统包括如上述的控制终端、以及与所述控制终端通信连接的可移动平台,所述可移动平台:In a fourth aspect, the present application also provides a video processing system, the video processing system includes the above-mentioned control terminal, and a movable platform communicatively connected with the control terminal, the movable platform:
机体;Body
动力系统,设于所述机体,所述动力系统用于为所述可移动平台提供动力,以使得搭载在所述可移动平台上的拍摄装置拍摄所述第一人称视角视频。A power system is provided in the body, and the power system is used to provide power to the movable platform so that a camera mounted on the movable platform can shoot the first-person view video.
第五方面,本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如上述的视频处理方法。In a fifth aspect, the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above-mentioned video processing method .
本申请公开的视频处理方法、视频处理装置、控制终端、视频处理系统及计算机可读存储介质,通过在控制终端的显示界面显示第一人称视角视频,并根据用户对控制终端的操作,对第一人称视角视频进行预设处理,预设处理包 括第一处理、第二处理、第三处理和第四处理中的至少一种,其中,第一处理用于使得第一人称视角视频加速播放,第二处理用于使得第一人称视角视频的至少一帧图像中至少局部画面模糊,第三处理用于使得第一人称视角视频的视角方向发生变化,第四处理用于使得第一人称视角视频的至少一帧图像发生旋转,并保存经过预设处理后的第一人称视角视频,相比于现有的常规播放模式,第一人称视角视频播放中根据用户的操作呈现出加速、画面模糊、画面旋转、视角改变等各种效果,实现了视频播放的丰富多变化,提升临场感。The video processing method, video processing device, control terminal, video processing system, and computer-readable storage medium disclosed in this application display first-person view video on the display interface of the control terminal, and respond to the first-person view based on the user’s operation on the control terminal. The viewing angle video is subjected to preset processing. The preset processing includes at least one of the first processing, the second processing, the third processing and the fourth processing. The first processing is used to accelerate the playback of the first-person view video, and the second processing It is used to make at least part of the picture in at least one frame of the first-person view video blurry, the third process is used to change the direction of the view of the first-person view video, and the fourth process is used to make at least one frame of the first-person view video occur. Rotate and save the preset first-person view video. Compared with the existing conventional playback mode, the first-person view video playback shows acceleration, blurring, rotation, and viewing angle changes according to the user's operation. The effect realizes the rich and varied video playback and enhances the sense of presence.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the application.
附图说明Description of the drawings
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can obtain other drawings based on these drawings without creative work.
图1是本申请的实施例提供的一种视频处理系统的示意性框图;Fig. 1 is a schematic block diagram of a video processing system provided by an embodiment of the present application;
图2是本申请的实施例提供的一种视频处理方法的步骤示意流程图;2 is a schematic flowchart of steps of a video processing method provided by an embodiment of the present application;
图3是本申请的实施例提供的一种控制终端的显示界面的示意图;FIG. 3 is a schematic diagram of a display interface of a control terminal provided by an embodiment of the present application;
图4是本申请的实施例提供的另一种控制终端的显示界面的示意图;FIG. 4 is a schematic diagram of another display interface of a control terminal provided by an embodiment of the present application;
图5是本申请的实施例提供的一种视频处理装置的示意性框图;FIG. 5 is a schematic block diagram of a video processing device provided by an embodiment of the present application;
图6是本申请的实施例提供的一种控制终端的示意性框图。Fig. 6 is a schematic block diagram of a control terminal provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
附图中所示的流程图仅是示例说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解、组合 或部分合并,因此实际执行的顺序有可能根据实际情况改变。The flowchart shown in the drawings is only an example, and does not necessarily include all contents and operations/steps, nor does it have to be executed in the described order. For example, some operations/steps can also be decomposed, combined or partially combined, so the actual execution order may be changed according to actual conditions.
应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in the specification of this application and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.
还应当进理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should also be understood that the term "and/or" used in the specification and appended claims of this application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .
下面结合附图,对本申请的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Hereinafter, some embodiments of the present application will be described in detail with reference to the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.
目前,穿越机由于体积小、机身轻,飞行速度很快,可以贴近飞驰的赛车、极限运动者进行跟拍,而且飞行灵活,能做出翻滚、旋转等各种特技飞行效果,穿越机飞行时,其镜头由于是被“硬挂”在机身上,镜头可以和穿越机的姿态一起旋转,因而能用更有自由度的视角去进行拍摄。例如,当机身倾侧、俯冲时,镜头拍摄出来的画面也一样是倾侧、俯冲的;用户通过FPV(First Person View,第一人称主视角)眼镜观看穿越机航拍视频时,就犹如自己亲身坐在驾驶舱跟着飞机一起倾侧、俯冲,临场感很强,给用户带来“身临其境”的视觉效果。本申请的实施例提供了一种视频处理方法、装置、控制终端、系统及存储介质,用于实现视频播放的丰富多变化,提升临场感,使用户在观看非穿越机航拍视频时,也能达到像观看穿越机航拍视频的“身临其境”视觉效果。At present, due to its small size, light body, and fast flying speed, the traversing aircraft can be close to speeding racing cars and extreme sportsmen for follow-up, and it is flexible in flight, and can perform various aerobatic effects such as tumbling and rotation. At this time, because the lens is "hard-hung" on the fuselage, the lens can rotate with the posture of the traversing machine, so it can shoot with a more free angle of view. For example, when the fuselage tilts or dives, the image captured by the lens is also tilted and dived; when the user watches the aerial video of the traversing aircraft through FPV (First Person View) glasses, it is as if they are sitting in person. The cockpit tilts and dives along with the aircraft, and has a strong sense of presence, giving users an "immersive" visual effect. The embodiments of the present application provide a video processing method, device, control terminal, system, and storage medium, which are used to implement rich and varied video playback, improve the sense of presence, and enable users to watch non-traveling aerial video. Achieve an "immersive" visual effect like watching an aerial video of a passing plane.
请参阅图1,图1为本申请实施例提供的一种视频处理系统的示意性框图。如图1所示,视频处理系统1000包括控制终端100、可移动平台200,控制终端100和可移动平台200通信连接。Please refer to FIG. 1. FIG. 1 is a schematic block diagram of a video processing system according to an embodiment of the application. As shown in FIG. 1, the video processing system 1000 includes a control terminal 100 and a movable platform 200, and the control terminal 100 and the movable platform 200 are in communication connection.
示例性的,控制终端100包括但不限于遥控设备、地面控制平台、手机、平板电脑、笔记本电脑和PC电脑等。可移动平台200包括但不限于无人机、无人车等。Exemplarily, the control terminal 100 includes, but is not limited to, a remote control device, a ground control platform, a mobile phone, a tablet computer, a notebook computer, a PC computer, and the like. The movable platform 200 includes, but is not limited to, unmanned aerial vehicles, unmanned vehicles, and the like.
示例性的,控制终端100内置有陀螺仪传感器,通过陀螺仪传感器检测控制终端100的旋转、移动等运动状态。Exemplarily, the control terminal 100 has a built-in gyroscope sensor, and the rotation and movement of the control terminal 100 are detected by the gyroscope sensor.
可移动平台200包括机体210和动力系统220,动力系统220设于机体210 中,动力系统220用于为可移动平台200提供动力。可移动平台200上搭载拍摄装置(图中未示出),拍摄装置包括但不限于摄像头、相机等,通过拍摄装置进行图像、视频的拍摄,其中,拍摄的视频包括第一人称视角(FPV,First Person View)视频。可移动平台200将拍摄的视频传送至控制终端100,控制终端100接收获取可移动平台200回传的视频。The movable platform 200 includes a body 210 and a power system 220. The power system 220 is provided in the body 210, and the power system 220 is used to provide power for the movable platform 200. The movable platform 200 is equipped with a photographing device (not shown in the figure). The photographing device includes but is not limited to a camera, a camera, etc., and images and videos are captured by the photographing device. The captured video includes a first-person perspective (FPV, First Person View) video. The movable platform 200 transmits the captured video to the control terminal 100, and the control terminal 100 receives and acquires the video transmitted back by the movable platform 200.
为了实现如贴着物体极速掠过、盘旋等“身临其境”效果的视频,控制终端100在其显示界面上显示第一人称视角视频,并获取用户对控制终端100的操作,根据用户对控制终端100的操作,对该第一人称视角视频进行预设处理,其中,预设处理包括但不限于第一处理、第二处理、第三处理和第四处理中的至少一种;控制终端100执行第一处理使得第一人称视角视频加速播放;控制终端100执行第二处理使得第一人称视角视频的至少一帧图像中至少局部画面模糊;控制终端100执行第三处理使得第一人称视角视频的视角方向发生变化;控制终端100执行第四处理使得第一人称视角视频的至少一帧图像发生旋转。通过控制终端100执行预设处理,获得具有极速掠过、俯冲、模糊、旋转等各种具有临场感效果的第一人称视角视频。In order to achieve "immersive" videos such as fast passing by and hovering against objects, the control terminal 100 displays the first-person view video on its display interface, and obtains the user's operation on the control terminal 100, according to the user's control The operation of the terminal 100 is to perform preset processing on the first-person view video, where the preset processing includes but is not limited to at least one of the first processing, the second processing, the third processing, and the fourth processing; the terminal 100 is controlled to execute The first processing makes the first-person view video play faster; the control terminal 100 executes the second processing to make at least part of the image in at least one frame of the first-person view video blurry; the control terminal 100 executes the third processing so that the direction of the first-person view video’s angle of view occurs Change; the control terminal 100 performs the fourth process to make at least one frame of the first-person view video rotate. By controlling the terminal 100 to execute a preset process, various first-person view videos with various immersive effects such as rapid skimming, diving, blurring, and rotation are obtained.
示例性的,控制终端100保存经过预设处理后的第一人称视角视频,从而便于后续用户直接查看使用该经过预设处理后的第一人称视角视频,而不必须再次进行上述预设处理。Exemplarily, the control terminal 100 saves the preset first-person view video, so that subsequent users can directly view and use the preset first-person view video without having to perform the above-mentioned preset processing again.
示例性的,当用户要对第一人称视角视频进行预设处理时,用户可以通过对控制终端100的显示界面执行相应触控操作,其中,触控操作包括但不限于点击、滑动操作等;用户也可以直接对控制终端100执行相应操作,包括但不限于移动、旋转操作等,以使控制终端100发生运动。控制终端100获取用户对显示界面的触控操作,和/或获取用户对控制终端的操作,根据用户对显示界面的触控操作,和/或用户对控制终端的操作,对第一人称视角视频进行预设处理。Exemplarily, when the user wants to perform preset processing on the first-person view video, the user can perform corresponding touch operations on the display interface of the control terminal 100, where the touch operations include but are not limited to clicking, sliding operations, etc.; the user It is also possible to directly perform corresponding operations on the control terminal 100, including but not limited to moving, rotating operations, etc., to make the control terminal 100 move. The control terminal 100 obtains the user's touch operation on the display interface, and/or obtains the user's operation on the control terminal, and performs the first-person view video according to the user's touch operation on the display interface and/or the user's operation on the control terminal Preset processing.
示例性的,为了方便用户对控制终端100的操作,在控制终端100的显示界面显示控制图标,控制图标用于表示对第一人称视角视频进行预设处理的程序标识;控制图标包括但不限于加速图标、模糊滤镜图标、视角设置图标、旋转图标中的至少一个。当用户要对第一人称视角视频进行预设处理时,用户可 以通过对显示界面显示的控制图标执行相应操作,包括但不限于对加速图标的第一触控操作、对模糊滤镜图标的第二触控操作、对视角设置图标的第三触控操作、对旋转图标的第四触控操作等。控制终端100获取用户对控制图标的操作,并根据对控制图标的操作,对第一人称视角视频进行预设处理。Exemplarily, in order to facilitate the operation of the control terminal 100 by the user, a control icon is displayed on the display interface of the control terminal 100. The control icon is used to indicate the program identifier for pre-processing the first-person view video; the control icon includes but is not limited to acceleration At least one of an icon, a blur filter icon, an angle setting icon, and a rotation icon. When the user wants to perform preset processing on the first-person view video, the user can perform corresponding operations on the control icons displayed on the display interface, including but not limited to the first touch operation on the acceleration icon, and the second operation on the blur filter icon. Touch operation, the third touch operation on the viewing angle setting icon, the fourth touch operation on the rotating icon, etc. The control terminal 100 obtains the user's operation on the control icon, and performs preset processing on the first-person view video according to the operation on the control icon.
可选地,当控制终端100获取用户对加速图标的第一触控操作时,根据该第一触控操作对第一人称视角视频进行第一处理,使得第一人称视角视频加速播放。当控制终端100获取用户对模糊滤镜图标的第二触控操作时,根据该第二触控操作对第一人称视角视频进行第二处理,使得第一人称视角视频的至少一帧图像中至少局部画面模糊。当控制终端100获取用户对视角设置图标的第三触控操作时,根据该第三触控操作对第一人称视角视频进行第三处理,使得第一人称视角视频的视角方向发生变化。当控制终端100获取用户对旋转图标的第四触控操作时,根据该第四触控操作对第一人称视角视频进行第四处理,使得第一人称视角视频的至少一帧图像发生旋转。Optionally, when the control terminal 100 acquires the user's first touch operation on the acceleration icon, first processing is performed on the first-person view video according to the first touch operation, so that the first-person view video is played at an accelerated rate. When the control terminal 100 acquires the user's second touch operation on the blur filter icon, the second touch operation is performed on the first-person view video according to the second touch operation, so that at least part of the image in at least one frame of the first-person view video is blurry. When the control terminal 100 acquires the user's third touch operation on the viewing angle setting icon, it performs a third process on the first-person view video according to the third touch operation, so that the viewing angle direction of the first-person view video is changed. When the control terminal 100 obtains the user's fourth touch operation on the rotation icon, the fourth processing is performed on the first-person view video according to the fourth touch operation, so that at least one frame of the first-person view video is rotated.
示例性的,控制终端100根据该第一触控操作,将第一人称视角视频对应播放的帧率增大,比如,将帧率从30帧/秒增大到50帧/秒,以增大的帧率进行视频播放,从而实现第一人称视角视频加速播放。或者,控制终端100根据该第一触控操作,对第一人称视角视频进行跳帧播放,从而实现第一人称视角视频加速播放。Exemplarily, the control terminal 100 increases the corresponding playback frame rate of the first-person view video according to the first touch operation, for example, increases the frame rate from 30 frames/sec to 50 frames/sec to increase Frame rate for video playback, so as to achieve accelerated playback of first-person view video. Alternatively, the control terminal 100 performs frame skipping playback of the first-person view video according to the first touch operation, thereby achieving accelerated playback of the first-person view video.
示例性的,为了进一步提高用户体验,控制终端100根据第一触控操作确定对应的加速倍数,进而根据加速倍数增大第一人称视角视频的播放速度,也即,用户执行的第一触控操作的触控参数不同,比如触控时长、触控轨迹等触控参数不同,则对应第一人称视角视频的播放速度也不相同,从而更进一步提高视频播放方式的灵活性。Exemplarily, in order to further improve the user experience, the control terminal 100 determines the corresponding acceleration factor according to the first touch operation, and then increases the playback speed of the first-person view video according to the acceleration factor, that is, the first touch operation performed by the user If the touch parameters are different, such as touch duration, touch trajectory and other touch parameters, the playback speed of the corresponding first-person view video is also different, thereby further improving the flexibility of the video playback mode.
示例性的,控制终端100根据第一触控操作将第一人称视角视频加速播放,也根据第一触控操作恢复第一人称视角视频加速前的播放速度。可选地,控制终端100对第一触控操作进行监测,当第一触控操作结束时,控制终端100控制恢复第一人称视角视频的播放速度。Exemplarily, the control terminal 100 accelerates the playback of the first-person view video according to the first touch operation, and also restores the playback speed of the first-person view video before the acceleration according to the first touch operation. Optionally, the control terminal 100 monitors the first touch operation, and when the first touch operation ends, the control terminal 100 controls to restore the playback speed of the first-person view video.
示例性的,控制终端100在根据第二触控操作对第一人称视角视频进行第二处理中,首先根据第二触控操作,确定第二处理也即模糊处理对应的模糊参 数,其中,模糊参数包括但不限于模糊区域、粒度等参数。控制终端100根据确定的模糊参数,对第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。例如,根据确定的模糊区域,对第一人称视角视频的至少一帧图像中该模糊区域所对应的画面进行模糊处理;又如,根据确定的粒度,对第一人称视角视频的至少一帧图像中至少局部画面进行该粒度所对应的模糊程度的模糊处理。Exemplarily, when the control terminal 100 performs the second processing on the first-person view video according to the second touch operation, first, according to the second touch operation, determine the blur parameters corresponding to the second processing, that is, the blur processing, where the blur parameters Including but not limited to fuzzy area, granularity and other parameters. The control terminal 100 performs blur processing on at least a part of the image in at least one frame of the first-person view video according to the determined blur parameter. For example, according to the determined blurred area, blur the picture corresponding to the blurred area in at least one frame of the first-person view video; for another example, according to the determined granularity, perform the blur processing on at least one frame of the first-person view video. The partial picture is subjected to blurring processing with the degree of blurring corresponding to the granularity.
示例性的,控制终端100除了可以根据第二触控操作对第一人称视角视频进行第二处理,也可以根据第一人称视角视频的画面信息,自动对第一人称视角视频进行第二处理。可选地,在一实施例中,控制终端100根据第一人称视角视频的图像帧构图信息,确定第一人称视角视频的视角方向,进而根据第一人称视角视频的视角方向,确定对应的模糊区域,控制终端100根据确定的模糊区域,对第一人称视角视频的至少一帧图像中该模糊区域所对应的画面进行模糊处理。在另一实施例中,控制终端100根据第一人称视角视频的图像帧构图信息,确定出第一人称视角视频的图像帧对应的前景区域,将前景区域作为图像帧的模糊区域,控制终端100对第一人称视角视频的图像帧中该前景区域所对应的画面进行模糊处理。Exemplarily, in addition to performing the second processing on the first-person view video according to the second touch operation, the control terminal 100 may also automatically perform the second processing on the first-person view video according to the screen information of the first-person view video. Optionally, in an embodiment, the control terminal 100 determines the viewing angle direction of the first-person view video according to the image frame composition information of the first-person view video, and then determines the corresponding blur area according to the viewing angle direction of the first-person view video, and controls The terminal 100 performs blur processing on a picture corresponding to the blurry region in at least one frame of image of the first-person view video according to the determined blurry region. In another embodiment, the control terminal 100 determines the foreground area corresponding to the image frame of the first-person view video according to the image frame composition information of the first-person view video, uses the foreground area as the blurred area of the image frame, and controls the terminal 100 to The image corresponding to the foreground area in the image frame of the one-person view video is blurred.
示例性的,控制终端100除了根据第二触控操作对第一人称视角视频进行第二处理,也可以在达到相应条件时自动对第一人称视角视频进行第二处理。可选地,控制终端100在检测到第一人称视角视频的播放速度达到预设速度阈值时,对第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理,也即在第一人称视角视频的播放速度变得较快时,将画面进行模糊处理,从而达到用户身临其境以第一视角观看体验的效果。Exemplarily, in addition to performing the second processing on the first-person view video according to the second touch operation, the control terminal 100 may also automatically perform the second processing on the first-person view video when the corresponding conditions are met. Optionally, when detecting that the playback speed of the first-person view video reaches a preset speed threshold, the control terminal 100 blurs at least a part of the image in at least one frame of the first-person view video, that is, when the first-person view video is played When the playback speed becomes faster, the picture is blurred, so as to achieve the effect of the user's immersive viewing experience from the first perspective.
示例性的,用户可以对控制终端100进行移动操作,以使得控制终端100发生其中一个方向的移动,例如往前方向的移动、往后方向的移动、往左方向的移动、往右方向的移动等等。控制终端100获取用户的移动操作,根据控制终端100移动的方向,对第一人称视角视频进行预设处理。例如,若控制终端100移动的方向为往前方向,则对第一人称视角视频进行加速播放;若控制终端100移动的方向为往后方向,则恢复第一人称视角视频的播放速度;若控制终端100移动的方向为往左方向,则将第一人称视角视频的视角方向往左偏; 若控制终端100移动的方向为往右方向,则将第一人称视角视频的视角方向往右偏。可选地,由于第一人称视角视频的图像帧大小有限,控制终端100改变第一人称视角视频的视角方向的处理过程,是通过截取第一人称视角视频的图像帧的局部图像,将截取的局部图像进行放大处理后进行显示播放,从而实现第一人称视角视频的视角方向改变的效果。例如,若控制终端100移动的方向为往左方向,则截取第一人称视角视频的图像帧的左边局部图像,将截取的左边局部图像进行放大处理后进行显示播放。若控制终端100移动的方向为往右方向,则截取第一人称视角视频的图像帧的右边局部图像,将截取的右边局部图像进行放大处理后进行显示播放。Exemplarily, the user may perform a movement operation on the control terminal 100 to cause the control terminal 100 to move in one of the directions, such as movement in the forward direction, movement in the backward direction, movement in the left direction, and movement in the right direction. and many more. The control terminal 100 obtains the movement operation of the user, and performs preset processing on the first-person view video according to the direction in which the control terminal 100 moves. For example, if the movement direction of the control terminal 100 is the forward direction, the first-person view video is played at an accelerated rate; if the movement direction of the control terminal 100 is the backward direction, the playback speed of the first-person view video is restored; if the terminal 100 is controlled The moving direction is the left direction, and the viewing angle of the first-person view video is shifted to the left; if the moving direction of the control terminal 100 is the right direction, the viewing angle of the first-person view video is shifted to the right. Optionally, due to the limited image frame size of the first-person view video, the process of controlling the terminal 100 to change the view direction of the first-person view video is to intercept partial images of the image frames of the first-person view video, and perform the intercepted partial images. After zooming in, it is displayed and played, so as to achieve the effect of changing the viewing angle of the first-person view video. For example, if the moving direction of the control terminal 100 is the left direction, the left partial image of the image frame of the first-person view video is intercepted, and the intercepted left partial image is enlarged and then displayed and played. If the moving direction of the control terminal 100 is the right direction, the right partial image of the image frame of the first-person view video is intercepted, and the intercepted right partial image is enlarged and then displayed and played.
示例性的,用户还可以对控制终端100进行旋转操作,以使得控制终端100进行旋转,例如绕平行控制终端100的显示界面的轴旋转、绕穿过控制终端100的显示界面的轴旋转等等。控制终端100获取用户的旋转操作,可选地,控制终端100采用内置的陀螺仪传感器检测其旋转运动,根据控制终端100的旋转运动,对第一人称视角视频进行预设处理。可选地,根据绕平行控制终端100的显示界面的轴旋转,调整第一人称视角视频的上下视角方向。例如,若控制终端100绕平行显示界面的轴顺时针旋转,调整第一人称视角视频的视角方向往上偏;若控制终端100绕平行显示界面的轴逆时针旋转,调整第一人称视角视频的视角方向往下偏。具体地,若控制终端100绕平行显示界面的轴顺时针旋转,则控制终端100截取第一人称视角视频的图像帧的上边局部图像,将截取的上边局部图像进行放大处理后进行显示播放,从而实现调整第一人称视角视频的视角方向往上偏;若控制终端100绕平行显示界面的轴逆时针旋转,则控制终端100截取第一人称视角视频的图像帧的下边局部图像,将截取的下边局部图像进行放大处理后进行显示播放,从而实现调整第一人称视角视频的视角方向往下偏。Exemplarily, the user may also perform a rotation operation on the control terminal 100 to make the control terminal 100 rotate, for example, rotation around an axis parallel to the display interface of the control terminal 100, rotation around an axis passing through the display interface of the control terminal 100, etc. . The control terminal 100 obtains the user's rotation operation. Optionally, the control terminal 100 uses a built-in gyroscope sensor to detect the rotation movement, and performs preset processing on the first-person view video according to the rotation movement of the control terminal 100. Optionally, according to the axis rotation around the display interface of the parallel control terminal 100, the upper and lower viewing angle directions of the first-person view video are adjusted. For example, if the control terminal 100 rotates clockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video upward; if the control terminal 100 rotates counterclockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video. Downward. Specifically, if the control terminal 100 rotates clockwise around the axis of the parallel display interface, the control terminal 100 intercepts the upper partial image of the image frame of the first-person view video, and enlarges the intercepted upper partial image for display and playback, thereby achieving Adjust the angle of view of the first-person view video to the upper side; if the control terminal 100 rotates counterclockwise around the axis parallel to the display interface, the control terminal 100 will capture the lower part of the image frame of the first-person view video, and perform the capture of the lower part of the image. After zooming in, it is displayed and played, so that the viewing angle of the first-person view video is adjusted downward.
示例性的,控制终端100获取用户的旋转操作,根据控制终端100的旋转运动,对第一人称视角视频的至少一帧图像进行旋转处理。可选地,在控制终端100的旋转运动为控制终端100绕穿过显示界面的轴进行旋转时,对第一人称视角视频的至少一帧图像进行旋转处理。Exemplarily, the control terminal 100 obtains the user's rotation operation, and performs rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal 100. Optionally, when controlling the rotation of the terminal 100 to control the terminal 100 to rotate around an axis passing through the display interface, perform rotation processing on at least one frame of the first-person view video.
示例性的,为了进一步提高用户体验,控制终端100根据旋转运动确定对 应的旋转参数,其中,旋转参数包括旋转方向、旋转角度、旋转速度中的至少一种。进而根据确定的旋转参数对第一人称视角视频的至少一帧图像进行旋转处理,也即,控制终端100旋转运动的旋转参数不同,对第一人称视角视频的至少一帧图像进行旋转处理也相应不同,从而使得视频播放方式更加丰富灵活。Exemplarily, in order to further improve the user experience, the control terminal 100 determines a corresponding rotation parameter according to the rotation movement, where the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed. Further, perform rotation processing on at least one frame of the first-person view video according to the determined rotation parameter, that is, if the rotation parameters for controlling the rotation of the terminal 100 are different, the rotation processing on at least one frame of the first-person view video is also different. This makes the video playback method more abundant and flexible.
示例性的,控制终端100根据控制终端的旋转运动对应的旋转运动参数,确定旋转处理对应的旋转参数。可选地,预先设置控制终端的旋转运动对应的旋转运动参数与旋转处理对应的旋转参数的映射关系,根据该映射关系,确定控制终端的旋转运动的旋转运动参数对应的旋转参数,进而根据确定的旋转参数对第一人称视角视频的至少一帧图像进行旋转处理。Exemplarily, the control terminal 100 determines the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal. Optionally, a mapping relationship between the rotation parameter corresponding to the rotation movement of the control terminal and the rotation parameter corresponding to the rotation processing is preset, and the rotation parameter corresponding to the rotation movement parameter of the rotation movement of the control terminal is determined according to the mapping relationship, and then according to the determination The rotation parameter of performs rotation processing on at least one frame of the first-person view video.
示例性的,为了避免第一人称视角视频的画面在旋转时出现黑边情况,控制终端100首先将第一人称视角视频的至少一帧图像进行图像放大处理,之后再将经过图像放大处理后的第一人称视角视频的至少一帧图像进行旋转处理。Exemplarily, in order to avoid a black border when the picture of the first-person view video is rotated, the control terminal 100 first performs image enlargement processing on at least one frame of the first-person view video, and then performs image enlargement processing on the first-person view after the image enlargement processing. At least one frame of the view video is rotated.
示例性的,为了进一步提高用户的交互体验,配置视频播放的多种播放模式,包括但不限于普通播放模式、预设播放模式等,用户可以根据自己需求选择相应的播放模式。若用户选择了预设播放模式,在启动预设播放模式后,在控制终端100的显示界面显示第一人称视角视频;而若用户选择了普通播放模式,在启动普通播放模式后,控制终端100将视频进行常规方式播放。Exemplarily, in order to further improve the user's interactive experience, multiple playback modes of video playback are configured, including but not limited to normal playback mode, preset playback mode, etc. The user can select the corresponding playback mode according to his needs. If the user selects the preset play mode, after the preset play mode is activated, the first-person view video is displayed on the display interface of the control terminal 100; and if the user selects the normal play mode, after the normal play mode is activated, the control terminal 100 will The video is played in the usual way.
可以理解的,上述对于视频处理系统各部件的命名仅仅出于标识的目的,并不因此对本申请实施例进行限制。It can be understood that the aforementioned naming of the components of the video processing system is only for identification purposes, and does not limit the embodiments of the present application accordingly.
综上,通过在控制终端100的显示界面显示第一人称视角视频,并根据用户对控制终端100的操作,对第一人称视角视频进行预设处理,从而使得第一人称视角视频呈现出了视频加速、画面模糊、画面旋转、视角改变等各种效果,用户观看该第一人称视角视频,就犹如是在观看穿越机航拍视频一样,达到了“身临其境”的视觉效果。In summary, the first-person view video is displayed on the display interface of the control terminal 100, and the first-person view video is preset according to the user's operation on the control terminal 100, so that the first-person view video presents a video acceleration and screen With various effects such as blurring, picture rotation, and viewing angle changes, the user watching the first-person view video is just like watching an aerial video of a traversing plane, achieving an "immersive" visual effect.
以下将基于视频处理系统、所述视频处理系统中的控制终端和所述视频处理系统中的可移动平台对本申请的实施例提供的视频处理方法进行详细介绍。需知,图1中的视频处理系统并不构成对该视频处理方法的应用场景的限定。Hereinafter, the video processing method provided by the embodiment of the present application will be introduced in detail based on the video processing system, the control terminal in the video processing system, and the movable platform in the video processing system. It should be understood that the video processing system in FIG. 1 does not constitute a limitation on the application scenario of the video processing method.
请参阅图2,图2是本申请的实施例提供的一种视频处理方法的示意流程图。该方法可以用于上述实施例提供的任意一种控制终端中,以实现视频播放 的丰富多变化,提升临场感。Please refer to FIG. 2, which is a schematic flowchart of a video processing method provided by an embodiment of the present application. This method can be used in any of the control terminals provided in the above embodiments to realize rich and varied video playback and enhance the sense of presence.
如图2所示,该视频处理方法具体包括步骤S101至步骤S103。As shown in FIG. 2, the video processing method specifically includes steps S101 to S103.
S101、在控制终端的显示界面显示第一人称视角视频。S101. Display a first-person view video on the display interface of the control terminal.
本实施例中,通过上述视频处理系统实施例中的控制终端进行视频播放时,在控制终端的显示界面上显示第一人称视角(FPV,First Person View)视频,其中,第一人称视角视频相比于普通视频,可以实现用户获得具有极速掠过、俯冲、模糊、旋转等各种具有身临其境效果的观看体验。可选地,第一人称视角视频为可移动平台上搭载的拍摄装置拍摄的视频,其中,可移动平台包括但不限于无人机、无人车等,拍摄装置包括但不限于摄像头等。In this embodiment, when the video is played by the control terminal in the foregoing embodiment of the video processing system, a first-person view (FPV) video is displayed on the display interface of the control terminal, where the first-person view video is compared to Ordinary video, users can get a variety of immersive viewing experiences such as rapid skimming, swooping, blurring, and rotating. Optionally, the first-person view video is a video shot by a camera mounted on a movable platform, where the movable platform includes but is not limited to drones, unmanned vehicles, etc., and the camera includes but is not limited to a camera.
为了提高用户的交互体验,在一些实施例中,配置视频播放的多种播放模式,包括但不限于普通播放模式、预设播放模式等,用户可以根据自己需求选择相应的播放模式。所述在控制终端的显示界面显示第一人称视角视频,包括:In order to improve the user's interactive experience, in some embodiments, multiple play modes of video play are configured, including but not limited to normal play mode, preset play mode, etc. The user can select the corresponding play mode according to his needs. The first-person view video displayed on the display interface of the control terminal includes:
在启动预设播放模式后,在所述控制终端的所述显示界面显示所述第一人称视角视频。After starting the preset play mode, the first-person view video is displayed on the display interface of the control terminal.
当用户要通过控制终端观看视频时,若用户选择了普通播放模式,在启动普通播放模式后,控制终端将视频进行普通常规方式播放。而当用户想获得具有身临其境效果的第一视角观看体验时,用户选择预设播放模式,在启动预设播放模式后,在控制终端的显示界面显示第一人称视角视频。When the user wants to watch the video through the control terminal, if the user selects the normal play mode, after the normal play mode is started, the control terminal will play the video in the normal normal mode. When the user wants to obtain a first-person viewing experience with an immersive effect, the user selects a preset playback mode, and after starting the preset playback mode, the first-person view video is displayed on the display interface of the control terminal.
S102、获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放;所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转。S102. Obtain a user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. At least one of the processing; the first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated.
控制终端在其显示界面显示第一人称视角视频,并且实时监测用户对控制终端的操作,包括但不限于对控制终端的移动、旋转操作,对控制终端的显示界面的触控操作等。在获取用户对控制终端的操作后,根据用户对控制终端的操作,对该第一人称视角视频进行预设处理,其中,预设处理包括但不限于第一处理、第二处理、第三处理和第四处理中的至少一种;控制终端执行第一处 理使得第一人称视角视频加速播放;控制终端执行第二处理使得第一人称视角视频的至少一帧图像中至少局部画面模糊;控制终端执行第三处理使得第一人称视角视频的视角方向发生变化;控制终端执行第四处理使得第一人称视角视频的至少一帧图像发生旋转。所述获取用户对所述控制终端的操作,包括:The control terminal displays the first-person view video on its display interface, and monitors the user's operations on the control terminal in real time, including but not limited to movement and rotation operations on the control terminal, and touch operations on the display interface of the control terminal. After obtaining the user's operation on the control terminal, according to the user's operation on the control terminal, perform preset processing on the first-person view video, where the preset processing includes, but is not limited to, the first processing, the second processing, the third processing, and At least one of the fourth processing; control the terminal to perform the first processing to accelerate the playback of the first-person view video; control the terminal to perform the second processing to make at least part of the image in at least one frame of the first-person view video blurry; control the terminal to perform the third The processing causes the viewing angle direction of the first-person view video to be changed; the control terminal performs the fourth processing to cause at least one frame of the first-person view video to rotate. The obtaining the operation of the user on the control terminal includes:
获取用户对所述显示界面的触控操作;Acquiring a user's touch operation on the display interface;
和/或,获取用户对所述控制终端的操作,以使所述控制终端发生运动。And/or, obtaining a user's operation on the control terminal to make the control terminal move.
在一些实施例中,用户可以通过对控制终端的显示界面执行相应触控操作,包括但不限于点击、滑动操作等;用户也可以直接对控制终端执行相应操作,包括但不限于移动、旋转操作等,以使控制终端100发生运动。控制终端获取用户对显示界面的触控操作,和/或获取用户对控制终端的操作,根据用户对显示界面的触控操作,和/或用户对控制终端的操作,对第一人称视角视频进行预设处理。In some embodiments, the user can perform corresponding touch operations on the display interface of the control terminal, including but not limited to clicking, sliding operations, etc.; the user can also perform corresponding operations directly on the control terminal, including but not limited to moving and rotating operations. And so on to make the control terminal 100 move. The control terminal obtains the user's touch operation on the display interface, and/or obtains the user's operation on the control terminal, and performs a preview of the first-person view video based on the user's touch operation on the display interface and/or the user's operation on the control terminal. Set up processing.
在一些实施例中,所述视频处理方法还包括:In some embodiments, the video processing method further includes:
在所述控制终端的显示界面显示控制图标;所述控制图标用于表示对所述第一人称视角视频进行预设处理的程序标识;Display a control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理包括:The acquiring the user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation includes:
获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理。Obtain the user's operation on the control icon, and perform the preset processing on the first-person view video according to the operation on the control icon.
为了方便用户对控制终端的操作,在控制终端的显示界面显示控制图标,控制图标用于表示对第一人称视角视频进行预设处理的程序标识,包括但不限于加速图标、模糊滤镜图标、视角设置图标、旋转图标中的至少一个。当用户要对第一人称视角视频进行预设处理时,用户可以通过对显示界面显示的控制图标执行相应操作,包括但不限于对加速图标的第一触控操作、对模糊滤镜图标的第二触控操作、对视角设置图标的第三触控操作、对旋转图标的第四触控操作等。控制终端获取用户对控制图标的操作,并根据对控制图标的操作,对第一人称视角视频进行预设处理。可选地,所述获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理,包括:In order to facilitate the operation of the control terminal by the user, the control icon is displayed on the display interface of the control terminal. The control icon is used to indicate the program identification for the preset processing of the first-person view video, including but not limited to the acceleration icon, the blur filter icon, and the viewing angle. Set at least one of the icon and the rotation icon. When the user wants to perform preset processing on the first-person view video, the user can perform corresponding operations on the control icons displayed on the display interface, including but not limited to the first touch operation on the acceleration icon, and the second operation on the blur filter icon. Touch operation, the third touch operation on the viewing angle setting icon, the fourth touch operation on the rotating icon, etc. The control terminal obtains the user's operation on the control icon, and performs preset processing on the first-person view video according to the operation on the control icon. Optionally, the acquiring the user's operation on the control icon and performing the preset processing on the first-person view video according to the operation on the control icon includes:
当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理;和/或When acquiring the user's first touch operation on the acceleration icon, perform first processing on the first-person view video according to the first touch operation; and/or
当获取用户对所述模糊滤镜图标的第二触控操作时,根据所述第二触控操作对所述第一人称视角视频进行第二处理;和/或When acquiring the user's second touch operation on the blur filter icon, perform a second process on the first-person view video according to the second touch operation; and/or
当获取用户对所述视角设置图标的第三触控操作时,根据所述第三触控操作对所述第一人称视角视频进行第三处理;和/或When acquiring the user's third touch operation on the viewing angle setting icon, perform third processing on the first-person view video according to the third touch operation; and/or
当获取用户对所述旋转图标的第四触控操作时,根据所述第四触控操作对所述第一人称视角视频进行第四处理。When the fourth touch operation of the user on the rotation icon is acquired, a fourth process is performed on the first-person view video according to the fourth touch operation.
当控制终端获取用户对加速图标的第一触控操作时,根据该第一触控操作对第一人称视角视频进行第一处理,使得第一人称视角视频加速播放。当控制终端获取用户对模糊滤镜图标的第二触控操作时,根据该第二触控操作对第一人称视角视频进行第二处理,使得第一人称视角视频的至少一帧图像中至少局部画面模糊。例如,如图3所示,以控制终端为手机为例,在控制终端的显示界面上显示模糊滤镜图标10,当控制终端获取用户对模糊滤镜图标10的第二触控操作时,根据该第二触控操作对第一人称视角视频进行第二处理,使得第一人称视角视频的至少一帧图像中至少局部画面模糊。当控制终端获取用户对视角设置图标的第三触控操作时,根据该第三触控操作对第一人称视角视频进行第三处理,使得第一人称视角视频的视角方向发生变化。当控制终端获取用户对旋转图标的第四触控操作时,根据该第四触控操作对第一人称视角视频进行第四处理,使得第一人称视角视频的至少一帧图像发生旋转。例如,如图4所示,仍以控制终端为手机为例,在控制终端的显示界面上显示旋转图标20,当控制终端获取用户对旋转图标20的第四触控操作时,根据该第四触控操作对第一人称视角视频进行第四处理,使得第一人称视角视频的至少一帧图像发生旋转。在图4所示的例子中,控制终端获取用户对旋转图标20的逆时针旋转操作,控制终端根据该操作,将第一人称视角视频的至少一帧图像进行逆时针旋转处理。When the control terminal acquires the user's first touch operation on the acceleration icon, it performs first processing on the first-person view video according to the first touch operation, so that the first-person view video is played at an accelerated rate. When the control terminal acquires the user's second touch operation on the blur filter icon, it performs a second process on the first-person view video according to the second touch operation, so that at least part of the image in at least one frame of the first-person view video is blurred . For example, as shown in Figure 3, taking the control terminal as a mobile phone as an example, the blur filter icon 10 is displayed on the display interface of the control terminal. When the control terminal obtains the user's second touch operation on the blur filter icon 10, according to The second touch operation performs second processing on the first-person view video, so that at least a part of the image in at least one frame of the first-person view video is blurred. When the control terminal acquires the user's third touch operation on the viewing angle setting icon, it performs third processing on the first-person view video according to the third touch operation, so that the viewing angle direction of the first-person view video is changed. When the control terminal acquires the user's fourth touch operation on the rotation icon, the fourth processing is performed on the first-person view video according to the fourth touch operation, so that at least one frame of the first-person view video is rotated. For example, as shown in FIG. 4, taking the control terminal as a mobile phone as an example, the rotation icon 20 is displayed on the display interface of the control terminal. When the control terminal obtains the user's fourth touch operation on the rotation icon 20, according to the fourth touch operation The touch operation performs the fourth processing on the first-person view video, so that at least one frame of the first-person view video is rotated. In the example shown in FIG. 4, the control terminal acquires the counterclockwise rotation operation of the rotation icon 20 by the user, and the control terminal performs counterclockwise rotation processing on at least one frame of the first-person view video according to the operation.
在一些实施例中,所述根据所述第一触控操作对所述第一人称视角视频进行第一处理,包括:In some embodiments, the performing the first processing on the first-person view video according to the first touch operation includes:
根据所述第一触控操作,将所述第一人称视角视频对应播放的帧率增大, 以增大的帧率进行视频播放;或者According to the first touch operation, the frame rate corresponding to the first-person view video is increased, and the video is played at the increased frame rate; or
根据所述第一触控操作,对所述第一人称视角视频进行跳帧播放。According to the first touch operation, the first-person view video is played by skipping frames.
为了实现第一人称视角视频的加速播放,在一实施方式中,控制终端根据用户的第一触控操作,将第一人称视角视频对应播放的帧率增大,比如,将帧率从30帧/秒增大到50帧/秒,以增大的帧率进行视频播放,从而实现第一人称视角视频加速播放。In order to achieve accelerated playback of the first-person view video, in one embodiment, the control terminal increases the corresponding playback frame rate of the first-person view video according to the user's first touch operation, for example, the frame rate is changed from 30 frames/sec. Increase to 50 frames per second, and play video at an increased frame rate, so as to achieve accelerated playback of first-person view video.
或者,在另一实施方式中,控制终端根据用户的第一触控操作,对第一人称视角视频进行跳帧播放,从而实现第一人称视角视频加速播放。Or, in another embodiment, the control terminal performs frame skipping playback of the first-person view video according to the user's first touch operation, so as to achieve accelerated playback of the first-person view video.
需要说明的是,上述列举的实施方式仅是对将第一人称视角视频加速播放方式的示例,并不构成对将第一人称视角视频加速播放方式的限定。It should be noted that the above-listed embodiments are only examples of ways to accelerate the playback of first-person view videos, and do not constitute a limitation on the way of accelerated playback of first-person view videos.
在一些实施例中,所述根据所述第一触控操作对所述第一人称视角视频进行第一处理,包括:In some embodiments, the performing the first processing on the first-person view video according to the first touch operation includes:
确定所述第一触控操作对应的加速倍数;Determining an acceleration factor corresponding to the first touch operation;
根据所述加速倍数,增大所述第一人称视角视频的播放速度。According to the acceleration multiple, the playback speed of the first-person view video is increased.
为了进一步提高用户体验,控制终端根据用户的第一触控操作确定对应的加速倍数,进而根据加速倍数增大第一人称视角视频的播放速度,也即,用户执行的第一触控操作的触控参数不同,比如触控时长、触控轨迹等触控参数不同,则对应第一人称视角视频的播放速度也不相同,从而更进一步提高视频播放方式的灵活性。可选地,预先设置触控参数与加速倍数的映射关系,根据第一触控操作的触控参数,确定对应的加速倍数,进而根据确定的加速倍数增大第一人称视角视频的播放速度。In order to further improve the user experience, the control terminal determines the corresponding acceleration factor according to the user's first touch operation, and then increases the playback speed of the first-person view video according to the acceleration factor, that is, the touch of the first touch operation performed by the user Different parameters, such as different touch parameters such as touch duration and touch trajectory, will have different playback speeds corresponding to the first-person view video, thereby further improving the flexibility of the video playback mode. Optionally, the mapping relationship between the touch parameters and the acceleration multiples is preset, and the corresponding acceleration multiples are determined according to the touch parameters of the first touch operation, and then the playback speed of the first-person view video is increased according to the determined acceleration multiples.
在一些实施例中,所述当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理之后,还包括:In some embodiments, when acquiring the user's first touch operation on the acceleration icon, after performing the first processing on the first-person view video according to the first touch operation, the method further includes:
在所述第一触控操作结束时,恢复所述第一人称视角视频的播放速度。When the first touch operation ends, the playback speed of the first-person view video is restored.
可选地,控制终端对用户的第一触控操作进行监测,当第一触控操作结束时,控制终端控制恢复第一人称视角视频的播放速度。从而实现用户执行第一触控操作时,第一人称视角视频加速播放,用户不执行第一触控操作时,第一人称视角视频正常速度播放。Optionally, the control terminal monitors the user's first touch operation, and when the first touch operation ends, the control terminal controls to restore the playback speed of the first-person view video. Therefore, when the user performs the first touch operation, the first-person view video is played at an accelerated rate, and when the user does not perform the first touch operation, the first-person view video is played at a normal speed.
在一些实施例中,所述根据所述第二触控操作对所述第一人称视角视频进 行第二处理,包括:In some embodiments, the performing the second processing on the first-person view video according to the second touch operation includes:
根据所述第二触控操作,确定模糊处理对应的模糊参数,所述模糊参数包括模糊区域;Determining a blur parameter corresponding to blur processing according to the second touch operation, where the blur parameter includes a blur area;
根据所述模糊参数,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。According to the blur parameter, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
控制终端在根据第二触控操作对第一人称视角视频进行第二处理中,可选地,先根据第二触控操作,确定第二处理也即模糊处理对应的模糊参数,其中,模糊参数包括但不限于模糊区域、粒度等参数。控制终端根据确定的模糊参数,对第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。例如,根据确定的模糊区域,对第一人称视角视频的至少一帧图像中该模糊区域所对应的画面进行模糊处理;又如,根据确定的粒度,对第一人称视角视频的至少一帧图像中至少局部画面进行该粒度所对应的模糊程度的模糊处理。When the control terminal performs the second processing on the first-person view video according to the second touch operation, optionally, it first determines the blur parameters corresponding to the second processing, that is, the blur processing, according to the second touch operation, where the blur parameters include But it is not limited to parameters such as fuzzy area and granularity. The control terminal performs blur processing on at least a part of the image in at least one frame of the first-person view video according to the determined blur parameter. For example, according to the determined blurred area, blur the picture corresponding to the blurred area in at least one frame of the first-person view video; for another example, according to the determined granularity, perform the blur processing on at least one frame of the first-person view video. The partial picture is subjected to blurring processing with the degree of blurring corresponding to the granularity.
在一些实施例中,控制终端除了可以根据第二触控操作对第一人称视角视频进行第二处理,也可以根据第一人称视角视频的画面信息,自动对第一人称视角视频进行第二处理。例如,控制终端根据第一人称视角视频的图像帧构图信息,确定第一人称视角视频的视角方向,进而根据第一人称视角视频的视角方向,确定对应的模糊区域,控制终端根据确定的模糊区域,对第一人称视角视频的至少一帧图像中该模糊区域所对应的画面进行模糊处理。例如,如图3所示,基于图3显示的第一人称视角视频的图像帧,控制终端根据该图像帧的构图信息,确定对应的模糊区域为图像帧的左下角区域,则控制终端将该图像帧的左下角区域确定为模糊区域,对第一人称视角视频的该图像帧中左下角区域所对应的画面进行模糊处理,模糊处理效果如图3所示。In some embodiments, in addition to performing the second processing on the first-person view video according to the second touch operation, the control terminal can also automatically perform the second processing on the first-person view video according to the screen information of the first-person view video. For example, the control terminal determines the viewing angle direction of the first-person view video based on the image frame composition information of the first-person view video, and then determines the corresponding blurred area according to the viewing angle direction of the first-person view video, and controls the terminal to determine the first-person view based on the determined blurred area. The picture corresponding to the blurred area in at least one frame of the one-person view video is blurred. For example, as shown in FIG. 3, based on the image frame of the first-person view video shown in FIG. 3, the control terminal determines that the corresponding blurred area is the lower left corner area of the image frame according to the composition information of the image frame, and then the control terminal uses the image The lower left corner area of the frame is determined as the blurred area, and the picture corresponding to the lower left corner area in the image frame of the first-person view video is blurred, and the blur processing effect is shown in FIG. 3.
又如,控制终端根据第一人称视角视频的图像帧构图信息,确定出第一人称视角视频的图像帧对应的前景区域,将前景区域作为图像帧的模糊区域,控制终端对第一人称视角视频的图像帧中该前景区域所对应的画面进行模糊处理。For another example, the control terminal determines the foreground area corresponding to the image frame of the first-person view video according to the image frame composition information of the first-person view video, uses the foreground area as the blurred area of the image frame, and controls the terminal to control the image frame of the first-person view video. Blur processing is performed on the picture corresponding to the foreground area.
在一些实施例中,所述视频处理方法还包括:In some embodiments, the video processing method further includes:
在检测到所述第一人称视角视频的播放速度达到预设速度阈值时,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。When it is detected that the playback speed of the first-person view video reaches a preset speed threshold, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
控制终端除了可以根据第二触控操作对第一人称视角视频进行第二处理,也可以在播放速度达到相应条件时自动对第一人称视角视频进行第二处理。可选地,配置视频播放速度对应的预设速度阈值,控制终端在检测到第一人称视角视频的播放速度达到预设速度阈值时,对第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理,也即在第一人称视角视频的播放速度变得较快时,将画面进行模糊处理,从而达到用户身临其境以第一视角观看体验的效果。In addition to performing the second processing on the first-person view video according to the second touch operation, the control terminal can also automatically perform the second processing on the first-person view video when the playback speed reaches the corresponding condition. Optionally, configure a preset speed threshold corresponding to the video playback speed, and when the control terminal detects that the playback speed of the first-person view video reaches the preset speed threshold, blur at least part of the image in at least one frame of the first-person view video Processing, that is, when the playback speed of the first-person perspective video becomes faster, the screen is blurred, so as to achieve the effect of the user's immersive viewing experience from the first perspective.
在一些实施例中,所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理,包括:In some embodiments, the acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation includes:
获取用户对所述控制终端的移动操作,以使所述控制终端发生其中一个方向的移动;Acquiring a user's movement operation on the control terminal, so that the control terminal moves in one of the directions;
根据所述控制终端移动的方向,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the direction in which the control terminal moves.
用户可以对控制终端进行移动操作,以使得控制终端发生其中一个方向的移动,例如往前方向的移动、往后方向的移动、往左方向的移动、往右方向的移动等等。控制终端获取用户的移动操作,根据控制终端移动的方向,对第一人称视角视频进行预设处理。例如,若控制终端移动的方向为往前方向,则对第一人称视角视频进行加速播放;若控制终端移动的方向为往后方向,则恢复第一人称视角视频的播放速度;若控制终端移动的方向为往左方向,则将第一人称视角视频的视角方向往左偏;若控制终端移动的方向为往右方向,则将第一人称视角视频的视角方向往右偏。可选地,由于第一人称视角视频的图像帧大小有限,控制终端改变第一人称视角视频的视角方向的处理过程,是通过截取第一人称视角视频的图像帧的局部图像,将截取的局部图像进行放大处理后进行显示播放,从而实现第一人称视角视频的视角方向改变的效果。例如,若控制终端移动的方向为往左方向,则截取第一人称视角视频的图像帧的左边局部图像,将截取的左边局部图像进行放大处理后进行显示播放。若控制终端移动的方向为往右方向,则截取第一人称视角视频的图像帧的右边局部图像,将截取的右边局部图像进行放大处理后进行显示播放。The user can move the control terminal to make the control terminal move in one of the directions, such as forward movement, backward movement, leftward movement, rightward movement, and so on. The control terminal obtains the user's movement operation, and performs preset processing on the first-person view video according to the direction in which the control terminal moves. For example, if the direction of movement of the control terminal is the forward direction, the first-person view video is played at an accelerated rate; if the direction of the control terminal movement is the backward direction, the playback speed of the first-person view video is restored; if the direction of the control terminal movement is controlled For the left direction, the viewing angle of the first-person view video is shifted to the left; if the direction of the control terminal movement is the right direction, the viewing angle of the first-person view video is shifted to the right. Optionally, since the image frame size of the first-person view video is limited, the process of controlling the terminal to change the view direction of the first-person view video is to capture a partial image of the image frame of the first-person view video, and enlarge the captured partial image After processing, display and play are performed, so as to achieve the effect of changing the viewing angle of the first-person view video. For example, if the moving direction of the control terminal is the left direction, the left partial image of the image frame of the first-person view video is intercepted, and the intercepted left partial image is enlarged and then displayed and played. If the moving direction of the control terminal is the right direction, the right partial image of the image frame of the first-person view video is intercepted, and the intercepted right partial image is enlarged and then displayed and played.
在一些实施例中,所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理,包括:In some embodiments, the acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation includes:
获取用户对所述控制终端的旋转操作,以使所述控制终端进行旋转;Acquiring a user's rotation operation on the control terminal, so as to make the control terminal rotate;
根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the rotation movement of the control terminal.
用户也可以对控制终端进行旋转操作,以使得控制终端进行旋转,例如绕平行控制终端的显示界面的轴旋转、绕穿过控制终端的显示界面的轴旋转等等。控制终端获取用户的旋转操作,可选地,控制终端采用内置的陀螺仪传感器检测其旋转运动,根据控制终端的旋转运动,对第一人称视角视频进行预设处理。The user can also perform a rotation operation on the control terminal to make the control terminal rotate, for example, rotation around an axis parallel to the display interface of the control terminal, rotation around an axis passing through the display interface of the control terminal, and so on. The control terminal acquires the user's rotation operation. Optionally, the control terminal uses a built-in gyroscope sensor to detect the rotation movement, and performs preset processing on the first-person view video according to the rotation movement of the control terminal.
可选地,根据绕平行控制终端的显示界面的轴旋转,调整第一人称视角视频的上下视角方向。例如,若控制终端绕平行显示界面的轴顺时针旋转,调整第一人称视角视频的视角方向往上偏;若控制终端绕平行显示界面的轴逆时针旋转,调整第一人称视角视频的视角方向往下偏。具体地,若控制终端绕平行显示界面的轴顺时针旋转,则控制终端截取第一人称视角视频的图像帧的上边局部图像,将截取的上边局部图像进行放大处理后进行显示播放,从而实现调整第一人称视角视频的视角方向往上偏;若控制终端绕平行显示界面的轴逆时针旋转,则控制终端截取第一人称视角视频的图像帧的下边局部图像,将截取的下边局部图像进行放大处理后进行显示播放,从而实现调整第一人称视角视频的视角方向往下偏。Optionally, adjust the upper and lower viewing angle directions of the first-person view video according to the axis rotation around the display interface of the parallel control terminal. For example, if the control terminal rotates clockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video upwards; if the control terminal rotates counterclockwise around the axis of the parallel display interface, adjust the angle of view of the first-person view video downwards Partial. Specifically, if the control terminal rotates clockwise around the axis of the parallel display interface, the control terminal intercepts the upper partial image of the image frame of the first-person view video, and performs the magnification processing on the intercepted upper partial image for display and playback, thereby realizing the adjustment of the first-person view. The viewing angle of the one-person view video is biased upward; if the control terminal rotates counterclockwise around the axis parallel to the display interface, the control terminal will intercept the lower partial image of the image frame of the first-person view video, and enlarge the intercepted lower partial image before proceeding. Display playback, so as to adjust the viewing angle of the first-person view video to shift downward.
在一些实施例中,控制终端获取用户的旋转操作,根据控制终端的旋转运动,对第一人称视角视频的至少一帧图像进行旋转处理。可选地,所述根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:In some embodiments, the control terminal obtains the user's rotation operation, and performs rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal. Optionally, the performing rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal includes:
在所述旋转运动为所述控制终端绕穿过所述显示界面的轴进行旋转时,对所述第一人称视角视频的至少一帧图像进行旋转处理。When the rotation movement is the rotation of the control terminal around an axis passing through the display interface, rotation processing is performed on at least one frame of the first-person view video.
例如,在控制终端的旋转运动为控制终端绕穿过显示界面的轴进行逆时针旋转时,相应地对第一人称视角视频的至少一帧图像进行逆时针旋转处理。在控制终端的旋转运动为控制终端绕穿过显示界面的轴进行顺时针旋转时,相应地对第一人称视角视频的至少一帧图像进行顺时针旋转处理。For example, when the rotation movement of the control terminal is to control the terminal to rotate counterclockwise around an axis passing through the display interface, at least one frame of the first-person view video is correspondingly rotated counterclockwise. When the rotation movement of the control terminal is to control the terminal to rotate clockwise around an axis passing through the display interface, correspondingly, at least one frame of image of the first-person view video is rotated clockwise.
在一些实施例中,所述对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:In some embodiments, the performing rotation processing on at least one frame of the first-person view video includes:
确定所述旋转处理对应的旋转参数;Determine the rotation parameter corresponding to the rotation process;
根据确定的所述旋转参数,对所述第一人称视角视频的至少一帧图像进行 旋转处理。Perform rotation processing on at least one frame of image of the first-person view video according to the determined rotation parameter.
为了进一步提高用户体验,控制终端根据旋转运动确定对应的旋转参数,其中,旋转参数包括旋转方向、旋转角度、旋转速度中的至少一种。进而根据确定的旋转参数对第一人称视角视频的至少一帧图像进行旋转处理,也即,控制终端旋转运动的旋转参数不同,对第一人称视角视频的至少一帧图像进行旋转处理也相应不同,从而使得视频播放方式更加丰富灵活。In order to further improve the user experience, the control terminal determines the corresponding rotation parameter according to the rotation movement, where the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed. Furthermore, at least one frame of image of the first-person view video is rotated according to the determined rotation parameter. That is, if the rotation parameter that controls the rotation of the terminal is different, the rotation process of at least one frame of the first-person view video is also different accordingly. Makes the video playback method more abundant and flexible.
可选地,所述确定所述旋转处理对应的旋转参数,包括:Optionally, the determining the rotation parameter corresponding to the rotation processing includes:
根据所述控制终端的旋转运动对应的旋转运动参数,确定所述旋转处理对应的所述旋转参数。Determine the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal.
预先设置控制终端的旋转运动对应的旋转运动参数与旋转处理对应的旋转参数的映射关系,其中,旋转运动对应的旋转运动参数包括但不限于运动方向、运动角度、运动速度等,旋转处理对应的旋转参数如上所述包括旋转方向、旋转角度、旋转速度中的至少一种。根据控制终端的旋转运动,获取控制终端的旋转运动对应的旋转运动参数,并根据旋转运动对应的旋转运动参数与旋转处理对应的旋转参数的映射关系,确定控制终端的旋转运动的旋转运动参数对应的旋转参数,进而根据确定的旋转参数对第一人称视角视频的至少一帧图像进行旋转处理。The mapping relationship between the rotary motion parameters corresponding to the rotary motion of the control terminal and the rotary parameters corresponding to the rotation processing is preset. The rotary motion parameters corresponding to the rotary motion include but are not limited to motion direction, motion angle, motion speed, etc., and the rotation processing corresponds to The rotation parameter includes at least one of the rotation direction, the rotation angle, and the rotation speed as described above. According to the rotation movement of the control terminal, obtain the rotation movement parameter corresponding to the rotation movement of the control terminal, and determine the rotation movement parameter corresponding to the rotation movement of the control terminal according to the mapping relationship between the rotation movement parameter corresponding to the rotation movement and the rotation parameter corresponding to the rotation processing According to the determined rotation parameter, at least one frame of image of the first-person view video is rotated according to the determined rotation parameter.
在一些实施例中,所述对所述第一人称视角视频的至少一帧图像进行旋转处理之前,还包括:In some embodiments, before performing the rotation processing on at least one frame of the first-person view video, the method further includes:
将所述第一人称视角视频的至少一帧图像进行图像放大处理;Performing image enlargement processing on at least one frame of the first-person view video;
所述对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:The performing rotation processing on at least one frame of the first-person view video includes:
将经过所述图像放大处理后的所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the image of the first-person view video after the image enlargement processing.
为了避免第一人称视角视频的画面在旋转时出现黑边情况,控制终端首先将第一人称视角视频的至少一帧图像进行图像放大处理,之后再将经过图像放大处理后的第一人称视角视频的至少一帧图像进行旋转处理,从而实现在第一人称视角视频的图像旋转过程中不会出现黑边情况,进一步提高了用户的观看体验。In order to avoid the black borders of the first-person view video when rotating, the control terminal first performs image enlargement processing on at least one frame of the first-person view video, and then at least one of the first-person view video after the image enlargement processing. The frame image is rotated, so that there will be no black borders during the image rotation of the first-person view video, which further improves the user's viewing experience.
S103、保存经过所述预设处理后的所述第一人称视角视频。S103. Save the first-person view video after the preset processing.
控制终端在对第一人称视角视频进行上述的预设处理后,保存经过预设处理后的第一人称视角视频。需要说明的是,可以将经过预设处理后的第一人称视角视频保存于控制终端侧,也可以将经过预设处理后的第一人称视角视频保存于相应的服务器侧,经过预设处理后的第一人称视角视频的保存方式在此不做限制。后续用户可以直接通过调取保存的经过预设处理后的第一人称视角视频,从而获得身临其境以第一视角观看的体验。After performing the foregoing preset processing on the first-person view video, the control terminal saves the first-person view video after the preset processing. It should be noted that the preset first-person view video can be saved on the control terminal side, or the preset first-person view video can be saved on the corresponding server side, and the preset first-person view video can also be saved on the corresponding server side. There is no restriction on the way of saving one-person view video. Subsequent users can directly retrieve the saved first-person view video after the preset processing, so as to obtain an immersive viewing experience from the first view.
上述实施例通过在控制终端的显示界面显示第一人称视角视频,并根据用户对控制终端的操作,对第一人称视角视频进行预设处理,预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种,其中,第一处理用于使得第一人称视角视频加速播放,第二处理用于使得第一人称视角视频的至少一帧图像中至少局部画面模糊,第三处理用于使得第一人称视角视频的视角方向发生变化,第四处理用于使得第一人称视角视频的至少一帧图像发生旋转,并保存经过预设处理后的第一人称视角视频,相比于现有的常规播放模式,第一人称视角视频播放中根据用户的操作呈现出加速、画面模糊、画面旋转、视角改变等各种效果,实现了视频播放的丰富多变化,提升临场感。The above embodiment displays the first-person view video on the display interface of the control terminal, and performs preset processing on the first-person view video according to the user's operation on the control terminal. The preset processing includes the first processing, the second processing, and the third processing. And at least one of the fourth processing, wherein the first processing is used to accelerate the playback of the first-person view video, the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred, and the third processing is used In order to change the viewing angle of the first-person view video, the fourth processing is used to rotate at least one frame of the first-person view video and save the first-person view video after the preset processing. Compared with the existing conventional In the playback mode, the first-person view video playback presents various effects such as acceleration, picture blurring, picture rotation, viewing angle change, etc. according to the user's operation, which realizes the rich and varied video playback and enhances the sense of presence.
请参阅图5,图5是本申请实施例提供的一种视频处理装置的示意性框图。如图5所示,该视频处理装置110包括处理器111和存储器112,处理器111和存储器112通过总线连接,该总线比如为I2C(Inter-integrated Circuit)总线。Please refer to FIG. 5, which is a schematic block diagram of a video processing apparatus provided by an embodiment of the present application. As shown in FIG. 5, the video processing device 110 includes a processor 111 and a memory 112, and the processor 111 and the memory 112 are connected by a bus, such as an I2C (Inter-integrated Circuit) bus.
具体地,处理器111可以是微控制单元(Micro-controller Unit,MCU)、中央处理单元(Central Processing Unit,CPU)或数字信号处理器(Digital Signal Processor,DSP)等。Specifically, the processor 111 may be a micro-controller unit (MCU), a central processing unit (CPU), a digital signal processor (Digital Signal Processor, DSP), or the like.
具体地,存储器112可以是Flash芯片、只读存储器(ROM,Read-Only Memory)磁盘、光盘、U盘或移动硬盘等。Specifically, the memory 112 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
其中,所述处理器用于运行存储在存储器中的计算机程序,并在执行所述计算机程序时实现如下步骤:Wherein, the processor is used to run a computer program stored in a memory, and implement the following steps when executing the computer program:
在所述控制终端的显示界面显示第一人称视角视频;Displaying a first-person view video on the display interface of the control terminal;
获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放; 所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转;Acquire the user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. The first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; the first The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
保存经过所述预设处理后的所述第一人称视角视频。Save the first-person view video after the preset processing.
在一些实施例中,所述处理器在实现所述获取用户对所述控制终端的操作时,具体实现:In some embodiments, when the processor implements the acquisition of the user's operation on the control terminal, it specifically implements:
获取用户对所述显示界面的触控操作;Acquiring a user's touch operation on the display interface;
和/或,获取用户对所述控制终端的操作,以使所述控制终端发生运动。And/or, obtaining a user's operation on the control terminal to make the control terminal move.
在一些实施例中,所述处理器在执行所述计算机程序时还实现:In some embodiments, the processor further implements when executing the computer program:
在所述控制终端的显示界面显示控制图标;所述控制图标用于表示对所述第一人称视角视频进行预设处理的程序标识;Display a control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
所述处理器在实现所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理时,具体实现:When the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理。Obtain the user's operation on the control icon, and perform the preset processing on the first-person view video according to the operation on the control icon.
在一些实施例中,所述第一人称视角视频为可移动平台上搭载的拍摄装置拍摄的视频。In some embodiments, the first-person view video is a video shot by a camera mounted on a movable platform.
在一些实施例中,所述可移动平台为无人机或无人车。In some embodiments, the movable platform is a drone or an unmanned vehicle.
在一些实施例中,所述控制图标包括加速图标、模糊滤镜图标、视角设置图标、旋转图标中的至少一个,所述处理器在实现所述获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理时,具体实现:In some embodiments, the control icon includes at least one of an acceleration icon, a blur filter icon, a viewing angle setting icon, and a rotation icon. When the operation of the control icon is performed on the first-person view video when the preset processing is performed, the specific implementation is as follows:
当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理;和/或When acquiring the user's first touch operation on the acceleration icon, perform first processing on the first-person view video according to the first touch operation; and/or
当获取用户对所述模糊滤镜图标的第二触控操作时,根据所述第二触控操作对所述第一人称视角视频进行第二处理;和/或When acquiring the user's second touch operation on the blur filter icon, perform a second process on the first-person view video according to the second touch operation; and/or
当获取用户对所述视角设置图标的第三触控操作时,根据所述第三触控操作对所述第一人称视角视频进行第三处理;和/或When acquiring the user's third touch operation on the viewing angle setting icon, perform third processing on the first-person view video according to the third touch operation; and/or
当获取用户对所述旋转图标的第四触控操作时,根据所述第四触控操作对 所述第一人称视角视频进行第四处理。When the fourth touch operation of the user on the rotation icon is acquired, the fourth processing is performed on the first-person view video according to the fourth touch operation.
在一些实施例中,所述处理器在实现所述根据所述第一触控操作对所述第一人称视角视频进行第一处理时,具体实现:In some embodiments, when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
根据所述第一触控操作,将所述第一人称视角视频对应播放的帧率增大,以增大的帧率进行视频播放;或者According to the first touch operation, increase the frame rate corresponding to the first-person view video to play the video at the increased frame rate; or
根据所述第一触控操作,对所述第一人称视角视频进行跳帧播放。According to the first touch operation, the first-person view video is played by skipping frames.
在一些实施例中,所述处理器在实现所述根据所述第一触控操作对所述第一人称视角视频进行第一处理时,具体实现:In some embodiments, when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
确定所述第一触控操作对应的加速倍数;Determining an acceleration factor corresponding to the first touch operation;
根据所述加速倍数,增大所述第一人称视角视频的播放速度。According to the acceleration multiple, the playback speed of the first-person view video is increased.
在一些实施例中,所述处理器在实现所述当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理之后,还实现:In some embodiments, after the processor performs the first processing on the first-person view video according to the first touch operation when acquiring the user's first touch operation on the acceleration icon , And also achieve:
在所述第一触控操作结束时,恢复所述第一人称视角视频的播放速度。When the first touch operation ends, the playback speed of the first-person view video is restored.
在一些实施例中,所述处理器在实现所述根据所述第二触控操作对所述第一人称视角视频进行第二处理时,具体实现:In some embodiments, when the processor implements the second processing of the first-person view video according to the second touch operation, it specifically implements:
根据所述第二触控操作,确定模糊处理对应的模糊参数,所述模糊参数包括模糊区域;Determining a blur parameter corresponding to blur processing according to the second touch operation, where the blur parameter includes a blur area;
根据所述模糊参数,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。According to the blur parameter, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
在一些实施例中,所述处理器在执行所述计算机程序时还实现:In some embodiments, the processor further implements when executing the computer program:
在检测到所述第一人称视角视频的播放速度达到预设速度阈值时,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。When it is detected that the playback speed of the first-person view video reaches a preset speed threshold, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
在一些实施例中,所述处理器在实现所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理时,具体实现:In some embodiments, when the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
获取用户对所述控制终端的移动操作,以使所述控制终端发生其中一个方向的移动;Acquiring a user's movement operation on the control terminal, so that the control terminal moves in one of the directions;
根据所述控制终端移动的方向,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the direction in which the control terminal moves.
在一些实施例中,所述处理器在实现所述获取用户对所述控制终端的操作, 根据所述操作对所述第一人称视角视频进行预设处理时,具体实现:In some embodiments, when the processor implements the acquisition of the user's operation on the control terminal, and performs preset processing on the first-person view video according to the operation, it specifically implements:
获取用户对所述控制终端的旋转操作,以使所述控制终端进行旋转;Acquiring a user's rotation operation on the control terminal, so as to make the control terminal rotate;
根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the rotation movement of the control terminal.
在一些实施例中,所述处理器在实现所述根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理时,具体实现:In some embodiments, when the processor implements the preset processing of the first-person view video according to the rotational movement of the control terminal, it specifically implements:
根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of image of the first-person view video according to the rotation movement of the control terminal.
在一些实施例中,所述处理器在实现所述根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:In some embodiments, when the processor implements the rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal, it specifically implements:
在所述旋转运动为所述控制终端绕穿过所述显示界面的轴进行旋转时,对所述第一人称视角视频的至少一帧图像进行旋转处理。When the rotation movement is the rotation of the control terminal around an axis passing through the display interface, rotation processing is performed on at least one frame of the first-person view video.
在一些实施例中,所述控制终端内置有陀螺仪传感器,采用所述陀螺仪传感器检测所述控制终端的旋转运动。In some embodiments, the control terminal has a built-in gyroscope sensor, and the gyroscope sensor is used to detect the rotational movement of the control terminal.
在一些实施例中,所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:In some embodiments, when the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
确定所述旋转处理对应的旋转参数;Determine the rotation parameter corresponding to the rotation process;
根据确定的所述旋转参数,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the first-person view video according to the determined rotation parameter.
在一些实施例中,所述处理器在实现所述确定所述旋转处理对应的旋转参数时,具体实现:In some embodiments, when the processor implements the determination of the rotation parameter corresponding to the rotation processing, it specifically implements:
根据所述控制终端的旋转运动对应的旋转运动参数,确定所述旋转处理对应的所述旋转参数。Determine the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal.
在一些实施例中,所述旋转参数包括旋转方向、旋转角度、旋转速度中的至少一种。In some embodiments, the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed.
在一些实施例中,所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理之前,还实现:In some embodiments, before implementing the rotation processing on at least one frame of the first-person view video, the processor further implements:
将所述第一人称视角视频的至少一帧图像进行图像放大处理;Performing image enlargement processing on at least one frame of the first-person view video;
所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:When the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
将经过所述图像放大处理后的所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the image of the first-person view video after the image enlargement processing.
在一些实施例中,所述处理器在实现所述在所述控制终端的显示界面显示第一人称视角视频时,具体实现:In some embodiments, when the processor implements the first-person view video to be displayed on the display interface of the control terminal, it specifically implements:
在启动预设播放模式后,在所述控制终端的所述显示界面显示所述第一人称视角视频。After starting the preset play mode, the first-person view video is displayed on the display interface of the control terminal.
请参阅图6,图6是本申请实施例提供的一种控制终端的示意性框图。该控制终端100包括上述实施例中的视频处理装置110、外壳(图中未示出)、以及设于外壳的显示面板120。控制终端100通过显示面板120在显示界面上显示第一人称视角视频,通过视频处理装置110根据用户对终端的操作,对第一人称视角视频进行预设处理,并保存经过预设处理后的第一人称视角视频,具体操作可参考本申请实施例提供的视频处理方法的步骤,在此不再赘述。Please refer to FIG. 6, which is a schematic block diagram of a control terminal according to an embodiment of the present application. The control terminal 100 includes the video processing device 110 in the above embodiment, a casing (not shown in the figure), and a display panel 120 provided in the casing. The control terminal 100 displays the first-person view video on the display interface through the display panel 120, and the video processing device 110 performs preset processing on the first-person view video according to the user's operation on the terminal, and saves the preset first-person view For the video, the specific operation can refer to the steps of the video processing method provided in the embodiment of the present application, which will not be repeated here.
本申请的实施例中还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序中包括程序指令,处理器执行所述程序指令,实现本申请实施例提供的视频处理方法的步骤。An embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes program instructions, and a processor executes the program instructions to implement the embodiments of the present application. Provides the steps of the video processing method.
其中,所述计算机可读存储介质可以是前述实施例所述的视频处理装置或控制终端的内部存储单元,例如所述视频处理装置或控制终端的硬盘或内存。所述计算机可读存储介质也可以是所述视频处理装置或控制终端的外部存储设备,例如所述视频处理装置或控制终端上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。The computer-readable storage medium may be the internal storage unit of the video processing device or the control terminal described in the foregoing embodiment, for example, the hard disk or memory of the video processing device or the control terminal. The computer-readable storage medium may also be an external storage device of the video processing device or the control terminal, for example, a plug-in hard disk or a smart memory card (Smart Media Card, SMC) equipped on the video processing device or the control terminal. , Secure Digital (SD) card, Flash Card (Flash Card), etc.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Anyone familiar with the technical field can easily think of various equivalents within the technical scope disclosed in this application. Modifications or replacements, these modifications or replacements shall be covered within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (45)

  1. 一种视频处理方法,其特征在于,应用于一控制终端,包括:A video processing method, characterized in that it is applied to a control terminal, and includes:
    在所述控制终端的显示界面显示第一人称视角视频;Displaying a first-person view video on the display interface of the control terminal;
    获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放;所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转;Acquire the user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. The first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; the first The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
    保存经过所述预设处理后的所述第一人称视角视频。Save the first-person view video after the preset processing.
  2. 根据权利要求1所述的方法,其特征在于,所述获取用户对所述控制终端的操作,包括:The method according to claim 1, wherein said obtaining the operation of the user on the control terminal comprises:
    获取用户对所述显示界面的触控操作;Acquiring a user's touch operation on the display interface;
    和/或,获取用户对所述控制终端的操作,以使所述控制终端发生运动。And/or, obtaining a user's operation on the control terminal to make the control terminal move.
  3. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    在所述控制终端的显示界面显示控制图标;所述控制图标用于表示对所述第一人称视角视频进行预设处理的程序标识;Display a control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
    所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理包括:The acquiring the user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation includes:
    获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理。Obtain the user's operation on the control icon, and perform the preset processing on the first-person view video according to the operation on the control icon.
  4. 根据权利要求1至3任一项所述的方法,其特征在于,所述第一人称视角视频为可移动平台上搭载的拍摄装置拍摄的视频。The method according to any one of claims 1 to 3, wherein the first-person perspective video is a video shot by a camera mounted on a movable platform.
  5. 根据权利要求4所述的方法,其特征在于,所述可移动平台为无人机或无人车。The method according to claim 4, wherein the movable platform is an unmanned aerial vehicle or an unmanned vehicle.
  6. 根据权利要求3所述的方法,其特征在于,所述控制图标包括加速图标、模糊滤镜图标、视角设置图标、旋转图标中的至少一个,所述获取用户对所述 控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理,包括:The method according to claim 3, wherein the control icon includes at least one of an acceleration icon, a blur filter icon, a viewing angle setting icon, and a rotation icon, and the obtaining the user's operation on the control icon is based on The operation of the control icon to perform the preset processing on the first-person view video includes:
    当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理;和/或When acquiring the user's first touch operation on the acceleration icon, perform first processing on the first-person view video according to the first touch operation; and/or
    当获取用户对所述模糊滤镜图标的第二触控操作时,根据所述第二触控操作对所述第一人称视角视频进行第二处理;和/或When acquiring the user's second touch operation on the blur filter icon, perform a second process on the first-person view video according to the second touch operation; and/or
    当获取用户对所述视角设置图标的第三触控操作时,根据所述第三触控操作对所述第一人称视角视频进行第三处理;和/或When acquiring the user's third touch operation on the viewing angle setting icon, perform third processing on the first-person view video according to the third touch operation; and/or
    当获取用户对所述旋转图标的第四触控操作时,根据所述第四触控操作对所述第一人称视角视频进行第四处理。When the fourth touch operation of the user on the rotation icon is acquired, a fourth process is performed on the first-person view video according to the fourth touch operation.
  7. 根据权利要求6所述的方法,其特征在于,所述根据所述第一触控操作对所述第一人称视角视频进行第一处理,包括:The method according to claim 6, wherein the performing first processing on the first-person view video according to the first touch operation comprises:
    根据所述第一触控操作,将所述第一人称视角视频对应播放的帧率增大,以增大的帧率进行视频播放;或者According to the first touch operation, increase the frame rate corresponding to the first-person view video to play the video at the increased frame rate; or
    根据所述第一触控操作,对所述第一人称视角视频进行跳帧播放。According to the first touch operation, the first-person view video is played by skipping frames.
  8. 根据权利要求6所述的方法,其特征在于,所述根据所述第一触控操作对所述第一人称视角视频进行第一处理,包括:The method according to claim 6, wherein the performing first processing on the first-person view video according to the first touch operation comprises:
    确定所述第一触控操作对应的加速倍数;Determining an acceleration factor corresponding to the first touch operation;
    根据所述加速倍数,增大所述第一人称视角视频的播放速度。According to the acceleration multiple, the playback speed of the first-person view video is increased.
  9. 根据权利要求6至8任一项所述的方法,其特征在于,所述当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理之后,还包括:The method according to any one of claims 6 to 8, wherein when acquiring the user's first touch operation on the acceleration icon, the first person viewing angle is viewed according to the first touch operation. After the first processing of the video, it also includes:
    在所述第一触控操作结束时,恢复所述第一人称视角视频的播放速度。When the first touch operation ends, the playback speed of the first-person view video is restored.
  10. 根据权利要求6所述的方法,其特征在于,所述根据所述第二触控操作对所述第一人称视角视频进行第二处理,包括:The method according to claim 6, wherein said performing second processing on said first-person view video according to said second touch operation comprises:
    根据所述第二触控操作,确定模糊处理对应的模糊参数,所述模糊参数包括模糊区域;Determining a blur parameter corresponding to blur processing according to the second touch operation, where the blur parameter includes a blur area;
    根据所述模糊参数,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。According to the blur parameter, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  11. 根据权利要求10所述的方法,其特征在于,还包括:The method according to claim 10, further comprising:
    在检测到所述第一人称视角视频的播放速度达到预设速度阈值时,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。When it is detected that the playback speed of the first-person view video reaches a preset speed threshold, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  12. 根据权利要求1所述的方法,其特征在于,所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理,包括:The method according to claim 1, wherein the acquiring the user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation, comprises:
    获取用户对所述控制终端的移动操作,以使所述控制终端发生其中一个方向的移动;Acquiring a user's movement operation on the control terminal, so that the control terminal moves in one of the directions;
    根据所述控制终端移动的方向,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the direction in which the control terminal moves.
  13. 根据权利要求1所述的方法,其特征在于,所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理,包括:The method according to claim 1, wherein said acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation comprises:
    获取用户对所述控制终端的旋转操作,以使所述控制终端进行旋转;Acquiring a user's rotation operation on the control terminal, so as to make the control terminal rotate;
    根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the rotation movement of the control terminal.
  14. 根据权利要求13所述的方法,其特征在于,所述根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理,包括:The method according to claim 13, wherein the performing preset processing on the first-person view video according to the rotational movement of the control terminal comprises:
    根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of image of the first-person view video according to the rotation movement of the control terminal.
  15. 根据权利要求14所述的方法,其特征在于,所述根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:The method according to claim 14, wherein the rotating at least one frame of the first-person view video according to the rotating movement of the control terminal comprises:
    在所述旋转运动为所述控制终端绕穿过所述显示界面的轴进行旋转时,对所述第一人称视角视频的至少一帧图像进行旋转处理。When the rotation movement is the rotation of the control terminal around an axis passing through the display interface, rotation processing is performed on at least one frame of the first-person view video.
  16. 根据权利要求13至15任一项所述的方法,其特征在于,所述控制终端内置有陀螺仪传感器,采用所述陀螺仪传感器检测所述控制终端的旋转运动。The method according to any one of claims 13 to 15, wherein the control terminal has a built-in gyroscope sensor, and the gyroscope sensor is used to detect the rotation movement of the control terminal.
  17. 根据权利要求14所述的方法,其特征在于,所述对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:The method according to claim 14, wherein the performing rotation processing on at least one frame of the first-person view video comprises:
    确定所述旋转处理对应的旋转参数;Determine the rotation parameter corresponding to the rotation process;
    根据确定的所述旋转参数,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the first-person view video according to the determined rotation parameter.
  18. 根据权利要求17所述的方法,其特征在于,所述确定所述旋转处理对应的旋转参数,包括:The method according to claim 17, wherein the determining the rotation parameter corresponding to the rotation processing comprises:
    根据所述控制终端的旋转运动对应的旋转运动参数,确定所述旋转处理对应的所述旋转参数。Determine the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal.
  19. 根据权利要求17所述的方法,其特征在于,所述旋转参数包括旋转方向、旋转角度、旋转速度中的至少一种。The method according to claim 17, wherein the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed.
  20. 根据权利要求17至19中任一项所述的方法,其特征在于,所述对所述第一人称视角视频的至少一帧图像进行旋转处理之前,还包括:The method according to any one of claims 17 to 19, wherein before performing rotation processing on at least one frame of the first-person view video, the method further comprises:
    将所述第一人称视角视频的至少一帧图像进行图像放大处理;Performing image enlargement processing on at least one frame of the first-person view video;
    所述对所述第一人称视角视频的至少一帧图像进行旋转处理,包括:The performing rotation processing on at least one frame of the first-person view video includes:
    将经过所述图像放大处理后的所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the image of the first-person view video after the image enlargement processing.
  21. 根据权利要求1所述的方法,其特征在于,所述在所述控制终端的显示界面显示第一人称视角视频,包括:The method according to claim 1, wherein the displaying the first-person view video on the display interface of the control terminal comprises:
    在启动预设播放模式后,在所述控制终端的所述显示界面显示所述第一人称视角视频。After starting the preset play mode, the first-person view video is displayed on the display interface of the control terminal.
  22. 一种视频处理装置,其特征在于,所述视频处理装置包括存储器和处理器;A video processing device, characterized in that the video processing device includes a memory and a processor;
    所述存储器用于存储计算机程序;The memory is used to store a computer program;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现如下步骤:The processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
    在所述控制终端的显示界面显示第一人称视角视频;Displaying a first-person view video on the display interface of the control terminal;
    获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理;其中,所述预设处理包括第一处理、第二处理、第三处理和第四处理中的至少一种;所述第一处理用于使得所述第一人称视角视频加速播放;所述第二处理用于使得所述第一人称视角视频的至少一帧图像中至少局部画面模糊;所述第三处理用于使得所述第一人称视角视频的视角方向发生变化;所述第四处理用于使得所述第一人称视角视频的至少一帧图像发生旋转;Acquire the user's operation on the control terminal, and perform preset processing on the first-person view video according to the operation; wherein, the preset processing includes a first processing, a second processing, a third processing, and a fourth processing. The first processing is used to accelerate the playback of the first-person view video; the second processing is used to make at least part of the picture in at least one frame of the first-person view video blurred; the first The third processing is used to change the viewing angle direction of the first-person view video; the fourth processing is used to cause at least one frame of image of the first-person view video to be rotated;
    保存经过所述预设处理后的所述第一人称视角视频。Save the first-person view video after the preset processing.
  23. 根据权利要求22所述的装置,其特征在于,所述处理器在实现所述获取用户对所述控制终端的操作时,具体实现:The apparatus according to claim 22, wherein when the processor implements the obtaining of the operation of the user on the control terminal, it specifically implements:
    获取用户对所述显示界面的触控操作;Acquiring a user's touch operation on the display interface;
    和/或,获取用户对所述控制终端的操作,以使所述控制终端发生运动。And/or, obtaining a user's operation on the control terminal to make the control terminal move.
  24. 根据权利要求22所述的装置,其特征在于,所述处理器在执行所述计算机程序时,还实现:The device according to claim 22, wherein when the processor executes the computer program, it further implements:
    在所述控制终端的显示界面显示控制图标;所述控制图标用于表示对所述第一人称视角视频进行预设处理的程序标识;Display a control icon on the display interface of the control terminal; the control icon is used to indicate a program identifier for performing preset processing on the first-person view video;
    所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理包括:The acquiring the user's operation on the control terminal, and performing preset processing on the first-person view video according to the operation includes:
    获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理。Obtain the user's operation on the control icon, and perform the preset processing on the first-person view video according to the operation on the control icon.
  25. 根据权利要求22至24任一项所述的装置,其特征在于,所述第一人称视角视频为可移动平台上搭载的拍摄装置拍摄的视频。The device according to any one of claims 22 to 24, wherein the first-person view video is a video shot by a camera mounted on a movable platform.
  26. 根据权利要求25所述的装置,其特征在于,所述可移动平台为无人机或无人车。The device according to claim 25, wherein the movable platform is an unmanned aerial vehicle or an unmanned vehicle.
  27. 根据权利要求24所述的装置,其特征在于,所述控制图标包括加速图标、模糊滤镜图标、视角设置图标、旋转图标中的至少一个,所述处理器在实现所述获取用户对所述控制图标的操作,根据所述对所述控制图标的操作,对所述第一人称视角视频进行所述预设处理时,具体实现:The device according to claim 24, wherein the control icon comprises at least one of an acceleration icon, a blur filter icon, a viewing angle setting icon, and a rotation icon, and the processor is implementing the acquisition of the user’s The operation of the control icon, when the preset processing is performed on the first-person view video according to the operation of the control icon, is specifically implemented:
    当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理;和/或When acquiring the user's first touch operation on the acceleration icon, perform first processing on the first-person view video according to the first touch operation; and/or
    当获取用户对所述模糊滤镜图标的第二触控操作时,根据所述第二触控操作对所述第一人称视角视频进行第二处理;和/或When acquiring the user's second touch operation on the blur filter icon, perform a second process on the first-person view video according to the second touch operation; and/or
    当获取用户对所述视角设置图标的第三触控操作时,根据所述第三触控操作对所述第一人称视角视频进行第三处理;和/或When acquiring the user's third touch operation on the viewing angle setting icon, perform third processing on the first-person view video according to the third touch operation; and/or
    当获取用户对所述旋转图标的第四触控操作时,根据所述第四触控操作对所述第一人称视角视频进行第四处理。When the fourth touch operation of the user on the rotation icon is acquired, a fourth process is performed on the first-person view video according to the fourth touch operation.
  28. 根据权利要求27所述的装置,其特征在于,所述处理器在实现所述根据所述第一触控操作对所述第一人称视角视频进行第一处理时,具体实现:The device according to claim 27, wherein when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
    根据所述第一触控操作,将所述第一人称视角视频对应播放的帧率增大, 以增大的帧率进行视频播放;或者According to the first touch operation, the frame rate corresponding to the first-person view video is increased, and the video is played at the increased frame rate; or
    根据所述第一触控操作,对所述第一人称视角视频进行跳帧播放。According to the first touch operation, the first-person view video is played by skipping frames.
  29. 根据权利要求27所述的装置,其特征在于,所述处理器在实现所述根据所述第一触控操作对所述第一人称视角视频进行第一处理时,具体实现:The device according to claim 27, wherein when the processor implements the first processing of the first-person view video according to the first touch operation, it specifically implements:
    确定所述第一触控操作对应的加速倍数;Determining an acceleration factor corresponding to the first touch operation;
    根据所述加速倍数,增大所述第一人称视角视频的播放速度。According to the acceleration multiple, the playback speed of the first-person view video is increased.
  30. 根据权利要求27至29任一项所述的装置,其特征在于,所述处理器在实现所述当获取用户对所述加速图标的第一触控操作时,根据所述第一触控操作对所述第一人称视角视频进行第一处理之后,还实现:The device according to any one of claims 27 to 29, wherein the processor performs the first touch operation on the acceleration icon according to the first touch operation when acquiring the user's first touch operation After performing the first processing on the first-person view video, it also implements:
    在所述第一触控操作结束时,恢复所述第一人称视角视频的播放速度。When the first touch operation ends, the playback speed of the first-person view video is restored.
  31. 根据权利要求27所述的装置,其特征在于,所述处理器在实现所述根据所述第二触控操作对所述第一人称视角视频进行第二处理时,具体实现:The device according to claim 27, wherein when the processor implements the second processing of the first-person view video according to the second touch operation, it specifically implements:
    根据所述第二触控操作,确定模糊处理对应的模糊参数,所述模糊参数包括模糊区域;Determining a blur parameter corresponding to blur processing according to the second touch operation, where the blur parameter includes a blur area;
    根据所述模糊参数,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。According to the blur parameter, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  32. 根据权利要求31所述的装置,其特征在于,所述处理器在执行所述计算机程序时,还实现:The device according to claim 31, wherein when the processor executes the computer program, it further implements:
    在检测到所述第一人称视角视频的播放速度达到预设速度阈值时,对所述第一人称视角视频的至少一帧图像中至少局部画面进行模糊处理。When it is detected that the playback speed of the first-person view video reaches a preset speed threshold, blurring is performed on at least a partial picture in at least one frame of the first-person view video.
  33. 根据权利要求22所述的装置,其特征在于,所述处理器在实现所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理时,具体实现:22. The device according to claim 22, wherein the processor implements the specific implementation when acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation :
    获取用户对所述控制终端的移动操作,以使所述控制终端发生其中一个方向的移动;Acquiring a user's movement operation on the control terminal, so that the control terminal moves in one of the directions;
    根据所述控制终端移动的方向,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the direction in which the control terminal moves.
  34. 根据权利要求22所述的装置,其特征在于,所述处理器在实现所述获取用户对所述控制终端的操作,根据所述操作对所述第一人称视角视频进行预设处理时,具体实现:22. The device according to claim 22, wherein the processor implements the specific implementation when acquiring the user's operation on the control terminal and performing preset processing on the first-person view video according to the operation :
    获取用户对所述控制终端的旋转操作,以使所述控制终端进行旋转;Acquiring a user's rotation operation on the control terminal, so as to make the control terminal rotate;
    根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理。Perform preset processing on the first-person view video according to the rotation movement of the control terminal.
  35. 根据权利要求34所述的装置,其特征在于,所述处理器在实现所述根据所述控制终端的旋转运动,对所述第一人称视角视频进行预设处理时,具体实现:The device according to claim 34, wherein when the processor implements the preset processing of the first-person view video according to the rotation movement of the control terminal, it specifically implements:
    根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of image of the first-person view video according to the rotation movement of the control terminal.
  36. 根据权利要求35所述的装置,其特征在于,所述处理器在实现所述根据所述控制终端的旋转运动,对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:The device according to claim 35, wherein when the processor implements the rotation processing on at least one frame of the first-person view video according to the rotation movement of the control terminal, it specifically implements:
    在所述旋转运动为所述控制终端绕穿过所述显示界面的轴进行旋转时,对所述第一人称视角视频的至少一帧图像进行旋转处理。When the rotation movement is the rotation of the control terminal around an axis passing through the display interface, rotation processing is performed on at least one frame of the first-person view video.
  37. 根据权利要求34至36任一项所述的装置,其特征在于,所述控制终端内置有陀螺仪传感器,采用所述陀螺仪传感器检测所述控制终端的旋转运动。The device according to any one of claims 34 to 36, wherein the control terminal has a built-in gyroscope sensor, and the gyroscope sensor is used to detect the rotation movement of the control terminal.
  38. 根据权利要求35所述的装置,其特征在于,所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:The device according to claim 35, wherein when the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
    确定所述旋转处理对应的旋转参数;Determine the rotation parameter corresponding to the rotation process;
    根据确定的所述旋转参数,对所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the first-person view video according to the determined rotation parameter.
  39. 根据权利要求38所述的装置,其特征在于,所述处理器在实现所述确定所述旋转处理对应的旋转参数时,具体实现:The device according to claim 38, wherein when the processor implements the determination of the rotation parameter corresponding to the rotation processing, it specifically implements:
    根据所述控制终端的旋转运动对应的旋转运动参数,确定所述旋转处理对应的所述旋转参数。Determine the rotation parameter corresponding to the rotation processing according to the rotation movement parameter corresponding to the rotation movement of the control terminal.
  40. 根据权利要求38所述的装置,其特征在于,所述旋转参数包括旋转方向、旋转角度、旋转速度中的至少一种。The device according to claim 38, wherein the rotation parameter includes at least one of a rotation direction, a rotation angle, and a rotation speed.
  41. 根据权利要求38至40中任一项所述的装置,其特征在于,所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理之前,还实现:The device according to any one of claims 38 to 40, wherein, before implementing the rotation processing on at least one frame of the first-person view video, the processor further implements:
    将所述第一人称视角视频的至少一帧图像进行图像放大处理;Performing image enlargement processing on at least one frame of the first-person view video;
    所述处理器在实现所述对所述第一人称视角视频的至少一帧图像进行旋转处理时,具体实现:When the processor implements the rotation processing on at least one frame of the first-person view video, it specifically implements:
    将经过所述图像放大处理后的所述第一人称视角视频的至少一帧图像进行旋转处理。Perform rotation processing on at least one frame of the image of the first-person view video after the image enlargement processing.
  42. 根据权利要求22所述的装置,其特征在于,所述处理器在实现所述在所述控制终端的显示界面显示第一人称视角视频时,具体实现:The device according to claim 22, wherein when the processor implements the first-person view video to be displayed on the display interface of the control terminal, it specifically implements:
    在启动预设播放模式后,在所述控制终端的所述显示界面显示所述第一人称视角视频。After starting the preset play mode, the first-person view video is displayed on the display interface of the control terminal.
  43. 一种控制终端,其特征在于,所述控制终端:A control terminal, characterized in that the control terminal:
    外壳;shell;
    设于所述外壳的显示面板;以及;A display panel provided in the housing; and;
    如权利要求22至42中任一项所述的视频处理装置。The video processing device according to any one of claims 22 to 42.
  44. 一种视频处理系统,其特征在于,所述视频处理系统包括如权利要求43所述的控制终端、以及与所述控制终端通信连接的可移动平台,所述可移动平台:A video processing system, characterized in that the video processing system comprises the control terminal according to claim 43, and a movable platform communicatively connected with the control terminal, and the movable platform:
    机体;Body
    动力系统,设于所述机体,所述动力系统用于为所述可移动平台提供动力,以使得搭载在所述可移动平台上的拍摄装置拍摄所述第一人称视角视频。A power system is provided in the body, and the power system is used to provide power to the movable platform so that a camera mounted on the movable platform can shoot the first-person view video.
  45. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如权利要求1至21中任一项所述的视频处理方法。A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor realizes as described in any one of claims 1 to 21. The video processing method described.
PCT/CN2019/130216 2019-12-30 2019-12-30 Video processing method and apparatus, and control terminal, system and storage medium WO2021134375A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980067328.6A CN112997508B (en) 2019-12-30 2019-12-30 Video processing method, device, control terminal, system and storage medium
PCT/CN2019/130216 WO2021134375A1 (en) 2019-12-30 2019-12-30 Video processing method and apparatus, and control terminal, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/130216 WO2021134375A1 (en) 2019-12-30 2019-12-30 Video processing method and apparatus, and control terminal, system and storage medium

Publications (1)

Publication Number Publication Date
WO2021134375A1 true WO2021134375A1 (en) 2021-07-08

Family

ID=76344291

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/130216 WO2021134375A1 (en) 2019-12-30 2019-12-30 Video processing method and apparatus, and control terminal, system and storage medium

Country Status (2)

Country Link
CN (1) CN112997508B (en)
WO (1) WO2021134375A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080043020A1 (en) * 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
CN106125747A (en) * 2016-07-13 2016-11-16 国网福建省电力有限公司 Based on the servo-actuated Towed bird system in unmanned aerial vehicle onboard the first visual angle mutual for VR
CN106708074A (en) * 2016-12-06 2017-05-24 深圳市元征科技股份有限公司 Method and device for controlling unmanned aerial vehicle based on VR glasses
WO2017173799A1 (en) * 2016-04-08 2017-10-12 吕佩剑 Head-mounted display apparatus enabling multiple flight-points-of-view
CN109154499A (en) * 2016-08-18 2019-01-04 深圳市大疆创新科技有限公司 System and method for enhancing stereoscopic display
US20190352005A1 (en) * 2018-05-18 2019-11-21 Qualcomm Incorporated Fiducial gates for drone racing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107547930A (en) * 2017-06-02 2018-01-05 北京小嘿科技有限责任公司 A kind of video play controller and control method based on mobile device rotation detection
CN107396151B (en) * 2017-08-24 2019-06-07 维沃移动通信有限公司 A kind of video playing control method and electronic equipment
CN108322650B (en) * 2018-02-08 2020-03-27 Oppo广东移动通信有限公司 Video shooting method and device, electronic equipment and computer readable storage medium
CN109104633B (en) * 2018-08-30 2021-09-28 Oppo广东移动通信有限公司 Video screenshot method and device, storage medium and mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080043020A1 (en) * 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
WO2017173799A1 (en) * 2016-04-08 2017-10-12 吕佩剑 Head-mounted display apparatus enabling multiple flight-points-of-view
CN106125747A (en) * 2016-07-13 2016-11-16 国网福建省电力有限公司 Based on the servo-actuated Towed bird system in unmanned aerial vehicle onboard the first visual angle mutual for VR
CN109154499A (en) * 2016-08-18 2019-01-04 深圳市大疆创新科技有限公司 System and method for enhancing stereoscopic display
CN106708074A (en) * 2016-12-06 2017-05-24 深圳市元征科技股份有限公司 Method and device for controlling unmanned aerial vehicle based on VR glasses
US20190352005A1 (en) * 2018-05-18 2019-11-21 Qualcomm Incorporated Fiducial gates for drone racing

Also Published As

Publication number Publication date
CN112997508B (en) 2024-03-15
CN112997508A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
US10893216B2 (en) Electronic apparatus and method for controlling same
US10127632B1 (en) Display and update of panoramic image montages
US20150271402A1 (en) Panoramic scene capturing and browsing mobile device, system and method
CN114302214B (en) Virtual reality equipment and anti-jitter screen recording method
EP3591499B1 (en) Electronic device, control method for electronic device, program, and computer readable medium
EP4096211A1 (en) Image processing method, electronic device and computer-readable storage medium
WO2021026789A1 (en) Photographing method based on handheld gimbal, and handheld gimbal and storage medium
CN112672050A (en) Shooting method and device based on holder and electronic equipment
WO2022206499A1 (en) Image capture method and apparatus, electronic device and readable storage medium
CN112653843A (en) Shooting method and device based on holder and electronic equipment
CN112732089A (en) Virtual reality equipment and quick interaction method
KR102477993B1 (en) Display control apparatus, imaging apparatus, control method, and computer readable medium
CN108134928A (en) VR display methods and device
WO2021238942A1 (en) Anti-shake method, anti-shake apparatus, and electronic device
US20230359198A1 (en) Unmanned aerial vehicle, control method thereof, and storage medium
WO2021134375A1 (en) Video processing method and apparatus, and control terminal, system and storage medium
US20190075249A1 (en) Image processing device, imaging processing method, and program
CN113542463B (en) Video shooting device and method based on folding screen, storage medium and mobile terminal
CN114286077B (en) Virtual reality device and VR scene image display method
WO2022041013A1 (en) Control method, handheld gimbal, system, and computer readable storage medium
WO2022061934A1 (en) Image processing method and device, system, platform, and computer readable storage medium
US10911593B2 (en) Electronic device having a rotatable camera module
CN113227931A (en) Holder control method, device, equipment and computer readable storage medium
CN113347290B (en) Terminal equipment, method and device for controlling terminal equipment
WO2024092586A1 (en) Control methods for unmanned aerial vehicle, apparatus and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19958662

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19958662

Country of ref document: EP

Kind code of ref document: A1