CN112312217A

CN112312217A - Image editing method and device, computer equipment and storage medium

Info

Publication number: CN112312217A
Application number: CN201910699483.1A
Authority: CN
Inventors: 李花
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-07-31
Filing date: 2019-07-31
Publication date: 2021-02-02

Abstract

The embodiment of the invention discloses an image editing method, an image editing device, computer equipment and a storage medium; the embodiment of the invention can display a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control, and the interaction area comprises an image display control; when the operation of a user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to the display video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area. The scheme can edit the video playing picture.

Description

Image editing method and device, computer equipment and storage medium

Technical Field

The invention relates to the technical field of communication, in particular to an image editing method, an image editing device, computer equipment and a storage medium.

Background

Video playing applications such as live broadcast or recorded broadcast applications are software for realizing online watching or watching back through a network communication technology, and users can watch or play back videos online through the video playing applications. In order to improve the applicability of video playing and also realize the editing of the playing content of the video, most of the existing editing technologies are to store the screenshot of the video playing content into an album, then quit the video playing application and open an image processing tool to edit the screenshot.

In the research and practice process of the prior art, the inventor of the invention finds that the video content is subjected to screenshot and then edited by using an image processing tool, so that the operation steps are more, the time is more consumed, the video playing application needs to be quitted midway, and the editing efficiency is lower.

Disclosure of Invention

The embodiment of the invention provides an image editing method, an image editing device, computer equipment and a storage medium, which can realize the editing of a video playing picture.

The embodiment of the invention provides an image editing method, which comprises the following steps:

displaying a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and video content which is played currently, and the interaction area comprises an image display control;

when the operation of a user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area;

editing the intercepted image of the editable area based on the editing operation of the user on the image editing page;

when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to display the video playing page;

and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interaction area.

Correspondingly, an embodiment of the present invention further provides an image editing apparatus, including:

the video display unit is used for displaying a video playing page, the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and video content which is played currently, and the interaction area comprises an image display control;

the editing and displaying unit is used for displaying an image editing page when the operation of a user for the content editing control is detected, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area;

the editing unit is used for editing the intercepted image of the editable area based on the editing operation of the user on the image editing page;

the return display unit is used for storing the edited intercepted image and returning to display the video playing page when the operation of the user on the storage control of the image editing page is detected;

and the image display unit is used for displaying the edited intercepted image in the interaction area when the operation of the user on the image display control is detected.

In one embodiment, the editing display unit includes:

the positioning subunit is configured to position a content playing area of the video playing page when detecting an operation of a user on the content editing control;

the intercepting subunit is used for intercepting the image of the content playing area according to the positioning result;

and the editing display subunit is used for displaying an image editing page based on the intercepted image of the content playing area.

In an embodiment, the capturing subunit is configured to obtain an image parameter of the content playing area according to the positioning result; generating the content playing area bitmap according to the image parameters; and taking the bitmap as a cut-out image of the content area.

In an embodiment, the editing and displaying subunit is configured to create a canvas, where the canvas background is a bitmap of the content playing area; based on the canvas, an image editing page is displayed.

In one embodiment, the editing unit includes:

the superposition subunit is used for superposing at least one transparent layer on the layer of the intercepted image of the canvas;

and the editing subunit is used for editing the intercepted image in the transparent layer based on the editing operation of the user on the image editing page.

In an embodiment, the editing subunit is configured to, when an operation of an editing setting control of the image editing page by a user is detected, display an editing setting list, where the editing setting list includes at least one editing tool control; acquiring the setting information of the editing tool control based on the setting operation of the user for the editing tool control; and when the editing operation of the user on the image editing page is detected, editing according to the setting information of the editing tool control.

In an embodiment, the editing unit further includes

The caching subunit is configured to, when a preview control operation for the image editing page is detected, cache a target video frame in a video according to a current time;

and the updating subunit is used for updating the background of the canvas into the target video frame.

In one embodiment, the image display unit includes:

the list display subunit is used for displaying the edited intercepted image list in the interaction area when the operation of the user on the image display control is detected;

and the intercepted image display subunit is used for displaying the updated edited intercepted image according to a preset strategy when the selection operation of the user on the edited intercepted image list is detected.

In an embodiment, the intercepted image display subunit is configured to, when a selection operation of a user on the edited intercepted image list is detected, display a thumbnail of the updated edited intercepted image in the interaction area; and when the selection operation of the user for the thumbnail is detected, displaying the updated edited intercepted image on the video playing page.

The embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in any image editing method provided in the embodiment of the present invention when executing the program.

In addition, the embodiment of the present invention further provides a storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps in any one of the image editing methods provided by the embodiments of the present invention.

The embodiment of the invention can display a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and currently played video content, and the interaction area comprises an image display control; when the operation of a user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to display the video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interaction area. The method can intercept the video playing picture, directly edit the intercepted image, has simple and convenient operation steps, does not need to quit playing midway, and greatly improves the editing efficiency.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a scene schematic diagram of an image editing method provided by an embodiment of the present invention;

FIG. 2 is a flowchart of an image editing method provided by an embodiment of the present invention;

FIG. 3 is a schematic display diagram of a video playback page provided in an embodiment of the present invention;

FIG. 4 is a schematic diagram of the operation of a course video search page provided by an embodiment of the present invention;

FIG. 5 is a schematic diagram of a display of an image editing page provided by an embodiment of the present invention;

fig. 6 is a schematic diagram illustrating a display of an edit setting list of an image editing page according to an embodiment of the present invention;

FIG. 7 is a schematic flow chart of an image editing method according to an embodiment of the present invention;

FIG. 8 is a diagram illustrating a preview image of an image editing page provided by an embodiment of the present invention;

FIG. 9 is a schematic display diagram of an edited captured image of a video playback page provided in an embodiment of the present invention;

FIG. 10 is a schematic flow chart of an image editing method according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of an image editing apparatus according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of an editing display unit of the image editing apparatus according to the embodiment of the present invention;

fig. 13 is a schematic structural diagram of an editing unit of the image editing apparatus according to the embodiment of the present invention;

fig. 14 is another schematic structural diagram of an editing display unit of the image editing apparatus according to the embodiment of the present invention;

fig. 15 is a schematic structural diagram of an image display unit of an image editing apparatus according to an embodiment of the present invention;

fig. 16 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides an image editing method, an image editing device, computer equipment and a storage medium.

The image editing apparatus may be integrated into a computer device, and the computer device may be a server or a terminal. The terminal may include a terminal device such as a smart phone, a tablet Computer, a notebook Computer, or a Personal Computer (PC).

For example, referring to fig. 1, a computer device is taken as an example of a terminal, wherein the image editing apparatus is integrated in the terminal, for example, in the form of a client.

The terminal can display a video playing page, the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and currently played video content, and the interaction area comprises an image display control; when the operation of a user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to the display video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area.

The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

The present embodiment will be described from the perspective of an image editing apparatus that can be specifically integrated in a terminal.

An image editing method provided in an embodiment of the present invention may be executed by a processor of a terminal, and as shown in fig. 2, a specific flow of the image editing method may be as follows:

101. and displaying a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and the currently played video content, and the interaction area comprises an image display control.

For example, the video playing page may include an online playing of a live or recorded education course, and the user may view a live or recorded course video on the course playing page, as shown in fig. 3.

The video playing page may include a content playing area and an interaction area, and the content playing area of the video playing page may play a live or recorded video or image, for example, may play a movie, an animation, a tv show, or live online lessons. The content playing area of the video playing page can be one or more. The interactive region of the video playing page may display the interactive information of the user with respect to the played video content, such as a message, a bullet screen, or an edited text and image.

In the embodiment of the invention, the user can operate the user operation interface of the video playing client so as to trigger the display of the video playing page. For example, in an embodiment, a user may operate through a content search page of a video playing client to trigger display of a video playing page. The content search page may provide search content for a user, such as pages of video content of various types of dramas, various types of movies, and art programs, and the user may perform a search operation on the content search page to search for video content to be played.

For example, a video search control may be set on a content search page, so that a user may operate the control to trigger display of a search result page, and based on a selection operation of the user on the search result page, trigger display of a video play page may specifically include: displaying a content search page of a video playing client, wherein the content search page comprises a video search control; when the triggering operation of a user for the video search control is detected, displaying a video search result page; and displaying the video playing page based on the selection operation of the user aiming at the search result page, wherein the content playing area comprises a content editing control and the currently played video content, and the interaction area comprises an image display control.

In the embodiment of the present invention, the representation form of the control is various, such as an input box, an icon, a button, and the like.

For example, taking the played video content as an online course as an example, referring to fig. 4, the terminal may display a course video search page, where the course video search page may include content search controls, such as a math course search control, an english course search control, a chinese course search control, and the like, and the course video search page may further include system recommended course content, and the like. When a user needs to search for a course, the user can operate a label search control in a course video search page, such as clicking, sliding and the like; and when the terminal detects the user operation, triggering and displaying a course search result page. The search result page may include one or more course videos, and when the terminal detects a selection operation of the user on the course search result page, the terminal triggers display of a video playing page as shown in fig. 3.

102. And when the operation of the user for the content editing control is detected, displaying an image editing page, wherein the editing page comprises a storage control and an intercepted image of the current content playing area.

The captured image of the current content playing area may include a screenshot of the currently played video content, for example, when the video content played in the content playing area reaches the 5 th second, the screenshot of a picture or a frame corresponding to the video of the second is performed when the video content played in the content playing area reaches the 5 th second, and the captured image of the current content playing area may be obtained.

The image editing page can be a page for a user to edit the captured image, the user can edit the captured image in the content playing area on the page, for example, in an online education scene, the image editing page can be a note adding page, and the user can add a note to the captured image on the note adding page to improve the learning efficiency. As shown in fig. 5.

In the embodiment of the present invention, when an operation of a user on a content editing control is detected, a content playing area of a video playing page is located, for example, information such as coordinates, length, width, height, pixel position, and/or pixel size of the content playing area is marked, an area where an image is captured is located on the video playing page, and the image of the located content playing area is captured according to a location result. When a plurality of content playing areas exist, the user selects an area to be positioned according to needs, for example, the user can select to capture an image of the content playing area for playing courseware. Specifically, the step of "performing image capture on the content playing area according to the positioning result" may include:

acquiring image parameters of the content playing area according to a positioning result;

generating a content playing area bitmap according to the image parameters;

the bitmap is used as a truncated image of the content playing area.

For example, after the content playing area is determined according to the positioning result, an image parameter of a video frame of the content playing area is acquired by using a memory snapshot (builddrawing cache) in a front-end interface component (View), a bitmap (bitmap) of the content playing area is generated according to the image parameter, and the bitmap is used as an intercepted image of the content playing area.

In an embodiment, after the capture image of the content playing area is obtained, the image editing page is displayed based on the capture image of the content playing area, for example, the capture image may be added to the image editing page and displayed. Specifically, the step of "capturing an image based on a content playing area and displaying an image editing page" includes:

creating a canvas, wherein the canvas background is a bitmap of the content playing area;

based on the canvas, an image editing page is displayed.

For example, a front canvas component (canvas) may be called to create a canvas with the same size as the content playing area, the canvas is a presentation tool, and JavaScript (a script language) may draw information such as various charts, animations, characters, or doodles on the canvas. And adding the generated bitmap of the content playing area to the canvas as the background of the canvas.

The bitmap is a cached bitmap, the video content frames are changed along with the continuous change of video playing content, the cached bitmap is also changed, an updating time or an updating instruction can be preset, when the updating time is up, the bitmap added to the canvas of the canvas is automatically updated to the cached bitmap of the latest frame, or after the updating instruction is triggered by a user, the bitmap added to the canvas of the canvas is automatically updated to the cached bitmap of the latest frame.

In an embodiment, the obtained captured image of the content area is displayed through an image editing page, for example, a dialog box or other interactive components (dialog) may be called, the captured image of the content area and a canvas are added to the dialog box or other interactive components, and the dialog box or other interactive components are generated into an interactive page, which is an image editing page, and the image editing page is displayed.

103. And editing the intercepted image of the editable area based on the editing operation of the user on the image editing page.

The editing operation may include performing an input action such as inserting characters, an image, or doodling on the captured image of the image editing page. For example, an editing tool such as a brush is used to perform input actions such as doodling, text adding, and symbols on an intercepted image of an image editing page.

The editable area may include an area where an editing operation is received, for example, an area where an editing tool such as a brush is received and an editing operation is performed on the captured image.

In the embodiment of the invention, at least one transparent layer is superposed on the layer of the intercepted image of the canvas of the image editing page, wherein the intercepted image may include a plurality of layers. And editing the intercepted image in the transparent layer based on the editing operation for the image editing page. Specifically, the step of "editing the intercepted image in the transparent layer" may include:

when the operation of a user on an editing setting control of an image editing page is detected, displaying an editing setting list, wherein the editing setting list comprises at least one editing tool control;

acquiring setting information of an editing tool control based on setting operation of a user for the editing tool control;

and when the editing operation of the user on the image editing page is detected, editing according to the setting information of the editing tool control.

For example, referring to fig. 6, after the image editing page is displayed, the user may click an editing setting control of the image editing page, at this time, an editing setting list is displayed, where the editing setting list includes at least one editing tool control, and the editing setting list may include editing tool controls such as a brush color setting, a brush shape setting, and a brush width setting, taking an editing tool as an example.

The painting brush color setting control can include setting of common colors such as black, white, red or yellow, and can also include setting of all colors. For example, if the user sets the color of the brush in the brush color setting control to be red, the color of the brush in the image editing page may be red, and the color of a line for editing text or graffiti with the brush is red. If the user does not select and set the painting brush color setting control, at the moment, the color of the painting brush can display the default color, and the default color can be set according to the actual application needs.

The painting brush shape setting control can include shape setting of a painting brush pen point, for example, common shapes such as a point, a circle, a straight line, a square (a square or a rectangle), a triangle and the like can be provided, and exclusive shapes uploaded by a user can also be provided, such as a heart shape, a letter shape and the like. For example, when the user sets a circle in the brush shape setting control, in the image editing page, the shape of the brush is a circle, and the shape of a line for editing characters or graffiti with the brush is a circle. If the user does not select and set the brush-shaped setting control, at this time, the shape of the brush is displayed as a default shape, which may be set according to the actual application needs, for example, the default shape may be a dot or a circle.

Wherein, the painting brush width sets up the setting that the control part can include painting brush nib width, for example, can set up painting brush nib width into three grades, what one grade width corresponds is painting brush nib width for 2mm, the nib width that two grades of width correspond is 4mm, the nib width that three grades of width correspond is 6mm, wherein, the grade that the nib width was divided can be divided according to actual conditions, divide into two grades at least, the nib width that each grade corresponds also can be set for according to actual need, grade width can be represented through the digit, also can show with the sign, for example the rectangle piece of specific width. For example, the user sets the second-level width in the brush width setting control, and assumes that the second-level width corresponds to the brush point width of 4mm, at this time, in the image editing page, the width of the brush point is just 4mm corresponding to the second-level width, and the line width of editing characters or doodling with the brush is just the width corresponding to the selected second-level width. If the user does not select and set the brush width setting control, at this time, the width of the brush tip of the brush is displayed as a default width, and the default width may be set according to the actual application needs, for example, the default width may be a first-grade width or a second-grade width.

In one embodiment, when an editing operation of the user on the image editing page is detected, the editing is performed according to the setting information of the editing tool control, such as, according to the setting of the editing tool control in the setting tool control by the user, for example, taking the editing tool as a brush pen as an example, the color of the brush pen selected by the user in the brush pen color setting control is red, the shape of the pen point of the painting brush selected in the painting brush shape setting control is a point, the width of the painting brush selected in the painting brush width setting control is a first-level width, and the specific width corresponding to the first-level width is assumed to be 2mm, at this time, the user sets the painting brush according to the setting information of the workpiece editing control, and edits the transparent layer on the image editing page after the setting is finished, for example, and editing actions such as inserting characters or graphics, scrawling by using a brush, marking the intercepted image and the like can be performed.

In an embodiment, after the image page finishes editing the captured image, the user can preview the edited captured image effect, and when a preview control in the image editing page is triggered, the preview image is displayed on the image editing page. For example, when a preview control operation for an image editing page is detected, a target video frame in a video is cached according to the current time, for example, when a user edits the image editing page, the video of a video playing page continues to be played at the front end or the background, when the user triggers the preview control operation, the current frame of the video played by the video playing page is cached according to the current time triggering the preview control, the current frame of the video is obtained, the background in a canvas is updated from a captured image to an image corresponding to the current frame, and the updated captured image and the editing content of the captured image on a transparent layer are displayed. For example, after detecting that the user triggers the preview control, the target frame of the video corresponding to the current time is acquired, the bitmap or the image a is generated according to the target frame, the background in the canvas is updated from the previously intercepted image B to the image a, and the updated image a and the editing content of the image B on the transparent layer of the image a are displayed.

In an embodiment, after the preview picture is displayed on the image editing page, the user may trigger an exit control on the preview picture to store the preview picture, or may set that the preview picture is automatically stored after the user is not detected to edit the preview picture for a certain time, and after the preview picture is stored, the captured image of the image editing page is also synchronously updated to the picture corresponding to the video frame at the current time that triggers the preview operation. Because the intercepted image is edited on the transparent layer, after the intercepted image is updated, the editing operation and the editing content of the intercepted image before updating on the transparent layer cannot be influenced, after the preview picture is stored, a user can select to continue editing the updated intercepted image on the transparent layer, and also can select to trigger a storage control of an image editing page, store the edited intercepted image and quit the image editing page.

104. And when the operation of the user on the storage control of the image editing page is detected, storing the edited intercepted image, and returning to the display video playing page.

In the embodiment of the present invention, when it is detected that the user operates the saving control of the image editing page, the default user finishes editing the intercepted image on the image editing page, saves the editing content of the intercepted image on the image editing page by the user, and saves the editing content and the background of the canvas updated during saving, and the saving mode may be various, for example, the editing content and the background of the canvas updated by superimposing may be generated, an image including the editing content and the background of the canvas is generated, and the generated image is cached in the terminal, may also be saved in the local database, and may also be uploaded to the network. The editing page may also be saved, for example, the editing page may also be intercepted to obtain an intercepted image of the editing page, where the intercepted image may include the editing content on the transparent layer and the background of the updated canvas, and the image of the editing page obtained by interception is cached in the terminal, may also be saved in the local database, and may also be uploaded to the network.

In one embodiment, the image containing the background of the canvas and the editing content is saved and returned to the display video playback page. After the video playing page is returned to be displayed, the video content played in the video playing page can be the current playing content and can also be displayed as the playing content when the content editing control is triggered to operate. When the video playing page comprises a plurality of content playing areas, when the video playing page is returned to be displayed, the content playing area intercepting the image can display the current playing content, or can display the current playing content as the playing page triggering the operation of the content editing control, other content playing areas without the intercepted image can be displayed according to whether the user triggers the operation of the pause control of other content playing areas, if the user triggers the operation of the pause control, the other content playing areas display the playing content triggering the pause control, if the user does not trigger the operation of the pause control, the other content playing areas can be continuously played in the background, or according to a preset strategy, for example, when the user does not detect the operation of the other content playing areas of the video playing page within a certain time, the playing of the other content playing areas is automatically paused, the other content playing area displays the playing content during pause.

105. And when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area.

In an embodiment of the present invention, the video playing page may include at least one content playing area and at least one interaction area. And when the operation of the user on the image display control is detected, displaying the edited intercepted image list in the interactive area. For example, if the edited captured image is stored in a local database of the terminal, when an operation of the user on the image display control is detected, the stored information of the edited captured image is read from the local database, and an edited captured image list is displayed in an interaction area of the video playback page, where the list can display related information of at least one edited captured image, such as information of a name, storage time, and storage type of the edited captured image.

In one embodiment, when a user selection operation for the edited intercepted image list is detected, the updated edited intercepted image is displayed according to a preset strategy. For example, when the user selects an image to be viewed in the edited list of captured images, a thumbnail of the image may be displayed in the interactive area, and the user may select a single image or a plurality of images in the edited list of captured images. When a user selects a single image in an edited intercepted image list, displaying the selected single image in an interactive area of a video playing page, displaying thumbnails of the single images, and displaying the original size of the single image according to the size of the interactive area of the video playing page.

In an embodiment, when the interactive area of the video playing page is not enough to display two or more edited captured images, a single or multiple thumbnails of the captured images may be displayed in the interactive area, and when multiple thumbnails are displayed, the thumbnails may be sorted according to capturing time or editing time, or may be sorted according to pixel size. When a user triggers a single thumbnail in an interactive area, the thumbnail after the size of a terminal display area is enlarged can be displayed on a video playing page, and if the original size of the captured image is not enough to fill the whole terminal display area, the original size of the captured image is displayed in the terminal area. And when the user can trigger a plurality of thumbnails in the interaction area, the thumbnails can be displayed in the display area of the terminal in the form of playing images according to the time for triggering the thumbnails and the sequence.

In an embodiment, the user may further select the edited captured image displayed in the interaction area to share or upload, for example, in an online course aiming at an educational scene, the user may further share the edited captured image with other users who watch the course online at the same time, and may also upload the edited captured image to the server, and the server sends the uploaded edited captured image to terminals corresponding to other users who watch the online course online.

As can be seen from the above, the embodiment of the present invention can display a video playing page, where the video playing page includes a content playing area and an interaction area, the content playing area includes a content editing control and a currently played video content, and the interaction area includes an image display control; when the operation of the user for the content editing control is detected, displaying an image editing page, wherein the editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of the user on the saving control of the image editing page is detected, returning to display the video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area. The scheme can play pictures in a video mode, and can directly edit the captured images, the operation steps are simple and convenient, the playing is not required to be quitted midway, and the editing efficiency is greatly improved.

In addition, the user can intercept part or all of the video playing pictures in the designated area according to the requirement of the user without redundant operation, and edit the intercepted images by utilizing abundant and various editing tools, so that the experience of the user in editing the video playing pictures can be improved.

The method described in the above embodiments will be described in further detail by way of example.

In this embodiment, the image editing apparatus will be described by taking an example in which the image editing apparatus is specifically integrated in a terminal. The specific integration mode can be that the terminal is integrated in a client form.

As shown in fig. 7, a specific flow of an image editing method is as follows:

201. the terminal displays a content search page of the video playing client, wherein the content search page comprises a video search control.

For example, taking the played video content as an online course as an example, referring to fig. 4, the terminal may display a course video search page, where the course video search page may include a plurality of content search controls, such as a math course search control, an english course search control, a chinese course search control, and the like, and the course video search page may further include system recommended course content and the like.

202. And when the triggering operation of the user for the video search control is detected, the terminal displays a video search result page.

For example, when a user needs to search a course video, the user may operate a content search control in a course video search page, such as clicking, sliding, and the like; when the terminal detects the user operation, the display of a course search result page is triggered, and the search result page can comprise one or more course videos.

203. And displaying the video playing page by the terminal based on the selection operation of the user aiming at the search result page.

For example, after the user selects a video to be played on the search result page, the terminal displays the video playing page based on the user's selection operation on the search result page. The video playing page comprises at least one content playing area and at least one interaction area. For example, when the video playing content is an online course, the content playing area may play a course video live or recorded by a teacher, where the course video may include a video of the teacher taking a course and a video of a corresponding courseware. The interaction area can display notes corresponding to courseware for the user and simultaneously view the discussion content of the video course student.

204. When the operation of the user for the content editing control is detected, the terminal displays an image editing page, and the image editing page comprises a storage control and an intercepted image of a current content playing area.

For example, a "click to add notes" or other prompt information may be prompted next to the content editing control. After a user triggers a content editing control on a video playing page, a terminal locates a content playing area of the video playing page, for example, information such as coordinates, length, width, height, pixel position and/or pixel size of the content playing area is marked, an area for capturing an image is located on the video playing page, and the image of the located content playing area is captured according to a locating result. When a plurality of content playing areas exist, the user selects an area to be positioned according to needs, for example, the user can select to capture an image of the content playing area for playing courseware. Specifically, the step of "performing image capture on the content playing area according to the positioning result" may include:

generating a content playing area bitmap according to the image parameters;

the bitmap is used as a truncated image of the content playing area.

For example, after determining a content playing area that a user needs to capture according to a positioning result, the terminal obtains image parameters of a video frame of video content in the content playing area by using a memory snapshot (build draw cache) in a front-end interface component (View), generates a bitmap (bitmap) of a courseware in the content playing area according to the image parameters, and uses the bitmap as a captured image of the content playing area.

In an embodiment, after acquiring the captured image of the content playing area, the terminal displays the image editing page based on the captured image of the content playing area, for example, the captured image may be added to the image editing page and displayed. Specifically, the step of "capturing an image based on a content playing area and displaying an image editing page" includes:

creating a canvas, wherein the canvas background is a bitmap of a content playing area;

based on the canvas, an image editing page is displayed.

In an embodiment, the obtained captured image of the content area of the video playing is displayed through an image editing page, for example, a dialog box or other interactive components (dialogs) may be called, the captured image of the content area of the courseware playing and a canvas are added to the dialog box or other interactive components, the dialog box or other interactive components are generated into an interactive page, and the interactive page is an image editing page, and the image editing page is displayed.

205. And editing the intercepted image of the editable area by the terminal based on the editing operation of the user on the image editing page.

In the embodiment of the invention, the terminal superposes at least one transparent layer on the layer of the intercepted image of the canvas of the image editing page, wherein the intercepted image may include a plurality of layers. And editing the intercepted image in the transparent layer based on the editing operation for the image editing page. Specifically, the step of "editing the intercepted image in the transparent layer" may include:

when the operation of a user on an editing setting control of an image editing page is detected, the terminal displays an editing setting list, wherein the editing setting list comprises at least one editing tool control;

based on the setting operation of a user for the editing tool control, the terminal acquires the setting information of the editing tool control;

and when the editing operation of the user on the image editing page is detected, the terminal edits according to the setting information of the editing tool control.

For example, referring to fig. 6, after an image editing page is displayed, a user may click an editing setting control of the image editing page, at this time, the terminal displays an editing setting list, where the editing setting list includes at least one editing tool control, and the editing setting list may include editing tool controls such as paint brush color setting, paint brush shape setting, and paint brush width setting, taking an editing tool as a paint brush as an example.

In one embodiment, when the user's editing operation on the image editing page is detected, the terminal performs editing according to the setting information of the editing tool control, such as, according to the setting of the editing tool control in the setting tool control by the user, for example, taking the editing tool as a brush pen as an example, the color of the brush pen selected by the user in the brush pen color setting control is red, the shape of the pen point of the painting brush selected in the painting brush shape setting control is a point, the width of the painting brush selected in the painting brush width setting control is a first-level width, and the specific width corresponding to the first-level width is assumed to be 2mm, at this time, the user sets the painting brush according to the setting information of the workpiece editing control, and edits the transparent layer on the image editing page after the setting is finished, for example, and editing actions such as inserting characters or graphics, scrawling by using a brush, marking the intercepted image and the like can be performed.

In an embodiment, after the user finishes editing the captured image on the image editing page, the user may preview the edited captured image effect, and when the user triggers a preview control in the image editing page, the terminal displays the preview image on the image editing page, as shown in fig. 8. For example, when a preview control operation for an image editing page is detected, a target video frame in a video is cached according to the current time, for example, when a user edits the image editing page, the video of a video playing page continues to be played at the front end or the background, when the user triggers the preview control operation, the current frame of the video played by the video playing page is cached according to the current time triggering the preview control, the current frame of the video is obtained, the background in a canvas is updated from a captured image to an image corresponding to the current frame, and the updated captured image and the editing content of the captured image on a transparent layer are displayed. For example, after detecting that the user triggers the preview control, the target frame of the courseware video corresponding to the current time is acquired, the bitmap or the image a is generated according to the target frame, the background in the canvas is updated to the image a from the previously intercepted image B, and the updated image a and the editing content of the image B on the transparent layer of the image a are displayed.

In an embodiment, after the terminal displays the preview picture on the image editing page, the user may trigger an exit control on the preview picture to store the preview picture, or may set that the preview picture is automatically stored after the user is not detected to edit the preview picture for a certain time, and after the preview picture is stored, the captured image of the image editing page is also synchronously updated to the picture corresponding to the video frame at the current time that triggers the preview operation. Because the intercepted image is edited on the transparent layer, after the intercepted image is updated, the editing operation and the editing content of the intercepted image before updating on the transparent layer cannot be influenced, after the preview picture is stored, a user can select to continue editing the updated intercepted image on the transparent layer, and also can select to trigger a storage control of an image editing page, store the edited intercepted image and quit the image editing page.

206. And when the operation of the user on the storage control of the image editing page is detected, the terminal stores the edited intercepted image and returns to the display video playing page.

In the embodiment of the present invention, when it is detected that the user operates the saving control for the image editing page, the default user finishes editing the captured image on the image editing page, the terminal saves the editing content of the captured image on the image editing page by the user, for example, saves a note added to the image of the captured courseware on the image editing page by the user, and saves the editing content and the background of the updated canvas during saving, and the saving mode may be various, for example, the editing content and the background of the updated canvas may be superimposed to generate an image including the editing content and the background of the canvas, and the generated image is cached to the terminal, may also be saved to a local database, and may also be uploaded to the network. The image editing page may also be stored, for example, the image editing page is intercepted to obtain an intercepted image of the image editing page, the intercepted image may include the editing content on the transparent layer and the background of the updated canvas, and the image of the image editing page obtained by interception is cached in the terminal, may also be stored in the local database, and may also be uploaded to the network.

In one embodiment, the terminal returns to displaying the video playback page after saving the image containing the background of the canvas and the editing content. After the video playing page is displayed, the video content played in the video playing page may be the current playing content, or may be displayed as the playing content when the content editing control is triggered to operate, for example, the playing page of the video before screenshot may be displayed, or may be the current playing page of the video. When the video playing page comprises a plurality of content playing areas, when the video playing page is returned to be displayed, the content playing area intercepting the image can display the current playing content, or can display the current playing content as the playing page triggering the operation of the content editing control, other content playing areas without the intercepted image can be displayed according to whether the user triggers the operation of the pause control of other content playing areas, if the user triggers the operation of the pause control, the other content playing areas display the playing content triggering the pause control, if the user does not trigger the operation of the pause control, the other content playing areas can be continuously played in the background, or according to a preset strategy, for example, when the user does not detect the operation of the other content playing areas of the video playing page within a certain time, the playing of the other content playing areas is automatically paused, the other content playing area displays the playing content during pause.

207. And when the operation of the user for the image display control is detected, the terminal displays the edited intercepted image in the interactive area.

In an embodiment of the present invention, the video playing page may include at least one content playing area and at least one interaction area. And when the operation of the user for the image display control is detected, the terminal displays the edited intercepted image list in the interactive area. For example, if the edited captured image is stored in a local database of the terminal, when an operation of the user on the image display control is detected, the stored information of the edited captured image is read from the local database, and an edited captured image list is displayed in an interaction area of the video playback page, where the list can display related information of at least one edited captured image, such as information of a name, storage time, and storage type of the edited captured image.

In one embodiment, when a user selection operation for the edited intercepted image list is detected, the terminal displays the updated edited intercepted image according to a preset strategy. For example, when the user selects an image to be viewed in the edited list of captured images, a thumbnail of the image may be displayed in the interactive area, as shown in fig. 9, the user may select a single image or multiple images in the edited list of captured images. When a user selects a single image in an edited intercepted image list, displaying the selected single image in an interactive area of a video playing page, displaying thumbnails of the single images, and displaying the original size of the single image according to the size of the interactive area of the video playing page.

As can be seen from the above, in the embodiment of the present invention, the terminal may display a video playing page, where the video playing page includes a content playing area and an interaction area, the content playing area includes a content editing control and a currently played video content, and the interaction area includes an image display control; when the operation of the user for the content editing control is detected, the terminal displays an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; based on the editing operation of the user on the image editing page, the terminal edits the intercepted image of the editable area; when the operation of a user on the storage control of the image editing page is detected, the terminal stores the edited intercepted image and returns to the display video playing page; and when the operation of the user for the image display control is detected, the terminal displays the edited intercepted image in the interactive area. The scheme can play pictures in a video mode, and can directly edit the captured images, the operation steps are simple and convenient, the playing is not required to be quitted midway, and the editing efficiency is greatly improved.

The method described in the above examples is further illustrated in detail below by way of example.

The image editing device is applied to an online education scene, the content played by a video playing page is courseware or a teaching video of an online course, the image editing page is a note adding page, and the image editing is used for explaining the courseware and the teaching video adding pen of the online course. The image editing apparatus is integrated in a computer device, taking the computer device as a terminal as an example, for example, integrated in the terminal in the form of an online education client, hereinafter referred to as a client.

As shown in fig. 10, a specific flow of an image editing method is as follows:

301. the client displays a course search page, which includes a course search control.

For example, referring to fig. 4, the client may display a course search page, and the course video search page may include a plurality of course search controls, such as a math course search control, an english course search control, a chinese course search control, and the like, and the course search page may further include system recommended course content, and the like.

302. And when the triggering operation of the user for the course search control is detected, the client displays a course search result page.

For example, when a user needs to search for a course, the user may operate a course search control in a course search page, such as clicking, sliding, and the like; when the client detects the user operation, the client triggers to display a course search result page, wherein the course search result page can include one or more course videos, and the one or more course videos displayed in the course search result page can be displayed in a list mode or in an icon mode, and the icon can include a cover page and a course name of the videos.

303. And displaying the course playing page by the client based on the selection operation of the user for the course search result page.

For example, after the user selects a course to be learned on the course search result page, the client displays the course playing page based on the user's selection operation on the course search result page. The course playing page comprises at least one course playing area and at least one interaction area. The course playing area can play the course video which is live or recorded and played by the teacher, wherein the course video can comprise the lesson-taking video of the teacher and/or the video playing courseware. The interaction area may display notes corresponding to the courseware for the user and discussion content of other users watching the same video lesson at the same time. The course playing area of the course playing page may include the current course playing content and the note adding control; the interaction area of the course play page may include a note presentation control and a discussion control.

304. When the operation of the user for the note adding control is detected, the client displays a note adding page, and the note adding page comprises a storage control and an intercepted image of a current courseware playing area.

For example, the note adding control can prompt to click to add a note or other prompt information. After the user triggers the note adding control on the course playing page, the client locates the course playing area of the course playing page, for example, marks information such as coordinates, length, width, height, pixel position and/or pixel size of the course playing area, locates the area for capturing the image on the course playing page, and captures the image of the located course playing area according to the locating result. When there are multiple curriculum playing areas, the user selects an area to be positioned as required, for example, can select to capture an image of the curriculum playing area for playing courseware. Specifically, the step of "capturing an image of the course playing area according to the positioning result" may include:

acquiring image parameters of a course playing area according to a positioning result;

generating a course playing area bitmap according to the image parameters;

and taking the bitmap as an intercepted image of the course playing area.

For example, after determining a course playing area of a courseware that a user needs to capture according to a positioning result, the terminal obtains an image parameter of a video frame of the courseware in the course playing area by using a memory snapshot (builddrawing cache) in a front-end interface component (View), and according to the image parameter, the client generates a bitmap (bitmap) of the courseware in the course playing area, and the bitmap is used as a captured image of the course playing area.

In an embodiment, after obtaining the captured image of the course playing area, the client displays the note adding page based on the captured image of the course playing area, for example, the captured image may be added to the note adding page and displayed. Specifically, the step of "capturing an image based on the course playing area and displaying a note adding page" includes:

creating a canvas, wherein the canvas background is a bitmap of a course playing area;

based on the canvas, a note addition page is displayed.

For example, the client may call a front-end canvas component (canvas) component to create a canvas with the same size as the size of the course playing area, the canvas is a presentation tool, and JavaScript (a scripting language) may draw information such as various charts, animations, characters, or doodles on the canvas. And adding the generated bitmap of the course playing area to the canvas as the background of the canvas.

In an embodiment, the client displays the obtained captured image of the course playing area where the user needs to capture the image through a note adding page, for example, a dialog box or other interactive components (dialog) may be called, the captured image of the course area where the user needs to capture the image and a canvas are added to the dialog box or other interactive components, the dialog box or other interactive components generate an interactive page, the interactive page is a note adding page, and the note adding page is displayed.

305. Based on a note adding operation of the user for the note adding page, the client adds a note on the intercepted image of the editable area.

In the embodiment of the invention, the client superposes at least one transparent layer on the layer of the intercepted image of the canvas of the note adding page, wherein the intercepted image can comprise a plurality of layers. And adding a note to the intercepted image on the transparent layer based on a note adding operation of the user for the note adding page. Specifically, the step of "adding a note to the intercepted image in the transparent layer" may include:

when detecting the operation of a user on a brush setting control of a note adding page, the client displays a brush setting list, wherein the brush setting list comprises at least one brush setting control;

based on the setting operation of a user for the painting brush setting control, the client side obtains the setting information of the painting brush setting control;

and when the adding operation of the user for the note adding page is detected, adding the note by the terminal according to the setting information of the brush setting control.

For example, referring to fig. 6, after a note adding page is displayed, a user may click a brush setting control of the note adding page, at this time, the client displays a brush setting list, the brush setting list includes at least one brush setting control, and the editing setting list may include editing tool controls such as brush color setting, brush shape setting, and brush width setting.

In an embodiment, when a note adding operation of a user for a note adding page is detected, the user adds a note according to setting information of a brush setting control, for example, the user sets the brush setting control in a setting tool control, for example, the user selects a color of a brush to be red in the brush color setting control, a shape of a brush point selected in the brush shape setting control is a point, a width of the brush selected in the brush width setting control is a first-level width, and a specific width corresponding to the first-level width is assumed to be 2 mm.

In an embodiment, after the user adds the note to the capture image in the note adding page, the user may preview the effect of the capture image after adding the note, and when the user triggers a preview control in the note adding page, the client displays a preview image in the note adding page, as shown in fig. 8. For example, when the operation of the preview control for the note adding page is detected, the target video frame in the video is cached according to the current time, for example, when the user adds a note to the note adding page, the course video of the course playing page continues to be played at the front end or the background, when the user triggers the preview control to operate, the current frame of the course video played by the course playing page is cached according to the current time of triggering the preview control, the current frame of the video is obtained, the background in the canvas is updated from the intercepted image to the image corresponding to the current frame, and the updated intercepted image and the note added to the intercepted image on the transparent layer are displayed. For example, after the user is detected to trigger the preview control, a target frame of the courseware video corresponding to the current time is obtained, a bitmap or an image a is generated according to the target frame, a background in the canvas is updated to the image a from a previously intercepted image B, and the updated image a and notes added to the image B on a transparent layer of the image a are displayed.

In an embodiment, after the preview picture is displayed on the note adding page, a user may trigger an exit control on the preview picture to store the preview picture, or may set that the preview picture is automatically stored after the user is not detected to edit the preview picture for a certain time, and after the preview picture is stored, the captured image of the note adding page is also synchronously updated to a picture corresponding to the video frame at the current time that triggers the preview operation. Due to the fact that the intercepted image is edited on the transparent layer, after the intercepted image is updated, the adding operation of the intercepted image before updating and the content of the added note on the transparent layer cannot be influenced, after the preview picture is stored, a user can select to continue editing the updated intercepted image on the transparent layer, and also can select to trigger a storage control of an image editing page, store the edited intercepted image and quit the image editing page.

306. When the operation of the user on the storage control of the note adding page is detected, the client stores the intercepted image after the note is added, and returns to display the course playing page.

In the embodiment of the invention, when the operation of the user on the saving control of the note adding page is detected, the default user finishes adding the note to the intercepted image on the note adding page, the client saves the note added by the user to the intercepted image on the note adding page, for example, the note added by the user to the image of the intercepted courseware on the note adding page is saved, and the note is saved together with the background of the updated canvas. The note adding page may also be saved, for example, the note adding page is intercepted to obtain an intercepted image of the note adding page, the intercepted image may include the note added on the transparent layer and the background of the updated canvas, and the image of the note adding page obtained by interception is cached to the client, may also be saved in the local database, and may also be uploaded to the network.

In one embodiment, the client returns to displaying the course play page after saving the image containing the notes and the background of the canvas. After the displayed course playing page is returned, the course video content played in the course playing page may be the current playing content, or may be displayed as the playing content when the note adding control is triggered to operate, for example, the playing page of the courseware before screenshot may be displayed, or may be the current playing page of the courseware. When the course playing page comprises a plurality of course playing areas and returns to display the course playing page, the course playing area intercepting the image can display the current playing course, or can display the course playing page when the note adding control is triggered to operate, other content playing areas without the intercepted image can be displayed according to whether the user triggers the operation of the pause control of other content playing areas, if the user triggers the operation of the pause control, the other content playing areas display the playing content when the pause control is triggered, if the user does not trigger the operation of the pause control, the other content playing areas can continue to play in the background, or according to a preset strategy, for example, when the user does not detect the operation of the other content playing areas of the course playing page within a certain time, the playing of the other content playing areas is automatically paused, the other content playing area displays the playing content during pause.

307. And when the operation of the user on the image display control is detected, the terminal displays the intercepted image added with the note in the interactive area.

In an embodiment of the present invention, the lesson playing page may include at least one content playing area and at least one interaction area. And when the operation of the user on the image display control is detected, the terminal displays the intercepted image list after the note is added in the interactive area. For example, if the captured image after adding the note is stored in the local database of the client, when detecting the operation of the user on the image display control, the information of the captured image after adding the note is read from the local database, and a list of the captured images after adding the note is displayed in the interaction area of the course playing page, where the list can display related information of at least one captured image after adding the note, such as information of the name, the storage time, the storage type, and the like of the captured image after adding the note.

In an embodiment, when a selection operation of a user for the intercepted image list after adding a note is detected, the client displays an updated intercepted image after adding the note according to a preset strategy. For example, when the user selects an image to be viewed in the captured image list after adding the note, a thumbnail of the image may be present in the interactive area, as shown in fig. 9, the user may select a single image or multiple images in the captured image list after adding the note. When the user selects a single image in the intercepted image list after adding the note, the selected single image is displayed in the interactive area of the course playing page, the thumbnail of the single image can be displayed, according to the size of the interactive area of the course playing page, the original size of a single image can be displayed, when the user selects a plurality of images, for example, image a and image B, the sorting can be carried out according to the interception time or the time of adding the notes, the sorting can also be carried out according to the pixel size of the image, the sorting can also be carried out according to the number and the importance degree of the added notes, if, in chronological order, image A is earlier than image B at which the note is intercepted or added, image A and image B are stacked in order, with image B or image A being displayed preferentially.

In an embodiment, when the interaction area of the course playing page is not enough to display two or more captured images with notes added, a single or multiple thumbnails of the captured images can be displayed in the interaction area, and when multiple thumbnails are displayed, the thumbnails can be sorted according to capturing time or editing time, or can be sorted according to the size of pixels. When a user triggers a single thumbnail in an interaction area, the enlarged thumbnail of the size of a terminal display area can be displayed on a course playing page, and if the original size of the captured image is not enough to fill the whole terminal display area, the original size of the captured image is displayed in the terminal area. And when the user triggers a plurality of thumbnails in the interaction area, the thumbnails can be displayed in the display area of the client in the form of playing images according to the time for triggering the thumbnails and in sequence.

In an embodiment, the user may further select to share or upload the captured image after the note is added, which is displayed in the interaction area, for example, the user may share the captured image after the note is added to other users who watch the course online at the same time, and may also upload the captured image after the note is added to the server, and the server sends the uploaded captured image after the note is added to clients corresponding to other users who watch the online course online.

As can be seen from the above, in the embodiment of the present invention, the client may display a course playing page, where the course playing page includes a content playing area and an interaction area, the content playing area includes a note adding control and a currently played course content, and the interaction area includes an image display control; when the operation of a user for the note adding control is detected, the client displays a note adding page, wherein the note adding page comprises a storage control and an intercepted image of a current content playing area; based on the note adding operation of the user for the note adding page, the client adds a note to the intercepted image of the editable area; when the operation of a user for saving a control of the note adding page is detected, the client edits the edited intercepted image and returns to the display course playing page; and when the operation of the user on the image display control is detected, the client displays the intercepted image added with the note in the interactive area. The scheme can play pictures in a video mode, and can directly edit the captured images, the operation steps are simple and convenient, the playing is not required to be quitted midway, and the editing efficiency is greatly improved.

In order to better implement the method, correspondingly, the embodiment of the invention also provides an image editing device, wherein the image editing device can be integrated in the terminal.

For example, as shown in fig. 11, the image editing apparatus may include a video display unit 401, an editing display unit 402, an editing unit 403, a return display unit 404, and an image display unit 405, and may be as follows:

(1) a video display unit 401;

a video display unit 401, configured to display a video playing page, where the video playing page includes a content playing area and an interaction area, the content playing area includes a content editing control and a currently played video content, and the interaction area includes an image display control;

for example, the video display unit 401 is specifically configured to enable a user to perform a search operation on a content search page to search for video content to be played, set a video search control on the content search page by the user, trigger to display a search result page, and trigger to display a video play page based on a selection operation of the user on the search result page.

(2) An editing display unit 402;

an editing display unit 402, configured to display an image editing page when an operation of the user on the content editing control is detected, where the editing page includes a save control and an intercepted image of a current content playing area;

as shown in fig. 12, the editing and displaying unit 402 may include a positioning subunit 4021, a capturing subunit 4022, and an editing and displaying subunit 4023;

the positioning subunit 4021 is configured to, when detecting that a user operates the content editing control, position a content playing area of a video playing page;

an intercepting subunit 4022, configured to intercept an image of the content playing area according to the positioning result;

an editing display subunit 4023, configured to intercept an image based on the content playing area and display an image editing page;

for example, when detecting an operation of a user on a content editing control, the positioning subunit 4021 positions a content playing area of a video playing page, and according to a positioning result, the capturing subunit 4022 performs image capturing on the content playing area, and based on the captured image of the content playing area, the editing display subunit 4023 displays an image editing page.

(3) An editing unit 403;

an editing unit 403, configured to edit the captured image of the editable area based on an editing operation performed by a user on the image editing page;

as shown in fig. 13, the editing unit may include a superposition subunit 4031 and an editing subunit 4032;

an overlapping subunit 4031, configured to overlap at least one transparent layer on the layer of the intercepted image;

an editing subunit 4032, configured to, when an operation of the user on an editing setting control of the image editing page is detected, display an editing setting list, and acquire setting information of an editing tool control based on a setting operation of the user on the editing tool control; and when the editing operation of the user on the image editing page is detected, editing according to the setting information of the editing tool control.

For example, after the superimposing subunit 4031 superimposes at least one transparent layer on the layer of the intercepted image, the editing subunit 4032 is configured to display an editing setting list when an operation of a user on an editing setting control of the image editing page is detected, and based on a setting operation of the user on the editing tool control, the editing subunit 4032 obtains setting information of the editing tool control; when the editing operation of the user on the image editing page is detected, the editing subunit 4032 edits according to the setting information of the editing tool control.

In an embodiment, as shown in fig. 14, the editing unit 403 may further include a caching subunit 4033 and an updating subunit 4034;

a caching subunit 4033, configured to, when a preview control operation for an image editing page is detected, cache a target video frame in a video according to a current time;

an update subunit 4034, configured to update the background of the canvas to the target video frame;

for example, when a preview control operation for an image editing page is detected, the cache subunit 4033 caches a target video frame in the video according to the current time, and the update subunit 4034 updates the background of the canvas to the target video frame.

(4) Return to the display unit 404;

and a return display unit 404, configured to, when an operation of the user on a save control of the image editing page is detected, save the edited intercepted image, and return to display the video playing page.

For example, the return display unit 404 is specifically configured to, when detecting that the user operates the save control of the image editing page, default that the user edits the captured image on the image editing page, save the editing content of the captured image on the image editing page by the user, save the editing content together with the updated background of the canvas during saving, and return to display the video playback page after saving the image including the editing content and the background of the canvas.

(5) An image display unit 405;

and an image display unit 405, configured to display the edited intercepted image in the interaction area when an operation of the user on the image display control is detected.

As shown in fig. 15, the image display unit 405 may further include a list display sub-unit 4051 and a screenshot display sub-unit 4052;

the list display subunit 4051 is configured to display the edited intercepted image list in the interaction area when an operation of the user on the image display control is detected;

the screenshot displaying subunit 4052, when detecting a selection operation of the user on the edited intercepted image list, displays the updated edited intercepted image according to a preset policy.

For example, when detecting an operation of the user on the image display control, the list display sub-unit 4051 displays the edited clipped image list in the interaction area, and when detecting a selection operation of the user on the edited clipped image list, the screenshot display unit 4052 displays the updated edited clipped image according to a preset policy.

In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.

As can be seen from the above, in the image editing apparatus of this embodiment, the video display unit 401 displays a video playing page, where the video playing page includes a content playing area and an interaction area, the content playing area includes a content editing control and currently played video content, and the interaction area includes an image display control; then, when an operation of the user for the content editing control is detected, an image editing page is displayed by the editing and displaying unit 402, where the image editing page includes a save control and an intercepted image of a current content playing area; based on the editing operation of the user on the image editing page, the editing unit 403 edits the captured image of the editable area; the return display unit 404 is configured to, when detecting an operation of a user on a save control of an image editing page, save the edited captured image and return to display a video playing page; then, when an operation of the user on the image presentation control is detected, the image display unit 405 displays the edited clipped image in the interactive area. The scheme can play pictures in a video mode, and can directly edit the captured images, the operation steps are simple and convenient, the playing is not required to be quitted midway, and the editing efficiency is greatly improved.

In addition, an embodiment of the present invention further provides a computer device, where the computer device may be a terminal or a server, as shown in fig. 16, which shows a schematic structural diagram of a computer device according to an embodiment of the present invention, and specifically:

the computer device may include Radio Frequency (RF) circuitry 501, memory 502 including one or more computer-readable storage media, input unit 503, display unit 504, sensor 505, audio circuitry 506, Wireless Fidelity (WiFi) module 507, processor 508 including one or more processing cores, and power supply 509. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 16 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:

the RF circuit 501 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for receiving downlink information of a base station and then sending the received downlink information to the one or more processors 508 for processing; in addition, data relating to uplink is transmitted to the base station. In general, RF circuit 501 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 501 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.

The memory 502 may be used to store software programs and modules, and the processor 508 executes various functional applications and data processing by operating the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the computer device, and the like. Further, the memory 502 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 508 and the input unit 503 access to the memory 502.

The input unit 503 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, the input unit 503 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 508, and can receive and execute commands sent by the processor 508. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 503 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 504 may be used to display information input by or provided to a user as well as various graphical user interfaces of the computer device, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 504 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 508 to determine the type of touch event, and then the processor 508 provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 16 the touch sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch sensitive surface may be integrated with the display panel to implement input and output functions.

The computer device may also include at least one sensor 505, such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel based on the intensity of ambient light, and a proximity sensor that turns off the display panel and/or backlight when the computer device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the computer device, detailed descriptions thereof are omitted.

Audio circuitry 506, a speaker, and a microphone may provide an audio interface between a user and a computer device. The audio circuit 506 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 506 and converted into audio data, which is then processed by the audio data output processor 508 and then sent to, for example, another computer device via the RF circuit 501, or output to the memory 502 for further processing. The audio circuit 506 may also include an earbud jack to provide communication of peripheral headphones with the computer device.

WiFi belongs to short-distance wireless transmission technology, and the computer equipment can help a user to receive and send emails, browse webpages, access streaming media and the like through the WiFi module 507, and provides wireless broadband internet access for the user. Although fig. 16 shows the WiFi module 507, it is understood that it does not belong to the essential constitution of the computer device, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 508 is a control center of the computer device, connects various parts of the entire cellular phone using various interfaces and lines, and performs various functions of the computer device and processes data by operating or executing software programs and/or modules stored in the memory 502 and calling data stored in the memory 502, thereby integrally monitoring the computer device. Optionally, processor 508 may include one or more processing cores; preferably, the processor 508 may integrate an application processor, which primarily handles operating systems, user interfaces, application programs, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 508.

The computer device also includes a power supply 509 (such as a battery) for powering the various components, which may preferably be logically connected to the processor 508 via a power management system that may be used to manage charging, discharging, and power consumption. The power supply 509 may also include any component such as one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the computer device may further include a camera, a bluetooth module, etc., which will not be described herein. Specifically, in this embodiment, the processor 508 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 502 according to the following instructions, and the processor 508 runs the application programs stored in the memory 502, thereby implementing various functions:

displaying a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and video content which is played currently, and the interaction area comprises an image display control; when the operation of the user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, the edited intercepted image is stored, and meanwhile, a display video playing page is returned; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area.

For example, a content search page of a video playing client is displayed, the content search page comprises a video search control, when the triggering operation of a user for the video search control is detected, a video search result page is displayed by the terminal, and the video playing page is displayed by the terminal based on the selection operation of the user for the search result page; when the operation of a user for a content editing control is detected, a content playing area of a video playing page is positioned, after the content playing area of a courseware is determined according to a positioning result, an image parameter of a courseware video frame in the content playing area is obtained by using a memory snapshot (build DrawingCache) in a front-end interface component (View), a bitmap (bitmap) of the courseware in the content playing area is generated according to the image parameter, and the bitmap is used as an intercepted image of the content playing area. A front end canvas component (canvas) may be invoked to create a canvas of the same size as the content play area, and add the generated bitmap of the content play area to the canvas as the background of the canvas. Calling a dialog box or other interactive components (dialog), adding the intercepted image of the content area and the canvas of the canvas into the dialog box or other interactive components, generating an interactive page by the dialog box or other interactive components, wherein the interactive page is an image editing page, and displaying the image editing page. The method comprises the steps that at least one transparent layer is superposed on an image layer of an intercepted image of an image editing page, when the operation of a user for editing a setting control of the image editing page is detected, an editing setting list is displayed, the editing setting list comprises at least one editing tool control, the setting information of the editing tool control is obtained based on the setting operation of the user for the editing tool control, and when the editing operation of the user for the image editing page is detected, the editing is carried out according to the setting information of the editing tool control; when the operation of the user on the saving control of the image editing page is detected, the default user finishes editing the intercepted image on the image editing page, the editing content of the intercepted image on the image editing page by the user is saved, and the terminal returns to display the video playing page after saving the image containing the editing content and the background of the canvas; when the operation of a user for the image display control is detected, displaying the edited intercepted image list in the interaction area of the video playing page, and when the selection operation of the user for the edited intercepted image list is detected, displaying the updated edited intercepted image according to a preset strategy.

The above operations can be implemented in the foregoing embodiments, and are not described herein.

As can be seen from the above, the embodiment of the present invention can display a video playing page, where the video playing page includes a content playing area and an interaction area, the content playing area includes a content editing control and a currently played video content, and the interaction area includes an image display control; when the operation of the user for the content editing control is detected, displaying an image editing page, wherein the editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to the display video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area. The scheme can play pictures in a video mode, and can directly edit the captured images, the operation steps are simple and convenient, the playing is not required to be quitted midway, and the editing efficiency is greatly improved.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present invention further provide a storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in any one of the image editing methods provided by the embodiments of the present invention. For example, the instructions may perform the steps of:

displaying a video playing page, wherein the video playing page comprises a content playing area and an interaction area, the content playing area comprises a content editing control and video content which is played currently, and the interaction area comprises an image display control; when the operation of the user for the content editing control is detected, displaying an image editing page, wherein the image editing page comprises a storage control and an intercepted image of a current content playing area; editing the intercepted image of the editable area based on the editing operation of the user on the image editing page; when the operation of a user on a storage control of the image editing page is detected, storing the edited intercepted image, and returning to the display video playing page; and when the operation of the user for the image display control is detected, displaying the edited intercepted image in the interactive area.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium can execute the steps in any image editing method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any image editing method provided in the embodiments of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.

The image editing method, apparatus, computer device and storage medium provided by the embodiments of the present invention are described in detail above, and a specific example is applied in the present disclosure to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An image editing method, comprising:

2. The image editing method of claim 1, wherein when the user operation on the content editing control is detected, displaying an image editing page comprises:

when the operation of the user for the content editing control is detected, positioning a content playing area of the video playing page;

according to the positioning result, image interception is carried out on the content playing area;

and displaying an image editing page based on the intercepted image of the content playing area.

3. The image editing method according to claim 2, wherein the image capturing the content playing area according to the positioning result includes:

generating a bitmap of the content playing area according to the image parameters;

and taking the bitmap as an intercepted image of the content playing area.

4. The image editing method according to claim 2, wherein displaying an image editing page based on the captured image of the content playback area includes:

based on the canvas, an image editing page is displayed.

5. The image editing method according to claim 4, wherein the clipped image includes a plurality of layers, and editing the clipped image of the editable area based on the editing operation of the user on the image editing page includes:

superposing at least one transparent layer on the layer of the intercepted image on the canvas;

and editing the intercepted image on the transparent layer based on the editing operation of the user on the image editing page.

6. The image editing method according to claim 5, wherein the image editing page includes an edit setting control, and editing the captured image in the editable area of the transparent layer includes:

when the operation of a user on an editing setting control of the image editing page is detected, displaying an editing setting list, wherein the editing setting list comprises at least one editing tool control;

acquiring the setting information of the editing tool control based on the setting operation of the user for the editing tool control;

7. The image editing method of claim 5, wherein the image editing page comprises a preview control, and after the transparent layer edits the intercepted image, the method further comprises:

when the operation of a preview control for the image editing page is detected, caching a target video frame in the video according to the current time;

updating the background of the canvas to the target video frame.

8. The image editing method according to claim 1, wherein when the operation of the user on the image display control is detected, displaying the edited intercepted image in the interaction area, comprises:

when the operation of a user for the image display control is detected, displaying the edited intercepted image list in the interaction area;

and when the selection operation of the user for the edited intercepted image list is detected, displaying the updated edited intercepted image according to a preset strategy.

9. An image editing apparatus characterized by comprising:

the editing and displaying unit is used for displaying an image editing page when the operation of a user for the content editing control is detected, wherein the editing page comprises a storage control and an intercepted image of a current content playing area;

10. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method according to any of claims 1-8 are implemented when the program is executed by the processor.

11. A storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps of the method according to any of claims 1-8.