CN114581564A

CN114581564A - Processing method and device and electronic equipment

Info

Publication number: CN114581564A
Application number: CN202210257751.6A
Authority: CN
Inventors: 高澍; 张亮
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2022-03-16
Filing date: 2022-03-16
Publication date: 2022-06-03

Abstract

The application discloses a processing method, a device and an electronic device, the application obtains input operation, the input track corresponding to the input operation forms a closed graph, and responds to the input operation, the display area corresponding to the closed graph displays and outputs the display content of at least one multimedia file, therefore, in the application, a user can directly input an input track capable of forming the closed graph on a corresponding interface of the device, the insertion and the display output of the multimedia file are realized by taking the display area corresponding to the closed graph as an insertion area, the operation flow/operation path of the inserted multimedia file is simplified, the insertion efficiency of the multimedia file on the corresponding interface is improved, and the user can achieve the self-defining effect of the display form (size and shape) of the inserted multimedia file by self-defining the position, form, size and other information of the input track, the requirements of the user on the diversified and personalized use of the multimedia file are further met.

Description

Processing method and device and electronic equipment

Technical Field

The application belongs to the technical field of equipment intellectualization, and particularly relates to a processing method and device and electronic equipment.

Background

At present, note application on electronic devices such as mobile phones and tablet computers supports insertion of pictures in note editing, in a traditional picture insertion scheme, a user needs to sequentially select corresponding options from a menu entry according to a path to insert the pictures, the inserted pictures are embedded into a text region according to a default size, the user needs to manually adjust the pictures to a required size according to a fixed length-width ratio of the pictures, the user has a long operation path, the operation is complicated, the efficiency and the flexibility are insufficient, and diversified use requirements of the user on the pictures cannot be met in the text editing.

Disclosure of Invention

Therefore, the application discloses the following technical scheme:

a method of processing, the method comprising:

obtaining input operation, wherein the input operation corresponds to an input track to form a closed graph;

responding to the input operation, and displaying and outputting display content of at least one multimedia file in a display area corresponding to the closed graph;

wherein, the displaying content of at least one multimedia file in the display area corresponding to the closed graph comprises:

determining a display area corresponding to the closed graph;

obtaining at least one multimedia file;

and outputting the display content of the at least one multimedia file in the display area.

Optionally, the determining a display area corresponding to the closed graph includes:

determining the closed graph;

correcting the closed figure into a standard closed figure;

displaying the standard closed graph and determining a display area corresponding to the standard closed graph.

Optionally, the obtaining an input operation includes:

determining the input operation based on the triggering of an inserted key displayed after the input track forms a closed graph;

or, determining the input operation based on the target track after the input track forms a closed graph.

Optionally, the obtaining at least one multimedia file includes:

at least one multimedia file in a selected state is obtained.

Optionally, the obtaining at least one multimedia file includes:

calling a camera assembly of the electronic equipment;

configuring a display area corresponding to the closed graph as a viewfinder for displaying a collected image collected by the camera assembly;

and acquiring a multimedia file based on the shooting instruction, wherein the multimedia file is output in a display area corresponding to the closed graph.

Optionally, wherein outputting the display content of the at least one multimedia file in the display area includes:

obtaining display content matched with a display area corresponding to the closed graph in the at least one multimedia file;

and outputting the display content matched with the display area corresponding to the closed graph in the display area.

Optionally, the obtaining at least one multimedia file in the selected state includes:

displaying a file set inlet in an associated area corresponding to the closed graph;

obtaining at least one multimedia file selected by multimedia file selection through the multimedia file set indicated in the file set entry.

Optionally, the method is applied to a text editing scene, and the method further includes:

saving the text file, wherein the display content of the text file comprises the display content of the at least one multimedia file in a display area corresponding to the closed graph;

wherein the determining the display area corresponding to the closed graph comprises:

and determining a display area corresponding to the closed graph in the text editing interface, and changing the typesetting of the display content in the text editing interface.

A processing apparatus, the apparatus comprising:

the acquisition module is used for acquiring input operation, and the input operation corresponds to an input track to form a closed graph;

the output control module is used for responding to the input operation and displaying and outputting display contents of at least one multimedia file in a display area corresponding to the closed graph;

wherein the output control module includes:

the determining unit is used for determining a display area corresponding to the closed graph;

an acquisition unit for acquiring at least one multimedia file;

and the output control unit is used for outputting the display content of the at least one multimedia file in the display area.

An electronic device, the electronic device comprising:

a memory for storing at least one set of instructions;

a processor for calling and executing said set of instructions in said memory, said processing method as described in any of the above being implemented by executing said set of instructions.

According to the scheme, the processing method, the processing device and the electronic equipment disclosed by the application can obtain the input operation, the input track corresponding to the input operation forms the closed graph, and the display area corresponding to the closed graph is used for displaying and outputting the display content of at least one multimedia file in response to the input operation, therefore, in the application, a user can directly input the input track capable of forming the closed graph on the corresponding interface of the equipment to realize the insertion and display output of the multimedia file by taking the display area corresponding to the closed graph as the insertion area, the operation flow/operation path for inserting the multimedia file is simplified, the insertion efficiency of the multimedia file on the corresponding interface is improved, and the user can define the area form of the insertion area/display area when the multimedia file is inserted by customizing the information such as the position, the form and the size of the input track, correspondingly, the user-defined effect of the display form (size and shape) of the inserted multimedia file is achieved, and the diversified and personalized use requirements of the user on the multimedia file are further met.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

FIG. 1 is a schematic flow diagram of a treatment process provided herein;

FIG. 2(a) is an example provided herein showing an inserted key after an input trace constitutes a closed graph;

FIG. 2(b) is an example of a pause of an operator at the end of an input track after the input track forms a closed graph provided in the present application;

FIG. 2(c) is an example of further inputting a special symbol after the input trace forms a closed graph provided by the present application;

FIG. 3(a) is an example of determining a display area corresponding to a closed figure based on a non-standard closed figure as provided herein;

FIG. 3(b) is an example of a non-standard closed graph obtained by compensation processing provided herein;

FIG. 3(c) is an example of a non-standard closed graph obtained by residual line removal provided herein;

FIG. 4 is a schematic flow chart of determining a display area corresponding to a closed figure according to the present application;

FIG. 5 is an example of determining a display area corresponding to a closed figure based on a corrected standard closed figure as provided herein;

FIG. 6 is a schematic flow chart of obtaining at least one multimedia file provided herein;

FIG. 7 is another schematic flow diagram of the treatment method provided herein;

8(a) -8 (b) are examples of adjusting the layout of the text editing interface for the input text content and the non-input text content based on the closed graph provided in the present application, respectively;

fig. 9(a) -9 (b) are application examples of inserting a matching square/pentagram photo obtained based on photographing into a closed area in the case that the closed graph corresponding to the input track provided by the present application is a square and a pentagram, respectively;

FIG. 10 is a block diagram showing the constitution of a processing apparatus provided in the present application;

fig. 11 is a configuration diagram of an electronic device provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.

The application discloses a processing method, a processing device and electronic equipment, which are used for solving the technical problems that in the traditional technology, when a user inserts a multimedia file (such as a picture) into an equipment interface such as a text editing area, the operation path is complex, the efficiency is low, the flexibility of the insertion operation is low, the diversified use requirements of the user on the multimedia file cannot be met, and the like. The processing method of the present application can be applied to an electronic device with a display device and/or a display interface capable of being connected with a display device, which can be, but is not limited to, any of a variety of general purpose or special purpose computing device environments or configurations with a display device and/or a display device capable of being connected with a display device, for example: personal computers, server computers, hand-held or portable devices, tablet-type devices, AR/VR devices, multi-processor devices, and the like.

The method can be suitable for performing multimedia file insertion and display processing on any display interface on a display device of the electronic equipment and/or an external display device, wherein the display interface can be but is not limited to a system desktop of the electronic equipment or any application interface, such as application interfaces of notebooks, words/excel/ppt and the like.

The processing procedure of the processing method disclosed in the embodiment of the present application is as shown in fig. 1, and at least includes:

step 101, obtaining input operation, wherein the input operation corresponds to an input track to form a closed graph.

The obtained input operation specifically includes an operation that a user inputs a corresponding track capable of forming a closed graph on a display interface (such as a text editing interface of note notes, a system desktop, and the like) of the multimedia file to be inserted, and the obtained input operation is used for indicating that the multimedia file is inserted into a corresponding display area of the closed graph on the display interface.

In this embodiment, when a user needs to insert a multimedia file into a display interface (e.g., a text editing interface of note notes) of an electronic device, a user operation body (e.g., a finger/stylus/mechanical arm, etc.) is supported to automatically define the position, shape, and size of a specific insertion area when the multimedia file is inserted into the display interface by inputting a corresponding trajectory capable of forming a closed graph in a region required by the display interface. The position, shape and size of the insertion area, namely the position, shape and size of the input track in the display area corresponding to the display interface, can be customized by a user according to the actual insertion requirement of the multimedia file.

The user may be a natural person or an unnatural person (e.g., a robot), without limitation.

The closed graph formed by the input trajectory corresponding to the input operation may be, but is not limited to, a closed graph formed by a circular trajectory, a heart-shaped trajectory, a pentagram-shaped trajectory, or any irregular input trajectory based on the input, and a closed graph formed by a circular trajectory, a heart-shaped trajectory, a pentagram-shaped trajectory, or any irregular shape.

Optionally, the input trajectory corresponding to the input operation may form a closed graph, where the original input trajectory corresponding to the input operation may form a closed graph, or the trajectory obtained by processing (e.g., compensating and/or correcting) the original input trajectory corresponding to the input operation may form a closed graph, which is not limited herein. Optionally, in the process that the user operation body inputs the corresponding input track on the corresponding display interface of the electronic device, the electronic device synchronously and visually displays the input track line at the input position, so that the user can watch the input track line conveniently.

In this step 101, the input operation is obtained, and may be further implemented as any one of the following 11) to 12):

11) and determining the input operation based on the triggering of the insertion key displayed after the input track forms the closed graph.

In this embodiment 11), during the process that the user operation body draws the input trajectory on the corresponding display interface of the electronic device, the electronic device detects whether the input trajectory of the user operation body constitutes a closed graph, and displays an insertion key in response to detecting that the input trajectory constitutes the closed graph (e.g., the drawn original trajectory constitutes the closed graph, or, after the operation body leaves the display interface, the trajectory obtained after performing compensation and/or correction processing on the drawn original trajectory constitutes the closed graph), as specifically shown in fig. 2 (a).

The displayed insertion key is used for providing a trigger function of inserting the multimedia file into the display area corresponding to the closed graph, and a user can trigger an instruction for indicating the insertion of the multimedia file into the display area corresponding to the closed graph by operating the insertion key, such as clicking/double clicking/long pressing.

This embodiment 11), correspondingly, the input operation is determined based on the triggering of the insertion key displayed after the input trace forms the closed graph, that is, the electronic device forms the closed graph based on the input trace detected by the operation body on the display interface of the electronic device, and detects the triggering event of the insertion key displayed after the closed graph is formed, and the operation of the operation body is determined as the input operation for instructing to insert the multimedia file into the display area corresponding to the closed graph. On the contrary, if the electronic device detects that the input track of the operation body on the display interface of the electronic device forms a closed graph, but does not detect the trigger event of inserting the key after the closed graph is formed, the operation of the operation body is recognized as the conventional graph drawing operation on the display interface of the electronic device, such as drawing a square, a circle, a heart and other shapes on the display interface to obtain the graph with the required shape.

12) And determining the input operation based on the target track after the input track forms a closed graph.

In this embodiment 12), in a process that the user operation body draws an input trajectory on the corresponding display interface of the electronic device, the electronic device detects whether the input trajectory of the user operation body forms a closed graph, and continues to detect whether the operation body further inputs a target trajectory to the display interface after detecting that the closed graph is formed (for example, the drawn original trajectory forms the closed graph, or after detecting that the operation body leaves the display interface, a trajectory obtained by performing compensation and/or correction processing on the drawn original trajectory forms the closed graph).

And determining the input operation based on the target track after the input track forms a closed graph. That is to say, the electronic device forms a closed graph based on the detected input track of the operation body on the display interface of the electronic device, and the operation body further inputs a target track after the detection of the formation of the closed graph, and determines that the operation of the operation body is an input operation for instructing to insert the multimedia file into the display area corresponding to the closed graph. On the contrary, if the electronic device detects that the input track of the operation body on the display interface of the electronic device forms a closed graph, but does not detect that the operation body further inputs a target track after the closed graph is formed, the operation of the operation body is recognized as a conventional graph drawing operation on the display interface of the electronic device.

The target track may be a track shape set at will or a special symbol (the special symbol essentially corresponds to a certain track shape), such as a point, or a special symbol such as an arrow, a tick, an asterisk, etc. And preferably, the target track is further input at the tail of the input track which can form a closed figure.

Accordingly, the one point is a point constituting the end of the input trace of the closed figure. In this embodiment where the target trajectory is one point, it may be specifically detected whether the operation body pauses for a period of time after drawing the input trajectory capable of forming the closed graph (the operation body such as a hand/stylus pen pauses for a period of time at a point at the end of the closed graph without leaving the device interface), that is, whether the pause time exceeds a set time threshold, if so, it indicates that the target trajectory of "one point" is further detected at the end of the input trajectory forming the closed graph, and accordingly, the operation of the operation body is determined as an input operation for instructing to insert the multimedia file into the display area corresponding to the closed graph. Otherwise, if the operation body does not pause at the tail of the input track or the pause time does not reach the duration threshold value, the target track is not detected, and the operation of the operation body is correspondingly recognized as the conventional graph drawing operation.

Referring to fig. 2(b) and fig. 2(c), respectively, in fig. 2(b), after it is detected that an input track of a user on a display interface of an electronic device forms a closed graph, based on further detection that a user operation body pauses for a period of time reaching a preset time length at the end of the input track, determining an operation of the user as an input operation for instructing to insert a multimedia file into a display area corresponding to the closed graph; in fig. 2(c), based on the fact that the user operation body is detected to further input the special symbol of the number matching at the tail of the input track after completing the input of the input track, the user operation is determined as the input operation for instructing to insert the multimedia file into the display area corresponding to the closed graph formed by the input track.

In addition, in practical application, the user may input the input trajectory that can be used to form the closed graph, where the user operation body is implemented in a line drawing manner, such as drawing a heart-shaped line, or in other embodiments, a series of graphical controls that can be selected by the user may be provided on a corresponding editing interface, each graphical control corresponds to a graphical template of a corresponding shape, such as a circular control, a heart-shaped template, a square template, and a circular control, a heart-shaped control, a square control, and a pentagonal control that respectively correspond to a circular template, a heart-shaped template, a square template, and a pentagonal template, and the user may input the trajectory of a desired shape and size in a corresponding editing area of the electronic device interface by operating the desired graphical controls, such as dragging and zooming the graphical controls, so as to form the closed graph of the corresponding shape and size.

The corresponding editing interface for displaying the graphical control may be an application interface (e.g., an editing interface of an application such as word/note pad/excel) of any application on the electronic device or a system desktop, and for a situation of the system desktop, optionally, a user may call up the graphical control on the system desktop through an input command such as a preset gesture or voice.

Optionally, for the closed graph of the square, the user may also obtain the corresponding square by inputting a straight line segment, for example, the electronic device specifically uses the input straight line segment as a diagonal line, and generates and displays and outputs the square using the input straight line segment as the diagonal line.

And 102, responding to input operation, and displaying and outputting display content of at least one multimedia file in a display area corresponding to the closed graph.

As shown in fig. 1, in step 102, outputting the display content of at least one multimedia file in the display area corresponding to the closed graph includes:

and step 1021, determining a display area corresponding to the closed graph.

The closed graph formed by the input trace corresponding to the input operation may be a standard graph or a non-standard graph, and is not limited.

Correspondingly, in an embodiment, a graph formed by a trace line of an original input trace drawn by a user may be directly determined as the closed graph (non-standard graph), and an area inside the closed graph on a display interface, that is, an area on the electronic device interface that is bounded by the trace line of the non-standard graph, is determined as a display area corresponding to the closed graph, so as to retain the personalized characteristics of the graph shape drawn by the user in a customized manner, which is specifically shown in fig. 3 (a).

In this embodiment of obtaining a closed graph and a corresponding display area based on an original input track drawn by a user, in some cases, a track line of the original input track drawn by the user does not form a complete closed graph, but meets an approach condition for representing an approach to closure, in this case, optionally, a corresponding closed graph is obtained by performing compensation processing on the track line of the original input track drawn by the user, where the compensation processing includes, but is not limited to, adding a straight line, an arc line, or any irregular shape line segment to a corresponding position of the input track input by the user according to an existing input track characteristic of the user, so as to obtain the closed graph, which may specifically refer to the example of fig. 3 (b). The approaching condition may be, but not limited to, that a ratio of the existing input trajectory to a missing part of the corresponding closed figure to the existing input trajectory is smaller than a preset ratio.

Or, in other cases, the original input trajectory drawn by the user already constitutes a complete closed graph and further includes a part of residual lines on the basis of the closed graph, in this case, after it is determined that the user operation is an input operation for instructing to insert a multimedia file into the display area corresponding to the closed graph, the residual lines are directly removed, as in the example provided in fig. 3 (c).

In another embodiment, a trace line of an original input trace drawn by a user may be processed, and a standard graph obtained by the processing may be used as the closed graph, and then a display area corresponding to the closed graph is determined based on the standard graph obtained by the processing, in this embodiment, referring to fig. 4, a process of determining the display area corresponding to the closed graph may be further implemented as:

step 401, determining the closed graph;

the closed graph refers to a non-standard closed graph determined based on an original input track drawn by a user. Specifically, the non-standard closed graph may be a non-standard closed graph strictly corresponding to the original input trajectory of the user, or a non-standard closed graph obtained by compensating the original input trajectory of the user or removing a residual line.

Step 402, correcting the closed graph into a standard closed graph.

After a non-standard closed graph is determined based on an original input track drawn by a user, according to graph features (such as curvature, inflection point positions, number and the like of graph lines) of the non-standard closed graph, the similarity between the non-standard closed graph and each preset graph template is calculated, the graph template with the maximum similarity is selected as a target graph template matched with the non-standard closed graph, the non-standard closed graph is corrected into a standard closed graph based on the determined target graph template, and for example, the non-standard heart-shaped graph drawn by the user is corrected into a standard heart-shaped graph based on the determined heart-shaped template.

Preferably, the area of the display region corresponding to the non-standard closed figure (i.e., the display region on the interface of the electronic device that is bounded by the line of the non-standard closed figure) is not changed or is changed as little as possible by the correction process.

And 403, displaying the standard closed graph and determining a display area corresponding to the standard closed graph.

After the corresponding standard closed graph is obtained through the graph correction processing, the standard closed graph is displayed on a display interface of the electronic equipment, and a display area on the display interface and with a graph line of the standard closed graph as a boundary is determined as a display area corresponding to the standard closed graph, wherein the display area is the display area corresponding to the closed graph determined in the step 1021. See in particular the example of fig. 5.

Step 1022, at least one multimedia file is obtained.

After the display area corresponding to the closed graph is determined, at least one multimedia file is further obtained to support inserting the multimedia file into the display area corresponding to the closed graph and performing display output processing on the inserted multimedia file.

An alternative embodiment of the obtaining of the at least one multimedia file is obtaining the at least one multimedia file in a selected state. The at least one multimedia file in the selected state may refer to a multimedia file that has been selected previously, for example, before a user draws an input track of a closed graph, one or more photos are selected from a photo album, a local/network gallery, or other picture sets, or a section of small video is selected, and the one or more selected photos or the small video is used as the at least one multimedia file in the selected state, so as to obtain the at least one multimedia file.

But not limited to, the at least one multimedia file in the selected state may also be a multimedia file selected from an associated region corresponding to the current closed graphic, and the associated region corresponding to the current closed graphic may refer to the display region itself corresponding to the closed graphic, or may be a corresponding region within a preset distance range around the display region.

In this embodiment, after the electronic device determines the display area corresponding to the closed graph, in response to determining the display area, at least one file set entry is displayed in a corresponding area (i.e., the associated area) within or outside the display area within a preset distance range, where each file set entry indicates a corresponding multimedia file set, such as an album/video set, and the displayed file set entry may be, but is not limited to, an album/gallery file icon, or a video set icon. And the user operates the corresponding file set inlet in the display area corresponding to the closed graph or the corresponding file set inlet in the preset distance range outside the display area, so that the corresponding multimedia file set such as an album, a gallery or a video set can be entered, the required multimedia file is selected, the selected multimedia file such as at least one photo/picture and/or video in the selected state is correspondingly obtained, and the acquisition of the at least one multimedia file is realized.

In other embodiments, referring to fig. 6, obtaining at least one multimedia file may also be implemented as:

step 601, calling a camera assembly of the electronic equipment.

Namely, in response to determining the display area corresponding to the closed graph, the camera assembly of the electronic equipment is started to be in a shooting state.

Step 602, configuring a display area corresponding to the closed graph as a viewfinder for displaying the acquired image acquired by the camera assembly.

Meanwhile, a display area corresponding to the closed figure is configured as a viewfinder, and image information shot by the camera assembly in a shooting state is displayed in the viewfinder.

It is easy to understand that the size and shape of the view area provided by the view finder are the size and shape of the display area corresponding to the closed graph, respectively, and the view finder displays a corresponding preview picture for a user to preview the picture based on image acquisition data transmitted by a camera assembly of the electronic device, and the user can change the content of the preview picture in the view finder by moving the electronic device, and the user can implement close-range or long-range preview by adjusting the depth of field of the preview picture in the view finder.

The image acquisition data transmitted to the viewfinder by the camera assembly of the electronic equipment can be complete image information which is acquired by a photosensitive element of the camera assembly and corresponds to the whole photosensitive area of the camera assembly, wherein the image information in the viewfinder window in the complete image information is in a display state and can be previewed by a user, and the image information outside the viewfinder window is in a hidden state. The image data transmitted from the camera head to the viewfinder may be partial image information matching the shape and size of the viewfinder area in the entire image information of the entire photosensitive area, and the viewfinder performs image preview matching in the viewfinder directly based on the image data transmitted from the camera head.

Step 603, a multimedia file is obtained based on the shooting instruction, and the multimedia file is output in a display area corresponding to the closed graph.

In addition, for the embodiment of obtaining at least one multimedia file provided in fig. 6, while the camera assembly of the electronic device is invoked and the display area corresponding to the closed graphic is configured as a viewfinder to display a preview picture, a shooting control, such as a shooting button, is displayed within the display area corresponding to the closed graphic or within a preset distance range outside the display area corresponding to the closed graphic, so as to provide a function of obtaining at least one multimedia file based on a shooting or video recording manner to a user through the shooting control.

When the user operates (such as clicks) the shooting control, in response to a shooting instruction such as shooting or video recording generated by triggering of shooting control, the electronic device performs shooting or video recording to obtain a corresponding shot photo or obtain a multimedia file such as a recorded video when a recording ending instruction is further obtained.

And 1023, outputting the display content of the at least one multimedia file in the display area.

After the at least one multimedia file is obtained, further obtaining the display content matched with the display area corresponding to the closed graph in the at least one multimedia file, and displaying and outputting the display content matched with the display area corresponding to the closed graph in the display area.

And the display content matched with the display area corresponding to the closed graph in the multimedia file is the display content matched with the size and the shape of the area in the multimedia file and the size and the shape of the display area.

According to the acquisition mode of acquiring the at least one multimedia file in the selected state, the display area corresponding to the closed graph can be configured as a picture cropping window, and a user is supported to execute required cropping operation on the selected multimedia file through the window to obtain the display content matched with the display area corresponding to the closed graph. Specifically, the electronic device may place a current multimedia file of the obtained at least one multimedia file on a lower layer of the picture cropping window for displaying, for example, place a rectangular photo or video frame on the lower layer of the picture cropping window for displaying, where a content of the current multimedia file located inside the picture cropping window is in a display state and a content of the current multimedia file located outside the picture cropping window is in a hidden state, and a user may change a display content of the current multimedia file in the picture cropping window by dragging and moving the current multimedia file in the picture cropping window, or may zoom a display content in the picture cropping window until a desired display content is obtained in the picture cropping window, and further perform a corresponding cropping operation, such as pressing a function button for triggering cropping processing, or performing a preset cropping gesture, or inputting a voice instruction for instructing to cut and the like, so that the electronic equipment cuts the display content positioned in the picture cutting window in the current multimedia file by responding to the cutting instruction. And cutting the obtained display content in the picture cutting window, namely the display content matched with the display area corresponding to the closed graph in the multimedia file, so as to embed the display area corresponding to the closed graph and perform display output.

And then, the user can obtain the next picture/video frame to be edited in the at least one multimedia file by executing picture switching or video playing progress control on the multimedia file in the picture trimming window, and the next picture/video frame to be edited is placed at the lower layer of the picture trimming window for the user to edit until all the files in the at least one multimedia file are edited, and all display contents which are used for being embedded into the display area corresponding to the closed graph and displayed and output in the display area are obtained.

For this acquisition mode of acquiring multimedia files based on shooting instructions, in one embodiment, the camera assembly directly transmits raw image acquisition information (a shot image, or a recorded video frame) acquired by its photosensitive element, such as a CCD (Charge-coupled Device), to the viewfinder for display, and the current application of the electronic Device (e.g., a memo application or Device system) responds to the acquired transmitted image acquisition data, displays it based on the viewfinder window, wherein the image content inside the viewfinder window is in a display state, the image content outside the viewfinder window is in a hidden state, and cutting the display content positioned in the viewfinder window into the display content which is used for embedding the display area corresponding to the closed graph, namely the display content which is matched with the display area corresponding to the closed graph in the multimedia file. .

Or, in other embodiments, the photosensitive area of the photosensitive element of the camera assembly and the display area corresponding to the closed figure are not in an equal ratio relationship, in this embodiment, the area size and the shape information of the viewfinder are acquired, and the matched acquisition data is transmitted based on the area size and the shape information of the viewfinder, that is, the part of the acquisition data matched with the size and the shape of the viewfinder area in the photosensitive area of the photosensitive element, that is, the display content matched with the display area corresponding to the closed figure in the multimedia file, so that the display content such as the image information or the video frame information matched with the size and the shape of the closed figure can be displayed in the viewfinder directly based on the transmitted acquisition data.

In the case where the at least one multimedia file includes a plurality of multimedia files, the at least one multimedia file has a plurality of display contents corresponding to the display area corresponding to the closed figure, such as a plurality of heart-shaped image areas (heart-shaped image areas in a photo or video frame) obtained by cropping, or a plurality of heart-shaped image areas of matching shapes directly conveyed according to the shape and size of the display area (viewfinder). For a plurality of display contents matched with the display area corresponding to the closed graph, the display contents (e.g., a plurality of heart-shaped or square-shaped image areas) may be displayed and output in the display area corresponding to the closed graph by, but not limited to, tiling or stacking, and in the stacked display mode, a switching instruction for each stacked display content may be triggered by gestures, control operations, and/or voices, so as to switch the display content output by the current uppermost layer of the display area.

It can be known from the above solutions that, in the method of the embodiment of the present application, an input operation is obtained, an input trajectory corresponding to the input operation forms a closed graph, and the display area corresponding to the closed graph displays and outputs the display content of at least one multimedia file in response to the input operation, and thus, in the present application, a user can directly input an input trajectory capable of forming a closed graph on a corresponding interface of a device to implement multimedia file insertion and display output by using the display area corresponding to the closed graph as an insertion area, an operation flow/operation path for inserting a multimedia file is simplified, the insertion efficiency of the multimedia file on the corresponding interface is improved, and the user can define the area form of the insertion area/display area when inserting the multimedia file by customizing information such as the position, form, size, and the like of the input trajectory, correspondingly, the user-defined effect of the display form (size and shape) of the inserted multimedia file is achieved, and the diversified and personalized use requirements of the user on the multimedia file are further met.

Optionally, in an embodiment, the processing method disclosed in the present application is applied to a text editing scenario, which may be but is not limited to a text editing scenario of an application such as a memo application or a word/excel/ppt application, and referring to a processing method flowchart shown in fig. 7, in the application scenario, after step 102, the processing method disclosed in the present application may further include the following processing:

step 103, storing the text file, wherein the display content of the text file comprises the display content of the at least one multimedia file in the display area corresponding to the closed graph.

Specifically, the currently edited text file may be saved in response to a saving instruction (e.g., a saving instruction triggered by operating a saving button/saving icon) for the currently edited text file (e.g., a memo file, a word file). The display content of the saved text file includes the display content of the at least one multimedia file in the display area corresponding to the closed figure, such as the image content of a heart shape or the content of a video frame, and besides, the display content of the saved text file may also include, but is not limited to, the content of an input text, a conventionally drawn figure, and the like.

In this embodiment, determining the display area corresponding to the closed graph may further be implemented as: and determining a display area corresponding to the closed graph in the text editing interface, and changing the typesetting of the display content in the text editing interface.

The process of determining the display area corresponding to the closed graphic in the text editing interface may refer to the related description of the above embodiment, and is not described in detail here.

Specifically, according to the position of the display area corresponding to the closed graph in the text editing interface, the typesetting of the display content in the text editing interface is changed, so that at least the position area of the display area on the text editing interface is reserved for embedding and displaying and outputting the multimedia file.

After an input track forming a closed graph is input in a corresponding area of a text editing interface, triggering the change of the text content typesetting on the text editing interface, wherein the dynamic adaptive adjustment is carried out on the text content typesetting layout on the text editing interface according to the area position of the closed graph corresponding to the input track in the text editing interface, the adjustment at least configures the area position of the closed graph in the text editing interface into a non-text editing area, and the area outside the area position of the closed graph in the text editing interface is a text editing area.

It should be noted that, the above processing procedure is applicable to both an application scenario in which the text editing interface already contains text content before the input trajectory is drawn and an application scenario in which the text editing interface does not contain text content before the input trajectory is drawn, and for the former scenario, as shown in fig. 8(a), in response to the input trajectory being input at a certain region position of the text editing interface, the attribute of the display region corresponding to the closed graph formed by the input trajectory is adjusted to be the "non-text editing region" attribute, and meanwhile, the layout of the existing text content on the text editing interface is dynamically changed, so that the region in the closed graph corresponding to the input trajectory is reserved for inserting multimedia files; for the latter application scenario, as shown in fig. 8(b), in response to the input track being input at a certain area position of the text editing interface, the attribute of the display area corresponding to the closed graph formed by the input track is adjusted to be a "non-text editing area" attribute, so that when text content is subsequently input into the text editing interface, text content is prevented from being input into the display area corresponding to the closed graph.

When a text file with an inserted multimedia file is saved, the inserted multimedia file becomes a part of the content of the text file, for example, when an input track forming a closed graph is drawn in a word file, and a picture is inserted into a display area corresponding to the closed graph formed by the input track, when the word file is saved, the picture becomes a part of the content of the word file, that is, the word file contains both edited text content (such as characters and characters) and the inserted picture, and simultaneously saves the typesetting layout information of each content (text and picture) of the file.

Subsequently, when the saved text file is opened, at least one embedded multimedia file display content matched with the display area in the user-defined position, shape and size of the text file interface can be viewed, the diversified use requirements of the user on pictures in text editing are met, in the text editing stage, the user can directly input an input track capable of forming a closed graph in the corresponding interface of the equipment to realize multimedia file insertion and display output by taking the display area corresponding to the closed graph as an insertion area, referring to fig. 9(a) and 9(a), when the closed graph corresponding to the input track is a square and a pentagram, respectively, an application example based on the matched square/pentagram photo obtained by photographing is inserted into the closed area, obviously, the operation flow/operation path for inserting the multimedia file is simplified, the insertion efficiency of the multimedia file in the corresponding interface is improved.

It should be noted that the embodiment of the present application is not limited to where the input track capable of forming the closed graph (for inserting the multimedia file) is input, and any area with an input function may input the input track, for example, a text editing area of a text editing interface, a graph drawing area of a graph drawing interface, an information input area provided by various input boxes (e.g., a chat input box and a form input box of instant messaging software), a search information input area provided by a search bar (a search bar of a network search engine, a search bar of a device file search function), and the like.

Taking a chat input box of instant messaging software as an example, if a user needs to send a small customized animation to the opposite side, a customized input track, such as a heart-shaped track, can be directly drawn in the chat input box, image insertion can be carried out on a heart-shaped display area corresponding to the heart-shaped track based on modes of video shooting or multi-picture selection (such as selecting a plurality of pictures from an album), editing and the like, and an animation file in the heart shape is formed and sent to the opposite side. Taking a search bar of a search engine as an example, a user can self-define and draw an input track with a required shape in a search information input area of the search bar according to requirements to form a closed graph, and insert a picture carrying required retrieval information into a corresponding area of the closed graph, so that information retrieval is realized at least based on the information of the picture.

In addition, closed graphics with a required shape can be drawn in any position of a desktop of a system (such as android, apple and the like) of the electronic equipment in a customized mode, the association relationship between the closed graphics and corresponding applications (such as some instant chat application) or corresponding path files (such as an album) on the equipment is configured, and the closed graphics drawn in the customized mode can be displayed on the desktop of the system as small components of the associated applications/files. The closed graph displayed on the desktop in the form of small component functions can be used as a portal to enter the associated application/file, and after the associated application/file is entered, a user is supported to select one or more multimedia files (pictures, videos and the like) according to requirements, and scaling, cutting and other processing on the multimedia files are supported to be performed on the basis of the closed graph corresponding to the small component, so that the multimedia file content matched with the shape of the closed graph is inserted into the closed graph, and on the basis, the closed graph corresponding to the small component is further supported to be used as a playing window on the desktop of the system, and each inserted multimedia file content matched with the closed graph is dynamically presented according to a certain rule (such as circular playing).

When the user needs to change the content of the multimedia file presented by the widget, the user can enter the associated application/file by taking the widget as an entrance again, and the content of the inserted multimedia file is adjusted by executing the processing of deleting, adding and the like to the inserted multimedia file. Of course, the small component can also be used as an entrance of a camera assembly of the device, and photo/video shooting is performed by calling the camera assembly, so that photo/video content with a shape matched with the closed graph is inserted into the area where the closed graph corresponding to the small component is located.

Optionally, the electronic device adaptively adjusts a layout position of each display content (such as various application icons and file icons) on the system desktop according to a corresponding area position of the widget on the system desktop.

In the application scene, the small component realized based on the input track of the user can be drawn by the user in a personalized and self-defined way at the position of the system desktop and the display area corresponding to the small component and used for inserting and presenting the multimedia content, and the multimedia content presented based on the small component is matched with the shape of the closed graph drawn by the user in a customized way, so that the user operation is flexible, and the personalized requirements of the user are better met.

Corresponding to the processing method, an embodiment of the present application further discloses a processing apparatus, where a composition structure of the processing apparatus is shown in fig. 10, and the processing apparatus specifically includes:

the acquisition module 10 is configured to acquire an input operation, where the input operation corresponds to an input trajectory to form a closed graph;

the output control module 20 is configured to respond to the input operation, and display and output display content of at least one multimedia file in a display area corresponding to the closed graph;

wherein the output control module includes:

a determining unit 201, configured to determine a display area corresponding to the closed graph;

an obtaining unit 202, configured to obtain at least one multimedia file;

an output control unit 203, configured to output the display content of the at least one multimedia file in the display area.

In an embodiment, the determining unit 201 is specifically configured to:

determining the closed graph;

correcting the closed figure into a standard closed figure;

In an embodiment, the obtaining module 10 is specifically configured to:

In an embodiment, the obtaining unit 202 is specifically configured to:

at least one multimedia file in a selected state is obtained.

In an embodiment, the obtaining unit 202 is specifically configured to:

calling a camera assembly of the electronic equipment;

In an embodiment, the output control unit 203 is specifically configured to:

In an embodiment, when obtaining at least one multimedia file in the selected state, the obtaining unit 202 is specifically configured to:

In one embodiment, the apparatus is applied to a text editing scene, and the apparatus further includes:

the storage module is used for storing the text file, and the display content of the text file comprises the display content of the at least one multimedia file in a display area corresponding to the closed graph;

In addition, embodiments of the present application also disclose an electronic device, which may be, but is not limited to, any of numerous general purpose or special purpose computing device environments or configurations, such as: personal computers, server computers, hand-held or portable devices, tablet-type devices, multi-processor appliances, and the like.

As shown in fig. 11, the structure of the electronic device at least includes:

a memory 1101 for storing a set of computer instructions;

the set of computer instructions may be embodied in the form of a computer program.

A processor 1102 for implementing a processing method as disclosed in any one of the above method embodiments by executing a set of computer instructions.

The processor 1102 may be a Central Processing Unit (CPU), an application-specific integrated circuit (ASIC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, etc.

Optionally, the electronic device is provided with a display device and/or a display interface, and can be externally connected with the display device.

The electronic equipment further comprises a camera assembly and/or is connected with an external camera assembly.

Besides, the electronic device may further include a communication interface, a communication bus, and the like. The memory, the processor and the communication interface communicate with each other via a communication bus.

The communication interface is used for communication between the electronic device and other devices. The communication bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like, and may be divided into an address bus, a data bus, a control bus, and the like.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.

For convenience of description, the above system or apparatus is described as being divided into various modules or units in terms of functions, respectively. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.

Finally, it is further noted that, herein, relational terms such as first, second, third, fourth, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. A method of processing, the method comprising:

determining a display area corresponding to the closed graph;

obtaining at least one multimedia file;

2. The method of claim 1, the determining a display area to which the closed graphic corresponds, comprising:

determining the closed graph;

correcting the closed figure into a standard closed figure;

3. The method of claim 1, the obtaining input operations comprising:

4. The method of claim 1, the obtaining at least one multimedia file comprising:

at least one multimedia file in a selected state is obtained.

5. The method of claim 1, the obtaining at least one multimedia file comprising:

calling a camera assembly of the electronic equipment;

and acquiring a multimedia file based on the shooting instruction, and outputting the multimedia file in a display area corresponding to the closed graph.

6. The method of claim 1, wherein outputting the display content of the at least one multimedia file in the display area comprises:

7. The method of claim 4, the obtaining at least one multimedia file in a selected state comprising:

8. The method of claim 1, applied to a text editing scenario, further comprising:

9. A processing apparatus, the apparatus comprising:

wherein the output control module includes:

an acquisition unit for acquiring at least one multimedia file;

10. An electronic device, the electronic device comprising:

a memory for storing at least one set of instructions;

a processor for invoking and executing said set of instructions in said memory, said processing method as claimed in any one of claims 1-8 being implemented by executing said set of instructions.