CN114554133A - Information processing method and device and electronic equipment - Google Patents

Information processing method and device and electronic equipment Download PDF

Info

Publication number
CN114554133A
CN114554133A CN202210162602.1A CN202210162602A CN114554133A CN 114554133 A CN114554133 A CN 114554133A CN 202210162602 A CN202210162602 A CN 202210162602A CN 114554133 A CN114554133 A CN 114554133A
Authority
CN
China
Prior art keywords
target
historical
image
content
intercepting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210162602.1A
Other languages
Chinese (zh)
Other versions
CN114554133B (en
Inventor
李刚
孙楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202210162602.1A priority Critical patent/CN114554133B/en
Publication of CN114554133A publication Critical patent/CN114554133A/en
Application granted granted Critical
Publication of CN114554133B publication Critical patent/CN114554133B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions

Abstract

The application provides an information processing method, an information processing device and electronic equipment, wherein in the process of outputting a video stream by a first application in the electronic equipment, target content in a target image to be output at the current moment is intercepted based on at least two historical intercepting operations aiming at the video stream to obtain a target image; the historical intercepting operation intercepts target contents in a historical image output at a historical moment in the video stream, the information contained in the target contents intercepted by the two random historical intercepting operations is different, and a target picture set is obtained by a plurality of target pictures obtained by intercepting for a plurality of times. In the process of outputting the video by the online conference, the target content is the presentation output in the online conference, the presentation in different frame images is intercepted for many times, the presentation in the output image at the current moment is automatically intercepted to obtain a picture set, a participant does not need to record the video in the process of participating in the conference, and the time consumption caused by watching the video is reduced.

Description

Information processing method and device and electronic equipment
Technical Field
The present application relates to the field of information technologies, and in particular, to an information processing method and apparatus, and an electronic device.
Background
The conventional conference has problems of low efficiency and high cost due to the labor of the boat and the vehicle, and thus the online conference is gradually popularized by compensating the problems.
In an online conference, a main speaker displays a file online and explains the file, for example, explains a PPT (PowerPoint, presentation), but does not share the explained file after the conference.
Therefore, during the conference, the participants need to record the conference in various ways. For example, videos are recorded during a meeting, but the recorded videos are long, so that the videos are watched for a long time after meeting, and the meeting content cannot be efficiently reviewed.
Disclosure of Invention
In view of the above, the present application provides an information processing method, comprising:
an information processing method comprising:
acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations of intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different;
and obtaining a target picture set based on the at least two target pictures.
Optionally, in the method, the determining, based on at least two historical capturing operations performed on the video stream, that the target content of the target image is captured to obtain a target picture includes:
acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
and determining that the target content of the target image meets the condition of triggering an interception instruction, and intercepting the target content of the target image to obtain a target picture.
Optionally, before the obtaining of the target image to be output at the current time in the video stream, the method further includes:
analyzing the historical intercepting operation to obtain an intercepting area, wherein the intercepting area corresponds to a display area of target content in the historical image;
and generating an intercepting instruction, wherein the intercepting instruction is used for intercepting the display area of the target content.
Optionally, the method for determining that the target content of the target image meets a condition of triggering an interception instruction and intercepting the target content of the target image to obtain the target picture includes:
based on the detection of the target image update, determining that the target content of the target image meets the condition of an interception triggering instruction;
analyzing the target image and determining a display area of target content in the target image;
and intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content.
Optionally, the method for detecting whether the target image is updated includes:
analyzing whether a first target content is the same as a second target content, wherein the first target content is a target content in a target image output at the current moment, and the second target content is a target content in a history image output at an adjacent moment before the current moment;
and if the first target content is different from the second target content, determining that the target image is updated.
Optionally, after obtaining the target picture set based on the at least two target pictures, the method further includes:
identifying information contained in at least two target pictures in the target picture set;
and reserving one of any two target pictures based on the condition that the information of any two target pictures meets the same condition.
An information processing apparatus comprising:
the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a target image to be output at the current moment in a video stream, and the video stream is output by a first application in the electronic equipment;
the processing module is used for determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations for intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
Optionally, in the foregoing apparatus, the processing module includes:
the acquisition unit is used for acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
and the intercepting unit is used for determining that the target content of the target image meets the condition of an intercepting triggering instruction, and intercepting the target content of the target image to obtain a target picture.
Optionally, in the above apparatus, the intercepting unit includes:
the detection subunit is used for determining that the target content of the target image meets a condition of triggering an interception instruction based on the detection of the update of the target image;
the analysis subunit is used for analyzing the target image and determining a display area of target content in the target image;
and the intercepting subunit is used for intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content.
An electronic device, comprising:
a display device for outputting a video stream;
the input device is used for receiving the intercepting operation of the operation body;
the processor is used for acquiring a target image to be output at the current moment in a video stream, wherein the video stream is the video stream output by a first application in the electronic equipment; determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations of intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
According to the technical scheme, in the process of outputting the video stream by the first application in the electronic equipment, the target image to be output at the current moment is obtained, and the target content in the target image is determined to be intercepted based on at least two historical intercepting operations aiming at the video stream to obtain the target image; the target content is part of the target image, the historical capture operation is an operation of capturing the target content in the historical image output at the historical time in the video stream, the information contained in the target content captured by any two times of historical capture operations is different, and a plurality of target images obtained by multiple times of capture are obtained to obtain a target image set. When the first application is an online conference application, the target content is contents such as a presentation output on the online conference, in the process of outputting a video by the online conference, the presentation in the video image is output at the current moment for automatic interception based on the fact that historical interception operations of intercepting the presentation in different frame images are received for multiple times, so that a picture set is obtained, a participant does not need to record a video in the process of participating in the conference, time consumption caused by watching the video is reduced, and the conference content can be efficiently reviewed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only the embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of an application scenario of an information processing method provided in the present application;
fig. 2 is a flowchart of an information processing method embodiment 1 provided in the present application;
fig. 3 is a flowchart of an information processing method embodiment 2 provided by the present application;
fig. 4 is a flowchart of an information processing method embodiment 3 provided in the present application;
fig. 5 is a flowchart of an information processing method embodiment 4 provided in the present application;
fig. 6 is a flowchart of an information processing method embodiment 5 provided by the present application;
FIG. 7 is a schematic structural diagram of an embodiment of an information processing apparatus provided in the present application;
fig. 8 is a schematic structural diagram of an embodiment of an electronic device provided in the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic diagram illustrating an application scenario of an information processing method according to the present application, wherein the scenario is an online conference, and includes a speaker 101 and multiple participants 102. The presenter 101 presents files such as a presentation on line, and the presenter-side device delivers the presentation (audio, or image and audio) and the files (images) of the presenter to each participant as video streams, and the participant sees the contents of the files displayed as part of the video during the viewing of the video. The electronic equipment is applied to the electronic equipment of the participant terminal, and after historical intercepting operations of intercepting the presentations in different frame images are received for multiple times, the presentations in the video images are output at the current moment to be automatically intercepted, so that a picture set is obtained, and the video recording of the participants in the participant process is not needed.
As shown in fig. 2, a flowchart of embodiment 1 of an information processing method provided by the present application, the method being applied to an electronic device, includes the following steps:
step S201: acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
wherein the first application is an online conferencing application.
The electronic equipment is used as an electronic equipment used by a participant of an online conference, a first application runs on the electronic equipment, and when the first application runs, the first application receives a video stream output by a speaker end device, wherein the video stream is formed by sequentially arranging and combining a frame of image.
Specifically, a frame of image is a page of the first application, wherein the page at least includes an image of a presentation file.
The target image may be fully distributed in a display area of a display screen of the electronic device, may be partially displayed, or may be changed between full distribution and partial use.
The method comprises the steps of analyzing a frame of image in a video stream acquired in real time, and processing the target image subsequently.
Step S202: determining to intercept target content in the target image based on at least two historical interception operations aiming at the video stream to obtain a target image;
the history intercepting operation is an operation of intercepting the target content in the history image output at the history moment in the video stream, and the information contained in the target content intercepted by any two times of history intercepting operations is different.
Wherein the target content is at least a component of the target image.
During the process of outputting the video stream by the electronic device at the time before the current time, the operation body performs an intercepting operation on the multi-frame historical image in the video stream, specifically, intercepts the target content in the historical image.
Specifically, the target image may include a plurality of area contents, such as a frame, a speaker image area, a presentation file area, and the like, where the target content is specific content intercepted from the target image, such as a presentation file.
In the process of outputting the video stream by the electronic equipment, the operation body manually intercepts the image in the video stream, and intercepts the target content in the image to obtain the corresponding number of target pictures.
Moreover, each time of manual interception, the intercepted target content has different information, and after the target content in the video stream output by the electronic device changes, the changed target content is manually intercepted.
In the application, based on the changed target content of the manual interception, after the image of the video stream is subsequently received, based on the changed target content of the manual interception, the target content of the target image to be output at the current moment is automatically intercepted without manual interception.
Step S203: and obtaining a target picture set based on the at least two target pictures.
And collecting the obtained target pictures together to obtain a target picture set.
The target picture includes the target picture obtained by capturing the target image in the step S202, and also includes a picture captured based on a history capturing operation.
Specifically, the target images are ordered and collected together based on the intercepted time sequence to obtain a target image set.
The target picture set corresponds to a display file displayed by the speaker, and subsequent participants can review the conference content based on the target picture set without recording videos.
In summary, in the information processing method provided by this embodiment, in a process of outputting a video stream by a first application in an electronic device, a target image to be output at a current moment is obtained, and based on at least two historical capture operations for the video stream, it is determined to capture target content in the target image, so as to obtain a target picture; the target content is part of the target image, the historical capture operation is an operation of capturing the target content in the historical image output at the historical time in the video stream, the information contained in the target content captured by any two times of historical capture operations is different, and a plurality of target images obtained by multiple times of capture are obtained to obtain a target image set. When the first application is an online conference application, the target content is contents such as a presentation output on the online conference, in the process of outputting a video by the online conference, the presentation in the video image is output at the current moment for automatic interception based on the fact that historical interception operations of intercepting the presentation in different frame images are received for multiple times, so that a picture set is obtained, a participant does not need to record a video in the process of participating in the conference, time consumption caused by watching the video is reduced, and the conference content can be efficiently reviewed.
As shown in fig. 3, a flowchart of embodiment 2 of an information processing method provided by the present application includes the following steps:
step S301: acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
step S301 is the same as step S201 in embodiment 1, and details are not described in this embodiment.
Step S302: acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
during the process of outputting the video stream by the electronic device at the time before the current time, the operation body performs an intercepting operation on multiple frames of historical images in the video stream, specifically intercepts target content in the historical images, and triggers and generates an intercepting instruction for the multiple times of historical intercepting operations.
Specifically, the interception instruction is used for triggering the interception operation under the condition that the condition similar to the historical interception operation is met.
The generation process of the intercept instruction will be explained in detail in the following embodiments, and details are not described in this embodiment.
Step S303: determining that the target content of the target image meets a condition of triggering an interception instruction, and intercepting the target content of the target image to obtain a target picture;
and when the target content of the target image is analyzed and the condition that the target content meets the condition of triggering an interception instruction is determined, intercepting the target content of the target image based on the interception instruction to obtain a target image.
Specifically, the target content of the target image is analyzed, including identifying and analyzing the text content, the image content and the like of the target content, wherein when the text content and/or the image content in the target content meet the condition of triggering the interception instruction, the target content is intercepted.
For example, the target content satisfies intercept instruction conditions including one or more of: the target content includes specific content, a change from the previous frame image, and the like.
When the participant intercepts the target picture in the video conference scene for the purpose of intercepting the presentation, the condition for triggering the intercepting instruction can be set to be that the presentation changes, namely, the presentation changes compared with the previous frame of image.
It should be noted that the condition for triggering the intercept instruction may be set according to actual situations.
Step S304: and obtaining a target picture set based on the at least two target pictures.
Step S304 is the same as step S203 in embodiment 1, and is not described in detail in this embodiment.
In summary, in an information processing method provided in this embodiment, the determining to perform capturing on the target content of the target image based on at least two historical capturing operations on the video stream to obtain a target picture includes: acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream; and determining that the target content of the target image meets the condition of triggering an interception instruction, and intercepting the target content of the target image to obtain a target picture. According to the scheme, based on the intercepting instruction generated by the historical intercepting operation for the video stream for multiple times, when the target content of the target image meets the condition of triggering the intercepting instruction, the target content of the target image is intercepted automatically without manual intercepting.
As shown in fig. 4, a flowchart of embodiment 3 of an information processing method provided by the present application includes the following steps:
step S401: analyzing the historical intercepting operation to obtain an intercepting area, wherein the intercepting area corresponds to a display area of target content in the historical image;
after the video conference is started, the video stream is output in real time, and the operation body executes intercepting operation at the historical time between the current time.
In this embodiment, the interception area is obtained by analyzing each of the plurality of interception operations performed by the operation body.
And analyzing the historical intercepting operation to obtain an intercepting area corresponding to the intercepting operation.
Specifically, the history intercepting operation is to intercept a display area corresponding to the target content in the corresponding history image, the display area has a corresponding relationship with the target content in the history image, and the history intercepting operation obtained by intercepting the display area is to intercept the target content in the history image by combining the corresponding relationship.
Specifically, the intercepted areas of the multiple historical interception operations are analyzed, and the intercepted areas are all display areas corresponding to the target content, so that the multiple historical interception operations can be determined to be all interception of the target content, and therefore, the target content is automatically intercepted, specifically, the interception instruction is generated, and the interception instruction is subsequently triggered to automatically intercept the target content.
Specifically, the time when the plurality of times of the historical capturing operations are received is analyzed, it can be known that the historical capturing operation occurs after the image in the video stream is changed (specifically, the target content is changed), and then based on the generation time of the historical capturing operation, it is determined that the time when the image is captured is after the image content (specifically, the target content) is changed.
Or, it can be known from the analysis of the obtained target pictures that the information contained in the plurality of target pictures is different, and accordingly it can be known that the condition for image capturing is that the target content of the image in the video stream changes, so that it can be determined that the timing for capturing the image is that the image content (specifically, the target content) changes.
Step S402: generating an intercepting instruction, wherein the intercepting instruction is used for intercepting a display area of the target content;
and analyzing and determining that an object which is intended to be intercepted by an operation body is the target content of the image in the video stream output in the first application based on a plurality of times of historical intercepting operations, and generating an intercepting instruction.
And the intercepting instruction is used for intercepting a display area corresponding to the target content of the image in the video stream.
The triggering condition of the interception instruction is that the target content of the image in the video stream changes, correspondingly, the interception instruction is generated, and the triggering condition of the interception instruction is stored.
In the subsequent process of video stream output, after a target image to be output is acquired, whether the target image is automatically intercepted or not is determined based on the triggering condition of the intercepting instruction.
After the intercepting instruction is generated, when the condition that the condition of triggering the intercepting instruction is met in the subsequent video stream output process occurs, intercepting the target content of the target image based on the intercepting instruction to obtain the target image.
Step S403: acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
step S404: acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
step S405: determining that the target content of the target image meets a condition of triggering an interception instruction, and intercepting the target content of the target image to obtain a target picture;
step S406: and obtaining a target picture set based on the at least two target pictures.
Steps S403 to 406 are the same as steps S301 to 304 in embodiment 2, and are not described in detail in this embodiment.
In summary, the information processing method provided in this embodiment further includes: analyzing the historical intercepting operation to obtain an intercepting area, wherein the intercepting area corresponds to a display area of target content in the historical image; and generating an intercepting instruction, wherein the intercepting instruction is used for intercepting the display area of the target content. According to the scheme, the object which is determined to be the target content in the image and is intended to be intercepted by the operation body is analyzed and determined based on multiple historical intercepting operations, and accordingly, an intercepting instruction is generated so as to automatically intercept the target content of the image in the video stream when the follow-up triggering condition is met, the situation that the participant manually intercepts the target content of the image all the time in the meeting process until the meeting is finished is avoided, and the experience of the participant is improved.
As shown in fig. 5, a flowchart of embodiment 4 of an information processing method provided by the present application includes the following steps:
step S501: acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
step S502: acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
steps S501 to 502 are the same as steps S301 to 302 in embodiment 2, and are not described in detail in this embodiment.
Step S503: determining that the target content of the target image meets a condition of triggering an interception instruction based on detecting the target image update;
and analyzing and determining whether the target content in the target image meets the condition of triggering and intercepting instructions or not when the target image is detected to be updated.
Specifically, the detection target image update may be detected by using an image recognition method.
Wherein detecting whether the target image is updated comprises:
step S5031: analyzing whether a first target content is the same as a second target content, wherein the first target content is a target content in a target image output at the current moment, and the second target content is a target content in a history image output at an adjacent moment before the current moment;
the target content in the target image to be output at the current moment is compared with the target content in the historical image output at the moment adjacent to the historical moment, and the target content is analyzed in an image recognition mode.
Step S5032: and if the first target content is different from the second target content, determining that the target image is updated.
If the first target content is the same as the second target content, representing that the two frames of images are not changed, namely the target image is not updated; otherwise the target image is updated.
Specifically, the video stream in the first application is output in a directional manner for different areas in the page of the first application, for example, there are two video streams in the first application, one video stream is a video stream of a speaker, the second video stream is a video stream of a presentation file, the first video stream is output to the first area of the page of the first application, and the second video stream is output to the second area of the page of the first application, that is, the area where the target content is located.
Specifically, the video stream in the first application is detected in a non-directional output manner, an area where the target content is located is determined based on a preset target content feature, and then whether the content of the previous frame of image in the area and the target content in the corresponding area in the target image are changed or not is judged.
Specifically, whether the image changes or not may specifically adopt a difference algorithm or a similarity algorithm. Calculating the difference between the two images by adopting a difference algorithm, and determining that the target content of the target image meets the condition of triggering an interception instruction when the difference is greater than a difference threshold; for another example, the similarity between the two images is calculated by adopting a similarity calculation mode, and when the similarity is smaller than a similarity threshold value, it is determined that the target content of the target image meets the condition of triggering the interception instruction.
Step S504: analyzing the target image and determining a display area of target content in the target image;
and analyzing the updated target image to determine a display area of the target content.
Specifically, when the video stream is in a directional output mode, a target area of the video stream output in a page of the first application is determined, and a display area corresponding to target content in the target image is determined based on a corresponding relationship between the target area and a corresponding display area in a display screen.
Specifically, when the video stream is in a non-directional output mode, the target image is identified to obtain a target area where the target content is located, and a display area corresponding to the target content in the target image is determined based on a corresponding relationship between the target area and a corresponding display area in a display screen.
It should be noted that the display areas of the target content in the respective images in the video stream are not necessarily the same, and when the display area of the page of the first application on the display screen changes, the display area of the target content in some of the frame images changes accordingly.
Step S505: intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises target content;
and carrying out image interception on the determined display area, wherein the target content is displayed in the display area, and the corresponding intercepted target image comprises the target content.
It should be noted that, in the process of outputting each frame of image in the video stream, the display area with changed target content is sequentially cut out to obtain multiple frames of target pictures.
Step S506: and obtaining a target picture set based on the at least two target pictures.
Step S506 is the same as step S304 in embodiment 2, and is not described in detail in this embodiment.
In summary, the information processing method provided in this embodiment determines that the target content of the target image meets a condition for triggering an interception instruction, intercepts the target content of the target image, and obtains a target picture, and includes: determining that the target content of the target image meets a condition of triggering an interception instruction based on detecting the target image update; analyzing the target image and determining a display area of target content in the target image; and intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content. In the scheme, based on the updating of the target image, if the target content in the target image is determined to meet the condition of the triggering and intercepting instruction, the intercepting action is triggered, the target image is analyzed to determine the display area of the target content, the display area is intercepted to obtain the target image, the target content in the updated target image can be automatically intercepted, and a participant does not need to manually intercept the target content of the image all the time in the participating process.
As shown in fig. 6, a flowchart of embodiment 5 of an information processing method provided by the present application includes the following steps:
step S601: acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
step S602: determining to intercept target content in the target image based on at least two historical interception operations aiming at the video stream to obtain a target image;
step S603: obtaining a target picture set based on at least two target pictures;
steps S601 to 603 are the same as steps S201 to 203 in embodiment 1, and are not described in detail in this embodiment.
Step S604: identifying information contained in at least two target pictures in the target picture set;
here, information included in each target picture is recognized, and for example, when a character is included in the target picture, the character in the target picture is recognized by using an ORC (optical character recognition).
When the text information contained in the two target pictures is compared, the difference or similarity between the two target pictures is specifically calculated so as to determine whether the text information contained in the two target pictures is the same. For example, if the similarity is greater than 90%, it can be determined to be the same, otherwise, it is considered to be different.
It should be noted that, when the target picture is a picture, the similarity of the pictures can be directly compared to determine whether the two target pictures are the same.
Step S605: and reserving one of any two target pictures based on the condition that the information of any two target pictures meets the same condition.
In the online meeting process, after explaining a certain page of display file, the speaker may return to the previous page or jump to a page which is discontinuous from the previous page.
For example, the presenter returns to page 2 for review or jumps to page 15 after explaining page 10, and returns to page 10 for further explanation after explaining page 2 or page 15.
In this process, when jumping to another page, the target content changes, and the target picture is automatically captured from the skipped target content, but the target picture may be the same as the previously captured picture, which results in repeated capture, and multiple identical target pictures may exist in the obtained target picture set, which may cause confusion when a participant reviews the conference content, and thus the repeated target pictures need to be deleted.
Wherein, a target picture with an earlier time can be reserved and obtained according to the appointed reservation condition.
In a specific implementation, when the display document displayed by the speaker has a page number, if the information for identifying the target picture can identify the page number, it may be agreed that the reservation condition is continuous with the page numbers of the preceding and following target pictures.
In specific implementation, the retention condition may be set according to an actual situation, and the specific content of the retention condition is not limited in this application.
In summary, the information processing method provided in this embodiment further includes: identifying information contained in at least two target pictures in the target picture set; and reserving one of any two target pictures based on the condition that the information of any two target pictures meets the same condition. In the scheme, based on the information contained in the target picture, the repeated pictures in the target picture set are deleted, so that the finally obtained target picture set is consistent with the display file displayed by the speaker.
Corresponding to the embodiment of the information processing method provided by the application, the application also provides an embodiment of a device applying the information processing method.
Fig. 7 is a schematic structural diagram of an embodiment of an information processing apparatus provided by the present application, where the apparatus includes the following structures: an acquisition module 701 and a processing module 702;
the obtaining module 701 is configured to obtain a target image to be output at a current moment in a video stream, where the video stream is a video stream output by a first application in an electronic device;
the processing module 702 is configured to determine to intercept target content in the target image based on at least two historical interception operations on the video stream to obtain a target image, where the target content is at least a component of the target image, the historical interception operation is an operation of intercepting the target content in the historical image output at a historical time in the video stream, and information included in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
Optionally, the processing module includes:
the acquisition unit is used for acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
and the intercepting unit is used for determining that the target content of the target image meets the condition of an intercepting triggering instruction, and intercepting the target content of the target image to obtain a target picture.
Optionally, the method further includes:
the instruction generation module is used for analyzing the historical intercepting operation to obtain an intercepting area, and the intercepting area corresponds to a display area of target content in the historical image; and generating an intercepting instruction, wherein the intercepting instruction is used for intercepting the display area of the target content.
Optionally, the intercepting unit includes:
the detection subunit is used for determining that the target content of the target image meets a condition of triggering an interception instruction based on the detection of the update of the target image;
the analysis subunit is used for analyzing the target image and determining a display area of target content in the target image;
and the intercepting subunit is used for intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content.
Optionally, the detecting subunit is specifically configured to:
analyzing whether a first target content is the same as a second target content, wherein the first target content is a target content in a target image output at the current moment, and the second target content is a target content in a history image output at an adjacent moment before the current moment; and if the first target content is different from the second target content, determining that the target image is updated.
Optionally, the method further includes:
the identification module is used for identifying information contained in at least two target pictures in the target picture set; and reserving one of any two target pictures based on the condition that the information of any two target pictures meets the same condition.
The structural functions of each part in the information processing apparatus are explained with reference to the method embodiment, and are not described in detail in this embodiment.
In summary, in the information processing apparatus provided in this embodiment, in the process of outputting a video stream by a first application in an electronic device, a target image to be output at a current moment is obtained, and based on at least two historical capturing operations for the video stream, it is determined to capture target content in the target image, so as to obtain a target image; the target content is part of the target image, the historical capture operation is an operation of capturing the target content in the historical image output at the historical time in the video stream, the information contained in the target content captured by any two times of historical capture operations is different, and a plurality of target images obtained by multiple times of capture are obtained to obtain a target image set. When the first application is an online conference application, the target content is contents such as a presentation output on the online conference, in the process of outputting a video by the online conference, the presentation in the video image is output at the current moment for automatic interception based on the fact that historical interception operations of intercepting the presentation in different frame images are received for multiple times, so that a picture set is obtained, a participant does not need to record a video in the process of participating in the conference, time consumption caused by watching the video is reduced, and the conference content can be efficiently reviewed.
Corresponding to the embodiment of the information processing method provided by the application, the application also provides an embodiment of the electronic equipment applying the information processing method.
Fig. 8 is a schematic structural diagram of an embodiment of an electronic device provided in the present application, where the electronic device includes the following structures: a display device 801, an input device 802, and a processor 803;
the display device 801 is configured to output a video stream;
the input device 802 is configured to receive an intercepting operation of an operation body;
the input device may be a keyboard, a mouse, a touch panel, a touch pad, or other devices capable of receiving input operations from an operation body.
The processor 803 is configured to obtain a target image to be output at a current time in a video stream, where the video stream is a video stream output by a first application in the electronic device; determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations of intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
The processor may specifically adopt a functional chip with information processing capability in the electronic device, such as a Central Processing Unit (CPU).
In summary, in the electronic device provided in this embodiment, in the process of outputting a video stream by a first application in the electronic device, a target image to be output at a current moment is obtained, and based on at least two historical capturing operations for the video stream, it is determined to capture target content in the target image, so as to obtain a target picture; the target content is part of the target image, the historical capture operation is an operation of capturing the target content in the historical image output at the historical time in the video stream, the information contained in the target content captured by any two times of historical capture operations is different, and a plurality of target images obtained by multiple times of capture are obtained to obtain a target image set. When the first application is an online conference application, the target content is contents such as a presentation output on the online conference, in the process of outputting a video by the online conference, the presentation in the video image is output at the current moment for automatic interception based on the fact that historical interception operations of intercepting the presentation in different frame images are received for multiple times, so that a picture set is obtained, a participant does not need to record a video in the process of participating in the conference, time consumption caused by watching the video is reduced, and the conference content can be efficiently reviewed.
In the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device provided by the embodiment, the description is relatively simple because the device corresponds to the method provided by the embodiment, and the relevant points can be referred to the method part for description.
The previous description of the provided embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features provided herein.

Claims (10)

1. An information processing method comprising:
acquiring a target image to be output at the current moment in a video stream, wherein the video stream is output by a first application in electronic equipment;
determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations of intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different;
and obtaining a target picture set based on the at least two target pictures.
2. The method of claim 1, wherein determining to intercept target content of the target image based on at least two historical interception operations for the video stream, resulting in a target picture, comprises:
acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
and determining that the target content of the target image meets the condition of triggering an interception instruction, and intercepting the target content of the target image to obtain a target picture.
3. The method of claim 2, before obtaining the target image to be output at the current time in the video stream, further comprising:
analyzing the historical intercepting operation to obtain an intercepting area, wherein the intercepting area corresponds to a display area of target content in the historical image;
and generating an intercepting instruction, wherein the intercepting instruction is used for intercepting the display area of the target content.
4. The method of claim 2, determining that the target content of the target image meets a condition for triggering an interception instruction, intercepting the target content of the target image to obtain a target picture, comprising:
determining that the target content of the target image meets a condition of triggering an interception instruction based on detecting the target image update;
analyzing the target image and determining a display area of target content in the target image;
and intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content.
5. The method of claim 4, detecting whether the target image is updated, comprising:
analyzing whether a first target content is the same as a second target content, wherein the first target content is a target content in a target image output at the current moment, and the second target content is a target content in a history image output at an adjacent moment before the current moment;
and if the first target content is different from the second target content, determining that the target image is updated.
6. The method of claim 1, after obtaining the target picture set based on at least two target pictures, further comprising:
identifying information contained in at least two target pictures in the target picture set;
and reserving one of any two target pictures based on the condition that the information of any two target pictures meets the same condition.
7. An information processing apparatus comprising:
the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a target image to be output at the current moment in a video stream, and the video stream is output by a first application in the electronic equipment;
the processing module is used for determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations for intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
8. The apparatus of claim 7, the processing module, comprising:
the acquisition unit is used for acquiring an interception instruction generated by at least two historical interception operations aiming at the video stream;
and the intercepting unit is used for determining that the target content of the target image meets the condition of an intercepting triggering instruction, and intercepting the target content of the target image to obtain a target picture.
9. The apparatus of claim 8, the intercept unit, comprising:
the detection subunit is used for determining that the target content of the target image meets a condition of triggering an interception instruction based on the detection of the update of the target image;
the analysis subunit is used for analyzing the target image and determining a display area of target content in the target image;
and the intercepting subunit is used for intercepting the display content of the display area to obtain a target picture, wherein the target picture comprises the target content.
10. An electronic device, comprising:
a display device for outputting a video stream;
the input device is used for receiving the intercepting operation of the operation body;
the processor is used for acquiring a target image to be output at the current moment in a video stream, wherein the video stream is the video stream output by a first application in the electronic equipment; determining to intercept target content in the target image to obtain a target image based on at least two historical interception operations aiming at the video stream, wherein the target content is at least a component of the target image, the historical interception operations are operations of intercepting the target content in the historical image output at the historical moment in the video stream, and the information contained in the target content intercepted by any two historical interception operations is different; and obtaining a target picture set based on the at least two target pictures.
CN202210162602.1A 2022-02-22 2022-02-22 Information processing method and device and electronic equipment Active CN114554133B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210162602.1A CN114554133B (en) 2022-02-22 2022-02-22 Information processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210162602.1A CN114554133B (en) 2022-02-22 2022-02-22 Information processing method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN114554133A true CN114554133A (en) 2022-05-27
CN114554133B CN114554133B (en) 2023-01-06

Family

ID=81678097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210162602.1A Active CN114554133B (en) 2022-02-22 2022-02-22 Information processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN114554133B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020608A (en) * 2016-05-20 2016-10-12 北京小米移动软件有限公司 Screenshot control method and device
CN112183249A (en) * 2020-09-14 2021-01-05 北京神州泰岳智能数据技术有限公司 Video processing method and device
CN112801876A (en) * 2021-02-07 2021-05-14 联想(北京)有限公司 Information processing method, information processing device, electronic equipment and storage medium
CN112989112A (en) * 2021-04-27 2021-06-18 北京世纪好未来教育科技有限公司 Online classroom content acquisition method and device
CN113822215A (en) * 2021-09-29 2021-12-21 平安银行股份有限公司 Equipment operation guide file generation method and device, electronic equipment and storage medium
US20220043544A1 (en) * 2019-04-25 2022-02-10 Vivo Mobile Communication Co., Ltd. Display control method and terminal device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020608A (en) * 2016-05-20 2016-10-12 北京小米移动软件有限公司 Screenshot control method and device
US20220043544A1 (en) * 2019-04-25 2022-02-10 Vivo Mobile Communication Co., Ltd. Display control method and terminal device
CN112183249A (en) * 2020-09-14 2021-01-05 北京神州泰岳智能数据技术有限公司 Video processing method and device
CN112801876A (en) * 2021-02-07 2021-05-14 联想(北京)有限公司 Information processing method, information processing device, electronic equipment and storage medium
CN112989112A (en) * 2021-04-27 2021-06-18 北京世纪好未来教育科技有限公司 Online classroom content acquisition method and device
CN113822215A (en) * 2021-09-29 2021-12-21 平安银行股份有限公司 Equipment operation guide file generation method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114554133B (en) 2023-01-06

Similar Documents

Publication Publication Date Title
US9473741B2 (en) Teleconference system and teleconference terminal
CN107682714B (en) Method and device for acquiring online video screenshot
US9756285B2 (en) Method, device, and display device for switching video source
US8116593B2 (en) Image processing apparatus, image processing method, and program for determining a zoom area for a displayed zoom image
US8717453B2 (en) Video processing apparatus, and control method and program therefor
CN110262866B (en) Screen multi-picture layout switching method and device and readable storage medium
CN112291502B (en) Information interaction method, device and system and electronic equipment
CN111078070A (en) PPT video barrage play control method, device, terminal and medium
CN111147911A (en) Video clipping method and device, electronic equipment and storage medium
US20130179910A1 (en) Terminal device, content display method for terminal device, server device, display data transmission method for server device, and ranking information transmission method for server device
EP3454202B1 (en) Frame drop processing method and system for played ppt
CN111050204A (en) Video clipping method and device, electronic equipment and storage medium
CN113010135B (en) Data processing method and device, display terminal and storage medium
US20140085402A1 (en) Conference terminal and method for processing videos from other conference terminals
CN114025185A (en) Video playback method and device, electronic equipment and storage medium
CN113438550B (en) Video playing method, video conference method, live broadcasting method and related devices
US20230327897A1 (en) Gaze Repositioning During A Video Conference
CN114554133B (en) Information processing method and device and electronic equipment
US20170139933A1 (en) Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments
CN108924624B (en) Information processing method and device
CN112565667B (en) Method and device for reviewing historical content of application program and electronic equipment
CN115529490A (en) Many-to-many screen projection method, device and system
CN114155151A (en) Image drawing method, device, equipment and storage medium
JP2023539273A (en) Methods, devices, electronic devices and media for determining target addition methods
WO2024004052A1 (en) Video streaming with provided information superimposed on video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant