CN114245146A - Display picture switching method, device, equipment and computer readable storage medium - Google Patents
Display picture switching method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN114245146A CN114245146A CN202111460625.2A CN202111460625A CN114245146A CN 114245146 A CN114245146 A CN 114245146A CN 202111460625 A CN202111460625 A CN 202111460625A CN 114245146 A CN114245146 A CN 114245146A
- Authority
- CN
- China
- Prior art keywords
- picture
- acquisition
- switching
- currently displayed
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Abstract
The application discloses a display picture switching method, a display picture switching device, display picture switching equipment and a computer readable storage medium. The display picture switching method comprises the steps of displaying a first acquisition picture acquired by a first picture acquisition device; under the condition that a target person appears in a first acquisition picture, acquiring a first area picture containing the target person from the first acquisition picture, and switching a currently displayed picture into the first area picture; and under the condition that the target person appears in the second acquisition picture acquired by the second picture acquisition device, switching the currently displayed picture into the second acquisition picture. According to the embodiment of the application, the accuracy of picture switching can be improved, and the whole interaction process can be displayed in an all-round manner.
Description
Technical Field
The present application belongs to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for switching display frames.
Background
With the continuous development of online education, more and more users view high-quality courses through the network. Therefore, how to realize the all-round display of the high-quality courses becomes an urgent problem to be solved.
In the process of recording or online live broadcasting and rebroadcasting the offline courses, the currently displayed pictures are often required to be switched, for example, the switching between a platform picture and a student picture. The existing picture switching mode is mainly to complete the switching of multiple video sources based on the audio source, that is, which video source collects the audio is switched to the display picture corresponding to the video source.
Therefore, under the condition that the acquisition equipment of the multi-channel video source is close to each other or in the same room, the condition that a plurality of acquisition equipment acquire audio easily occurs, and accordingly, the picture switching is inaccurate. In addition, the whole interaction process cannot be shown in all directions because the screen switching trigger mechanism is single.
Disclosure of Invention
The embodiment of the application provides a display picture switching method, a display picture switching device, display picture switching equipment and a computer readable storage medium, which can improve the picture switching accuracy and comprehensively show the whole interaction process.
In a first aspect, an embodiment of the present application provides a display screen switching method, where the method includes:
displaying a first acquisition picture acquired by a first picture acquisition device;
under the condition that a target person appears in the first acquisition picture, acquiring a first area picture containing the target person from the first acquisition picture, and switching a currently displayed picture into the first area picture;
and under the condition that the target person appears in a second acquisition picture acquired by a second picture acquisition device, switching the currently displayed picture into the second acquisition picture.
In some embodiments, after switching the currently displayed screen to the first area screen, the method further comprises:
acquiring reference position information corresponding to the first area picture and real-time position information of the target person in the first area picture;
determining the displacement of the target person according to the reference position information and the real-time position information;
and under the condition that the displacement is larger than a preset threshold value, switching the currently displayed picture into the first acquisition picture.
In some embodiments, after switching the currently displayed screen to the first area screen, the method further comprises:
and under the condition that the first acquisition picture is detected not to contain any person, switching the currently displayed picture to the second acquisition picture.
In some embodiments, the method further comprises:
monitoring motion postures corresponding to a plurality of characters contained in the second acquisition picture respectively;
determining whether a first person in a preset movement posture exists in the plurality of persons according to the movement posture;
and under the condition that a first person in the preset motion posture exists, acquiring a second area picture containing the first person from the second acquisition picture, and switching the currently displayed picture into the second area picture.
In some embodiments, the monitoring the motion gestures respectively corresponding to a plurality of characters included in the second captured image includes:
acquiring position information of target parts respectively corresponding to a plurality of people contained in the second acquisition picture;
and determining the motion postures corresponding to the multiple people respectively according to the position information of the target part.
In some embodiments, after determining whether a first person in the plurality of persons is present at a preset action gesture according to the action gesture, the method further comprises:
and switching the currently displayed picture to the second acquisition picture under the condition that the currently displayed picture is other pictures except the second acquisition picture and a plurality of characters in the preset motion posture exist in the currently displayed picture.
In some embodiments, the method further comprises:
detecting whether a display picture of target equipment is changed; the target equipment display picture is a picture displayed in the target equipment;
and under the condition that the change is determined, switching the currently displayed picture to the target equipment display picture.
In some embodiments, the detecting whether the display screen of the target device changes includes:
acquiring change information between a current frame and a previous frame of the display picture of the target equipment;
determining whether the change degree of the display picture of the target equipment reaches a change degree threshold value corresponding to preset sensitivity or not according to the change information;
and determining that the target device display screen changes when the change degree threshold is reached.
In a second aspect, an embodiment of the present application provides a display screen switching apparatus, including:
the picture display module is used for displaying a first collected picture collected by the first picture collection device;
the first switching module is used for acquiring a first area picture containing a target person from the first acquisition picture under the condition that the target person appears in the first acquisition picture, and switching a currently displayed picture into the first area picture;
and the second switching module is used for switching the currently displayed picture into the second acquisition picture under the condition that the target person appears in the second acquisition picture acquired by the second picture acquisition device or the first acquisition picture does not contain any person.
In some embodiments, the display screen switching apparatus further includes:
the position acquisition module is used for acquiring reference position information corresponding to the first area picture and real-time position information of the target person in the first area picture after the currently displayed picture is switched to the first area picture;
the displacement determining module is used for determining the displacement of the target person according to the reference position information and the real-time position information;
and the third switching module is used for switching the currently displayed picture into the first acquisition picture under the condition that the displacement is greater than a preset threshold value.
In some embodiments, the display screen switching apparatus further includes:
and the fourth switching module is used for switching the currently displayed picture to the second acquisition picture under the condition that the first acquisition picture does not contain any person after the currently displayed picture is switched to the first area picture.
In some embodiments, the display screen switching apparatus further includes:
the gesture monitoring module is used for monitoring motion gestures respectively corresponding to a plurality of characters contained in the second acquisition picture;
the character determining module is used for determining whether a first character in a preset motion gesture exists in the plurality of characters according to the motion gesture;
and the fifth switching module is used for acquiring a second area picture containing the first person from the second acquisition picture under the condition that the first person in the preset motion posture exists, and switching the currently displayed picture into the second area picture.
In some embodiments, the attitude monitoring module comprises:
the information acquisition submodule is used for acquiring position information of target parts corresponding to a plurality of characters contained in the second acquisition picture;
and the posture determining submodule is used for determining the motion postures corresponding to the multiple people respectively according to the position information of the target part.
In some embodiments, the display screen switching apparatus further includes:
and a sixth switching module, configured to, after determining whether a first person in a preset motion posture exists in the multiple persons according to the motion posture, switch the currently displayed picture to the second captured picture when the currently displayed picture is another picture except the second captured picture and there are multiple persons in the preset motion posture in the currently displayed picture.
In some embodiments, the display screen switching apparatus further includes:
the image detection module is used for detecting whether the display image of the target equipment changes; the target equipment display picture is a picture displayed in the target equipment;
and the seventh switching module is used for switching the currently displayed picture to the target equipment display picture under the condition that the change is determined.
In some embodiments, the picture detection module comprises:
the information acquisition submodule is used for acquiring the change information between the current frame and the previous frame of the display picture of the target equipment;
the degree determining submodule is used for determining whether the change degree of the display picture of the target equipment reaches a change degree threshold value corresponding to preset sensitivity or not according to the change information;
and the change determining submodule is used for determining that the display picture of the target equipment changes under the condition that the change degree threshold is determined to be reached.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the steps of the display switching method as described in any of the embodiments of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, on which computer program instructions are stored, and when executed by a processor, the computer program instructions implement the steps of the display screen switching method as described in any one of the embodiments of the first aspect.
According to the display picture switching method, device, equipment and computer-readable storage medium in the embodiments of the application, when a target person appears in a displayed first captured picture, a first area picture including the target person is acquired from the first captured picture, and a currently displayed picture is switched to the first area picture, and when the target person appears in a second captured picture captured by a second picture capturing device, the currently displayed picture is switched to the second captured picture. In this way, since the embodiment of the present application employs the screen switching mechanism based on screen recognition, the accuracy of screen switching can be improved. In addition, the image of the close-up area of the object can be switched to according to the target person appearing in the image, and the image of the close-up area of the object can be switched to other images according to the fact that the target person enters other image acquisition areas, so that the whole interaction process can be displayed more comprehensively.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a method for switching a display screen according to an embodiment of the present disclosure;
FIG. 2 is a schematic illustration of a close-up cut scene provided by an embodiment of the present application;
fig. 3 is a second schematic flowchart of a display screen switching method according to an embodiment of the present application;
fig. 4 is a third schematic flowchart of a display screen switching method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a display screen switching apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative only and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In order to solve the problem of the prior art, embodiments of the present application provide a method, an apparatus, a device, and a computer-readable storage medium for switching a display screen. The display image switching method can be applied to scenes of recording, live broadcasting, rebroadcasting and the like of courses in offline classes, and firstly, the display image switching method provided by the embodiment of the application is introduced below.
Fig. 1 illustrates a flowchart of a display screen switching method according to an embodiment of the present application.
As shown in fig. 1, the display screen switching method may specifically include the following steps:
and step 110, displaying the first collected picture collected by the first picture collecting device.
And step 120, under the condition that the target person appears in the first acquisition picture, acquiring a first area picture containing the target person from the first acquisition picture, and switching the currently displayed picture into the first area picture.
And 130, under the condition that the target person appears in the second acquisition picture acquired by the second picture acquisition device, switching the currently displayed picture into the second acquisition picture.
Therefore, when the target person appears in the displayed first captured picture, the first area picture containing the target person is acquired from the first captured picture, the currently displayed picture is switched to the first area picture, and when the target person appears in the second captured picture captured by the second picture capturing device, the currently displayed picture is switched to the second captured picture. In this way, since the embodiment of the present application employs the screen switching mechanism based on screen recognition, the accuracy of screen switching can be improved. In addition, the image of the close-up area of the object can be switched to according to the target person appearing in the image, and the image of the close-up area of the object can be switched to other images according to the fact that the target person enters other image acquisition areas, so that the whole interaction process can be displayed more comprehensively.
The above steps are described in detail below, specifically as follows:
referring to step 110, in the embodiment of the present application, in the online classroom teaching scene, the first image capturing device may be a camera that shoots a platform area, and correspondingly, the first captured image may be a panoramic image of the platform area captured by the first image capturing device in real time.
Referring to step 120, in the embodiment of the present application, the target person may be any person distinguished from the object, or may be a specific registered person, such as a teacher.
For example, it may be detected through an image recognition technology whether a picture captured by the first picture capturing device, that is, the first captured picture, includes a target person, and when the target person appears in the first captured picture, a first area picture of a preset range centered on a position of the target person in the first captured picture may be cut from the first captured picture according to the position of the target person in the first captured picture, and then a currently displayed picture may be switched to the first area picture displayed in an enlarged manner, where the first area picture may be a close-up picture of the target person.
In a specific example, as shown in fig. 2, if it is detected that the teacher 21 appears in the 4K picture 20 captured by the podium area capturing camera, that is, the teacher 21 appears in the podium area, the teacher may be identified through an image analysis algorithm, and the 2K close-up picture 22 is captured from the panoramic 4K picture 20 captured by the camera, and at the same time, the picture position where the teacher 21 is located is taken as the center position of the close-up picture 22 through an AI identification algorithm.
In the above example, the target person may be a person other than a teacher, such as a student, and the embodiment is the same as that in the above example, and is not described herein again.
In addition, under the condition that multiple persons are simultaneously identified in the first acquisition picture, the first acquisition picture can still be displayed, and if the currently displayed picture is not the first acquisition picture, the currently displayed picture can be switched to the first acquisition picture.
In some examples, after step 120, the display screen switching method provided in the embodiment of the present application may further include:
acquiring reference position information corresponding to the first area picture and real-time position information of a target person in the first area picture;
determining the displacement of the target person according to the reference position information and the real-time position information;
and under the condition that the displacement is greater than a preset threshold value, switching the currently displayed picture into a first acquisition picture.
Here, when the facial feature of the target person is recognized from the first captured picture, the plane coordinates of the position of the target person in the first captured picture may be acquired and used as the reference position information corresponding to the first area picture. In some examples, the plane coordinates may be used as the coordinates of the center position of the first region view, so as to ensure that the target person can be located at the center position of the close-up view when switching to the close-up view of the target person, that is, the first region view. In addition, the real-time position information may be plane coordinates of the position where the target person is located, which are acquired in real time from the first captured picture after the reference position information is determined.
For example, the displacement of the target person may be determined by calculating the distance between the real-time position coordinates and the reference position coordinates. If the displacement is larger than the preset threshold value, the target person is shown to leave the close-up picture or walk to the picture edge corresponding to the close-up picture at the moment, and at the moment, the currently displayed close-up picture can be switched into a panoramic picture for display; otherwise, if the displacement is less than or equal to the preset threshold value, keeping the currently displayed close-up picture unchanged.
Therefore, when the moving amplitude of the target person is larger than the set value, the close-up picture is switched back to the panoramic picture, so that the picture can be prevented from shaking along with the target person, the whole picture is displayed in a panoramic way in the process that the target person moves greatly, the close-up picture is displayed when the target person is static, the picture display quality is improved, and the interaction process of the persons is well displayed.
Referring to step 130, in this embodiment of the application, in an online classroom teaching scene, the second image capturing device may be a camera that shoots a student area, and correspondingly, the second captured image may be a panoramic image of the student area captured by the second image capturing device in real time.
For example, if it is detected that a target person appears in the second captured picture, for example, the target person moves from the shooting area corresponding to the first picture capturing device to the shooting area corresponding to the second picture capturing device, the currently displayed picture may be switched to the second captured picture.
In some embodiments, after the step 120, the display screen switching method provided in the embodiment of the present application may further include:
and under the condition that the first acquisition picture is detected not to contain any person, switching the currently displayed picture to the second acquisition picture.
For example, if it is detected that no one is present in the first captured picture, the currently displayed picture may be switched to the second captured picture.
In summary, in a specific example, when the teacher moves from the lecture area to the student area or when there is no more person in the lecture area, the currently displayed screen is switched to the capture screen corresponding to the student area.
In addition, in some embodiments, as shown in fig. 3, the display screen switching method may further include: steps 310 and 330 are described in detail below.
Here, the second captured picture may include a plurality of characters. Under classroom teaching scene under online, the second is gathered the picture, promptly, in the regional picture of student, can contain a plurality of students, and then accessible image recognition and AI identification algorithm discerns the motion gesture that every student corresponds respectively to whether real-time supervision every student is in predetermined motion gesture.
In some examples, the step 310 may specifically include:
acquiring position information of target parts respectively corresponding to a plurality of people contained in a second acquisition picture;
and determining the motion postures corresponding to the multiple people according to the position information of the target part.
Here, the target part may be a human head. The student area cameras can select the head portrait frames of all the students, and acquire the corresponding position coordinates of the head portraits of each student in the acquisition picture as the position information of the heads of the students. Therefore, when the students move, the position coordinates of the corresponding head portraits can change, and the movement postures corresponding to the students respectively can be determined according to the movement amplitude of the position coordinates.
For example, in the case where the position of the avatar of a certain student moves from bottom to top and exceeds a preset magnitude, it can be determined that the student has stood up, that is, the student is in a standing posture.
In this way, the position information of the target part of each person is recorded, and the movement posture of the person is determined based on the change condition of the position information, so that the calculation and judgment process can be simplified while the accuracy of the judgment result of the movement posture is ensured.
And step 320, determining whether a first person in a preset motion gesture exists in the plurality of persons according to the motion gesture.
Here, the preset moving posture may be a standing posture.
In one specific example, it may be determined whether there is a person in a standing posture therein based on the motion posture of each person monitored in real time.
For example, if it is determined that there is a person in the second captured picture, that is, the first person, in the preset motion posture, the second region picture of the preset range centered on the position of the first person in the second captured picture may be captured from the second captured picture according to the position of the first person in the second captured picture, and the currently displayed picture may be switched to the second region picture displayed in an enlarged manner, where the second region picture may be a close-up picture of the first person.
In a specific example, if it is detected through a preset detection algorithm that a student in a standing posture appears in a 4K picture acquired by a camera for shooting in a student area, after the student stands up, a 2K close-up picture can be captured from a 4K panoramic picture shot by the camera, and meanwhile, the picture position where the student is located is taken as the center position of the close-up picture through an AI recognition algorithm.
In some embodiments, after step 320, the display screen switching method provided in the embodiment of the present application may further include:
and switching the currently displayed picture into the second acquisition picture under the condition that the currently displayed picture is other pictures except the second acquisition picture and a plurality of characters in preset motion postures exist in the currently displayed picture.
For example, if the currently displayed picture is not the second captured picture and a plurality of persons in preset motion gestures are identified, the currently displayed picture may be switched to the second captured picture.
In a specific example, if the currently displayed screen is a non-student panoramic screen such as a close-up screen of a certain student, a podium area panoramic screen, or a teacher close-up screen, the currently displayed screen can be switched to the student panoramic screen when a plurality of standing students appear in the student panoramic screen.
Therefore, by monitoring the motion gestures respectively corresponding to the characters in the second acquisition picture, under the condition that the first character in the preset motion gesture exists, the currently displayed picture is switched to the close-up picture of the first character, namely the second area picture, so that the characters with interactive behaviors can be specifically displayed in time, and the interactive process of the characters can be displayed.
In addition, in some embodiments, as shown in fig. 4, the display screen switching method may further include: steps 410 and 420 are described in detail below.
Here, in the online classroom teaching scene, the target device may be, for example, an electronic device used by the teacher to demonstrate a courseware, and specifically may be a desktop computer, a tablet computer, a mobile phone, and the like.
In a specific example, when a teacher uses a computer device to play courseware during a teaching process, the change of a display picture of the computer device can be automatically detected.
In some examples, the step 410 may specifically include:
acquiring change information between a current frame and a previous frame of a display picture of target equipment;
determining whether the change degree of the display picture of the target equipment reaches a change degree threshold value corresponding to the preset sensitivity or not according to the change information;
in a case where it is determined that the threshold value of the degree of change is reached, it is determined that the target device display screen has changed.
In the embodiment of the application, the change information between the current frame and the previous frame in the display picture of the target device can be obtained in real time, and the change information between the two frames can be determined by comparing the pixel values of the pixel points included in the two frames. Wherein, the change information may include whether the change occurs and the degree of the change.
For example, the user may set the detection sensitivity in advance as needed, and then determine that the target device display screen changes when the change degree of the target device display screen reaches a change degree threshold corresponding to the sensitivity, so as to switch the currently displayed screen to the target device display screen.
In a specific example, the detection sensitivity may be divided into a plurality of levels, and the user may select the sensitivity of the corresponding level as required, and when the teacher operates the computer device for displaying courseware and the degree of change of courseware display content is greater than the threshold corresponding to the sensitivity, the currently displayed screen is automatically switched to the computer device display screen to display teacher operation content and/or courseware content. The sensitivity setting process may be, for example, to divide the entire display screen into 4 regions, to detect the degree of change of the 4 regions, and the detection range may be manually adjusted. By adjusting the detection range, adjustment of the detection sensitivity for triggering screen switching can be achieved.
In addition, if the operation of the teacher on the computer device is not detected within the preset time length range, that is, if the displayed courseware content is not changed or the change degree is not large, the default screen, for example, the panoramic screen of the platform area, can be automatically switched to.
And step 420, under the condition that the change is determined, switching the currently displayed picture to the target equipment display picture.
Therefore, the change condition of the display picture of the target equipment is monitored, and the currently displayed picture is switched to the display picture of the target equipment under the change condition, so that the whole interaction process can be further displayed in an all-round manner.
It should be noted that the application scenarios described in the embodiments of the present application are for more clearly illustrating the technical solutions in the embodiments of the present application, and do not constitute limitations on the technical solutions provided in the embodiments of the present application, and as a person having ordinary skill in the art can appreciate, with the occurrence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
Based on the same inventive concept, the application also provides a display screen switching device. The details are described with reference to fig. 5.
Fig. 5 is a schematic structural diagram illustrating a display screen switching apparatus according to an exemplary embodiment.
As shown in fig. 5, the display screen switching apparatus 500 may include:
the picture display module 501 is configured to display a first collected picture collected by the first picture collection device;
a first switching module 502, configured to, when a target person is detected to appear in a first captured image, acquire a first area image including the target person from the first captured image, and switch a currently displayed image to the first area image;
the second switching module 503 is configured to switch the currently displayed picture to the second captured picture when it is detected that the target person appears in the second captured picture captured by the second picture capturing device.
The display screen switching device 500 is described in detail below, specifically as follows:
in some embodiments, the display screen switching apparatus 500 may further include:
the position acquisition module is used for acquiring reference position information corresponding to a first area picture and real-time position information of the target person in the first area picture after the currently displayed picture is switched to the first area picture;
the displacement determining module is used for determining the displacement of the target person according to the reference position information and the real-time position information;
and the third switching module is used for switching the currently displayed picture into the first acquisition picture under the condition that the displacement is greater than the preset threshold value.
In some embodiments, the display screen switching apparatus 500 further includes:
and the fourth switching module is used for switching the currently displayed picture to the second acquisition picture under the condition that the first acquisition picture does not contain any person after the currently displayed picture is switched to the first area picture.
In some embodiments, the display screen switching apparatus 500 further includes:
the gesture monitoring module is used for monitoring motion gestures respectively corresponding to a plurality of characters contained in the second acquisition picture;
the character determining module is used for determining whether a first character in a preset motion gesture exists in the plurality of characters according to the motion gesture;
and the fifth switching module is used for acquiring a second area picture containing the first person from the second acquisition picture under the condition that the first person in the preset motion posture exists, and switching the currently displayed picture into the second area picture.
In some embodiments, an attitude monitoring module, comprising:
the information acquisition submodule is used for acquiring position information of target parts corresponding to a plurality of characters contained in the second acquisition picture;
and the posture determining submodule is used for determining the motion postures corresponding to the multiple people respectively according to the position information of the target part.
In some embodiments, the display screen switching apparatus 500 may further include:
and the sixth switching module is used for switching the currently displayed picture into the second acquisition picture under the condition that the currently displayed picture is other pictures except the second acquisition picture and a plurality of characters in the preset motion posture exist in the currently displayed picture after determining whether the first character in the preset motion posture exists in the plurality of characters according to the motion posture.
In some embodiments, the display screen switching apparatus 500 may further include:
the image detection module is used for detecting whether the display image of the target equipment changes; the target equipment display picture is a picture displayed in the target equipment;
and the seventh switching module is used for switching the currently displayed picture to the target equipment display picture under the condition that the change is determined.
In some embodiments, a picture detection module, comprising:
the information acquisition submodule is used for acquiring the change information between the current frame and the previous frame of the display picture of the target equipment;
the degree determining submodule is used for determining whether the change degree of the display picture of the target equipment reaches a change degree threshold value corresponding to the preset sensitivity according to the change information;
and the change determining submodule is used for determining that the display picture of the target device changes under the condition that the change degree threshold value is determined to be reached.
Therefore, when the target person appears in the displayed first captured picture, the first area picture containing the target person is acquired from the first captured picture, the currently displayed picture is switched to the first area picture, and when the target person appears in the second captured picture captured by the second picture capturing device, the currently displayed picture is switched to the second captured picture. In this way, since the embodiment of the present application employs the screen switching mechanism based on screen recognition, the accuracy of screen switching can be improved. In addition, the image of the close-up area of the object can be switched to according to the target person appearing in the image, and the image of the close-up area of the object can be switched to other images according to the fact that the target person enters other image acquisition areas, so that the whole interaction process can be displayed more comprehensively.
Fig. 6 shows a hardware schematic diagram of an electronic device provided in an embodiment of the present application.
The electronic device 600 may include a processor 601 and a memory 602 that stores computer program instructions.
Specifically, the processor 601 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured to implement one or more Integrated circuits of the embodiments of the present Application.
The memory may include Read Only Memory (ROM), Random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors), it is operable to perform operations described with reference to the methods according to an aspect of the application.
The processor 601 realizes any one of the display screen switching methods in the above embodiments by reading and executing computer program instructions stored in the memory 602.
In some examples, electronic device 600 may also include a communication interface 603 and a bus 610. As shown in fig. 6, the processor 601, the memory 602, and the communication interface 603 are connected via a bus 610 to complete communication therebetween.
The communication interface 603 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present application.
The electronic device may execute the display screen switching method in the embodiment of the present application, so as to implement the display screen switching method and apparatus described in conjunction with fig. 1 to 5.
In addition, with reference to the display screen switching method in the foregoing embodiment, the embodiment of the present application may provide a computer-readable storage medium to implement the method. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the display screen switching methods in the above embodiments.
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions or change the order between the steps after comprehending the spirit of the present application.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
Aspects of the present application are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware for performing the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As described above, only the specific embodiments of the present application are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.
Claims (11)
1. A display screen switching method is characterized by comprising the following steps:
displaying a first acquisition picture acquired by a first picture acquisition device;
under the condition that a target person appears in the first acquisition picture, acquiring a first area picture containing the target person from the first acquisition picture, and switching a currently displayed picture into the first area picture;
and under the condition that the target person appears in a second acquisition picture acquired by a second picture acquisition device, switching the currently displayed picture into the second acquisition picture.
2. The method according to claim 1, wherein after switching the currently displayed picture to the first area picture, the method further comprises:
acquiring reference position information corresponding to the first area picture and real-time position information of the target person in the first area picture;
determining the displacement of the target person according to the reference position information and the real-time position information;
and under the condition that the displacement is larger than a preset threshold value, switching the currently displayed picture into the first acquisition picture.
3. The method according to claim 1, wherein after switching the currently displayed picture to the first area picture, the method further comprises:
and under the condition that the first acquisition picture is detected not to contain any person, switching the currently displayed picture to the second acquisition picture.
4. The method of claim 1, further comprising:
monitoring motion postures corresponding to a plurality of characters contained in the second acquisition picture respectively;
determining whether a first person in a preset movement posture exists in the plurality of persons according to the movement posture;
and under the condition that a first person in the preset motion posture exists, acquiring a second area picture containing the first person from the second acquisition picture, and switching the currently displayed picture into the second area picture.
5. The method of claim 4, wherein the monitoring of the motion gestures of the plurality of people included in the second captured image comprises:
acquiring position information of target parts respectively corresponding to a plurality of people contained in the second acquisition picture;
and determining the motion postures corresponding to the multiple people respectively according to the position information of the target part.
6. The method of claim 4, wherein after determining whether a first person in the plurality of persons in a preset action gesture exists according to the action gesture, the method further comprises:
and switching the currently displayed picture to the second acquisition picture under the condition that the currently displayed picture is other pictures except the second acquisition picture and a plurality of characters in the preset motion posture exist in the currently displayed picture.
7. The method according to any one of claims 1-6, further comprising:
detecting whether a display picture of target equipment is changed; the target equipment display picture is a picture displayed in the target equipment;
and under the condition that the change is determined, switching the currently displayed picture to the target equipment display picture.
8. The method according to claim 7, wherein the detecting whether the target device display screen changes comprises:
acquiring change information between a current frame and a previous frame of the display picture of the target equipment;
determining whether the change degree of the display picture of the target equipment reaches a change degree threshold value corresponding to preset sensitivity or not according to the change information;
and determining that the target device display screen changes when the change degree threshold is reached.
9. A display screen switching apparatus, comprising:
the picture display module is used for displaying a first collected picture collected by the first picture collection device;
the first switching module is used for acquiring a first area picture containing a target person from the first acquisition picture under the condition that the target person appears in the first acquisition picture, and switching a currently displayed picture into the first area picture;
and the second switching module is used for switching the currently displayed picture into the second acquisition picture under the condition that the target person appears in the second acquisition picture acquired by the second picture acquisition device.
10. An electronic device, characterized in that the device comprises: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the steps of the method of switching between display screens of any of claims 1-8.
11. A computer-readable storage medium, having stored thereon computer program instructions, which, when executed by a processor, implement the steps of the display screen switching method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111460625.2A CN114245146A (en) | 2021-12-02 | 2021-12-02 | Display picture switching method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111460625.2A CN114245146A (en) | 2021-12-02 | 2021-12-02 | Display picture switching method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114245146A true CN114245146A (en) | 2022-03-25 |
Family
ID=80752796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111460625.2A Pending CN114245146A (en) | 2021-12-02 | 2021-12-02 | Display picture switching method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114245146A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4531024A (en) * | 1983-10-25 | 1985-07-23 | At&T Bell Laboratories | Multilocation video conference terminal including video switching contention control |
| CN103093654A (en) * | 2013-01-28 | 2013-05-08 | 北京航空航天大学 | Double video camera interactive intelligent tracking teaching system |
| JP2014090750A (en) * | 2012-10-31 | 2014-05-19 | Fujitsu Ltd | Display control device, display control method, and display control program |
| CN105139702A (en) * | 2015-10-14 | 2015-12-09 | 广州天莱软件科技有限公司 | Recording and broadcasting system used for teaching and use method thereof |
| CN106961568A (en) * | 2017-03-09 | 2017-07-18 | 广州盈可视电子科技有限公司 | A kind of picture changeover method, device and system |
| CN107657849A (en) * | 2017-09-29 | 2018-02-02 | 北京优教互动教育科技有限公司 | A kind of remote interactive teaching system and method |
| CN111988520A (en) * | 2020-07-07 | 2020-11-24 | 北京文香信息技术有限公司 | Picture switching method and device, electronic equipment and storage medium |
| CN112689092A (en) * | 2020-12-23 | 2021-04-20 | 广州市迪士普音响科技有限公司 | Automatic tracking conference recording and broadcasting method, system, device and storage medium |
| CN113612961A (en) * | 2021-07-13 | 2021-11-05 | 杭州海康威视数字技术股份有限公司 | Picture output control method, device, equipment and machine readable storage medium |
-
2021
- 2021-12-02 CN CN202111460625.2A patent/CN114245146A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4531024A (en) * | 1983-10-25 | 1985-07-23 | At&T Bell Laboratories | Multilocation video conference terminal including video switching contention control |
| JP2014090750A (en) * | 2012-10-31 | 2014-05-19 | Fujitsu Ltd | Display control device, display control method, and display control program |
| CN103093654A (en) * | 2013-01-28 | 2013-05-08 | 北京航空航天大学 | Double video camera interactive intelligent tracking teaching system |
| CN105139702A (en) * | 2015-10-14 | 2015-12-09 | 广州天莱软件科技有限公司 | Recording and broadcasting system used for teaching and use method thereof |
| CN106961568A (en) * | 2017-03-09 | 2017-07-18 | 广州盈可视电子科技有限公司 | A kind of picture changeover method, device and system |
| CN107657849A (en) * | 2017-09-29 | 2018-02-02 | 北京优教互动教育科技有限公司 | A kind of remote interactive teaching system and method |
| CN111988520A (en) * | 2020-07-07 | 2020-11-24 | 北京文香信息技术有限公司 | Picture switching method and device, electronic equipment and storage medium |
| CN112689092A (en) * | 2020-12-23 | 2021-04-20 | 广州市迪士普音响科技有限公司 | Automatic tracking conference recording and broadcasting method, system, device and storage medium |
| CN113612961A (en) * | 2021-07-13 | 2021-11-05 | 杭州海康威视数字技术股份有限公司 | Picture output control method, device, equipment and machine readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11943532B2 (en) | Enhanced image capture | |
| CN106791485B (en) | Video switching method and device | |
| CN112087574B (en) | Enhanced image capture | |
| CN106464802B (en) | The image capture of enhancing | |
| EP3146708B1 (en) | Enhanced image capture | |
| CN110718067A (en) | Violation behavior warning method and related device | |
| CN111241872B (en) | Video image shielding method and device | |
| CN108416337A (en) | User is reminded to clean the method and device of camera lens | |
| KR102511287B1 (en) | Image-based pose estimation and action detection method and appratus | |
| CN111814587A (en) | Human behavior detection method, teacher behavior detection method, and related system and device | |
| CN110244923B (en) | Image display method and device | |
| CN114245146A (en) | Display picture switching method, device, equipment and computer readable storage medium | |
| CN114222065B (en) | Image processing method, image processing apparatus, electronic device, storage medium, and program product | |
| Sanketi et al. | Anti-blur feedback for visually impaired users of smartphone cameras | |
| CN116030411B (en) | Human privacy shielding method, device and equipment based on gesture recognition | |
| CN113762156B (en) | Video data processing method, device and storage medium | |
| CN115410232B (en) | Blackboard writing snapshot method and device, electronic equipment and readable storage medium | |
| CN111582243B (en) | Countercurrent detection method, countercurrent detection device, electronic equipment and storage medium | |
| CN117636259A (en) | Fall detection method and device, nonvolatile storage medium and electronic equipment | |
| CN116453181A (en) | Automatic guiding and broadcasting method based on machine vision, intelligent screen and storage medium | |
| CN114519789A (en) | Classroom scene classroom switching discrimination method and device and electronic equipment | |
| CN112437249A (en) | Personnel tracking method and personnel tracking system | |
| Singh et al. | Recognizing fast moving objects at normal human perception rate |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |