CN112291507A - Video picture adjusting method and device, electronic equipment and storage medium - Google Patents

Video picture adjusting method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112291507A
CN112291507A CN202011556189.4A CN202011556189A CN112291507A CN 112291507 A CN112291507 A CN 112291507A CN 202011556189 A CN202011556189 A CN 202011556189A CN 112291507 A CN112291507 A CN 112291507A
Authority
CN
China
Prior art keywords
video picture
control operation
initial video
initial
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011556189.4A
Other languages
Chinese (zh)
Inventor
周捷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Youmi Technology Shenzhen Co ltd
Original Assignee
Youmi Technology Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Youmi Technology Shenzhen Co ltd filed Critical Youmi Technology Shenzhen Co ltd
Priority to CN202011556189.4A priority Critical patent/CN112291507A/en
Publication of CN112291507A publication Critical patent/CN112291507A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a video picture adjusting method, a device, electronic equipment and a storage medium, and relates to the technical field of video processing, when the electronic equipment is in a conference mode, an initial video picture is displayed, when a control operation of external equipment acting on the initial video picture is detected, a corresponding control position of the control operation in the initial video picture is obtained, then the initial video picture is processed based on the control position, a current video picture is obtained, the current video picture is a picture adjusted according to control operation of a user, and the current video picture is displayed, so that the electronic equipment automatically adjusts the picture according to the control of the external equipment, and great convenience is brought to the user.

Description

Video picture adjusting method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of video processing technologies, and in particular, to a method and an apparatus for adjusting a video frame, an electronic device, and a storage medium.
Background
The video conference refers to two or more places of participants, and audio and video information communicated with each other between the participants is transmitted by means of a communication network so as to realize two-place or multi-place interaction. At present, in a video conference, in order to present a clear video picture on a display screen of a computer or a projection screen of a projector, adjustment is usually performed by a user, but an existing adjustment mode is usually complicated, and great inconvenience is brought to user operation.
Disclosure of Invention
In view of the foregoing problems, the present application provides a method and an apparatus for adjusting a video frame, an electronic device, and a storage medium, which can solve the foregoing problems.
In a first aspect, an embodiment of the present application provides a method for adjusting a video picture, which is applied to an electronic device, and the method includes: displaying an initial video picture when the electronic device is in a conference mode; when detecting a control operation acted on the initial video picture by an external device, obtaining a corresponding control position of the control operation in the initial video picture; processing the initial video picture based on the control position to obtain a current video picture; and displaying the current video picture.
In a second aspect, an embodiment of the present application provides an apparatus for adjusting a video picture, where an initial video picture display module is configured to display an initial video picture when an electronic device is in a conference mode; the control position acquisition module is used for acquiring a corresponding control position of the control operation in the initial video picture when the control operation acted on the initial video picture by the external equipment is detected; the current video picture acquisition module is used for processing the initial video picture based on the control position to obtain a current video picture; and the current video picture display module is used for displaying the current video picture.
In a third aspect, embodiments of the present application provide an electronic device, one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the above-described methods.
In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.
According to the method and the device for adjusting the video picture, the electronic device and the storage medium, when the electronic device is in a conference mode, an initial video picture is displayed, when the control operation of the external device acting on the initial video picture is detected, a corresponding control position of the control operation in the initial video picture is obtained, then the initial video picture is processed based on the control position, a current video picture is obtained, the current video picture is a picture which is not adjusted according to the control operation of a user, and the current video picture is displayed, so that the electronic device automatically adjusts the picture according to the control of the external device, the adjustment operation of the user is simplified, and great convenience is brought to the user.
These and other aspects of the present application will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic application environment diagram of a video frame adjustment method according to an embodiment of the present application;
fig. 2 is a flowchart of a video frame adjustment method according to an embodiment of the present application;
fig. 3 is a flowchart of a video frame adjustment method according to another embodiment of the present application;
FIG. 4 is a schematic diagram of an initial video frame according to an embodiment of the present application;
FIG. 5 is a schematic view of a zoom control operation according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a zoomed current video frame according to an embodiment of the present application;
fig. 7 is a flowchart of a video frame adjustment method according to still another embodiment of the present application;
FIG. 8 is a schematic diagram of an initial video frame according to another embodiment of the present application;
FIG. 9 is a schematic view of a focus control operation according to an embodiment of the present application;
FIG. 10 is a diagram illustrating a focused current video frame according to an embodiment of the present application;
fig. 11 is a flowchart of a video frame adjustment method according to another embodiment of the present application;
fig. 12 is a flowchart of step S440 of the adjusting method of the video frame shown in fig. 11 according to the present embodiment;
fig. 13 is a block diagram of an adjusting apparatus for video frames according to an embodiment of the present application;
fig. 14 is a block diagram of an electronic device for executing an adjustment method of a video screen according to an embodiment of the present application;
fig. 15 is a storage unit for storing or carrying program code that implements adjustment of video pictures according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The video conference refers to two or more places of participants, and audio and video information communicated with each other between the participants is transmitted by means of a communication network so as to realize two-place or multi-place interaction. At present, in a video conference, in order to present a clear video picture on a display screen of a computer or a projection screen of a projector, manual adjustment is usually performed by a user, and an adjustment mode in the prior art is relatively complicated, which brings great inconvenience to the user.
In view of the above technical problems, the inventor has found through long-term research and provided a method, an apparatus, an electronic device, and a storage medium for adjusting a video picture provided by the present application, where when the electronic device is in a conference mode, a display screen of the electronic device displays an initial video picture, and a user performs a control operation on the initial video picture through an external device, so that the initial video picture is displayed, and a convenient adjustment of the video picture is achieved. The specific video frame adjustment method will be described in detail in the following embodiments.
The electronic device is connected to an external device, when a user performs a video conference, the audio and video information of the video conference is displayed through the electronic device, when the user needs to adjust the video information, the video picture is controlled and operated through the external device to achieve adjustment of the video picture, the electronic device is taken as a computer, and the external device is taken as a mouse for example for explanation, referring to fig. 1, the computer 110 is connected to the mouse 120, a display screen of the computer 110 displays an initial video picture, when the user needs to adjust the initial video picture, the user can perform control operation on the mouse 120, for example, clicking a left key or a right key of the mouse 120, sliding a pulley of the mouse 120, or moving the mouse 120, so as to achieve adjustment of the initial video picture, and obtain an adjusted current video picture.
Fig. 2 is a flowchart of a video picture adjustment method according to an embodiment of the present application, in which a video picture is adjusted by an external device, so that a complicated process caused by manual adjustment of a user is avoided, and great convenience is brought to the user. In a specific embodiment, the adjusting method of the video picture is applied to the adjusting apparatus 300 of the video picture as shown in fig. 13 and the electronic device 400 (fig. 14) equipped with the adjusting apparatus 300 of the video picture. The following will describe a specific flow of the embodiment by taking an electronic device as an example, and it is understood that the electronic device applied in the embodiment may be a tablet computer, a desktop computer, a notebook computer, a television, a projection device, and the like, and is not limited herein. As will be described in detail with respect to the flow shown in fig. 2, the method for adjusting a video picture may specifically include the following steps:
and step S110, when the electronic equipment is in a conference mode, displaying an initial video picture.
When a user needs to carry out a video conference, the working mode of the electronic equipment can be adjusted to a conference mode after logging in a video conference account through an application program or a website which is installed on the electronic equipment and can support the video conference. In the conference mode, audio and video information communicated with each other can be displayed through the local electronic equipment of the user and the electronic equipment of the remote participant, specifically, the sound box or the loudspeaker can play the audio information of the remote participant, and the display screen or the projection screen of the electronic equipment can display initial video pictures of the user and the remote participant, for example, the initial video pictures include a first initial video picture and a second initial video picture, the first initial video picture of the user can be displayed through the first display area, and the second initial video picture of the remote participant can be displayed through the second display area.
Optionally, the initial video picture may be a picture acquired in real time, for example, the first initial video picture is a picture of a user acquired by a camera on the electronic device of the user in real time, or the second initial video picture is a picture of a participant acquired by a camera on the electronic device of a participant at a distance in real time.
And step S120, when the control operation acted on the initial video picture by the external equipment is detected, obtaining the corresponding control position of the control operation in the initial video picture.
When the initial video picture needs to be adjusted, a user inputs control operation to the initial video picture through the external device, and when the electronic device detects the control operation acted on the initial video picture by the external device, the corresponding control position of the control operation in the initial video picture is determined, the initial video picture is adjusted by taking the control position as a center, and the control position can be understood as a position concerned by the user.
In some embodiments, the user may adjust the local video picture, that is, the user may adjust the first initial video picture by using the external device, and when the electronic device detects a first control operation performed on the first initial video picture by using the external device, the electronic device obtains a first control position corresponding to the first control operation in the first initial video picture, and adjusts the first initial video picture by using the first control position as a center.
In other embodiments, the user may further adjust the video frames of the remote participants, when the electronic device of the user has an adjustment right for the second initial video frame, the user may adjust the second initial video frame through the external device, and when the electronic device detects a second control operation performed by the external device on the second initial video frame, obtain a second control position corresponding to the second control operation in the second initial video frame, and adjust the second initial video frame with the second control position as a center.
Alternatively, the control position may be a coordinate point on the initial video frame, or may be a region on the initial video frame, for example, a 200 × 200 pixel frame on the initial video frame.
In the present embodiment, the external device may be, but is not limited to, a mouse, a keyboard, a microphone, and the like. In embodiments where the external device includes a mouse, the user may enter a control operation by clicking on the mouse, sliding a wheel of the mouse, or the like. In embodiments where the external device includes a keyboard, the user may enter control operations via the keyboard, by long press, etc. In embodiments where the external device includes a microphone, the user may enter a control operation by voice input through the microphone, for example, the user may enter "please focus on the video screen" by voice.
And step S130, processing the initial video picture based on the control position to obtain a current video picture.
And taking the control position as a center, automatically focusing, zooming and other processing on the initial video picture to obtain the current video picture, wherein the current video picture is the focused or zoomed video picture, and the user can more clearly see the condition of the concerned position through the current video picture.
In some embodiments, the user adjusts the local video frame, and when performing focus adjustment on the first initial video frame, the camera of the local electronic device performs focus based on the control position to obtain a focused current video frame. And when the first initial video picture is subjected to zooming adjustment, zooming the first initial video picture based on the control position to obtain a zoomed current video picture.
In other embodiments, the user adjusts the video frame of the distant participant, that is, performs focus adjustment on the second initial video frame, transmits the focus adjustment instruction to the distant electronic device, and the camera of the distant electronic device obtains a control position based on the focus adjustment instruction, performs focus shooting based on the control position, obtains a current video frame after focusing, and transmits the current video frame after focusing to the local electronic device for display. And when the second initial video picture is zoomed and adjusted, zooming the second initial video picture on the local electronic equipment based on the control position to obtain a zoomed current video picture.
And step S140, displaying the current video picture.
And displaying the current video picture of the user through a display screen or a projection screen of the electronic equipment.
According to the method for adjusting the video picture, when the electronic device is in a conference mode, an initial video picture is displayed, when the control operation of the external device acting on the initial video picture is detected, a corresponding control position of the control operation in the initial video picture is obtained, then the initial video picture is processed based on the control position, a current video picture is obtained, the current video picture is a picture adjusted according to the control operation of a user, and the current video picture is displayed, so that the electronic device automatically adjusts the picture according to the control of the external device, and great convenience is brought to the user.
The adjusting of the initial video frame includes zoom adjustment, and a user controls an external device to zoom the initial video frame, where this embodiment takes the external device as a mouse as an example for description, fig. 3 is a flowchart of a video frame adjusting method according to another embodiment of the present application, and please refer to fig. 3, where the video frame adjusting method specifically includes the following steps:
and step S210, when the electronic equipment is in a conference mode, displaying an initial video picture.
For detailed description of step S210, please refer to step S110, which is not described herein again.
And step S220, when the control operation acted on the initial video picture by the external equipment is detected, obtaining the corresponding control position of the control operation in the initial video picture.
In the initial video frame, when the position or area focused by the user is small, such as shown in fig. 4, and the participant 210, the participant 220, and the participant 230 are small in the initial video frame and affect the finger quality of the user video conference, the user may perform zoom control on the video frame by using the mouse, and first determine a zoom position, such as a coordinate position on the initial video frame or a display area on the initial video frame, and then determine a zoom range, wherein the zoom range includes zoom-in or zoom-out, and a zoom range, such as a zoom range of-0.2 and a zoom range of 0.2, and further such as a zoom range of +0.2 and a zoom range of 0.2.
When a user uses a mouse to perform zoom control on an initial video picture, and when a first zoom control operation acted on the initial video picture by the mouse is detected, a zoom position corresponding to the first zoom control operation in the initial video picture is obtained, where the first zoom control operation is generated based on a movement operation acted on the mouse, for example, as shown in fig. 5, the mouse is displayed as an arrow on a display screen or a projection screen, when the mouse moves, the arrow on the display screen or the projection screen moves, a position where the arrow on the display screen or the projection screen is located is a zoom position, and the zoom position is a position where a dotted line frame in fig. 5 is located. Optionally, the mouse may also be displayed as a palm shape on the display screen.
And step S230, obtaining the scaling amplitude corresponding to the scaling control operation.
When the second zooming control operation acted on the initial video picture by the mouse is detected, obtaining the corresponding zooming amplitude of the second zooming control operation in the initial video picture, wherein the second zooming control operation is generated based on the sliding operation acted on the pulley of the mouse.
The zooming range includes zooming in or zooming out, which can be determined by the sliding direction of the wheel of the mouse, for example, zooming out when the wheel slides in a first direction, and zooming in when the wheel slides in a second direction opposite to the first direction.
The zoom range also includes a zoom range, and the zoom range is determined by the sliding range of the pulley, specifically, the zoom range is positively correlated with the sliding range, when the sliding range of the pulley is larger, the zoom range is larger, and conversely, when the sliding range of the pulley is smaller, the zoom range is smaller. The sliding range can be determined by the sliding speed and the sliding duration, and the sliding range is positively correlated with the sliding speed and the sliding duration, namely the sliding range is larger when the sliding speed is higher, and conversely, the sliding range is smaller when the sliding speed is lower; alternatively, when the sliding time length is longer, the corresponding sliding range is larger, and conversely, when the sliding time length is shorter, the corresponding sliding range is smaller.
Step S240, zooming the initial video frame by the zoom position according to the zoom range, and obtaining the current video frame.
According to the zoom range, the initial video picture is directly zoomed and controlled by taking the zoom position as the center, and the zoomed current video picture is obtained, for example, the zoom position is a point a of the mouse on the initial video picture, the zoom range is +2, then the initial video picture corresponding to the point a is zoomed in 2 times, and the current video picture is obtained, as shown in fig. 6, all of the participant 210, the participant 220 and the participant 230 are zoomed in 2 times, but because the size of the display area on the display screen is fixed, and the position corresponding to the participant 230 is the zoom position, after the initial video picture is zoomed in 2 times, the position of the participant 230 is moved to the central position of the display area, and the participant 210 is partially displayed in the display area.
Optionally, in addition to directly zooming the initial image, the zoomed current video image may be obtained by adjusting a lens of the camera, specifically, determining a zoom position in the initial video image, and shooting after adjusting the lens of the camera, so as to obtain the current video image. When the zooming amplitude comprises zooming, the distance between the lens and the zooming position is shortened, so that a zoomed current video picture is obtained, for example, "rancour face shot" in the shooting and shooting skill is realized, the participant can watch the zooming position more carefully, and the video conference experience is improved. When the zooming amplitude comprises zooming, the distance between the lens and the zooming position is pulled open, and then shooting is carried out, so that a zoomed current video picture is obtained, the current video picture contains richer contents, and the experience of a video conference is improved.
And step S250, displaying the current video picture.
For a detailed description of step S250, please refer to step S140, which is not described herein.
In the method for adjusting a video image provided in this embodiment, the zoom position is determined by the movement operation of the mouse, and the zoom amplitude is determined by the sliding operation of the mouse wheel, so that the initial video image is zoomed at the zoom position according to the zoom amplitude according to the zoom operation of the mouse, the zoomed current video image is obtained, and the operation of adjusting the video image by the user is simplified.
The adjustment of the initial video frame includes focus adjustment, the video frame of the video conference is acquired by a camera of the electronic device, the initial video frame is acquired by the camera, when an image of a region concerned by a user in the initial video frame is blurred, the camera needs to be adjusted to focus the region concerned by the user, so as to shoot a clear image of the region concerned, the process of the focus adjustment is as follows, fig. 7 is a flowchart of an adjustment method of the video frame provided in another embodiment of the present application, please refer to fig. 7, and the adjustment method of the video frame specifically may include the following steps:
and step S310, when the electronic equipment is in a conference mode, displaying an initial video picture.
For detailed description of step S310, please refer to step S110, which is not described herein again.
Step S320, when the control operation acted on the initial video picture by the external equipment is detected, obtaining the corresponding control position of the control operation in the initial video picture.
When the acquired initial video image is unclear or the image of the area focused by the user in the initial video image is blurred, for example, as shown in fig. 8, the initial video image includes participant 210, participant 220, and participant 230, the areas corresponding to participant 210, participant 220, and participant 230 are unclear, and the area focused by the user is the area where participant 230 is located, the image of the area is unclear, and the position needs to be focused. The control operation of the user comprises a focusing control operation, the user inputs the focusing control operation through the external device, and when the electronic device detects the focusing control operation acted on the initial video picture by the external device, the electronic device obtains the corresponding focusing position of the focusing control operation in the initial video picture, for example, the external device comprises a mouse, a keyboard, a microphone and the like.
In some embodiments, when the external device includes a mouse, and the mouse is displayed in an arrow shape on the display screen or the projection screen, the user performs a click operation on the mouse, as shown in fig. 9, the user clicks a position of the participant 230, a dashed frame shown in fig. 9 is a selected frame, and the mouse in fig. 9 can be moved away after being selected, a first focus control operation is generated based on the click operation performed on the mouse, and when the first focus control operation performed on the initial video picture by the mouse is detected, the focus position corresponding to the first focus control operation in the initial video picture is obtained, where the focus position is a position where a cursor in the initial video picture is located or a position where the selected frame in fig. 9 is located.
In other embodiments, the external device includes a keyboard, and when a user performs an input operation on the keyboard, for example, the user inputs a focus position through the keyboard, a second focus control operation is generated based on the input operation applied to the keyboard, and when the second focus control operation applied to the initial video frame by the mouse is detected, a corresponding focus position of the second focus control operation in the initial video frame is obtained.
In other embodiments, the external device includes a microphone, and when the user inputs a voice "please focus on a long hair woman with glasses in the upper left corner of the screen" through the microphone, a third focusing control operation is generated based on the voice, and a corresponding focusing position of the third focusing control operation in the initial video screen is detected.
And step S330, determining the focal length of the camera based on the focusing position.
And determining the focal length of the camera based on the focus position determined by the focusing operation of the mouse, the keyboard or the microphone.
And step S340, adjusting shooting parameters of the camera according to the focal length so that the camera performs focusing shooting at the focusing position by the focal length to obtain the current video picture.
And adjusting shooting parameters of the camera according to the focal length, for example, adjusting the focal length of an aperture of the camera, and performing focusing shooting at the focal length by the camera at a focusing position after the adjustment to obtain a current video picture, wherein the obtained current video picture includes a clear image of an area concerned by the user, as shown in fig. 10, the picture of the area where the participant 230 is located is clear, and areas corresponding to the participants 210 and 220 which are not concerned by the rest of users are still not clear.
And step S350, displaying the current video picture.
For the detailed description of step S350, please refer to step S140, which is not described herein again.
In the method for adjusting a video picture provided by this embodiment, a user inputs a focus control operation through an external device, and when the electronic device detects the focus control operation of the external device on an initial video picture, a focus position corresponding to the operation is obtained, a focal length of a camera is determined based on the focus position, and the focal length of the camera is adjusted, so that the camera performs focus shooting at the focus position, obtains a current video picture, and displays the current video picture.
When focusing and adjusting an initial video frame, the external device may include a keyboard, and may control the camera to focus and shoot through input content of the keyboard, fig. 11 is a flowchart of a video frame adjusting method according to another embodiment of the present application, and please refer to fig. 11, where the video frame adjusting method specifically includes the following steps:
and S410, displaying an initial video picture when the electronic equipment is in a conference mode.
For detailed description of step S410, please refer to step S110, which is not described herein again.
Step S420, when detecting the second focusing control operation that the keyboard acts on the initial video image, obtaining a conference theme corresponding to the second focusing control operation, where the second focusing control operation is generated based on an input operation that acts on the keyboard.
When the acquired initial video picture is not clear or the image of the area concerned by the user in the initial video picture is blurred, the user performs an input operation through a keyboard, for example, the content input by the user is "a cultural relic exhibition of a certain cultural relic hall", or "a work report of a certain meeting of a certain work" generates a second focusing control operation based on the input operation, and then obtains a conference subject corresponding to the second focusing control operation, for example, a conference subject obtained for the "cultural relic exhibition of the certain cultural hall" is "a cultural relic show", and a conference subject obtained for the "a work report of a certain meeting of a certain work" is "a work report".
Optionally, the video conference theme may also be preset by the user before the conference.
And step S430, acquiring a plurality of detection objects from the initial video picture.
The camera captures an initial video picture, and the electronic device divides the initial video picture to obtain a plurality of detection objects, for example, the plurality of detection objects include B1 people, B2 people, B3 people, C1 items, C2 items, C3 items, and the like.
Step S440, determining a detection object matching the conference subject as a target object among the plurality of detection objects.
Among the plurality of detection objects, a detection object matching the conference subject is determined as a target object, and it is understood that the obtained target object is an object focused by the user, that is, the center of focus.
In some embodiments, when the conference theme includes "cultural relic exhibition," the plurality of test subjects include a first staff member, a second staff member, a third staff member, a cup, a table, a cloisonne enamel ancient playing vase (cultural relic). And determining that the detection object matched with the conference theme ' cultural relic exhibition ' in the detection objects is a cultural relic ' cloisonne enamel ancient playing vase ', and determining the cloisonne enamel ancient playing vase ' as a target object.
In other embodiments, when the conference topic includes a "work report", the obtained multiple detection objects may be multiple participants, for example, the multiple participants include a first participant, a second participant, and a third participant, and the obtained target object may be as follows, where fig. 12 is a flowchart of step S440 of the video picture adjustment method shown in fig. 11 of this embodiment, please refer to fig. 12, and step S440 includes the following steps:
step S441, obtaining a plurality of lip opening degrees of the plurality of participants, wherein the plurality of participants correspond to the plurality of lip opening degrees one to one.
The lip opening degree corresponding to each of the multiple participants is obtained, for example, the multiple participants include a first participant, a second participant and a third participant, and the lip opening degrees corresponding to the first participant, the second participant and the third participant are respectively obtained.
Step S442, determining, as the target object, a participant corresponding to a lip opening degree greater than a preset opening degree among the plurality of lip opening degrees.
According to the speaking habit of people, when people speak, the opening and closing degree of the corresponding lips is used as a preset opening and closing degree, and in the plurality of lip opening and closing degrees, a participant corresponding to the lip opening and closing degree larger than the preset opening and closing degree shows that the participant is speaking, and then the participant is used as a target object.
For example, when the opening degree of lips of the first participant, the second participant, and the third participant is 10%, 0, and 60%, respectively, and when the preset opening degree is 50%, the opening degree of lips of the third participant is 50%, the third participant is determined to be the target object.
And step S450, determining the position of the target object in the initial video picture as the focusing position.
The determined target object is an object of interest, and the position of the target object is a position of interest of the user, namely a focusing position.
Optionally, when the conference subject includes a "work report", when the conference shares one microphone or speaker, the microphone or speaker is located at the speaker, and thus, the location of the microphone or speaker may also be determined as the focus position.
And step S460, determining the focal length of the camera based on the focusing position.
And step 470, adjusting shooting parameters of the camera according to the focal length, so that the camera performs focusing shooting at the focusing position by the focal length, and obtaining the current video picture.
For the detailed description of steps S460 to S470, please refer to steps S330 to S340, which are not described herein again.
And step S480, displaying the current video picture.
For a detailed description of step S480, please refer to step S140, which is not described herein.
In the method for adjusting a video picture provided by this embodiment, a user inputs a focus control operation through a keyboard, and when an electronic device detects a second focus control operation in which the keyboard acts on an initial video picture, a focus position corresponding to the operation is obtained, a focal length of a camera is determined based on the focus position, and the focal length of the camera is adjusted, so that the camera performs focus shooting at the focus position to obtain a current video picture and display the current video picture.
To implement the above method embodiments, the present embodiment provides an apparatus for adjusting a video frame, fig. 13 is a block diagram of the apparatus for adjusting a video frame according to an embodiment of the present application, and referring to fig. 13, an apparatus 300 for adjusting a video frame includes: an initial video frame display module 310, a control position acquisition module 320, a current video frame acquisition module 330, and a current video frame display module 340.
An initial video frame display module 310, configured to display an initial video frame when the electronic device is in a conference mode;
a control position obtaining module 320, configured to, when a control operation that an external device acts on the initial video image is detected, obtain a corresponding control position of the control operation in the initial video image;
a current video picture collecting module 330, configured to process the initial video picture based on the control position to obtain a current video picture;
and a current video picture display module 340, configured to display the current video picture.
Optionally, when the control operation includes a zoom control operation, the control position includes a zoom position, and the current video picture capturing module 330 includes: a zoom amplitude acquisition submodule and a first current video picture acquisition submodule.
A scaling amplitude obtaining submodule, configured to obtain a scaling amplitude corresponding to the scaling control operation;
the first current video picture acquisition submodule is used for zooming the initial video picture at the zooming position according to the zooming amplitude to obtain the current video picture;
optionally, the external device includes a mouse, the zoom control operation includes a first zoom control operation and a second zoom control operation, and the control position obtaining module 320 includes: and a zoom position acquisition submodule.
A zoom position obtaining sub-module, configured to, when the first zoom control operation that the mouse acts on the initial video image is detected, obtain a zoom position corresponding to the first zoom control operation in the initial video image, where the first zoom control operation is generated based on a movement operation that acts on the mouse.
The scaling amplitude acquisition sub-module comprises: and sliding the sub-modules.
The sliding sub-module is used for obtaining the corresponding zooming amplitude of the second zooming control operation in the initial video picture when the second zooming control operation acted on the initial video picture by the mouse is detected, wherein the second zooming control operation is generated based on the sliding operation acted on the pulley of the mouse.
Optionally, the electronic device includes a camera, when the control operation includes a focus control operation, the control position includes a focus position, and the current video picture capturing module 330 further includes: a focal length determination submodule and a second current video picture acquisition submodule.
The focal length determining submodule is used for determining the focal length of the camera based on the focusing position;
and the second current video picture acquisition submodule is used for adjusting shooting parameters of the camera according to the focal length so as to enable the camera to carry out focusing shooting at the focusing position by the focal length to obtain the current video picture.
Optionally, the external device includes a mouse, the focus control operation includes a first focus control operation, and the control position obtaining module 320 further includes: a first focus position acquisition submodule.
A first focus position obtaining sub-module, configured to, when the first focus control operation that the mouse acts on the initial video frame is detected, obtain a corresponding focus position of the first focus control operation in the initial video frame, where the first focus control operation is generated based on a click operation that acts on the mouse.
Optionally, the external device includes a keyboard, the focusing control operation includes a second focusing control operation, and the control position obtaining module 320 further includes: the system comprises a conference subject acquisition sub-module, a detection object acquisition sub-module, a target object acquisition sub-module and a second focusing position acquisition sub-module.
A conference theme acquisition sub-module, configured to, when it is detected that the keyboard acts on the second focusing control operation of the initial video image, acquire a conference theme corresponding to the input second focusing control operation, where the second focusing control operation is generated based on the input operation acting on the keyboard;
a detection object obtaining sub-module, configured to obtain a plurality of detection objects from the initial video frame;
the target object acquisition sub-module is used for determining a detection object matched with the conference theme as a target object in the plurality of detection objects;
and the second focusing position acquisition sub-module is used for determining the position of the target object in the initial video picture as the focusing position.
Optionally, the plurality of detection objects includes a plurality of participants, and the target object obtaining sub-module includes: a lip opening ratio determination submodule and a target participant determination submodule.
The lip opening and closing degree determining submodule is used for acquiring a plurality of lip opening and closing degrees of the plurality of participants, wherein the plurality of participants correspond to the plurality of lip opening and closing degrees one by one;
and the target participant determining submodule is used for determining participants corresponding to the lip opening degrees larger than the preset opening degree as the target object in the plurality of lip opening degrees.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
Fig. 14 is a block diagram of an electronic device for executing an adjusting method of a video frame according to an embodiment of the present application, and please refer to fig. 14, which shows a block diagram of an electronic device 400 according to an embodiment of the present application. The electronic device 400 may be a smart phone, a tablet computer, an electronic book, or other electronic devices capable of running an application. The electronic device 400 in the present application may include one or more of the following components: a processor 410, a memory 420, and one or more applications, wherein the one or more applications may be stored in the memory 420 and configured to be executed by the one or more processors 410, the one or more programs configured to perform a method as described in the aforementioned method embodiments.
Processor 410 may include one or more processing cores, among other things. The processor 410 interfaces with various components throughout the electronic device 400 using various interfaces and circuitry to perform various functions of the electronic device 400 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 420 and invoking data stored in the memory 420. Alternatively, the processor 410 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 410 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content to be displayed; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 410, but may be implemented by a communication chip.
The Memory 420 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 420 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 420 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the mobile terminal 400 during use, such as a phonebook, audio-video data, chat log data, and the like.
Referring to fig. 15, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 500 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.
The computer-readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 500 includes a non-volatile computer-readable storage medium. The computer readable storage medium 500 has storage space for program code 510 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 510 may be compressed, for example, in a suitable form.
To sum up, according to the method, the apparatus, the electronic device and the storage medium for adjusting a video picture provided in the embodiments of the present application, when the electronic device is in a conference mode, an initial video picture is displayed, when a control operation of an external device acting on the initial video picture is detected, a corresponding control position of the control operation in the initial video picture is obtained, and then the initial video picture is processed based on the control position to obtain a current video picture, which is a picture adjusted according to a user control operation, and the current video picture is displayed, so that the electronic device automatically adjusts the picture according to the control of the external device, the user operation is simplified, and great convenience is brought to the user.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (10)

1. A method for adjusting a video picture, applied to an electronic device, includes:
displaying an initial video picture when the electronic device is in a conference mode;
when detecting a control operation acted on the initial video picture by an external device, obtaining a corresponding control position of the control operation in the initial video picture;
processing the initial video picture based on the control position to obtain a current video picture;
and displaying the current video picture.
2. The method of claim 1, wherein when the control operation comprises a zoom control operation, the control location comprising a zoom location, and wherein processing the initial video picture based on the control location to obtain a current video picture comprises:
obtaining a scaling amplitude corresponding to the scaling control operation;
and zooming the initial video picture at the zooming position according to the zooming amplitude to obtain the current video picture.
3. The method of claim 2, wherein the external device comprises a mouse, and the zoom control operation comprises a first zoom control operation and a second zoom control operation; when the control operation acted on the initial video picture by the external equipment is detected, obtaining a corresponding control position of the control operation in the initial video picture, wherein the control position comprises the following steps:
when the first zooming control operation acted on the initial video picture by the mouse is detected, obtaining the corresponding zooming position of the first zooming control operation in the initial video picture, wherein the first zooming control operation is generated based on the movement operation acted on the mouse;
the obtaining of the scaling amplitude corresponding to the scaling control operation includes:
when the second zooming control operation acted on the initial video picture by the mouse is detected, obtaining the corresponding zooming amplitude of the second zooming control operation in the initial video picture, wherein the second zooming control operation is generated based on the sliding operation acted on the pulley of the mouse.
4. The method of claim 1, wherein the electronic device comprises a camera, wherein when the control operation comprises a focus control operation, the control position comprises a focus position, and wherein processing the initial video picture based on the control position to obtain a current video picture comprises:
determining a focal length of the camera based on the focus position;
and adjusting shooting parameters of the camera according to the focal length so that the camera performs focusing shooting at the focusing position by the focal length to obtain the current video picture.
5. The method according to claim 4, wherein the external device comprises a mouse, the focus control operation comprises a first focus control operation, and when the control operation of the external device on the initial video picture is detected, obtaining a corresponding control position of the control operation in the initial video picture comprises:
when the first focusing control operation acted on the initial video picture by the mouse is detected, the corresponding focusing position of the first focusing control operation in the initial video picture is obtained, wherein the first focusing control operation is generated based on clicking operation acted on the mouse.
6. The method according to claim 4, wherein the external device comprises a keyboard, the focus control operation comprises a second focus control operation, and the obtaining of the corresponding control position of the control operation in the initial video picture when the control operation of the external device on the initial video picture is detected comprises:
when the second focusing control operation acted on the initial video picture by the keyboard is detected, obtaining a conference subject corresponding to the second focusing control operation, wherein the second focusing control operation is generated based on input operation acted on the keyboard;
acquiring a plurality of detection objects from the initial video picture;
determining a detection object matched with the conference subject as a target object in the plurality of detection objects;
determining a position of the target object in the initial video picture as the focus position.
7. The method of claim 6, wherein the plurality of detection objects comprises a plurality of participants, and wherein the determining, as the target object, a detection object that matches the conference subject among the plurality of detection objects comprises:
obtaining a plurality of lip opening degrees of the plurality of participants, wherein the plurality of participants correspond to the plurality of lip opening degrees one by one;
and determining the participant corresponding to the lip opening degree larger than the preset opening degree as the target object in the plurality of lip opening degrees.
8. An apparatus for adjusting a video frame, comprising:
the initial video picture display module is used for displaying an initial video picture when the electronic equipment is in a conference mode;
the control position acquisition module is used for acquiring a corresponding control position of the control operation in the initial video picture when the control operation acted on the initial video picture by the external equipment is detected;
the current video picture acquisition module is used for processing the initial video picture based on the control position to obtain a current video picture;
and the current video picture display module is used for displaying the current video picture.
9. An electronic device, comprising:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-7.
10. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 7.
CN202011556189.4A 2020-12-25 2020-12-25 Video picture adjusting method and device, electronic equipment and storage medium Pending CN112291507A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011556189.4A CN112291507A (en) 2020-12-25 2020-12-25 Video picture adjusting method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011556189.4A CN112291507A (en) 2020-12-25 2020-12-25 Video picture adjusting method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112291507A true CN112291507A (en) 2021-01-29

Family

ID=74426381

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011556189.4A Pending CN112291507A (en) 2020-12-25 2020-12-25 Video picture adjusting method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112291507A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113823211A (en) * 2021-09-28 2021-12-21 惠科股份有限公司 Driving method, driving device and display device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102215372A (en) * 2010-04-07 2011-10-12 苹果公司 Remote control operations in a video conference
CN102761732A (en) * 2012-07-25 2012-10-31 鲁懿齐 Eye-to-eye communication system for video conference
CN104603764A (en) * 2012-09-14 2015-05-06 坦戈迈公司 Camera manipulation during a video conference
CN105915798A (en) * 2016-06-02 2016-08-31 北京小米移动软件有限公司 Camera control method in video conference and control device thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102215372A (en) * 2010-04-07 2011-10-12 苹果公司 Remote control operations in a video conference
CN102761732A (en) * 2012-07-25 2012-10-31 鲁懿齐 Eye-to-eye communication system for video conference
CN104603764A (en) * 2012-09-14 2015-05-06 坦戈迈公司 Camera manipulation during a video conference
CN105915798A (en) * 2016-06-02 2016-08-31 北京小米移动软件有限公司 Camera control method in video conference and control device thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113823211A (en) * 2021-09-28 2021-12-21 惠科股份有限公司 Driving method, driving device and display device

Similar Documents

Publication Publication Date Title
US11343445B2 (en) Systems and methods for implementing personal camera that adapts to its surroundings, both co-located and remote
JP6642191B2 (en) Method, system, and program for controlling video conferencing
CN109257645B (en) Video cover generation method and device
TW201901527A (en) Video conference and video conference management method
KR102036054B1 (en) Method for recoding a video in the terminal having a dual camera and device thereof
EP3701715B1 (en) Electronic apparatus and method for controlling thereof
CN110677734B (en) Video synthesis method and device, electronic equipment and storage medium
US20210392292A1 (en) System and method for extracting and transplanting live video avatar images
CN104380721A (en) Video-conference terminal device, video-conference system, image distortion correction method, and image distortion correction processing program product
US20230111361A1 (en) Method and apparatus for processing video data
US11310443B2 (en) Video processing method, apparatus and storage medium
CN111988555B (en) Data processing method, device, equipment and machine readable medium
CN106210495A (en) Image capturing method and device
EP3466057A1 (en) Information processing apparatus, conference system, and control method of information processing apparatus
CN110673811B (en) Panoramic picture display method and device based on sound information positioning and storage medium
US9582179B2 (en) Apparatus and method for editing image in portable terminal
CN112291507A (en) Video picture adjusting method and device, electronic equipment and storage medium
EP3799415A2 (en) Method and device for processing videos, and medium
US11756302B1 (en) Managing presentation of subject-based segmented video feed on a receiving device
US20220264156A1 (en) Context dependent focus in a video feed
KR101850158B1 (en) Apparatus and method for outputting a image in a portable terminal
CN114079724B (en) Taking-off snapshot method, device and storage medium
US12028645B2 (en) Subject-based smart segmentation of video feed on a transmitting device
CN115499537B (en) Microphone control method and device, mobile terminal and storage medium
WO2023231009A1 (en) Focusing method and apparatus, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210129