CN117857723A - Picture processing method and device - Google Patents
Picture processing method and device Download PDFInfo
- Publication number
- CN117857723A CN117857723A CN202410017308.0A CN202410017308A CN117857723A CN 117857723 A CN117857723 A CN 117857723A CN 202410017308 A CN202410017308 A CN 202410017308A CN 117857723 A CN117857723 A CN 117857723A
- Authority
- CN
- China
- Prior art keywords
- picture
- screen
- main
- processing method
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 34
- 238000000034 method Methods 0.000 claims description 31
- 238000004891 communication Methods 0.000 abstract description 7
- 239000003086 colorant Substances 0.000 description 16
- 230000006870 function Effects 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000001186 cumulative effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
- H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Abstract
The application discloses a picture processing method and device, and belongs to the technical field of communication. The picture processing method comprises the following steps: in a picture-in-picture display mode, respectively acquiring a first picture change frequency of a first picture in the first preset time period and a second picture change frequency of a second picture in the first preset time period at intervals of a first preset time period; and updating the first picture to a secondary picture for display and updating the second picture to a primary picture for display when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value. According to the technical scheme provided by the embodiment of the application, the problem that in the prior art, under the picture-in-picture display mode, a user is easy to miss picture content due to the fact that the switching between the main picture and the auxiliary picture needs manual operation is solved to a certain extent.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a picture processing method and device.
Background
With the development of electronic devices (such as mobile phones, tablet computers, desktop computers, etc.), users often use electronic devices to watch video, and as the demand of users for video watching experience increases, a picture-in-picture display mode is developed.
The picture-in-picture display mode is a video content presentation mode, and refers to that a video is played in full screen (i.e. displayed as a main picture in the picture-in-picture display mode) while a play window of another video is simultaneously displayed on a small area of the video picture, so that another video is played (i.e. displayed as a sub-picture in the picture-in-picture display mode).
In the picture-in-picture display mode, the user may have a need for switching between the main picture and the sub picture, i.e., switching the original main picture to the sub picture for display and switching the original sub picture to the main picture for display. However, in the prior art, when switching between the main screen and the sub screen, a manual operation is required by a user. During the manual switching of the user, the user may temporarily leave the displayed screen due to the attention of the user on the switching operation, and the user's hand may also obstruct part of the screen content, thereby causing the user to miss part of the screen content.
Disclosure of Invention
The embodiment of the application aims to provide a picture processing method and device, which can solve the problem that in the prior art, under the picture-in-picture display mode, a user is required to manually operate for switching between a main picture and a sub picture, so that the user is easy to miss picture contents.
In order to solve the technical problems, the application is realized as follows:
in a first aspect, an embodiment of the present application provides a picture processing method, where the picture processing method includes:
in a picture-in-picture display mode, respectively acquiring a first picture change frequency of a first picture in the first preset time period and a second picture change frequency of a second picture in the first preset time period at intervals of a first preset time period; the first picture is a main picture displayed in the picture-in-picture display mode, and the second picture is a sub-picture displayed in the picture-in-picture display mode;
updating the first picture to a secondary picture for display and updating the second picture to a primary picture for display when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value; wherein the second preset value is greater than the first preset value.
In a second aspect, an embodiment of the present application provides a picture processing apparatus, including:
the first acquisition module is used for respectively acquiring a first picture change frequency of a first picture in a first preset duration and a second picture change frequency of a second picture in the first preset duration at intervals of the first preset duration in a picture-in-picture display mode; the first picture is a main picture displayed in the picture-in-picture display mode, and the second picture is a sub-picture displayed in the picture-in-picture display mode;
The first picture adjusting module is used for updating the first picture to a secondary picture to display and updating the second picture to a main picture to display when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value; wherein the second preset value is greater than the first preset value.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor, implement the steps in the picture processing method as described in the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implement the steps of the picture processing method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method for processing a picture according to the first aspect.
In the embodiment of the application, if the picture change amplitude of the first picture serving as the main picture is detected to be smaller and the picture change amplitude of the second picture serving as the auxiliary picture is detected to be larger within the preset time, the main picture and the auxiliary picture between the first picture and the second picture can be automatically switched, and the second picture with the larger picture change amplitude is used as the main picture to be displayed in an enlarged mode, so that a user can watch the picture content of the second picture, the trouble of manual adjustment of the user is omitted, and the probability of missing the picture content due to picture switching is reduced.
Drawings
Fig. 1 is a schematic flow chart of a picture processing method according to an embodiment of the present application;
FIG. 2 is one of the schematic diagrams of examples provided by embodiments of the present application;
FIG. 3 is a second schematic illustration of an example provided by an embodiment of the present application;
FIG. 4 is a third schematic illustration of an example provided by an embodiment of the present application;
FIG. 5 is a fourth schematic illustration of an example provided by an embodiment of the present application;
FIG. 6 is a fifth schematic illustration of an example provided by an embodiment of the present application;
fig. 7 is a schematic block diagram of a picture processing apparatus provided in an embodiment of the present application;
FIG. 8 is one of the schematic block diagrams of an electronic device provided by an embodiment of the present application;
Fig. 9 is a second schematic block diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein, and that the objects identified by "first," "second," etc. are generally of a type and do not limit the number of objects, for example, the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The following describes in detail the image processing method provided in the embodiment of the present application through specific embodiments and application scenarios thereof with reference to the accompanying drawings.
Fig. 1 is a flowchart of a picture processing method according to an embodiment of the present application, where the picture processing method is applied to an electronic device.
As shown in fig. 1, the picture processing method may include:
step 101: and respectively acquiring a first picture change frequency of the first picture in the first preset time period and a second picture change frequency of the second picture in the first preset time period at intervals of the first preset time period in the picture-in-picture display mode.
As shown in fig. 2, the first screen is a main screen 201 (i.e., a large display screen, typically in full screen display mode) displayed in the picture-in-picture display mode, and the second screen is a sub-screen 202 (i.e., a small display screen) displayed in the picture-in-picture display mode. The second picture is displayed on the first picture. In this embodiment of the present application, at least one of the first frame and the second frame is a dynamic frame.
The picture change frequency in the embodiment of the application is the change frequency of the picture content, and the larger the change frequency of the picture content is, the richer the picture content in the first preset duration is. Specifically, the first frame change frequency may be the number of pixels with changed colors in the first frame obtained by statistics in the first preset period. The second frame change frequency may be the number of pixels with changed colors in the second frame obtained by statistics in the first preset time period.
Step 102: and when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value, updating the first picture to a secondary picture for display and updating the second picture to a primary picture for display.
Wherein the second preset value is greater than the first preset value.
In the embodiment of the application, the first frame change frequency is smaller than or equal to the first preset value, which indicates that the frame content change amplitude of the first frame is smaller or is still within the first preset duration; the second picture change frequency is larger than or equal to a second preset value, which indicates that the picture content change amplitude of the first picture is larger in the first preset duration. The general user is more inclined to watch the picture with large variation range, so that the electronic device can automatically switch the main picture and the auxiliary picture between the first picture and the second picture when the first picture variation frequency is smaller than or equal to the first preset value and the second picture variation frequency is larger than or equal to the second preset value, namely: the first picture serving as the main picture is switched to the auxiliary picture for display, and the second picture serving as the auxiliary picture is switched to the main picture for display, so that after adjustment, the second picture with large picture content variation range can be displayed in an enlarged mode so as to be convenient for a user to watch, and meanwhile, the trouble of manual adjustment of the user is avoided. And because of automatic switching, the problem that the user misses part of the picture content because the attention is not on the picture or the hand is blocked when the user manually switches can be avoided, and the probability of missing the picture content because of switching the picture is reduced.
Optionally, the first preset duration may be a default value of the system, or may be set by a user according to a requirement of the user. If the user does not want to switch the main and auxiliary pictures too frequently, the first preset duration may be set to a larger duration value, such as ten minutes, fifteen minutes, and the like.
Optionally, step 101: in the picture-in-picture display mode, respectively obtaining a first picture change frequency of the first picture within the first preset duration and a second picture change frequency of the second picture within the first preset duration at intervals of the first preset duration may include:
respectively recording the number of pixels with changed colors in preset N pixels of a first picture and the number of pixels with changed colors in preset M pixels of a second picture in a first preset time period; and determining the number of pixels with changed colors in a first picture obtained by accumulatively recording in a first preset time period as a first picture change frequency, and determining the number of pixels with changed colors in a second picture obtained by accumulatively recording in the first preset time period as a second picture change frequency.
The preset N pixels may be obtained by extracting one pixel every first preset number (an integer greater than or equal to 0) of pixels in the first picture, where N is an integer greater than 1. The preset M pixels may be obtained by extracting one pixel every second preset number (an integer greater than or equal to 0) of pixels in the second picture, where M is an integer greater than 1. The first preset number and the second preset number may be the same or different, and N and M may be the same or different, and may specifically be determined according to parameters such as resolutions of the first frame and the second frame. For example, when the resolutions of the first screen and the second screen are the same, the first preset number and the second preset number may be set to be the same and N and M may be the same; when the resolutions of the first and second images are different, the first and second preset numbers may be set to be different and the N and M may be set to be different, and at this time, the relationship between the first and second preset numbers and the relationship between the N and M may be determined according to the ratio of the resolutions of the first and second images.
The second preset time period is smaller than the first preset time period.
In order to better understand the foregoing, an example is described below.
For example, taking the first screen as an example, assume that the first preset duration is five minutes, the second preset duration is one minute, and n=2000. After the electronic device enters the picture-in-picture display mode, the picture change frequency of the first picture (i.e., the first picture change frequency) can be obtained once every five minutes. Within the five minutes, the electronic device determines once every one minute whether the color of the 2000 pixels has changed from the color of the pixel recorded one minute ago, and records the number of pixels whose color has changed. Assuming four recordings were made in total in these five minutes, the values for each recording were: 300. 350, 200, 500, the picture change frequency of the first picture in these five minutes is: 300+350+200+500=1350.
The calculation method of the picture change frequency of the second picture is the same as the calculation method of the picture change frequency of the first picture, and the calculation method of the picture change frequency of the second picture is referred to as the calculation method of the picture change frequency of the first picture, and will not be described by way of example.
Optionally, step 102: when the first frame change frequency is less than or equal to a first preset value and the second frame change frequency is greater than or equal to a second preset value, updating the first frame to a secondary frame for display and updating the second frame to a primary frame for display includes:
acquiring a first picture area with the minimum picture change frequency in a second picture within a first preset duration under the condition that the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value; the first screen is updated to the sub-screen and displayed, and simultaneously, the first screen is displayed in a first screen area in a second screen which is a main screen.
Wherein, the first picture area is one of at least two picture areas obtained by dividing the second picture in advance. For example, as shown in fig. 3, four screen regions are divided in advance for the second screen 202, namely, a region 2021, a region 2022, a region 2023 and a region 2024, and the first screen region is one of the four screen regions in fig. 3.
In this embodiment of the present invention, in addition to counting the overall picture change frequency of the second picture (i.e., the second picture change frequency) within the first preset duration, the picture change frequency of each of the picture areas obtained by dividing in advance in the second picture may be counted, and the picture area with the minimum picture change frequency (i.e., the first picture area) may be determined. The smaller the picture change frequency is, the less the user is likely to have a smaller viewing interest in the picture content of the picture region, so that when the primary picture and the secondary picture are switched between the first picture and the second picture, the first picture serving as the secondary picture can be displayed on the first picture region in the second picture serving as the primary picture, so that the secondary picture is prevented from shielding the picture content more interested in viewing by the user in the primary picture as much as possible. Alternatively, if the first screen region displays the subject image (typically, the subject image is an image of which the user is interested), the first screen as the sub-screen may be adjusted to a fourth screen region in which the screen change frequency is the next smallest. Optionally, in the embodiment of the present application, it may further be designed: for each screen region in the second screen, when the second screen is displayed as the main screen, the region area and shape thereof are the same as or similar to those of the sub-screen.
The calculation of the picture change frequency for each picture area in the second picture is similar to that of the whole second picture, namely: and respectively recording the number of pixels with changed colors in the preset X pixels in each picture area every second preset time period within the first preset time period, and then determining the number of the pixels with changed colors in each picture area obtained by accumulative recording within the first preset time period as the picture change frequency of the picture area. Wherein X is an integer greater than 1. The X pixels may be obtained by extracting one pixel every third preset number (integer greater than or equal to 0) of pixels for each picture area.
Optionally, after step 101, the picture processing method may further include:
and when the first picture change frequency is larger than the first preset value and/or the second picture change frequency is smaller than the second preset value, adjusting the second picture from the second picture area in the first picture to be displayed on the third picture area in the first picture.
Wherein, the second picture area and the third picture area are respectively one of at least two picture areas obtained by dividing the first picture in advance. For example, as shown in fig. 4, the first screen 201 is divided into four screen areas, that is, an area 2011, an area 2012, an area 2013, and an area 2014, respectively. As can be seen from fig. 4, the second frame 202 is displayed on the region 2014 of the first frame, the second frame region is the region 2014 in fig. 4, and the third frame region is one of the three other regions except the region 2014.
In this embodiment, in addition to counting the overall picture change frequency (i.e., the first picture change frequency) of the first picture in the first preset duration, the picture change frequency of each picture area obtained by dividing in advance in the first picture may also be counted, so that when the first picture and the second picture do not meet the switching conditions of the main picture and the auxiliary picture (i.e., when the first picture change frequency is greater than the first preset value and/or the second picture change frequency is less than the second preset value), the display position of the second picture in the first picture may be adjusted according to the picture change frequency of each picture area in the first picture, i.e., the second picture is adjusted to the picture area with the lowest picture change frequency in the first picture (i.e., the third picture area) for displaying (when the second picture area in the first picture where the second picture is located is not the lowest in picture change frequency), so as to avoid the auxiliary picture to cover the picture content more interesting to the user in the main picture. Alternatively, if the third screen region displays the subject image (typically, the subject image is an image of interest to the user), the second screen may be adjusted to the fifth screen region with the smallest screen change frequency. Optionally, in the embodiment of the present application, it may further be designed: each picture region in the first picture as the main picture is the same as or similar to the region area of the second picture as the sub-picture.
The calculation of the picture change frequency for each picture area in the first picture is similar to that of the whole first picture, namely: and respectively recording the number of pixels with changed colors in the preset Y pixels in each picture area every second preset time period within the first preset time period, and then determining the number of the pixels with changed colors in each picture area obtained by accumulative recording within the first preset time period as the picture change frequency of the picture area. Wherein Y is an integer greater than 1. The Y pixels may be obtained by extracting one pixel every fourth preset number (integer greater than or equal to 0) of pixels for each picture area.
Optionally, the method for processing a picture may further include, while updating the first picture to the sub-picture for display and updating the second picture to the main picture for display:
acquiring the signal quality of a target network; according to a preset corresponding relation between the resolution of the main picture and the network signal quality and according to a preset corresponding relation between the resolution of the auxiliary picture and the network signal quality, respectively determining a first resolution and a second resolution corresponding to the target network signal quality; when the resolution of the second picture is smaller than the first resolution and the resolution of the first picture is larger than the second resolution, the resolution of the second picture is adjusted to the first resolution and the resolution of the first picture is adjusted to the second resolution.
The first resolution is a resolution of the main picture corresponding to the quality of the target network, and the second resolution is a resolution of the sub picture corresponding to the quality of the target network.
In this embodiment of the present application, when the primary and secondary frames between the first frame and the second frame are switched, the resolutions of the first frame and the second frame may be automatically adjusted according to the current network signal quality. For example, when the network signal quality is poor, the resolution of the main picture can be properly adjusted up, and the resolution of the auxiliary picture can be adjusted down, so that the user can clearly and smoothly watch the picture content of the main picture to a certain extent. Or when the network signal quality is better, the resolution of the main picture and the auxiliary picture can be improved, so that the user can watch the picture contents of the main picture and the auxiliary picture better.
Optionally, in the embodiment of the present application, the first frame and the second frame may be video frames displayed by the electronic device during the video recording process, and are video frames collected by different cameras of the electronic device, for example, video frames collected by a front camera and a rear camera of the electronic device, where, in a case where the first frame is a video frame collected by the front camera, the second frame is a video frame collected by the rear camera; under the condition that the first picture is a video picture collected by the rear camera, the second picture is a video picture collected by the front camera.
The picture processing method may further include:
under the condition that a first picture and a second picture are displayed in a picture-in-picture display mode, acquiring a preset relative position of a first main body image in the first picture and a second main body image in the second picture; and adjusting the position of the second picture in the first picture according to the position of the first main body image in the first picture, and keeping the preset relative position of the first main body image and the second main body image unchanged.
As shown in fig. 5, the user may select a favorite shooting mode through a shooting mode menu, for example, may select a shooting mode in which an animal catches up with a person, and after selecting the shooting mode, introduction information about the shooting mode may be displayed (as shown in the right diagram in fig. 5). In the shooting mode of the animal tracking person, the first picture may be a picture recorded for the animal (i.e., the first subject image), and the second picture may be a picture recorded for the person (i.e., the second subject image). In order to create the effect of capturing images of the animal following the person, the relative positional relationship between the animal on the first screen and the person on the second screen may be set. The relative positional relationship may be system default or manually set by a user.
And in the display process of the first picture and the second picture, if the animal image is detected in the first picture and the character image is detected in the second picture, adjusting the position of the second picture in the first picture according to the preset relative position relationship between the animal and the character and the position of the animal in the first picture so as to keep the relative position relationship between the animal and the character unchanged. If the animal image disappears from the first picture, the position of the second picture in the first picture can be kept unchanged until the animal image appears again in the first picture or the video recording is finished; or after the position of the second picture in the first picture is kept unchanged for a third preset time period, if the animal image still does not appear, ending the video recording. After the video recording is finished, the video recording pictures displayed by the electronic device from the beginning of the video recording to the end of the video recording can be saved (the saved video recording pictures comprise a first picture and a second picture) for the user to check.
As shown in fig. 5, the user may also select a custom shooting mode. In the selection of the custom shooting mode, the user can select the subject images in the first screen and the second screen according to own requirements, and set the relative positional relationship between the subject images. For example, as shown in fig. 6, when the user wants to create a group photo scene of the subject image 2015 in the first screen 201 and the subject image 2025 in the second screen 202, the relative positional relationship of the subject image 2015 and the subject image 2025 may be set to be a horizontal flush relationship. In the user-defined shooting mode, the user can perform a selection operation of the subject images in the first screen and the second screen and a setting operation of the relative positional relationship between the subject images in the recording process.
Optionally, in the case that the first main image and the second main image are automatically identified by the system according to a shooting mode (such as a display mode of an animal tracking person) in the video recording process, when the shooting mode is selected, the system may provide the feature parameters of the main image for the user to select, such as the type of the main image (animal, article or person), and when the main image is an animal, the main image is an animal of which type; when the person is the person, the characteristic parameters such as sex, age and the like of the person can be selected, so that the system can recognize the main body image more accurately.
Alternatively, in the embodiment of the present application, in the case where the first screen and the second screen are video screens, in order to increase the interest of display, display settings for the first screen and the second screen may be performed similar to those in the video recording. For example, in a picture-in-picture display mode, a preset relative positional relationship between a first main image in a first picture and a second main image in a second picture in a preset display mode is obtained; and adjusting the position of the second picture in the first picture according to the position of the first main body image in the first picture, and keeping the preset relative position relation between the first main body image and the second main body image unchanged. The preset relative positional relationship is a relative positional relationship between the corresponding first subject image and the corresponding second subject image in different display modes. The preset relative positional relationship may be a default of the system or may be set by a user.
When the first main body image is selected in different display modes, the first picture can be called out, and a video playing progress bar is provided for a user to select the first main body image in the first picture; similarly, when the second main image is selected, the second picture can be called out and a video playing progress bar can be provided for the user to select the second main image in the second picture.
Optionally, in the embodiment of the present application, when the first screen and the second screen are displayed in a preset display mode, a screen recording function of the electronic device may be further started, so as to record the content of the screen displayed in the screen, and increase the interestingness of the screen recording. It can be understood that the display mode between the first screen and the second screen can also be set for the screen recording function, that is, only in the screen recording process, the first screen and the second screen are displayed according to the preset display mode.
In summary, in the embodiment of the present application, if it is detected that the frame change width of the first frame as the main frame is smaller and the frame change width of the second frame as the sub frame is larger within the preset time period, the main frame and the sub frame between the first frame and the second frame can be automatically switched, and the second frame with the larger frame change width is used as the main frame to be displayed in an enlarged manner, so that the user views the frame content of the second frame, the trouble of manual adjustment of the user is omitted, and the probability of missing the frame content due to the frame switching is reduced.
It should be noted that, in the image processing method provided in the embodiment of the present application, the execution subject may be an image processing apparatus, or a control module for executing the image processing method in the image processing apparatus. In the embodiment of the present application, a picture processing device is described by taking a picture processing method performed by the picture processing device as an example.
Fig. 7 is a schematic block diagram of a picture processing apparatus provided in an embodiment of the present application.
As shown in fig. 7, the picture processing apparatus may include:
the first obtaining module 701 is configured to obtain, in a picture-in-picture display manner, a first picture change frequency of a first picture within a first preset duration and a second picture change frequency of a second picture within the first preset duration, respectively, every first preset duration.
The first picture is a main picture displayed in the picture-in-picture display mode, and the second picture is a sub-picture displayed in the picture-in-picture display mode.
The first screen adjustment module 702 is configured to update the first screen to a sub-screen for display and update the second screen to a main screen for display when the first screen change frequency is less than or equal to a first preset value and the second screen change frequency is greater than or equal to a second preset value.
Wherein the second preset value is greater than the first preset value.
Optionally, the first obtaining module 701 includes:
the recording unit is used for respectively recording the number of pixels with changed colors in the preset N pixels of the first picture and the number of pixels with changed colors in the preset M pixels of the second picture at intervals of a second preset time length within the first preset time length.
Wherein, N and M are integers greater than 1.
The first determining unit is configured to determine, as the first frame change frequency, the number of pixels with color changed in the first frame obtained by cumulative recording in the first preset duration, and determine, as the second frame change frequency, the number of pixels with color changed in the second frame obtained by cumulative recording in the first preset duration.
Optionally, the first screen adjustment module 702 includes:
and the second determining unit is used for determining a first picture area with the minimum picture change frequency in the second picture within the first preset duration when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value.
The first picture area is one of at least two picture areas obtained by dividing the second picture in advance.
And a screen adjustment unit configured to display the first screen in the first screen region in the second screen as a main screen while updating the first screen to a sub-screen for display.
Optionally, the picture processing apparatus further includes:
and the second picture adjusting module is used for adjusting the second picture from a second picture area in the first picture to a third picture area in the first picture to display under the condition that the first picture change frequency is larger than a first preset value and/or the second picture change frequency is smaller than a second preset value.
Wherein the second picture area and the third picture area are respectively one of at least two picture areas obtained by dividing the first picture in advance; the third picture area is a picture area with the minimum picture change frequency in at least two picture areas obtained by dividing the first picture in advance.
Optionally, the picture processing apparatus further includes:
and the second acquisition module is used for acquiring the target network signal quality in the process of updating the first picture to the auxiliary picture for display and updating the second picture to the main picture for display.
The determining module is used for respectively determining a first resolution and a second resolution corresponding to the target network signal quality according to a preset corresponding relation between the resolution of the main picture and the network signal quality and according to a preset corresponding relation between the resolution of the auxiliary picture and the network signal quality.
The first resolution is a resolution of the main picture corresponding to the quality of the target network, and the second resolution is a resolution of the auxiliary picture corresponding to the quality of the target network.
And a third picture adjustment module for adjusting the resolution of the second picture to the first resolution and the resolution of the first picture to the second resolution when the resolution of the second picture as the main picture is smaller than the first resolution and the resolution of the first picture as the sub picture is larger than the second resolution.
Optionally, the first frame and the second frame are video frames displayed by the electronic device in the video process, and are video frames acquired by different cameras of the electronic device.
The picture processing apparatus further includes:
and a third obtaining module, configured to obtain a preset relative positional relationship between a first main image in the first screen and a second main image in the second screen when the first screen and the second screen are displayed in the picture-in-picture display mode.
And the fourth picture adjusting module is used for adjusting the position of the second picture in the first picture according to the position of the first main picture in the first picture, and keeping the preset relative position relationship between the first main picture and the second main picture unchanged.
In the embodiment of the application, if the picture change amplitude of the first picture serving as the main picture is detected to be smaller and the picture change amplitude of the second picture serving as the auxiliary picture is detected to be larger within the preset time, the main picture and the auxiliary picture between the first picture and the second picture can be automatically switched, and the second picture with the larger picture change amplitude is used as the main picture to be displayed in an enlarged mode, so that a user can watch the picture content of the second picture, the trouble of manual adjustment of the user is omitted, and the probability of missing the picture content due to picture switching is reduced.
The image processing device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.
The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
The image processing apparatus provided in this embodiment of the present application can implement each process implemented by the embodiment of the image processing method shown in fig. 1, and in order to avoid repetition, a detailed description is omitted here.
Optionally, as shown in fig. 8, the embodiment of the present application further provides an electronic device 800, including a processor 801, a memory 802, and a program or an instruction stored in the memory 802 and capable of running on the processor 801, where the program or the instruction implements each process of the above-mentioned image processing method embodiment when executed by the processor 801, and the process can achieve the same technical effect, and for avoiding repetition, a description is omitted herein.
The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 9 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 900 includes, but is not limited to: radio frequency unit 901, network module 902, audio output unit 903, input unit 904, sensor 905, display unit 906, user input unit 907, interface unit 908, memory 909, and processor 910.
Those skilled in the art will appreciate that the electronic device 900 may further include a power source (e.g., a battery) for powering the various components, and that the power source may be logically coupled to the processor 910 by a power management system to perform functions such as managing charging, discharging, and power consumption by the power management system. The electronic device structure shown in fig. 9 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.
Wherein the processor 910 is configured to: in a picture-in-picture display mode, respectively acquiring a first picture change frequency of a first picture in the first preset time period and a second picture change frequency of a second picture in the first preset time period at intervals of a first preset time period; and updating the first picture to a secondary picture for display and updating the second picture to a primary picture for display when the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value. The first picture is a main picture displayed in the picture-in-picture display mode, and the second picture is a sub-picture displayed in the picture-in-picture display mode; the second preset value is greater than the first preset value.
Optionally, the processor 910 is specifically configured to: respectively recording the number of pixels with changed colors in preset N pixels of the first picture and the number of pixels with changed colors in preset M pixels of the second picture in the first preset time period every second preset time period; determining the number of pixels with changed colors in the first picture obtained by accumulatively recording in the first preset time period as the first picture change frequency, and determining the number of pixels with changed colors in the second picture obtained by accumulatively recording in the first preset time period as the second picture change frequency. Wherein, N and M are integers greater than 1.
Optionally, the processor 910 is specifically configured to: determining a first picture area with the minimum picture change frequency in the second picture within the first preset duration under the condition that the first picture change frequency is smaller than or equal to a first preset value and the second picture change frequency is larger than or equal to a second preset value; the first screen is displayed in the first screen region in the second screen as a main screen while the first screen is updated to a sub screen for display. The first picture area is one of at least two picture areas obtained by dividing the second picture in advance.
Optionally, the processor 910 is further configured to: and when the first picture change frequency is larger than a first preset value and/or the second picture change frequency is smaller than a second preset value, adjusting the second picture from a second picture area in the first picture to a third picture area in the first picture for display. Wherein the second picture area and the third picture area are respectively one of at least two picture areas obtained by dividing the first picture in advance; the third picture area is a picture area with the minimum picture change frequency in at least two picture areas obtained by dividing the first picture in advance.
Optionally, the processor 910 is further configured to: acquiring the signal quality of a target network; according to a preset corresponding relation between the resolution of the main picture and the network signal quality and according to a preset corresponding relation between the resolution of the auxiliary picture and the network signal quality, respectively determining a first resolution and a second resolution corresponding to the target network signal quality; when the resolution of the second picture as the main picture is smaller than the first resolution and the resolution of the first picture as the sub picture is larger than the second resolution, the resolution of the second picture is adjusted to the first resolution and the resolution of the first picture is adjusted to the second resolution. The first resolution is a resolution of the main picture corresponding to the quality of the target network, and the second resolution is a resolution of the auxiliary picture corresponding to the quality of the target network.
Optionally, the processor 910 is further configured to: acquiring a preset relative position relationship between a first main body image in the first picture and a second main body image in the second picture under the condition that the first picture and the second picture are displayed in the picture-in-picture display mode; and adjusting the position of the second picture in the first picture according to the position of the first main picture in the first picture, and keeping the preset relative position relation between the first main picture and the second main picture unchanged. The first picture and the second picture are video pictures displayed by the electronic equipment in the video recording process respectively, and are video pictures acquired by different cameras of the electronic equipment respectively.
In the embodiment of the application, if the picture change amplitude of the first picture serving as the main picture is detected to be smaller and the picture change amplitude of the second picture serving as the auxiliary picture is detected to be larger within the preset time, the main picture and the auxiliary picture between the first picture and the second picture can be automatically switched, and the second picture with the larger picture change amplitude is used as the main picture to be displayed in an enlarged mode, so that a user can watch the picture content of the second picture, the trouble of manual adjustment of the user is omitted, and the probability of missing the picture content due to picture switching is reduced.
It should be appreciated that in embodiments of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, with the graphics processor 9041 processing image data of still pictures or video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 907 includes a touch panel 9071 and other input devices 9072. Touch panel 9071, also referred to as a touch screen. The touch panel 9071 may include two parts, a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 909 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 910 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 910.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the processes of the above embodiment of the image processing method are implemented, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.
Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, so as to implement each process of the above embodiment of the image processing method, and achieve the same technical effect, so that repetition is avoided, and no redundant description is provided herein.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.
Claims (10)
1. A picture processing method, characterized in that the picture processing method comprises:
acquiring a preset relative position relation between a first main body image in a first picture and a second main body image in a second picture in a picture-in-picture display mode; the first picture is a main picture of the picture-in-picture display mode, and the second picture is a sub-picture of the picture-in-picture display mode;
and adjusting the position of the second picture in the first picture according to the position of the first main body image in the first picture so as to enable the first main body image and the second main body image to keep the preset relative position relation.
2. The picture processing method according to claim 1, wherein the picture-in-picture display mode is applied to a recorded scene.
3. The picture processing method as claimed in claim 2, wherein the method further comprises:
determining a shooting mode in response to a user selection operation of a shooting mode menu;
according to the shooting mode, the first subject image is determined from the first screen, and the first subject image is determined from the second screen.
4. The picture processing method as claimed in claim 2, wherein the method further comprises:
When the shooting mode is a custom shooting mode, responding to the selection operation of a user on the first picture, and determining the first main image from the first picture;
determining the first subject image from the second screen in response to a selection operation of the second screen by a user;
and determining the preset relative position relationship in response to a setting operation of a user.
5. The picture processing method as claimed in claim 2, wherein the method further comprises:
if the first main image disappears from the first picture, the position of the second picture in the first picture is maintained until the first main image reappears from the first picture or the video recording is finished.
6. The picture processing method according to claim 1, wherein the picture-in-picture display mode is applied to a video play scene.
7. The picture processing method as claimed in claim 6, wherein the method further comprises:
displaying the first picture and the video playing progress bar;
the first subject image is determined from the first screen in response to a user selection operation of the first screen.
8. The picture processing method as claimed in claim 6, wherein the method further comprises:
displaying the second picture and the video playing progress bar;
and determining the second main body image from the second picture in response to a selection operation of the second picture by a user.
9. The picture processing method as claimed in claim 6, wherein the method further comprises:
and starting a screen recording function of the electronic equipment.
10. A picture processing apparatus, characterized in that the picture processing apparatus comprises:
the third acquisition module is used for acquiring a preset relative position relation between a first main body image in a first picture and a second main body image in a second picture in a picture-in-picture display mode; the first picture is a main picture of the picture-in-picture display mode, and the second picture is a sub-picture of the picture-in-picture display mode;
and the fourth picture adjusting module is used for adjusting the position of the second picture in the first picture according to the position of the first main body image in the first picture so as to enable the first main body image and the second main body image to keep the preset relative position relation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410017308.0A CN117857723A (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011522593.XA CN112637528B (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
| CN202410017308.0A CN117857723A (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011522593.XA Division CN112637528B (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117857723A true CN117857723A (en) | 2024-04-09 |
Family
ID=75320502
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410017308.0A Pending CN117857723A (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
| CN202011522593.XA Active CN112637528B (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011522593.XA Active CN112637528B (en) | 2020-12-21 | 2020-12-21 | Picture processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN117857723A (en) |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR19980043991A (en) * | 1996-12-05 | 1998-09-05 | 배순훈 | You can switch between the main and secondary screens. |
| MX9805242A (en) * | 1996-12-29 | 1998-11-30 | Thomson Consumer Electronics | Television system with provisions for displaying an auxiliary image of variable size. |
| JP2001128062A (en) * | 1999-10-29 | 2001-05-11 | Matsushita Electric Ind Co Ltd | Device and method for forming image |
| CN101207749A (en) * | 2006-12-15 | 2008-06-25 | 北京海尔集成电路设计有限公司 | Apparatus and method for multi-picture dynamic condition displaying multi-path TV program contents |
| CN101742223B (en) * | 2010-01-19 | 2012-08-22 | 华平信息技术股份有限公司 | Intelligent video stream bandwidth regulating method |
| CN102695035B (en) * | 2011-03-24 | 2015-05-20 | 创想空间软件技术(北京)有限公司 | Bandwidth-adaptive video conference |
| CN104822038A (en) * | 2015-04-30 | 2015-08-05 | 广州瀚唐电子科技有限公司 | Recording and broadcasting system and picture switching method thereof |
| CN106131647B (en) * | 2016-07-18 | 2019-03-19 | 杭州当虹科技有限公司 | A kind of more pictures based on virtual reality video viewing method simultaneously |
| CN106791485B (en) * | 2016-11-16 | 2020-02-07 | 深圳市异度信息产业有限公司 | Video switching method and device |
| CN206224916U (en) * | 2016-11-17 | 2017-06-06 | 深圳市完美显示科技有限公司 | A kind of multipurpose electronic Billboard |
| CN107231537B (en) * | 2017-05-10 | 2019-11-15 | 浙江大华技术股份有限公司 | A kind of picture-in-picture switching method and apparatus |
| CN107333160B (en) * | 2017-08-09 | 2021-01-15 | 康佳集团股份有限公司 | Intelligent remote controller, television one-key live broadcast processing method and storage medium |
| CN107809658A (en) * | 2017-10-18 | 2018-03-16 | 维沃移动通信有限公司 | A kind of barrage content display method and terminal |
| CN108024146A (en) * | 2017-12-14 | 2018-05-11 | 深圳Tcl数字技术有限公司 | News interface automatic setting method, smart television and computer-readable recording medium |
| CN109284078B (en) * | 2018-10-16 | 2021-10-29 | 维沃移动通信有限公司 | Control method of double-sided screen and mobile terminal |
| CN110086985B (en) * | 2019-03-25 | 2021-03-30 | 华为技术有限公司 | Recording method for delayed photography and electronic equipment |
| CN110896451B (en) * | 2019-11-20 | 2022-01-28 | 维沃移动通信有限公司 | Preview picture display method, electronic device and computer readable storage medium |
-
2020
- 2020-12-21 CN CN202410017308.0A patent/CN117857723A/en active Pending
- 2020-12-21 CN CN202011522593.XA patent/CN112637528B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112637528A (en) | 2021-04-09 |
| CN112637528B (en) | 2023-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113766129B (en) | Video recording method, video recording device, electronic equipment and medium | |
| CN112135049B (en) | Image processing method and device and electronic equipment | |
| CN112135046A (en) | Video shooting method, video shooting device and electronic equipment | |
| CN112954199B (en) | Video recording method and device | |
| CN112738402B (en) | Shooting method, shooting device, electronic equipment and medium | |
| CN112911147B (en) | Display control method, display control device and electronic equipment | |
| CN113794829B (en) | Shooting method and device and electronic equipment | |
| CN112333382B (en) | Shooting method and device and electronic equipment | |
| CN112616078A (en) | Screen projection processing method and device, electronic equipment and storage medium | |
| CN113259743A (en) | Video playing method and device and electronic equipment | |
| CN112394806A (en) | User interface display method and device, electronic equipment and storage medium | |
| CN111835972B (en) | Shooting method and device and electronic equipment | |
| CN111586305B (en) | Anti-shake method, anti-shake device and electronic equipment | |
| CN112437237A (en) | Shooting method and device | |
| CN112637528B (en) | Picture processing method and device | |
| US20230274388A1 (en) | Photographing Method, and Electronic Device and Non-Transitory Readable Storage Medium | |
| CN113852756B (en) | Image acquisition method, device, equipment and storage medium | |
| CN113852757B (en) | Video processing method, device, equipment and storage medium | |
| CN113794831B (en) | Video shooting method, device, electronic equipment and medium | |
| CN112367467B (en) | Display control method, display control device, electronic apparatus, and medium | |
| CN112788233B (en) | Video shooting processing method and electronic equipment | |
| CN112565909B (en) | Video playing method and device, electronic equipment and readable storage medium | |
| CN113891018A (en) | Shooting method and device and electronic equipment | |
| CN113923392A (en) | Video recording method, video recording device and electronic equipment | |
| CN114285978A (en) | Video processing method, video processing device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |