CN116743976B - Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium - Google Patents
Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium Download PDFInfo
- Publication number
- CN116743976B CN116743976B CN202310667782.3A CN202310667782A CN116743976B CN 116743976 B CN116743976 B CN 116743976B CN 202310667782 A CN202310667782 A CN 202310667782A CN 116743976 B CN116743976 B CN 116743976B
- Authority
- CN
- China
- Prior art keywords
- color temperature
- frame sequence
- live broadcast
- live
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000004044 response Effects 0.000 claims abstract description 33
- 230000000694 effects Effects 0.000 claims description 52
- 238000012545 processing Methods 0.000 claims description 30
- 238000007781 pre-processing Methods 0.000 claims description 15
- 238000012549 training Methods 0.000 claims description 8
- 238000000926 separation method Methods 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 6
- 238000010200 validation analysis Methods 0.000 claims description 4
- 238000003672 processing method Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 239000003086 colorant Substances 0.000 description 8
- 230000008569 process Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a live broadcasting room color temperature adjusting method, a live broadcasting system and a storage medium, wherein the live broadcasting room color temperature adjusting method comprises the following steps: acquiring a color temperature preset mode; in response to a color temperature preset mode being a non-null mode, toning the live-room image frame sequence based on the color temperature preset mode; in response to the color temperature preset mode being the null mode, acquiring the position of a color temperature reference point in a first color temperature setting area and acquiring a white balance offset coordinate in a second color temperature setting area; toning the live broadcasting room image frame sequence based on a color temperature value of a color temperature reference point and a white balance offset value; the method for adjusting the color temperature of the live broadcasting room responds to the adjustment of the white balance in a software mode, and sets all parameters related to the color temperature on the same interface, so that the efficiency of adjusting the white balance is improved, and meanwhile, the problems of misoperation and low adjustment efficiency of a camera caused by small self-contained keys are avoided.
Description
Technical Field
The present disclosure relates to the field of live broadcast, and in particular, to a live broadcast room color temperature adjustment method, a live broadcast system, and a storage medium.
Background
A special single-lens camera needs to be carried during live broadcasting in a live broadcasting room at ordinary times, and a worker needs to manually operate on a screen and keys of the camera to adjust color temperature, namely, the live broadcasting room needs to be additionally provided with a special staff to be responsible for operating the camera.
However, the existing method for directly adjusting the color temperature through the camera key in the live broadcasting room is not convenient to use. When in adjustment, the adjustment is needed by switching the interfaces for 2 times, one is used for adjusting a color temperature reference point, and the other is used for adjusting white balance deviation or white balance surrounding, and because the keys of the camera are small, the camera is inconvenient to use and easy to operate by mistake.
Disclosure of Invention
In order to overcome the defects and shortcomings in the prior art, the invention provides a live broadcasting room color temperature adjusting method, a live broadcasting system and a storage medium.
According to one aspect of the application, a live room color temperature adjustment method is provided, and is used for a live broadcast preprocessing system, wherein the live broadcast preprocessing system is connected with a live broadcast server, and the live broadcast server is used for transmitting live broadcast videos;
the live broadcast preprocessing system comprises a camera and a processing terminal which are connected with each other, wherein the camera is used for collecting a live broadcast room image frame sequence, and the processing terminal is used for toning the live broadcast room image frame sequence;
the method comprises the following steps:
acquiring a color temperature preset mode;
in response to a color temperature preset mode being a non-null mode, toning the live-room image frame sequence based on the color temperature preset mode;
in response to the color temperature preset mode being the null mode, acquiring the position of a color temperature reference point in a first color temperature setting area and acquiring a white balance offset coordinate in a second color temperature setting area;
toning the live broadcasting room image frame sequence based on a color temperature value of a color temperature reference point and a white balance offset value;
the display positions of the first color temperature setting region and the second color temperature setting region are not overlapped, the color temperature value of the color temperature reference point is determined according to the position relation of the color temperature reference point in the first color temperature setting region, and the white balance offset value is determined according to the coordinate position relation of the white balance offset coordinate in the second color temperature setting region.
According to another aspect of the present application, there is provided a live broadcast method for a live broadcast room, including:
the live broadcast pretreatment specifically comprises the following steps:
acquiring a first anchor image frame sequence and toning parameters;
displaying the first anchor image frame sequence in a first display area and a target live broadcast area, and displaying a first preview effect frame sequence in a second display area, wherein the first preview effect frame sequence is determined based on the toning parameters and the first anchor image frame sequence;
in response to a user's palette confirm request, displaying the first preview effect frame sequence in the target live zone to overlay the first anchor image frame sequence;
the color mixing parameters comprise color temperature adjusting information, the color temperature adjusting information is used for adjusting white balance, the color temperature adjusting information comprises a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value, and the color temperature adjusting information is determined by using the live broadcasting room color temperature adjusting method.
Preferably, the live pre-processing further comprises:
determining first location information and second location information in response to a comparison request of a user;
adjusting the picture based on the first position information and the second position information so that the size of the second display area is the same as that of the first display area in the picture, and symmetrically arranging and displaying based on the directions of the two horizontal ends of a preset separation line;
the comparison request is generated through the triggering of a preset operation of a user in a second display area, the first position information is used for determining the display area of the first display area in a picture, the second position information is used for determining the display area of the second display area in the picture, and the preset separation line is obtained through extending in the vertical direction of the center of the picture.
Preferably, the method further comprises:
at the time of live broadcast, comprising:
acquiring a second anchor image frame sequence;
identifying a first gesture type of the anchor according to the second anchor image frame sequence;
responding to the first gesture type as a first target gesture type, and acquiring a live voice frame sequence in a preset time period;
identifying a target voice command type according to the live voice frame sequence;
determining a target live broadcast frame sequence based on the target voice command type;
and setting the target live broadcast frame sequence in the target live broadcast area for display.
Preferably, in identifying the first gesture type of the anchor from the second anchor image frame sequence, it includes:
the first gesture type is detected from the second sequence of anchor image frames using a gesture recognition model that was previously trained from sample data of the anchor gesture for training.
Preferably, in identifying a target voice command type according to the live voice frame sequence, it includes:
the target voice command type is detected from the sequence of live voice frames using a voice command recognition model that is trained in advance from sample data of the training anchor voice command.
Preferably, in determining the target live frame sequence based on the target voice instruction type, the method includes:
determining a preset palette template in response to successful recognition of the target voice command types, wherein each target voice command type is matched with the preset palette template to form a mapping relationship;
and determining a target live broadcast frame sequence according to the preset palette and the second anchor image frame sequence.
Preferably, the method further comprises:
in determining a target live broadcast frame sequence according to the preset palette and the second anchor image frame sequence, the method further includes:
determining a second preview effect frame sequence according to the preset palette and the second anchor image frame sequence;
when the second preview effect frame sequence is determined, identifying a second gesture type of the anchor according to the second anchor image frame sequence in preset cancelling time;
and canceling a second preview effect frame sequence in response to the second gesture type being a second target gesture type, and taking the second anchor image frame sequence as the target live broadcast frame sequence.
According to another aspect of the present application, there is provided a live broadcast system for a live broadcast room, the live broadcast system including a live broadcast pre-processing module and a live broadcast time processing module;
the live broadcast preprocessing module comprises:
the first data acquisition sub-module is used for acquiring a first anchor image frame sequence and toning parameters;
the first preview effect generation sub-module is used for displaying the first anchor image frame sequence in a first display area and a target live broadcast area, and displaying a first preview effect frame sequence in a second display area, wherein the first preview effect frame sequence is determined based on the color mixing parameters and the first anchor image frame sequence;
a palette validation sub-module for displaying the first preview effect frame sequence in the target live zone to overlay the first anchor image frame sequence in response to a palette validation request by a user;
the color mixing parameters comprise color temperature adjusting information, the color temperature adjusting information is used for adjusting white balance, the color temperature adjusting information comprises a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value, and the color temperature adjusting information is determined by using the live broadcasting room color temperature adjusting method;
the live broadcast processing module comprises:
the second data acquisition sub-module is used for acquiring a second anchor image frame sequence;
a first gesture recognition sub-module for recognizing a first gesture type of the anchor according to the second anchor image frame sequence;
the first gesture response sub-module is used for responding to the first gesture type as a first target gesture type and acquiring a live broadcast voice frame sequence in a preset time period;
the voice recognition sub-module is used for recognizing a target voice instruction type according to the live voice frame sequence;
the target effect generation sub-module is used for determining a target live broadcast frame sequence based on the target voice instruction type;
and the target display sub-module is used for setting the target live broadcast frame sequence in the target live broadcast area for display.
According to another aspect of the present application, there is provided a storage medium for storing program code for performing any of the live broadcast methods described above.
Compared with the prior art, the invention has the following advantages and beneficial effects:
(1) The method comprises the steps of obtaining a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value, responding and adjusting the white balance in a software mode, and setting all parameters related to the color temperature on the same interface, so that the efficiency of adjusting the white balance is improved, and meanwhile, the problems of misoperation of a camera caused by small self-contained keys and low adjustment efficiency of staff in a live broadcasting room are avoided.
(2) Through the discernment of gesture and voice command, make the anchor can combine live script to carry out a self-adaptation mixing of colors processing better when living broadcast to improve the automatic mixing of colors effect of living broadcast, avoided living broadcast room staff to need to do mixing of colors processing according to living broadcast scene condition manual cooperation, improved living broadcast room staff's work efficiency.
(3) By identifying the second target gesture type to be used as a relief measure when the misoperation is dealt with, when the anchor carelessly makes the first target gesture and triggers the second preview effect frame sequence to be used as the target live broadcast frame sequence, the color mixing processing caused by the misoperation is canceled by making the second target gesture in the preset cancellation time, so that the unexpected color mixing condition caused by the misoperation of the anchor is avoided.
Drawings
Fig. 1 is a flow chart of a live room color temperature adjustment method in the embodiment 1;
fig. 2 is a flow chart of a live broadcasting method in the embodiment 2;
fig. 3 is a schematic diagram showing steps of the live broadcast pretreatment in the present embodiment 2;
fig. 4 is a schematic diagram showing steps of the live broadcast processing in the present embodiment 2;
fig. 5 is a schematic diagram of steps for determining a target live frame sequence based on a target voice command type in embodiment 2;
fig. 6 is a schematic diagram of steps for determining a target live frame sequence according to a preset palette and a second anchor image frame sequence in embodiment 2;
fig. 7 is a block diagram of a live broadcast system in embodiment 3;
fig. 8 is a block diagram of a live broadcast preprocessing module in embodiment 3;
fig. 9 is a block diagram of a processing module at the time of live broadcast in the present embodiment 3;
fig. 10 is a block diagram of a target live frame sequence determination submodule in embodiment 3;
fig. 11 is a block diagram of a terminal in this embodiment 4;
fig. 12 is a block diagram of a computer device in embodiment 5.
Reference numerals: 100. a live broadcast system; 110. a live broadcast pretreatment module; 120. a processing module for live broadcasting; 111. a first data acquisition sub-module; 112. a first preview effect generation sub-module; 113. a color matching confirmation sub-module; 120. a processing module for live broadcasting; 121. a second data acquisition sub-module; 122. a first gesture recognition sub-module; 123. a first gesture response sub-module; 124. a speech recognition sub-module; 125. a target effect generation sub-module; 126. a target display sub-module; 127. the template determines a sub-module; 128. a target live frame sequence determining submodule; 129. a second preview effect generation sub-module; 130. a second gesture recognition sub-module; 131. and a second gesture response sub-module.
Detailed Description
In the description of the present disclosure, it is to be noted that embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure. It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "a" and "an" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be construed as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Examples
Example 1
As shown in fig. 1, this embodiment provides a method for adjusting color temperature of a living room, which is described in terms of an application scenario applied to a living room transmission system for understanding, where the living room transmission system at least includes a living room preprocessing system connected to a living server, the living room preprocessing system includes a camera and a processing terminal that are connected to each other, and an execution body of the method for adjusting color temperature of a living room is the processing terminal, and the camera is used to capture a sequence of image frames of the living room and transmit data to the execution body through a wired or wireless connection manner. The processing terminal is provided with a display screen, the display screen is used for displaying pictures, and related parameters are obtained by triggering and setting on the display screen through mouse operation of a user.
In this embodiment, the live broadcasting room image frame sequence includes a first anchor image frame sequence and a second anchor image frame sequence, where the first anchor image frame sequence is obtained by shooting before live broadcasting, and the second anchor image frame sequence is obtained by shooting when live broadcasting. The live room image frame sequence may be an image frame sequence composed of at least one frame of real scene images. It will be appreciated that each frame image in the first anchor image frame sequence may comprise an anchor human image.
In this embodiment, the live broadcasting room color temperature adjustment method is used for a live broadcasting pretreatment system, the live broadcasting pretreatment system is connected with a live broadcasting server, the live broadcasting server is used for transmitting live broadcasting video, the live broadcasting pretreatment system comprises a camera and a processing terminal which are connected with each other, the camera is used for collecting a live broadcasting room image frame sequence, and the processing terminal is used for toning the live broadcasting room image frame sequence;
referring to fig. 1, the method comprises the steps of:
s100, acquiring a color temperature preset mode;
in this embodiment, the color temperature preset mode is a pre-configured color temperature correlation parameter, for example: each color temperature preset mode has a mapping relation with the color temperature value of the corresponding color temperature reference point and the white balance offset value. Specifically, a mapping table is constructed according to the corresponding relation between the theme type and the color temperature preset mode, and the color temperature preset mode is determined by acquiring the theme type of the current live scene theme before or during live broadcast, so that the effect of automatically adjusting the color temperature according to the theme type is achieved, and the working efficiency of staff in a live broadcast room is improved. The theme type can be extracted from the live broadcast script, specifically, the live broadcast script has a complete progress, and the theme type corresponding to the current live broadcast script progress is determined according to the theme keywords, so that the self-adaptive color temperature adjustment can be achieved according to the theme type in the live broadcast process.
S200, in response to the color temperature preset mode being a non-null mode, toning the live broadcasting room image frame sequence based on the color temperature preset mode;
in this embodiment, when the color temperature preset mode has a configuration parameter value, the color temperature preset mode is regarded as a non-null mode, and the live-room image frame sequence may be toned based on the specific configuration parameter value of the color temperature preset mode.
S300, acquiring the position of a color temperature reference point in a first color temperature setting area and acquiring a white balance offset coordinate in a second color temperature setting area in response to the color temperature preset mode being a null mode;
in the present embodiment, when the color temperature preset mode does not have any configuration parameter value, it is regarded as a non-null mode,
s400, toning the live broadcasting room image frame sequence based on the color temperature value of the color temperature reference point and the white balance offset value;
in this embodiment, the position of the color temperature reference point and the white balance offset coordinate are obtained, so that the color temperature value and the white balance offset value of the color temperature reference point are determined, and the white balance is adjusted in a software mode in response, so that the efficiency of adjusting the white balance is improved, and meanwhile, the problems of misoperation and low adjustment efficiency caused by small self-contained keys of the camera are avoided.
The display positions of the first color temperature setting region and the second color temperature setting region are not overlapped, the color temperature value of the color temperature reference point is determined by the position relation of the color temperature reference point in the first color temperature setting region, and the white balance offset value is determined by the coordinate position relation of the white balance offset coordinate in the second color temperature setting region.
The first color temperature setting area is a color temperature strip, and a color temperature value of a color temperature reference point is determined through the position relation of the color temperature reference point on the color temperature strip; the second color temperature setting area is a white balance offset graph, and the white balance offset value is determined through the coordinate position relation of the white balance offset coordinates in the white balance offset graph.
Example 2
This embodiment 2 provides a live broadcast method for a live broadcast room.
As shown in fig. 2, in the present embodiment, the live broadcast method includes S1000, live broadcast preprocessing and S2000, live broadcast time processing.
As shown in fig. 3, in this embodiment, the pre-live process is used to perform a process of color matching on a picture before live broadcast, and specifically includes:
s1100, acquiring a first anchor image frame sequence and a toning parameter;
s1200, displaying a first anchor image frame sequence in a first display area and a target live broadcast area, and displaying a first preview effect frame sequence in a second display area, wherein the first preview effect frame sequence is determined based on a color mixing parameter and the first anchor image frame sequence; specifically, the first anchor image frame sequence is subjected to toning processing according to the toning parameters to obtain a first preview effect frame sequence.
S1300, responding to a color matching confirmation request of a user, and displaying a first preview effect frame sequence in a target live broadcast area to cover a first anchor image frame sequence;
the color mixing parameters at least comprise color temperature adjusting information, the color temperature adjusting information is used for adjusting white balance, the color temperature adjusting information comprises a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value, and the color temperature adjusting information is determined by using the live broadcasting room color temperature adjusting method.
In the embodiment, the color matching parameters are set to ensure that the color of the live broadcast picture is accurate and bright, and the atmosphere and emotion conforming to the theme of the live broadcast scene are shown. In practical application, the color mixing parameters specifically include color temperature adjustment information, exposure adjustment information, contrast adjustment information, color saturation adjustment information and detail enhancement information. The color temperature adjusting information is used for adjusting white balance to enable the color temperature of the live broadcast picture to reach the optimal state, and the color accuracy is ensured so as to accord with the live broadcast scene theme. The color temperature of the camera is adjusted by adjusting the white balance, so that white is truly and naturally displayed in a live broadcast picture, a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value are required to be adjusted when the white balance is adjusted, and the color temperature refers to the temperature of the color represented by an object when the object emits light and is generally expressed in Kelvin (K). When the color temperature preset mode is set, the required white balance mode is different under different environments. For example, the indoor white balance mode and the outdoor white balance mode are different, so that different preset white balance modes can be selected according to actual scene requirements. In addition, when the white balance is adjusted, a reference point needs to be selected as a reference, that is, a color temperature value of the color temperature reference point, for example, white paper or gray card can be used as a reference, and white or gray in the reference point is selected to adjust the white balance.
The exposure adjusting information is used for adjusting the brightness of the live broadcast picture so that the whole live broadcast picture looks more comfortable and natural, and the exposure adjusting information is adjusted by setting reasonable parameters such as an aperture, a shutter and the like in practical application.
The contrast adjusting information is used for enhancing the depth sense of the live broadcast picture, so that the live broadcast picture is more colorful, and the contrast of black and white colors in the live broadcast picture is adjusted during practical application.
The color saturation adjustment information is used to emphasize or suppress the importance of a specific color to increase the visual hierarchy of the live view. In practical application, the color saturation in the live broadcast picture is adjusted.
The detail enhancement information is used to increase the definition and detail of the live view so that the live view looks more vivid and real. In practical application, the sharpening operation, the denoising operation and the like are set for adjustment.
In this embodiment, the palette confirm request is generated by the user clicking a confirm palette control on the display screen of the processing terminal.
In this embodiment, before live broadcast processing, further includes:
s1400, determining first position information and second position information in response to a comparison request of a user;
in this embodiment, the preset operation of the user in the second display area is double-clicking at a preset position in the second display area. It should be appreciated that the person skilled in the art may modify the preset operation according to the actual situation, for example, click may be performed at a preset position in the second display area, or by sliding the mouse cursor from the first preset coordinate area to the second preset coordinate area, or by clicking the mouse cursor on the first preset coordinate area and the second preset coordinate area within a preset time, or clicking a control for generating the first contrast request, etc. Here, the specific generation manner of various requests of the user is not limited in this embodiment.
In this embodiment, the first location information and the second location information are both determined based on a preset area type, which is preset by a user.
In this embodiment, the first position information and the second position information are determined by the same method, and the determination of the first position information will be described below as an example. When the type of the preset area is judged to be round, taking the center coordinates and the radius distance as first position information, and obtaining a round range based on the center coordinates and the radius distance, so as to determine the display area of the first display area in the picture; when the preset region type is judged to be rectangular, the two-point coordinate set with the diagonal relation is used as the first position information, and the rectangular range is obtained based on the two-point coordinate set, so that the display region of the first display region in the picture is determined. It should be noted that, the center coordinates and the two point coordinates have a mapping relationship with the coordinate information of the picture.
S1500, adjusting the picture based on the first position information and the second position information so that the size of the second display area is the same as that of the first display area in the picture, and symmetrically arranging and displaying based on the directions of the two horizontal ends of a preset separation line; the comparison request is generated through the triggering of the preset operation of the user on the second display area, the first position information is used for determining the display area of the first display area on the picture, and the second position information is used for determining the display area of the second display area on the picture.
When the user needs to compare the color matching result before live broadcast, the first position information and the second position information are determined by triggering the comparison request, and then the first display area and the second display area with the same area are determined by the first position information and the second position information, a preset separation line is formed by extending in the vertical direction of the center of the picture, at the moment, the first display area and the second display area are symmetrical about the preset separation line, so that the second display area and the first display area have the same area size on the picture, and are symmetrically arranged and displayed in the horizontal direction, the user can conveniently and clearly observe the color matching difference of the first main broadcasting image frame sequence and the first preview effect frame sequence when the user completes the color matching task before live broadcast, and the user is assisted to compare the color matching effect quickly.
As shown in fig. 4, in this embodiment, the live broadcast processing is used for processing during live broadcast, and specifically includes:
s2100, acquiring a second anchor image frame sequence;
s2200, identifying a first gesture type of the anchor according to the second anchor image frame sequence; specifically, a gesture recognition model is used to detect the first gesture type from the second sequence of anchor image frames, the gesture recognition model being trained in advance from sample data of the anchor gesture for training.
For example, the first gesture type may be at least one of: other digital gesture types such as praise, waving hands, making fists, gathering and stretching fingers, semi-making fists, digital 1 gestures, digital 2 gestures and the like.
For example, sample images of various gestures which may occur during live broadcast of a host may be collected in advance, a sample library is established, feature extraction is performed on various host gestures, and a machine learning method is used for training to obtain a classifier of the host gesture, such as a like classifier, a waving classifier, and the like.
S2300, responding to the first gesture type as a first target gesture type, and acquiring a live broadcast voice frame sequence in a preset time period;
s2400, identifying a target voice command type according to the live voice frame sequence; specifically, a voice command recognition model is used to detect a target voice command type from a live voice frame sequence, the voice command recognition model being trained in advance based on sample data of a host voice command for training.
In this embodiment, for example, the target voice instruction type may be at least one of the following: other voice command types such as "get on", "get on shopping cart", "countdown start", "grasp time", etc.
For example, a sample voice frame sequence of various voice instructions possibly occurring during live broadcast of a host can be collected in advance, a sample library is established, feature extraction is performed on the various host voice instructions, and a classifier of the host voice instructions is obtained through training by a machine learning method, such as a shopping cart classifier, a countdown start classifier and the like.
S2500, determining a target live broadcast frame sequence based on the target voice instruction type;
as shown in fig. 5, in this embodiment, in determining the target live frame sequence based on the target voice command type, it includes:
s2501, determining a preset palette template in response to successful recognition of target voice command types, wherein each target voice command type is matched with the preset palette template to form a mapping relationship;
it should be noted that, in live broadcast, the live visual effect directly affects sales of the product. In live broadcasting, in order to attract the attention of a user, a live broadcasting picture needs to have a certain artistic sense and aesthetic feeling, and complex live broadcasting operations such as shooting, lens switching and the like of a plurality of angles need to be performed, and all the operations need to be completed by special personnel. In addition, in order to create video pictures attracting audience in the live broadcast room, workers need to mix colors in advance before live broadcast in the live broadcast room so as to create light and color effects suitable for live broadcast scene subjects. Meanwhile, in the live broadcast process of the live broadcast, a photographer needs to adjust the picture in time, and the picture is switched at any time according to the requirements of a host and a client, so that the focus of live broadcast is highlighted, and a better display effect is achieved.
In this embodiment, through the discernment of gesture and voice command, make the anchor can combine live script to carry out a self-adaptation mixing of colors processing better when living broadcast to improve the automatic mixing of colors effect of living broadcast, avoided living broadcast room staff to need to do mixing of colors processing according to living broadcast scene condition manual cooperation, improved living broadcast room staff's work efficiency.
S2502, determining a target live broadcast frame sequence according to the preset palette and the second anchor image frame sequence.
As shown in fig. 6, in particular, in determining a target live frame sequence according to a preset palette and a second anchor image frame sequence, the method includes:
S2502A, determining a second preview effect frame sequence according to a preset palette and a second anchor image frame sequence;
S2502B, when the second preview effect frame sequence is determined, identifying a second gesture type of the anchor according to the second anchor image frame sequence within a preset cancel time; specifically, the gesture recognition model described above is used to detect a second gesture type from a second anchor image frame sequence.
S2502C, canceling the second preview effect frame sequence and taking the second anchor image frame sequence as a target live frame sequence in response to the second gesture type being the second target gesture type.
In actual application, the second target gesture type is identified to be used as a relief measure for coping with misoperation, and when the anchor carelessly makes the first target gesture and triggers the second preview effect frame sequence to be used as the target live frame sequence, the second target gesture is made in the preset cancellation time to cancel the toning treatment caused by misoperation, so that the unexpected toning condition caused by the anchor misoperation is avoided.
S2600, setting the target live broadcast frame sequence in a target live broadcast area for display.
Example 3
As shown in fig. 7, the present embodiment provides a live broadcast system 100, where the live broadcast system 100 corresponds to the live broadcast method in the above embodiment and is used in a live broadcast room, and the live broadcast system 100 includes a live broadcast pre-processing module 110 and a live broadcast time processing module 120; the same contents as those of the above embodiment in this embodiment are not described here.
As shown in fig. 8, in this embodiment, the live pre-processing module 110 includes:
a first data acquisition sub-module 111, configured to acquire a first anchor image frame sequence and a palette parameter;
a first preview effect generating sub-module 112, configured to display a first anchor image frame sequence in a first display area and a target live broadcast area, and display a first preview effect frame sequence in a second display area, where the first preview effect frame sequence is determined based on a palette parameter and the first anchor image frame sequence;
a palette confirm sub-module 113 for displaying the first preview effect frame sequence in the target live zone to cover the first anchor image frame sequence in response to a palette confirm request of the user;
the color mixing parameters at least comprise color temperature adjusting information, wherein the color temperature adjusting information is used for adjusting white balance, the color temperature adjusting information comprises a color temperature preset mode, a color temperature reference point color temperature value and a white balance offset value, and the color temperature adjusting information is determined by using the live broadcasting room color temperature adjusting method;
as shown in connection with fig. 9, the live-time processing module 120 includes:
a second data acquisition sub-module 121, configured to acquire a second anchor image frame sequence;
a first gesture recognition sub-module 122 for recognizing a first gesture type of the anchor from the second anchor image frame sequence;
a first gesture response sub-module 123, configured to obtain a live voice frame sequence within a preset time period in response to the first gesture type being a first target gesture type;
a voice recognition sub-module 124, configured to recognize a target voice command type according to the live voice frame sequence;
a target effect generation sub-module 125 for determining a target live frame sequence based on the target voice command type;
the target display sub-module 126 sets the target live frame sequence in the target live region for display.
In this embodiment, the target live frame sequence is taken as the final live frame, and the target live region is used to provide a display area for the target live frame sequence.
In this embodiment, the target effect generation sub-module 125 further includes a template determination sub-module 127 and a target live frame sequence determination sub-module 128. Wherein, the template determination submodule 127 is used for determining a preset palette template in response to the successful recognition of the target voice instruction type; the target live frame sequence determining sub-module 128 is configured to determine a target live frame sequence according to the preset palette and the second anchor image frame sequence.
As shown in conjunction with fig. 10, in particular, the target live frame sequence determination sub-module 128 includes a second preview effect generation sub-module 129, a second gesture recognition sub-module 130, and a second gesture response sub-module 131.
A second preview effect generating sub-module 129 for determining a second preview effect frame sequence from the preset palette and the second anchor image frame sequence;
a second gesture recognition sub-module 130, configured to recognize a second gesture type of the anchor according to the second anchor image frame sequence within a preset cancellation time when the second preview effect frame sequence is determined;
the second gesture response sub-module 131 is configured to cancel the second preview effect frame sequence and take the second anchor image frame sequence as the target live frame sequence in response to the second gesture type being the second target gesture type.
Example 4
As shown in fig. 11, the present embodiment provides a terminal including: at least one memory and at least one processor;
wherein the at least one memory is configured to store program code and the at least one processor is configured to invoke the program code stored by the at least one memory to perform any of the live methods of the above embodiments.
Example 5
The present embodiment provides a computer device, which may be a server, and an internal structure thereof may be as shown in fig. 12. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is a physical layer for storing various databases. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a live method.
Example 6
The present embodiment provides a storage medium for storing program code for executing the live broadcast method described above.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
The above examples are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above examples, and any other changes, modifications, substitutions, combinations, and simplifications that do not depart from the spirit and principle of the present invention should be made in the equivalent manner, and the embodiments are included in the protection scope of the present invention.
Claims (10)
1. The live broadcasting room color temperature adjusting method is used for a live broadcasting pretreatment system, the live broadcasting pretreatment system is connected with a live broadcasting server, and the live broadcasting server is used for transmitting live broadcasting videos and is characterized in that: the live broadcast preprocessing system comprises a camera and a processing terminal which are connected with each other, wherein the camera is used for collecting a live broadcast room image frame sequence, and the processing terminal is used for toning the live broadcast room image frame sequence; the method comprises the following steps: acquiring a color temperature preset mode; in response to a color temperature preset mode being a non-null mode, toning the live-room image frame sequence based on the color temperature preset mode; in response to the color temperature preset mode being a null mode, acquiring the position of a color temperature reference point in a first color temperature setting area and acquiring a white balance offset coordinate in a second color temperature setting area, wherein the first color temperature setting area is a color temperature bar, the color temperature value of the color temperature reference point is determined through the position relation of the color temperature reference point in the color temperature bar, the second color temperature setting area is a white balance offset graph, and the white balance offset value is determined through the coordinate position relation of the white balance offset coordinate in the white balance offset graph; toning the live broadcasting room image frame sequence based on a color temperature value of a color temperature reference point and a white balance offset value; the display positions of the first color temperature setting region and the second color temperature setting region are not overlapped, the color temperature value of the color temperature reference point is determined according to the position relation of the color temperature reference point in the first color temperature setting region, and the white balance offset value is determined according to the coordinate position relation of the white balance offset coordinate in the second color temperature setting region.
2. A live broadcast method for a live broadcast room, comprising: the live broadcast pretreatment specifically comprises the following steps: acquiring a first anchor image frame sequence and toning parameters, wherein the first anchor image frame sequence is obtained by shooting before live broadcast, and each frame image in the first anchor image frame sequence comprises an anchor human body image; displaying the first anchor image frame sequence in a first display area and a target live broadcast area, and displaying a first preview effect frame sequence in a second display area, wherein the first preview effect frame sequence is determined based on the toning parameters and the first anchor image frame sequence; in response to a user's palette confirm request, displaying the first preview effect frame sequence in the target live zone to overlay the first anchor image frame sequence; wherein the color mixing parameters include color temperature adjustment information for adjusting white balance, the color temperature adjustment information including a color temperature preset pattern, a color temperature reference point color temperature value, and a white balance shift value, the color temperature adjustment information being determined using the direct broadcasting room color temperature adjustment method of claim 1.
3. The live broadcast method of claim 2, wherein the live broadcast pre-processing further comprises: determining first location information and second location information in response to a comparison request of a user; adjusting the picture based on the first position information and the second position information so that the size of the second display area is the same as that of the first display area in the picture, and symmetrically arranging and displaying based on the directions of the two horizontal ends of a preset separation line; the comparison request is generated through the triggering of a preset operation of a user in a second display area, the first position information is used for determining the display area of the first display area in a picture, the second position information is used for determining the display area of the second display area in the picture, and the preset separation line is obtained through extending in the vertical direction of the center of the picture.
4. The live broadcast method of claim 2, further comprising: the live broadcast processing method specifically comprises the following steps: acquiring a second anchor image frame sequence, wherein the second anchor image frame sequence is obtained by shooting when live broadcasting is performed; identifying a first gesture type of the anchor according to the second anchor image frame sequence; responding to the first gesture type as a first target gesture type, and acquiring a live voice frame sequence in a preset time period; identifying a target voice command type according to the live voice frame sequence; determining a target live broadcast frame sequence based on the target voice command type; and setting the target live broadcast frame sequence in the target live broadcast area for display.
5. The live broadcast method of claim 4, wherein in identifying a first gesture type of a presenter from the sequence of second presenter image frames comprises: the first gesture type is detected from the second sequence of anchor image frames using a gesture recognition model that was previously trained from sample data of the anchor gesture for training.
6. The live broadcast method of claim 4, wherein identifying a target voice command type from the sequence of live voice frames comprises: the target voice command type is detected from the sequence of live voice frames using a voice command recognition model that is trained in advance from sample data of the training anchor voice command.
7. The live broadcast method of claim 4, wherein determining a target live frame sequence based on the target voice command type comprises: determining a preset palette template in response to successful recognition of the target voice command types, wherein each target voice command type is matched with the preset palette template to form a mapping relationship; and determining a target live broadcast frame sequence according to the preset palette and the second anchor image frame sequence.
8. The live broadcast method of claim 7, further comprising: in determining a target live broadcast frame sequence according to the preset palette and the second anchor image frame sequence, the method further includes: determining a second preview effect frame sequence according to the preset palette and the second anchor image frame sequence; when the second preview effect frame sequence is determined, identifying a second gesture type of the anchor according to the second anchor image frame sequence in preset cancelling time; and canceling a second preview effect frame sequence in response to the second gesture type being a second target gesture type, and taking the second anchor image frame sequence as the target live broadcast frame sequence.
9. The live broadcast system is used for a live broadcast room and is characterized by comprising a live broadcast pretreatment module and a live broadcast time treatment module; the live broadcast preprocessing module comprises: the first data acquisition sub-module is used for acquiring a first anchor image frame sequence and toning parameters, wherein the first anchor image frame sequence is shot before live broadcast, and each frame image in the first anchor image frame sequence comprises an anchor human body image; the first preview effect generation sub-module is used for displaying the first anchor image frame sequence in a first display area and a target live broadcast area, and displaying a first preview effect frame sequence in a second display area, wherein the first preview effect frame sequence is determined based on the color mixing parameters and the first anchor image frame sequence; a palette validation sub-module for displaying the first preview effect frame sequence in the target live zone to overlay the first anchor image frame sequence in response to a palette validation request by a user; wherein the color mixing parameters include color temperature adjustment information for adjusting white balance, the color temperature adjustment information including a color temperature preset pattern, a color temperature reference point color temperature value, and a white balance shift value, the color temperature adjustment information being determined using the direct broadcasting room color temperature adjustment method of claim 1; the live broadcast processing module comprises: the second data acquisition sub-module is used for acquiring a second anchor image frame sequence, and the second anchor image frame sequence is obtained by shooting when live broadcasting is performed; a first gesture recognition sub-module for recognizing a first gesture type of the anchor according to the second anchor image frame sequence; the first gesture response sub-module is used for responding to the first gesture type as a first target gesture type and acquiring a live broadcast voice frame sequence in a preset time period; the voice recognition sub-module is used for recognizing a target voice instruction type according to the live voice frame sequence; the target effect generation sub-module is used for determining a target live broadcast frame sequence based on the target voice instruction type; and the target display sub-module is used for setting the target live broadcast frame sequence in the target live broadcast area for display.
10. A storage medium for storing program code for performing the live method of any of claims 2-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310667782.3A CN116743976B (en) | 2023-06-07 | 2023-06-07 | Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310667782.3A CN116743976B (en) | 2023-06-07 | 2023-06-07 | Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116743976A CN116743976A (en) | 2023-09-12 |
| CN116743976B true CN116743976B (en) | 2024-03-19 |
Family
ID=87902241
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310667782.3A Active CN116743976B (en) | 2023-06-07 | 2023-06-07 | Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116743976B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107529051A (en) * | 2017-07-31 | 2017-12-29 | 努比亚技术有限公司 | Method, equipment and the computer for adjusting color temp can storage mediums |
| CN108234981A (en) * | 2018-03-09 | 2018-06-29 | 北京小米移动软件有限公司 | Color temperature adjusting method, device, equipment and storage medium |
| CN109729332A (en) * | 2018-12-12 | 2019-05-07 | 珠海亿智电子科技有限公司 | A kind of automatic white balance antidote and system |
| CN110191329A (en) * | 2019-03-29 | 2019-08-30 | 上海传英信息技术有限公司 | A kind of image processing method, image processing apparatus and electronic equipment |
| CN116033130A (en) * | 2022-12-02 | 2023-04-28 | 稻兴光学(厦门)有限公司 | Color temperature adjusting method and system for laser projection picture |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101920816B1 (en) * | 2013-07-08 | 2018-11-21 | 한화테크윈 주식회사 | White balance method for shading compensation, and apparatus applied to the same |
-
2023
- 2023-06-07 CN CN202310667782.3A patent/CN116743976B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107529051A (en) * | 2017-07-31 | 2017-12-29 | 努比亚技术有限公司 | Method, equipment and the computer for adjusting color temp can storage mediums |
| CN108234981A (en) * | 2018-03-09 | 2018-06-29 | 北京小米移动软件有限公司 | Color temperature adjusting method, device, equipment and storage medium |
| CN109729332A (en) * | 2018-12-12 | 2019-05-07 | 珠海亿智电子科技有限公司 | A kind of automatic white balance antidote and system |
| CN110191329A (en) * | 2019-03-29 | 2019-08-30 | 上海传英信息技术有限公司 | A kind of image processing method, image processing apparatus and electronic equipment |
| CN116033130A (en) * | 2022-12-02 | 2023-04-28 | 稻兴光学(厦门)有限公司 | Color temperature adjusting method and system for laser projection picture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116743976A (en) | 2023-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107679497B (en) | Video face mapping special effect processing method and generating system | |
| US20200380594A1 (en) | Virtual try-on system, virtual try-on method, computer program product, and information processing device | |
| US8007110B2 (en) | Projector system employing depth perception to detect speaker position and gestures | |
| US11450075B2 (en) | Virtually trying cloths on realistic body model of user | |
| US20050088542A1 (en) | System and method for displaying an image composition template | |
| US10516830B2 (en) | Guided image composition on mobile devices | |
| CN107004279A (en) | Natural user interface camera calibrated | |
| CN111527468A (en) | Air-to-air interaction method, device and equipment | |
| US10984610B2 (en) | Method for influencing virtual objects of augmented reality | |
| CN114025097B (en) | Composition guidance method, device, electronic equipment and storage medium | |
| WO2021039856A1 (en) | Information processing device, display control method, and display control program | |
| CN208013970U (en) | A kind of living creature characteristic recognition system | |
| CN105960801A (en) | Enhancing video conferences | |
| KR20200094915A (en) | Exercise Posture Correction System and Correction Method using it | |
| JP2021144582A (en) | Makeup simulation device, makeup simulation method and program | |
| JP2013168146A (en) | Method, device and system for generating texture description of real object | |
| JP2018195996A (en) | Image projection apparatus, image projection method, and image projection program | |
| CN113412479A (en) | Mixed reality display device and mixed reality display method | |
| EP3863275B1 (en) | System and method for smart image-capturing | |
| CN116743976B (en) | Live broadcasting room color temperature adjustment method, live broadcasting system and storage medium | |
| CN112073640A (en) | Panoramic information acquisition pose acquisition method, device and system | |
| CN109885172A (en) | A kind of object interaction display method and system based on augmented reality AR | |
| CN116452745A (en) | Hand modeling, hand model processing method, device and medium | |
| CN110597397A (en) | Augmented reality implementation method, mobile terminal and storage medium | |
| CN113778233B (en) | Method and device for controlling display equipment and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |