CN115604392A - Color printing information generation method, device, equipment and computer program product - Google Patents
Color printing information generation method, device, equipment and computer program product Download PDFInfo
- Publication number
- CN115604392A CN115604392A CN202110723595.3A CN202110723595A CN115604392A CN 115604392 A CN115604392 A CN 115604392A CN 202110723595 A CN202110723595 A CN 202110723595A CN 115604392 A CN115604392 A CN 115604392A
- Authority
- CN
- China
- Prior art keywords
- color printing
- printing information
- information
- color
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007639 printing Methods 0.000 title claims abstract description 296
- 238000000034 method Methods 0.000 title claims abstract description 76
- 238000004590 computer program Methods 0.000 title claims abstract description 15
- 238000012549 training Methods 0.000 claims description 45
- 239000013598 vector Substances 0.000 claims description 45
- 230000015654 memory Effects 0.000 claims description 18
- 238000004891 communication Methods 0.000 abstract description 24
- 230000009286 beneficial effect Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 23
- 238000012545 processing Methods 0.000 description 13
- 238000013527 convolutional neural network Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000004913 activation Effects 0.000 description 6
- 210000002569 neuron Anatomy 0.000 description 6
- 230000036651 mood Effects 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 238000010606 normalization Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000002265 prevention Effects 0.000 description 3
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 2
- 230000003042 antagnostic effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008929 regeneration Effects 0.000 description 2
- 238000011069 regeneration method Methods 0.000 description 2
- 230000006403 short-term memory Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 108091026890 Coding region Proteins 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 239000003242 anti bacterial agent Substances 0.000 description 1
- 229940088710 antibiotic agent Drugs 0.000 description 1
- 230000003115 biocidal effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/42017—Customized ring-back tones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Accessory Devices And Overall Control Thereof (AREA)
Abstract
The invention discloses a color printing information generation method, a color printing information generation device, color printing information generation equipment and a computer program product, and relates to the technical field of communication. The color printing information generation method comprises the following steps: acquiring video color ring information of a user; and generating color printing information of the user based on the video color ring information. The color printing information generating method provided by the invention cancels the step of editing or customizing the color printing information when the user orders the color printing service, thereby eliminating the limited factor of editing the color printing information and being beneficial to the popularization of the color printing service.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, a device, and a computer program product for generating color printing information.
Background
The color printing Service is that when the calling terminal dials the called terminal, before connection, during conversation and after hang-up, the system automatically pushes the preset color printing information of the called terminal, such as mood, joke, customer care, anti-harassment/false/fraud calls, etc., to the calling terminal in USSD (Unstructured Supplementary Service Data) or flash mode, so that the calling terminal or the called terminal can display the personalized mobile color printing information to achieve the purposes of showing personality, information transmission, anti-fraud, etc.
However, when a user subscribes to the color printing service, the limited factor of color printing information editing is more.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a color printing information generation method, a color printing information generation device, color printing information generation equipment and a computer program product, and aims to solve the technical problem that limited factors for color printing information editing are more when a user orders a color printing service.
In order to achieve the above object, in a first aspect, the present invention provides a color printing information generating method, including:
acquiring video color ring information of a user;
and generating color printing information of the user based on the video color ring information.
In an embodiment, the generating color printing information of the user based on the video color ring information includes:
and inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain color printing information output by the color printing information generation network.
In an embodiment, before the inputting the video color ring back tone information into a pre-trained color printing information generating network to obtain color printing information output by the color printing information generating network, the method further includes:
acquiring a training sample set and a pre-constructed confrontation generation network; each group of training samples in the training sample set comprises video polyphonic ringtone samples and color printing information samples of the same user sample; the countermeasure generating network comprises a generating network and a judging network;
inputting the video color ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video color ring back tone sample;
judging the authenticity of the color printing information samples and the color printing generation samples in each group of training samples through the judging network to obtain corresponding judging results;
and performing countermeasure training on the countermeasure generating network based on the discrimination result corresponding to each set of training samples and the color printing generating sample, and determining the generated network after training as a color printing information generating network.
In one embodiment, the color printing information generation network comprises an image feature extractor and a decoder;
the inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network comprises the following steps:
inputting the video color ring information into the image feature extractor to obtain an image feature vector output by the image feature extractor;
and inputting the image feature vector into the decoder to obtain the color printing information output by the decoder.
In one embodiment, the color printing information generation network further comprises a noise feature extractor;
before the inputting the image feature vector into the decoder to obtain the color printing information output by the decoder, the method further includes:
inputting random noise corresponding to the video color ring information into the noise feature extractor to obtain a noise feature vector output by the noise feature extractor;
the inputting the image feature vector into the decoder to obtain the color printing information output by the decoder comprises:
and inputting the image characteristic vector and the noise characteristic vector into the decoder to obtain the color printing information output by the decoder.
In an embodiment, the generating color printing information of the user based on the video color ring information includes:
extracting a preset number of frames of video frame images from the video color ring information;
and generating the color printing information of the user based on the preset number of frames of video frame images.
In an embodiment, after generating the color printing information of the user based on the video color ring information, the method further includes:
sending the color printing information to the terminal equipment of the user, and receiving the selection operation of the user;
and if the selection operation is a determination operation, determining the color printing information as the customized color printing information of the user.
In a second aspect, the present invention also provides a color printing information generating apparatus, including:
the color ring back tone obtaining module is used for obtaining the video color ring back tone information of the user;
and the color printing generation module is used for generating color printing information of the user based on the video color ring information.
In a third aspect, the present invention also provides a color printing information generating device, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the method as described above.
In a fourth aspect, the invention also provides a computer program product comprising executable program code, wherein the program code, when executed by a processor, performs the method as described above.
According to the color printing information generation method provided by the embodiment of the invention, the color printing information belonging to the user is generated through the customized video color ring information of the user, the step of editing or customizing the color printing information when the user orders the color printing service is cancelled, and the limited factor of editing the color printing information is eliminated, so that the color printing service is promoted.
Drawings
FIG. 1 is a schematic flow chart of a color printing information generating method according to a first embodiment of the present invention;
FIG. 2 is a schematic flow chart of a color printing information generating method according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a color printing information generation network according to an embodiment of the color printing information generation method of the present invention;
FIG. 4 is a flow chart illustrating a color printing information generating method according to a third embodiment of the present invention;
FIG. 5 is a schematic diagram of a judgment network according to an embodiment of the color printing information generating method of the present invention;
FIG. 6 is a flowchart illustrating a color printing information generating method according to a fourth embodiment of the present invention;
FIG. 7 is a flow chart illustrating a fifth embodiment of a color printing information generating method according to the present invention;
FIG. 8 is a functional block diagram of a color printing information generating apparatus according to the present invention;
fig. 9 is a schematic structural diagram of a recommended electronic device of the color printing information generating method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the related art, the color printing service is a value added service for additional information transfer during the user call process of a communication service provider. In the process of the calling and called users communicating, the system automatically pushes the color printing information preset by the users, such as moods, jokes, customer care, harassment prevention/false prevention/fraud calls and the like, to the opposite terminal communicating with the users, so that the users of the opposite terminal can see the color printing information after the communication is finished, and the purposes of showing individuality, sharing moods, transmitting business conditions and the like are achieved. For example, when a user of a calling terminal subscribes a color printing service, when the calling terminal dials a called terminal, before connection, during a call or after hang-up, the system automatically pushes preset color printing information of the called terminal, such as mood, laughter, customer care, harassment prevention/false/fraud calls and the like, to the called terminal in a USSD or flash mode, so that the called terminal can display personalized mobile color printing information. Similarly, when the user of the called terminal subscribes the color printing service, when the calling terminal dials the called terminal, before connection, during conversation or after hanging up, the system automatically pushes the color printing information preset by the called terminal to the calling terminal, so that the calling terminal can display the personalized mobile color printing information.
However, when a user customizes and edits the personalized color printing information, the limited factors are more, such as time factor, some users feel that the editing wastes time, or the user is limited by the character factor, for example, some users have difficulty in selecting and are difficult to edit the color printing information desired by the user. Therefore, the editing of color printing information limits the spread of color printing services.
Therefore, the embodiment of the invention provides a color printing information generation method, which generates color printing information belonging to a user through customized video color ring information of the user, and cancels the step of editing or customizing the color printing information by the user, thereby being beneficial to the popularization of color printing services.
The inventive concept of the present application is further illustrated below with reference to some specific embodiments.
The embodiment of the invention provides a color printing information generation method. Referring to fig. 1, fig. 1 is a schematic flow chart diagram of a color printing information generating method according to a first embodiment of the present invention.
In this embodiment, the method includes the steps of:
step S101, obtaining video color ring information of a user.
Video color ring is a short video content service provided by communication service providers. After a user customizes a video color ring service, when other users use a calling terminal supporting the video color ring function to initiate an audio or video call to a called terminal of the user with the video color ring function under a Voice over Long-Term Evolution (VoLTE) network, a system plays the customized video color ring information of the user to the calling terminal so as to improve the call waiting experience of other users.
The video polyphonic ringtone information can be a section of video customized or edited by a user according to the preference or the requirement of the user, namely an original video file selected from or uploaded to a system platform of a communication service provider when the called user customizes the video polyphonic ringtone service. The video color ring back tone information comprises a plurality of frames of images and audio data matched with the plurality of frames of images.
In the embodiment of the invention, after a user logs in the cloud end of a communication service provider through a mobile phone, a tablet or a computer and enters a color printing ordering service interface, the cloud end can be triggered to automatically call the video color ring information ordered by the user and stored in the background database based on a corresponding instruction input by the user in the color printing ordering service interface.
For example, an "auto generate color print" virtual button may be displayed on the color print ordering service interface. The user can input an acquisition command by clicking a virtual key of 'automatic color printing generation', and the terminal equipment sends the acquisition command to the cloud. And responding to the received acquisition command, and automatically calling the video color ring data ordered by the user stored in the background database by the cloud end.
It can be understood that when the user orders the color printing service, the user sets an order-confirming virtual key on the color printing order service interface, the user inputs the acquisition command by clicking the order-confirming virtual key on the terminal device, and the terminal device sends the acquisition command to the cloud. Therefore, after the user determines to order the color printing service, the video color ring data ordered by the user and stored in the background database is automatically called.
And S102, generating color printing information of the user based on the video color ring information.
After the cloud platform obtains the video color ring data ordered by the user, the cloud platform can generate color printing information of the user based on the video color ring information. After the color printing information customizes the color printing service for the user, the color printing information is used as text information or image-text information such as mood information, smiling information, customer care information, harassment/false/fraud call prompt information and the like pushed to the calling terminal when the called terminal is dialed by the calling terminal of other users, before the called terminal is connected, in a call or after the called terminal is hung up, and is pushed to the calling terminal in a USSD or flash mode.
In this step, the customized video color ring information of each user can reflect the personal preference or requirement of the user to a certain extent. The color printing service also promotes personalized information for the user to other users so as to achieve the purposes of displaying the personality, transmitting the information, preventing fraud and the like. Therefore, in this embodiment, the color printing information belonging to the user can be generated based on the customized personalized video color ring back tone information customized by the user, and the color printing information has the video color ring back tone information style of the user, so that the personal preference or the requirement of the user can be embodied, the user does not need to edit the color printing information, the time for the user to edit the color printing information can be saved, or the difficulty for the user to edit the color printing information is reduced, so that the limited factors during the color printing information editing can be reduced as much as possible, and the popularization of the color printing service is facilitated.
In this embodiment, in step S102, color printing information in a text or image-text form may be generated based on image information such as a video frame of the video color ring back tone information, color printing information in a text or image-text form may be generated based on playing text information of the video color ring back tone information, and color printing information in a text or image-text form may be obtained based on internal rules of existing color printing information, which is not limited in this embodiment.
On the basis of the first embodiment of the color printing information generation method of the present invention, a second embodiment of the color printing information generation method of the present invention is proposed. Referring to fig. 2, fig. 2 is a flow chart of the color printing information generating method of the present invention.
In this embodiment, the method includes the steps of:
step S201, obtaining the video color ring information of the user.
Step S201 may refer to step S101, and is not described herein again.
Step S202, inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain color printing information output by the color printing information generation network.
And the color printing information generation network automatically outputs color printing information according to the input video color ring information.
The input video color ring back tone information has the personal style of the user, so that the output color printing information reflects the personal preference or requirement of the user. The color printing information generation network does not need the user to edit, so that the time for the user to edit the color printing information can be saved, or the difficulty for the user to edit the color printing information can be reduced, thereby reducing the limited factors during the color printing information editing as much as possible and being beneficial to the popularization of color printing services.
Referring to fig. 3, in the embodiment, the color printing information generating network includes an image feature extractor and a decoder.
At this time, step S202 includes:
and A10, inputting the video color ring information into an image feature extractor to obtain an image feature vector output by the image feature extractor.
In this embodiment, the image feature extractor includes a deep convolutional neural network inceptionV3 model and two fully connected layers. The normalized result image with the image size of 299 × 299 input to the image feature extractor is preprocessed with a pre-trained deep convolutional neural network inceptionV3 model, the feature representation of the image is extracted, the image is encoded into a vector of a fixed length, the last convolution layer of the inception v3 model is taken as an output, a vector of the shape (8, 2048) is output, and the vector is compressed into a vector of the shape (64, 2048). The vector of (64, 2048) is then input to the two CNN fully-connected layers in the image feature extractor. The activation function of the CNN full-link layer is set as a ReLU function, and the last CNN full-link layer outputs an image feature vector of (None, 64, 512).
And step A20, inputting the image characteristic vector into a decoder to obtain color printing information output by the decoder.
In this embodiment, the decoder is an LSTM (Long Short-Term Memory) decoder. The decoder comprises at least two LSTM layers and a full link layer. Each LSTM layer contains 512 LSTM neurons and the activation function is set to the ReLU function. The image feature vector of (None, 64, 512) is input to the LSTM layer, which outputs a vector of shape (None, 64, 512). The vector of (None, 64, 512) is input to the fully connected layer. The number of fully connected neurons of the fully connected layer is flash SMS _ vocab _ size, and the activation function is set to be the softmax function. The shape of the layer output data is (None), so that the output shape of the vector of (None, 64, 512) is converted into the dimension of the final output, i.e., the color printing information. The color printing information can be text information.
Therefore, in the embodiment, the color ring back tone information of the video is input into the color printing information in the form of the trained generated network generated text. Therefore, the personalized color printing information belonging to the user is generated based on the personalized video color ring back tone ordered by the user, so that the generated color printing information is relatively matched with the real selection of the user, the time for the user to edit the text is saved, and the difficulty in popularization of the color printing service is reduced.
Further, in this embodiment, the color printing information generating network further includes a noise feature extractor. The noise feature extractor extracts noise feature vectors from noise through LSTM (Long Short-Term Memory) neurons.
In this case, step a20 is preceded by:
and inputting random noise corresponding to the video color ring information into the noise characteristic extractor to obtain a noise characteristic vector output by the noise characteristic extractor.
The random noise may be noise data randomly selected from normally distributed noise, making the color print information generation network more robust. At this time, when the color print information generation network is acquired through the resist generation network GAN, a condition is added on the basis of the resist generation network GAN: random noise. So that the antagonistic creating network GAN becomes the conditional creating antagonistic network. Using this additional condition variable: random noise has a guiding effect on the generation of generator data of the anti-biotic network GAN.
Step a20 the adaptation becomes:
and inputting the image characteristic vector and the noise characteristic vector into a decoder to obtain color printing information output by the decoder.
In the embodiment, the color printing information is generated by the noise characteristic guide and supervision decoder, so that the color printing information generated by the color printing information generation network is more in line with the real selection of a user.
On the basis of the second embodiment of the color printing information generating method of the present invention, a third embodiment of the color printing information generating method of the present invention is proposed. Referring to fig. 4, fig. 4 is a schematic flow chart diagram of a color printing information generating method according to a third embodiment of the present invention.
In this embodiment, the color printing information generating network may be obtained by training in the following manner, that is, before step S101 or step S201, the method further includes:
s301, acquiring a training sample set and a pre-constructed confrontation generation network; each group of training samples in the training sample set comprises video polyphonic ringtone samples and color printing information samples of the same user sample; the countermeasure generation network includes a generation network and a discrimination network.
In this step, a sample set can be collected from the existing video color ring data and color printing data of the communication service provider. Each training sample group of the sample set comprises a video color ring back tone sample and a color printing information sample of the same user sample. The color printing information sample of the color ring back tone style which is really matched with the video color ring back tone sample ordered by the user can be added with an identifier which is marked as 1.
The video color ring samples can extract a preset number of frames of video frame images, and normalization processing is carried out on the preset number of frames of video frame images to obtain a normalized result image with the size of 299 multiplied by 299. The specific steps can refer to step S202 and step S203 of the above embodiments. And will not be described in detail herein.
In addition, text cleaning and text serialization are also required for the color printing information sample. Specifically, the upper and lower cases of letters in the color printing information sample are unified, for example, the upper case letters are converted into the lower case letters. Each word in the color printed information sample may also be converted to a sequence of integers. And simultaneously taking the length M of the longest sample in all color printing information samples as the length of the coding sequence of the color printing information samples. And filling the length of each color printing information sample to M.
Thus, the color-printed information sample can be represented as X-sequence
Wherein, the first and the second end of the pipe are connected with each other,
the sample set obtained by collecting the existing video color ring data and color printing data of the communication service provider can be divided into a training sample set and a test set. If 90% of the sample set is divided into training set, 10% is divided into testing set. The training sample set is used for training the color printing information generation network, and the test set is used for testing the color printing information generation network.
Step S302, inputting the video color ring back tone sample into a generation network to obtain a color printing generation sample corresponding to the video color ring back tone sample.
And collecting color printing generation samples which are generated by the generator and matched with the color ring back tone information of the video. Wherein, the color printing generation sample can be added with an identifier, and the identifier is marked as 0.
The color printing generation sample can still be subjected to text serialization processing, and the specific processing steps can refer to the text serialization processing steps of the color printing information sample, which are not described herein again.
And step S303, judging the authenticity of the color printing information samples and the color printing generation samples in each group of training samples through a judging network to obtain corresponding judging results.
In this embodiment, the color print generating sample output by the generating network and matching the video color ring back tone sample is connected with the input video color ring back tone sample and is input to the discriminating network together. Referring to fig. 5, in the present embodiment, the decision network may be composed of a first branch network, a second branch network and a fully connected neural network.
The first layer of the first branch network is a word embedding layer. The input of the word embedding layer is set as a color print generation sample, and the output is set as a vector of 128 dimensions of the fixed shape.
The second and third layers of the first branch network are two hidden layers, 64 LSTM neurons are arranged in each hidden layer, and the activation function of each layer is set as a Relu function.
The second branch network comprises an image feature extractor and two fully connected layers. Firstly, the normalized result image of 299 x 299 size of the video color ring sample is input to an image feature extractor, which can be a depth convolution neural network inceptinionV 3 model utilizing pre-training. The deep convolutional neural network inceptionV3 model preprocesses the normalized result image, extracts feature representation of the image, encodes the image into vectors of fixed length, outputs the last convolutional layer of the inception v3 model as an output, outputs vectors of the shape (8, 2048), and compresses them into vectors of (64, 2048). The vector of (64, 2048) is then input to two CNN fully-connected layers, outputting a vector of shape (None, 64, 512).
The fully-connected neural network comprises a merging layer and two fully-connected layers. Wherein, the last full-connection layer is an output layer.
And the output results of the first branch network branch and the second branch network are: and combining and splicing the 128-dimensional vector and the (None, 64 and 512) vector to form a new vector.
The first fully-connected layer contains 16 neurons, and the activation function is set to the Relu function.
The sixth output layer contains 1 sense neuron, the activation function setting can be set as a sigmoid function, and the discrimination result of the output layer is 1 or 0, wherein the true value is 1, and the false value is 0.
And S304, performing countermeasure training on the countermeasure network based on the discrimination result corresponding to each group of training samples and the color printing generation samples, and determining the trained generation network as the color printing information generation network.
In the step, the discrimination network learns that the video CRBT ordered by the user and the corresponding color print generation sample which truly matches the color ring style of the video are given higher scores, and the video CRBT ordered by the user and the corresponding generated color print generation sample which matches the color ring style of the video are given lower scores, so that the parameters of the discrimination network are updated. It can be understood that the goal of the generation network learning is to make the generated color print generation sample matching the video color ring tone and the color print information sample matching the real video color ring tone style better, so as to maximize the fraction (true 1, false 0) of the discrimination network output. The output scores may be considered as model parameters for the reward update generation network.
For example, firstly initializing the model parameters of the generation network and the discrimination network, in each training cycle, firstly fixing the parameters of the generator, training the discriminator, then fixing the parameters of the discriminator, training the generator until the discriminator can not distinguish whether the color printing text corresponding to the called ordered video color ring back tone is real or generated by the generator, deriving the model weight after convergence, and generating the color printing text content corresponding to the called video color ring back tone style by the trained generator in real time.
In this embodiment, the number of training rounds may be set to 1000, the batch size may be set to 100 (batch _ size = 100), a coordinated cross entropy function may be selected as a loss function, i.e., an objective function, and used by a gradient descent optimization algorithm, such as an adam optimizer to improve the learning speed of traditional gradient descent (optimal = 'adam'). The countermeasure generation network can find the optimal weight value which enables the objective function to be minimum through gradient descent, and the countermeasure generation network can learn the weight value independently through training.
In this step, the output result of the discrimination network is sent to the objective function, so as to obtain a corresponding weight value.
Wherein the objective function can be expressed as:
wherein L is an objective function, N is the total number of training samples in the sample set, theta is a model parameter of the generated network, and c i Is the ith video color ring, x i Is c i Corresponding ith color print generation sample, D (c) i ,x i ) To determine the output value of the network, when D (c) i ,x i ) If 1, then the model parameters are updated to increase P θ (x i |c i ) When D (c) i ,x i ) At 0, the model parameters are updated to reduce P θ (x i |c i )，P θ (x i |c i ) To form networks based on c i Corresponding to generated x i Probability of being judged as true by the judged network.
And updating the model of the generated network in the training process, and determining the trained generated network as the color printing information generation network after the training is finished.
In this embodiment, the color printing information generation network obtained through the training in the above steps can generate color printing information with a matched style according to the input video color ring information, so as to accurately recommend appropriate color printing content for the user, improve the user experience on the color printing service and the ordering rate of color printing, and facilitate the popularization of the color printing service.
A fourth embodiment of the color printing information generating method of the present invention is proposed on the basis of the first to third embodiments of the color printing information generating method of the present invention. Referring to fig. 6, fig. 6 is a flow chart illustrating a color printing information generating method according to the present invention.
In this embodiment, the method includes the steps of:
step S401, obtaining the video color ring information of the user.
Step S402, extracting a preset number of frames of video frame images from the video color ring information.
The video color ring back tone information is a section of video and comprises a plurality of frames of video frame images. The extraction of the preset number of frame video frame images from all the video frame images of the video color ring information can be random extraction, so that the calculation amount is reduced, and the calculation speed of a generated network is increased. The extraction may also be based on a preset rule, such as extracting a video frame image with a displayed caption, or extracting a video frame image with a specific element, such as a virtual character, a special effect, and the like. And extracting the video frame images of the preset number of frames based on the preset rule, so that the generated color printing information can be more matched with the video color ring information of the user. The present embodiment does not limit the specific rule for extracting the video frame image.
Step S403, generating the color printing information of the user based on a preset number of frames of video frame images.
Specifically, in this step, normalization processing may be performed on all video frame images to obtain a normalization result image.
Extracting a corresponding number of frame images from the video color ring ordered by the user, and converting the picture shape of each frame of video frame image into 299 x 299. Meanwhile, in order to ensure that the data are all in the same range, the data need to be standardized, each pixel of each frame of video frame image is proportionally compressed to be in the range of 0 to 1, and then the pixel value of each frame of image is correspondingly subtracted by the pixel value of the global mean image to realize normalization.
The pixel value of the global mean picture is obtained by calculating the mean value of the pixel value of each position of each frame of image sample in the training sample set in the training process of the color printing information generation network. The image pixel values of all the processed video frame images are normalized to image data with a mean value of 0 and a variance of 1. At this time, the video frame image of the video color ring can be expressed as: c = { C1, C2.,. CN }, where cN is the feature vector at spatial position N.
Then, based on the normalized result image, color print information of the user is generated.
Specifically, the color ring back tone information of the video, namely the normalized result image, is input into the pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network.
A fifth embodiment of the color printing information generating method of the present invention is provided on the basis of the first to fourth embodiments of the color printing information generating method of the present invention. Referring to fig. 7, fig. 7 is a schematic flow chart of a color printing information generating method according to the present invention. The color printing information generation method is applied to a cloud platform of a communication service provider.
In this embodiment, the method includes the steps of:
step S501, the cloud platform acquires video color ring information of a user.
And S502, the cloud platform generates color printing information of the user based on the video color ring information.
Step S503, the cloud platform sends the color printing information to the terminal equipment of the user and receives the selection operation of the user.
The terminal equipment of the user can be the terminal equipment when the user logs in a cloud platform of a communication service provider, and the terminal equipment displays color printing information on a display interface of the terminal equipment after receiving the color printing information sent by the cloud platform. It can be understood that the terminal device may be a tablet, a computer, or the like when the user logs in the system cloud platform of the communication service provider. In addition, when a user logs in a system cloud platform of a communication service provider through a tablet, a computer and the like, the cloud platform can also send generated color printing information to a personal mobile terminal of the user, such as a smart phone, in the form of short message notification and the like.
The terminal device may have a display screen. When a user logs in a system platform of a communication service provider through terminal equipment and orders color printing services, corresponding automatic generation operation can be selected to generate color printing information. And the system platform generates color printing information according to the video color ring information of the user stored in the background and then sends the color printing information to the terminal equipment. And after receiving the color printing information, the terminal equipment displays the color printing information on a display interface of the terminal equipment. And displaying the 'confirm' virtual key and the 'cancel' virtual key on the display interface, or 'regenerating' the virtual key, and the like. The user can select the virtual key through mouse clicking or touch screen clicking and other operations, and accordingly corresponding selection operations are sent to the system platform.
Step S504, if the selection operation is a determination operation, the cloud platform determines the color printing information as the customized color printing information of the user.
In this embodiment, if the user is satisfied with the color printing information generated by the system platform, the "confirm" virtual key may be selected through operations such as mouse clicking or touch screen clicking, so as to order the color printing information as the customized color printing information of the user.
If the user is not satisfied with the color printing information generated by the system platform, the 'cancel' virtual key can be selected through mouse clicking or touch screen clicking and other operations, so that the color printing information of the top cover is cancelled to be the customized color printing information of the user. Or the regeneration virtual key is selected through mouse click or touch screen click, and the regeneration instruction is sent to the system platform. And the system platform regenerates new color printing information and retransmits the new color printing information to the terminal equipment of the user for selection by the user.
After the user determines to order the color printing service based on the generated color printing information, when the personal mobile terminal of the user dials the called terminal of other users, before the user is connected, in a call or after the user is hung up, the system automatically pushes the color printing information generated by the calling party to the called terminal in a USSD or flash mode, so that the called terminal can display the generated color printing information. Similarly, when the calling terminal of other users dials the personal mobile terminal of the user, before connection, during call or after hanging up, the system automatically pushes the generated color printing information to the calling terminal, so that the calling terminal can display the generated color printing information.
In this embodiment, the ordering experience of the user can be improved by submitting the selection to the user.
It is understood that in other embodiments, the color print generation method may be applied to a terminal device of a user. After a user logs in the cloud end of a communication service provider through a mobile phone, a tablet or a computer and enters a color printing ordering service interface, the cloud end can be triggered to automatically call the video color ring information ordered by the user and stored in a background database based on a corresponding instruction input by the user in the color printing ordering service interface. And the cloud platform sends the called video color ring information to the terminal equipment logged in by the user at the moment. The terminal equipment executes the color printing information generation method of any one of the embodiments based on the received video color ring information, so as to generate color printing information. The specific steps of the color printing information generating method are not described herein again. At this time, after the color printing information is generated, the terminal device can directly display the color printing information on the display interface to receive the selection operation of the user.
In addition, referring to fig. 8, an embodiment of the present invention further provides a color printing information generating apparatus, including:
a color ring back tone obtaining module 10, configured to obtain video color ring back tone information of a user;
and the color printing generation module 20 is configured to generate color printing information of the user based on the video color ring information.
In an embodiment, the color printing generation module 20 is further configured to input the video color ring back tone information into a pre-trained color printing information generation network, so as to obtain color printing information output by the color printing information generation network.
In one embodiment, the color printing information generating apparatus further includes:
acquiring a training sample set and a pre-constructed confrontation generation network; each group of training samples in the training sample set comprises video color ring back tone samples and color printing information samples of the same user sample; the countermeasure generation network comprises a generation network and a discrimination network;
inputting the video color ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video color ring back tone sample;
judging the authenticity of the color printing information samples and the color printing generation samples in each group of training samples through the judging network to obtain corresponding judging results;
and performing countermeasure training on the countermeasure generation network based on the discrimination results corresponding to each group of training samples and the color printing generation samples, and determining the generation network after training as a color printing information generation network.
In one embodiment, the color printing information generation network comprises an image feature extractor and a decoder; the color printing generation module 20 is further configured to input the video color ring back tone information into the image feature extractor to obtain an image feature vector output by the image feature extractor; and inputting the image feature vector into the decoder to obtain the color printing information output by the decoder.
In one embodiment, the color printing information generation network further comprises a noise feature extractor;
the color printing generation module 20 is further configured to input random noise corresponding to the video color ring back tone information into the noise feature extractor, so as to obtain a noise feature vector output by the noise feature extractor; and inputting the image characteristic vector and the noise characteristic vector into the decoder to obtain the color printing information output by the decoder.
In one embodiment, the color printing information generating apparatus further includes:
the video frame image extraction module is used for extracting a preset number of frame video frame images from the video color ring information;
and the processing module is used for generating the color printing information of the user based on a preset number of frames of video frame images.
In one embodiment, the color printing information generating apparatus further includes:
the information receiving and sending module is used for sending the color printing information to the terminal equipment of the user and receiving the selection operation of the user;
and the color printing ordering determining module is used for determining the color printing information as the customized color printing information of the user if the selecting operation is the determining operation.
Other embodiments or specific implementation manners of the color printing information generating device of the present invention may refer to the above method embodiments, and are not described herein again.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a recommendation device of a color printing information generation method according to an embodiment of the present invention.
The color printing information generating apparatus includes: at least one processor 301, a memory 302, and a color printing information generating program stored on the memory and executable on the processor, the color printing information generating program configured to implement the steps of the color printing information generating method as before.
The processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), PLA (Programmable Logic Array). The processor 301 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 301 may be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing content that the display screen needs to display.
The key processing device based on the block chain further comprises: a communication interface 303. The processor 301, the memory 302 and the communication interface 303 may be connected by a bus or signal lines. Various peripheral devices may be connected to communication interface 303 via a bus, signal line, or circuit board.
The communication interface 303 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 301 and the memory 302. In some embodiments, processor 301, memory 302, and communication interface 303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 301, the memory 302 and the communication interface 303 may be implemented on a single chip or circuit board, which is not limited in this embodiment.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the color-printed information generating apparatus and may include more or less components than those shown, or some components in combination, or a different arrangement of components.
In addition, an embodiment of the present invention further provides a computer program product, in which a degree code is stored, and when the degree code is executed by a processor, the steps of the color printing information generating method as above are implemented. Therefore, a detailed description thereof will be omitted. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer program product referred to in the present application, reference is made to the description of the embodiments of the method of the present application. It is determined that, by way of example, the program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program, which may be stored in a computer readable storage medium and includes the processes of the embodiments of the methods described above when the program is executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
It should be noted that the above-described embodiments of the apparatus are merely schematic, where units illustrated as separate components may or may not be physically separate, and components illustrated as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection therebetween, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by software plus necessary general hardware, and may also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components and the like. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions may be various, such as analog circuits, digital circuits, or dedicated circuits. However, the software program implementation is a better implementation mode for the present invention in more cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, where the computer software product is stored in a readable storage medium, such as a floppy disk, a usb disk, a removable hard disk, a Read-only memory (ROM), a random-access memory (RAM), a magnetic disk or an optical disk of a computer, and includes instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A color printing information generating method, comprising:
acquiring video color ring information of a user;
and generating color printing information of the user based on the video color ring information.
2. The method of generating color printing information according to claim 1, wherein the generating color printing information of the user based on the video color ring information comprises:
and inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain color printing information output by the color printing information generation network.
3. The method of claim 2, wherein before inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain color printing information output by the color printing information generation network, the method further comprises:
acquiring a training sample set and a pre-constructed confrontation generation network; each group of training samples in the training sample set comprises video color ring back tone samples and color printing information samples of the same user sample; the countermeasure generating network comprises a generating network and a judging network;
inputting the video color ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video color ring back tone sample;
judging the authenticity of the color printing information samples and the color printing generation samples in each group of training samples through the judging network to obtain corresponding judging results;
and performing countermeasure training on the countermeasure generating network based on the discrimination result corresponding to each set of training samples and the color printing generating sample, and determining the generated network after training as a color printing information generating network.
4. The color printing information generating method according to claim 2 or 3, wherein the color printing information generating network includes an image feature extractor and a decoder;
the inputting the video color ring back tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network comprises the following steps:
inputting the video color ring information into the image feature extractor to obtain an image feature vector output by the image feature extractor;
and inputting the image feature vector into the decoder to obtain the color printing information output by the decoder.
5. The color printing information generation method according to claim 4, wherein the color printing information generation network further comprises a noise feature extractor;
before the inputting the image feature vector into the decoder to obtain the color printing information output by the decoder, the method further includes:
inputting random noise corresponding to the video color ring information into the noise feature extractor to obtain a noise feature vector output by the noise feature extractor;
the inputting the image feature vector into the decoder to obtain the color printing information output by the decoder comprises:
and inputting the image characteristic vector and the noise characteristic vector into the decoder to obtain the color printing information output by the decoder.
6. The method of generating color printing information according to claim 1, wherein the generating color printing information of the user based on the video color ring information comprises:
extracting a preset number of frames of video frame images from the video color ring information;
and generating the color printing information of the user based on the preset number of frames of video frame images.
7. The method of generating color printing information according to claim 1, wherein after generating color printing information of the user based on the video color ring information, the method further comprises:
sending the color printing information to the terminal equipment of the user, and receiving the selection operation of the user;
and if the selection operation is a determination operation, determining the color printing information as the customized color printing information of the user.
8. A color printing information generating apparatus, comprising:
the color ring back tone obtaining module is used for obtaining the video color ring back tone information of the user;
and the color printing generation module is used for generating color printing information of the user based on the video color ring information.
9. A colour print information generating device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the method of any one of claims 1 to 7.
10. A computer program product comprising executable program code, wherein the program code, when executed by a processor, performs the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110723595.3A CN115604392A (en) | 2021-06-28 | 2021-06-28 | Color printing information generation method, device, equipment and computer program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110723595.3A CN115604392A (en) | 2021-06-28 | 2021-06-28 | Color printing information generation method, device, equipment and computer program product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115604392A true CN115604392A (en) | 2023-01-13 |
Family
ID=84841280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110723595.3A Pending CN115604392A (en) | 2021-06-28 | 2021-06-28 | Color printing information generation method, device, equipment and computer program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115604392A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101237488A (en) * | 2008-02-22 | 2008-08-06 | 华为技术有限公司 | Device and method for realizing CRBT service and device for getting CRBT file |
| CN101959152A (en) * | 2010-10-21 | 2011-01-26 | 杭州东信北邮信息技术有限公司 | Method and system for realizing word coloring ring back tone based on coloring ring back tone platform |
| CN110598651A (en) * | 2019-09-17 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Information processing method, device and storage medium |
-
2021
- 2021-06-28 CN CN202110723595.3A patent/CN115604392A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101237488A (en) * | 2008-02-22 | 2008-08-06 | 华为技术有限公司 | Device and method for realizing CRBT service and device for getting CRBT file |
| CN101959152A (en) * | 2010-10-21 | 2011-01-26 | 杭州东信北邮信息技术有限公司 | Method and system for realizing word coloring ring back tone based on coloring ring back tone platform |
| CN110598651A (en) * | 2019-09-17 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Information processing method, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102893590B (en) | Provide and present and social network information to phone | |
| CN110619889B (en) | Sign data identification method and device, electronic equipment and storage medium | |
| CN108156317A (en) | call voice control method, device and storage medium and mobile terminal | |
| CN108920640A (en) | Context acquisition methods and equipment based on interactive voice | |
| CN107995370A (en) | Call control method, device and storage medium and mobile terminal | |
| US20230410815A1 (en) | Transcription generation technique selection | |
| CN116934924A (en) | Cartoon image generation method and device and computer equipment | |
| CN113284500B (en) | Audio processing method, device, electronic equipment and storage medium | |
| CN109918628A (en) | Report-generating method, device, equipment and storage medium based on speech recognition | |
| CN115604392A (en) | Color printing information generation method, device, equipment and computer program product | |
| CN110532448B (en) | Document classification method, device, equipment and storage medium based on neural network | |
| CN111031183A (en) | Color ring back tone playing method, electronic equipment and storage medium | |
| CN116824004A (en) | Icon generation method and device, storage medium and electronic equipment | |
| CN114648442A (en) | Image style migration method and device | |
| CN110008907B (en) | Age estimation method and device, electronic equipment and computer readable medium | |
| CN110070385A (en) | Advertising commentary method, apparatus, electronic equipment and storage medium | |
| CN111901673B (en) | Video prediction method, device, storage medium and terminal | |
| CN115941844A (en) | Color ring back tone intelligent screening method and device based on color printing information | |
| CN116798052B (en) | Training method and device of text recognition model, storage medium and electronic equipment | |
| CN116416688A (en) | Living body detection method, living body detection device, living body detection equipment and storage medium | |
| CN117493661A (en) | Transaction recommendation method, device, storage medium and equipment | |
| CN113849757A (en) | Webpage loading time consumption calculation method and device, storage medium and terminal | |
| CN115578103A (en) | Video method, device, equipment and medium based on face recognition and voice broadcast | |
| CN115730361A (en) | Interactive interface generation method and device, electronic equipment and storage medium | |
| CN116246322A (en) | Living body anti-attack method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |