CN107944397A - Video recording method, device and computer-readable recording medium - Google Patents

Video recording method, device and computer-readable recording medium Download PDF

Info

Publication number
CN107944397A
CN107944397A CN201711209645.6A CN201711209645A CN107944397A CN 107944397 A CN107944397 A CN 107944397A CN 201711209645 A CN201711209645 A CN 201711209645A CN 107944397 A CN107944397 A CN 107944397A
Authority
CN
China
Prior art keywords
lyrics
special efficacy
special
video
currently playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711209645.6A
Other languages
Chinese (zh)
Inventor
刘培
林若曦
徐良
俞骁
牟伟成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Music Entertainment Technology Shenzhen Co Ltd
Original Assignee
Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Music Entertainment Technology Shenzhen Co Ltd filed Critical Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority to CN201711209645.6A priority Critical patent/CN107944397A/en
Publication of CN107944397A publication Critical patent/CN107944397A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The embodiment of the invention discloses a kind of video recording method, device and computer-readable recording medium, belong to multimedia technology field.Method is applied to the terminal for including at least one camera, including：Selected lyrics special efficacy is determined, according to lyrics special efficacy special effect processing information corresponding with the correspondence list acquisition lyrics special efficacy of special effect processing information；During video record, selected song is played, and utilize camera collection video pictures；Recognition of face is carried out to video pictures, obtains face recognition result；Based on face recognition result, the currently playing lyrics are handled according to special effect processing information, the special efficacy lyrics after display processing.Pass through the corresponding special effect processing information of lyrics special efficacy selected by acquisition, recognition of face is carried out to the video pictures of collection, the special efficacy lyrics after being handled according to special effect processing information are shown based on face recognition result, so that video pictures are associated with the special efficacy lyrics, the video content of recording is enriched, optimizes the effect of video record.

Description

Video recording method, device and computer-readable recording medium
Technical field
The present invention relates to multimedia technology field, more particularly to a kind of video recording method, device and computer-readable deposit Storage media.
Background technology
As people are continuously increased the demand of amusement and leisure mode, the product of the multi-medium data such as audio and video is more and more richer It is rich, there is provided the music software that recording song sings Video service is one kind therein.In order to provide the service more optimized, song The recording mode of video is sung also in continuous changes and improvements.
In correlation technique, when recording song sings video, song selection entrance can be provided, after song is selected, broadcast While putting selected song, show the lyrics and gather video pictures.Afterwards, by the video pictures of collection and the song that plays and aobvious The lyrics shown are synthesized together, the video after being synthesized.
At present, it is not abundant enough to record the content of the singing songs video of completion, there is certain limitation, it is relatively simple.
The content of the invention
An embodiment of the present invention provides a kind of video recording method, device and computer-readable recording medium, can solve Technical problem present in correlation technique, concrete technical scheme are as follows：
A kind of video recording method is provided, the method is applied to mobile terminal, and the mobile terminal includes at least one A camera, for gathering video pictures, the described method includes：
Determine selected lyrics special efficacy, institute is obtained according to the correspondence list of the lyrics special efficacy and special effect processing information State the corresponding special effect processing information of lyrics special efficacy；
During video record, selected song is played, and utilize camera collection video pictures；
Recognition of face is carried out to the video pictures, obtains face recognition result；
Based on the face recognition result, the currently playing lyrics are handled according to the special effect processing information, are shown Show the special efficacy lyrics after processing.
In one implementation, the method further includes：
Video pictures comprising the special efficacy lyrics are synthesized with the song played, the video after generation synthesis.
In one implementation, it is described to be based on the face recognition result, to the currently playing lyrics according to the spy Effect processing information is handled, including：
Determine position coordinates of the currently playing lyrics in screen display, face mouth is determined based on the face recognition result Position coordinates of the portion in screen；
According to the currently playing lyrics in the position coordinates of screen display and the face mouth in the position of screen Coordinate calculates movement locus；
Based on the movement locus, the currently playing lyrics are handled according to the special effect processing information.
In one implementation, the special efficacy lyrics after the display processing, including：
Icon is carried out landing according to the movement locus to show, and according to the currently playing lyrics in screen display Position coordinates show the currently playing lyrics.
In one implementation, the icon is word icon or other icons.
In one implementation, the special efficacy lyrics after the display processing, including：
Determine face location coordinate, the lyrics are shown according to the distance of the face location coordinate and screen frame.
In one implementation, it is described that the lyrics, bag are shown according to the distance of the face location coordinate and screen frame Include：
When the distance of the face location coordinate and the screen frame is less than threshold value, the special efficacy after the processing is sung Word carries out simple sentence and shows；
When the distance of the face location coordinate and the screen frame is more than threshold value, the special efficacy after the processing is sung Word carries out more displays.
In one implementation, the method further includes：
Obtain the reproduction time stamp of current song；
The currently playing lyrics are positioned according to reproduction time stamp；
The corresponding playing progress rate of the currently playing lyrics is calculated according to reproduction time stamp；
Based on the corresponding playing progress rate of the currently playing lyrics, to the currently playing lyrics according to the special efficacy Processing information is handled.
In one implementation, the method further includes：
Corresponding resource file, tinter and character library are loaded according to the lyrics special efficacy；
Based on the resource file, tinter and character library, the currently playing lyrics are believed according to the special effect processing Breath is handled.
In one implementation, it is special to include lyrics static state special efficacy, lyrics typesetting special efficacy, lyrics dynamic for the lyrics special efficacy At least one of effect；
Wherein, the lyrics static state special efficacy include lyrics font, word color, word weight, font size, retouch side, shade, word have an X-rayed in At least one special efficacy；
The lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；
The lyrics dynamic special efficacy includes the appearance animation effect of the lyrics.
A kind of video recording device is additionally provided, described device is applied to mobile terminal, and the mobile terminal includes at least One camera, for gathering video pictures, described device includes：
Determining module, for determining selected lyrics special efficacy；
Acquisition module, the lyrics are obtained for the correspondence list according to the lyrics special efficacy and special effect processing information The corresponding special effect processing information of special efficacy；
Module is recorded, is drawn for during video record, playing selected song, and using camera collection video Face；
Identification module, for carrying out recognition of face to the video pictures, obtains face recognition result；
Processing module, for based on the face recognition result, believing according to the special effect processing the currently playing lyrics Breath is handled；
Display module, for the special efficacy lyrics after display processing.
In one implementation, described device further includes：
Synthesis module, for the video pictures comprising the special efficacy lyrics to be synthesized with the song played, generation is closed Video after.
In one implementation, the processing module, for determining the currently playing lyrics in the position of screen display Coordinate, position coordinates of the face mouth in screen is determined based on the face recognition result；According to the currently playing lyrics In the position coordinates of screen display and the face mouth movement locus is calculated in the position coordinates of screen；Based on the movement rail Mark, the currently playing lyrics are handled according to the special effect processing information.
In one implementation, the display module, shows for icon to be carried out landing according to the movement locus, And the currently playing lyrics are shown in the position coordinates of screen display according to the currently playing lyrics.
In one implementation, the icon is word icon or other icons.
In one implementation, the display module, for determining face location coordinate, sits according to the face location Mark and the distance of screen frame show the lyrics.
In one implementation, the display module, for when the face location coordinate and the screen frame When distance is less than threshold value, simple sentence is carried out to the special efficacy lyrics after the processing and is shown；When the face location coordinate and the screen When the distance of curtain frame is more than threshold value, the special efficacy lyrics after the processing are carried out with more displays.
In one implementation, described device further includes：
Computing module, the reproduction time for obtaining current song stab；It is currently playing according to reproduction time stamp positioning The lyrics；The corresponding playing progress rate of the currently playing lyrics is calculated according to reproduction time stamp；
The processing module, is additionally operable to, based on the corresponding playing progress rate of the currently playing lyrics, currently broadcast to described The lyrics put are handled according to the special effect processing information.
In one implementation, described device further includes：
Load-on module, for loading corresponding resource file, tinter and character library according to the lyrics special efficacy；
The processing module, for based on the resource file, tinter and character library, being pressed to the currently playing lyrics Handled according to the special effect processing information.
In one implementation, it is special to include lyrics static state special efficacy, lyrics typesetting special efficacy, lyrics dynamic for the lyrics special efficacy At least one of effect；
Wherein, the lyrics static state special efficacy include lyrics font, word color, word weight, font size, retouch side, shade, word have an X-rayed in At least one special efficacy；
The lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；
The lyrics dynamic special efficacy includes the appearance animation effect of the lyrics.
Additionally provide a kind of computer equipment, the computer equipment includes processor and memory, in the memory At least one instruction, at least one section of program, code set or instruction set are stored with, described at least one instructs, is at least one section described Program, the code set or instruction set are loaded by the processor and performed to realize above-mentioned video recording method.
A kind of computer-readable recording medium is additionally provided, at least one instruction, at least is stored with the storage medium One section of program, code set or instruction set, at least one instruction, at least one section of program, the code set or the instruction set Loaded by processor and performed to realize above-mentioned video recording method.
Technical solution provided in an embodiment of the present invention can include the following benefits：
During video record, by selecting lyrics special efficacy, the corresponding special effect processing information of lyrics special efficacy is obtained, afterwards Recognition of face is carried out to the video pictures of collection, is shown based on face recognition result after being handled according to special effect processing information The special efficacy lyrics, so that video pictures are associated with the special efficacy lyrics, enrich the video content of recording, optimize and regard The effect that frequency is recorded.
Brief description of the drawings
Attached drawing herein is merged in specification and forms the part of this specification, shows the implementation for meeting the present invention Example, and for explaining the principle of the present invention together with specification.
Fig. 1 is the configuration diagram of the video recording system shown in the embodiment of the present invention；
Fig. 2 is the video recording method flow chart shown in the embodiment of the present invention；
Fig. 3 is the video record interface schematic diagram shown in the embodiment of the present invention；
Fig. 4 is the content schematic diagram of the configuration file shown in the embodiment of the present invention；
Fig. 5 is the video record interface schematic diagram shown in the embodiment of the present invention；
Fig. 6 is the video record interface schematic diagram shown in the embodiment of the present invention；
Fig. 7 is that the superposition of the lyrics special efficacy shown in the embodiment of the present invention uses table；
Fig. 8 is the video record interface schematic diagram shown in the embodiment of the present invention；
Fig. 9 is the video record interface schematic diagram shown in the embodiment of the present invention；
Figure 10 is the video record interface schematic diagram shown in the embodiment of the present invention；
Figure 11 is the video recording method flow chart shown in the embodiment of the present invention；
Figure 12 is the video playing interface schematic diagram shown in the embodiment of the present invention；
Figure 13 is the video recording method flow chart shown in the embodiment of the present invention；
Figure 14 is the structure diagram of the video recording device shown in the embodiment of the present invention；
Figure 15 is the structure diagram of the video recording device shown in the embodiment of the present invention；
Figure 16 is the structure diagram of the video recording device shown in the embodiment of the present invention；
Figure 17 is the structure diagram of the video recording device shown in the embodiment of the present invention；
Figure 18 is a kind of structure diagram of terminal shown in the embodiment of the present invention.
Embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
As people are continuously increased the demand of amusement and leisure mode, the product of the multi-medium data such as audio and video is more and more richer It is rich.An embodiment of the present invention provides a kind of video recording method, is associated video pictures with the special efficacy lyrics by this method, So that the video content more horn of plenty recorded, optimizes the effect of video record.
When it is implemented, this method can be realized in end side, it can also be cooperated and realized by terminal and server.Example Such as, terminal obtains special efficacy configuration file etc. from server, is locally realizing video record afterwards.
By taking terminal and server cooperates and realizes video recording method provided in an embodiment of the present invention as an example, figure refer to 1, it illustrates the schematic diagram of the implementation environment involved by video recording method provided in an embodiment of the present invention.As shown in Figure 1, should Implementation environment can include terminal 110 and server 120.
Terminal 110 includes at least one camera, for gathering video pictures, refers to such as mobile phone, tablet computer, desk-top The terminal that can connect network of computer or electronic reader etc.Terminal 110 can also pass through wired or wireless network It is connected with server 120.When actually realizing, client can be installed in terminal 110, which can be video record visitor Family end.Alternatively, client can be the client of default installation in terminal 110, or self-defined installation in terminal 110 Client.
Server 120 can be a server or the server cluster being made of some servers, may be used also To be a cloud computing service center.When actually realizing, which refers to provide for the client installed in terminal 110 The server of background service.
In order to make it easy to understand, next, by taking terminal performs video recording method as an example, regarded to provided in an embodiment of the present invention Frequency method for recording is explained.As shown in Fig. 2, this method includes：
In step 201, selected lyrics special efficacy is determined；
In order to make the display of the lyrics more horn of plenty, the embodiment of the present invention is before recorded video, there is provided optional song Word special efficacy, so that it is determined that selected lyrics special efficacy.When providing optional lyrics special efficacy, method provided in an embodiment of the present invention is adopted The mode of lyrics special efficacy selection entrance is shown in video record interface.During specific implementation, when detect lyrics special efficacy select When choosing operation of entrance, shows special efficacy Selection Floater, one or more special efficacy option is shown on special efficacy Selection Floater, different special Effect option corresponds to different lyrics special efficacys；Obtain the selection operation on special efficacy Selection Floater, the special efficacy that selection operation is chosen The corresponding lyrics special efficacy of option is as selected lyrics special efficacy.
In order to make it easy to understand, by taking the display interface shown in Fig. 3 as an example, wherein, the display interface on the left of Fig. 3 is video record Interface, the video record interface is except including recording function Touch control key, further including lyrics special efficacy selection entrance.When detecting the song Word special efficacy selection entrance choose operation after, triggering displaying special efficacy Selection Floater, as shown in the display interface among Fig. 3.The spy Effect Selection Floater includes multiple special efficacy options, and each special efficacy option corresponds to a lyrics special efficacy.When any special efficacy option is chosen In after, the corresponding lyrics special efficacy of the special efficacy option is definite selected lyrics special efficacy.Exemplified by shown in Fig. 3, " special efficacy One " corresponding lyrics special efficacy is selected lyrics special efficacy.
In order to further confirm that selected lyrics special efficacy, method provided in an embodiment of the present invention further includes：To selection operation The corresponding lyrics special efficacy of special efficacy option chosen carries out preview and shows.Still by taking the display interface shown in Fig. 3 as an example, when " special efficacy , can be to " lyrics special efficacy corresponding to special efficacy one " carries out preview and shows, on the right side of Fig. 3 after one " corresponding lyrics special efficacy is selected Display interface shown in.
After selected lyrics special efficacy and song is determined, the blank space at video record interface can be clicked on, is packed up with triggering Special efficacy Selection Floater.
In addition, except determining selected lyrics special efficacy, method provided in an embodiment of the present invention also provides song selecting function, The song played during selecting recorded video.During specific implementation, entrance, such as Fig. 3 can be selected in video record interface display song In display interface shown in middle left side, the icon in the lower left corner indicates song selection entrance.When detecting song selection entrance After trigger action, song selective listing can be provided, to provide song selection, and selected song will be determined according to song selection operation It is bent.In order to can subsequently be played out to selected song, method provided in an embodiment of the present invention, which further includes, obtains song files Process.The song files can be stored in terminal local, then can be directly from local acquisition.Certainly, song files can also be deposited On the server, then terminal is downloaded from server for storage.
It should be noted that on determining selected lyrics special efficacy and determining the sequencing of selected song, the present invention Embodiment is not specifically limited.
In step 202, it is corresponding with the correspondence list acquisition lyrics special efficacy of special effect processing information according to lyrics special efficacy Special effect processing information；
After selected lyrics special efficacy is determined, in order to realize special effect during video record, the present invention is implemented The method that example provides is before recorded video, it is necessary to obtain corresponding special effect processing information according to lyrics special efficacy.Acquisition modes include But it is not limited to be realized according to the correspondence list of lyrics special efficacy and special effect processing information.Wherein, special effect processing information can be with It is recorded in special efficacy configuration file, i.e., record has the corresponding special effect processing information of lyrics special efficacy in the special efficacy configuration file.It is different Lyrics special efficacy can correspond to different configuration files, and correspondence list is established between lyrics special efficacy and special efficacy configuration file. Thus after selected lyrics special efficacy is determined, text can be configured according to the corresponding special efficacy of correspondence list lookup lyrics special efficacy Part.
In practical applications, the special efficacy configuration file of each lyrics special efficacy can be prestored, can both be deposited in terminal local Storage, can also store in the server., can be according to institute if the special efficacy configuration file of each lyrics special efficacy is being locally stored The lyrics special efficacy of choosing obtains corresponding special efficacy configuration file from local；If the special efficacy of each lyrics special efficacy is stored in the server Configuration file, then can ask the selected corresponding special efficacy configuration file of lyrics special efficacy to server.
After getting special efficacy configuration file, in order to realize follow-up special effect processing, it is necessary to configure text to the special efficacy got Part is parsed, specific analysis mode, can use arbitrary document analysis mode, and the embodiment of the present invention does not do this specific limit It is fixed.For example, by taking the special efficacy configuration file parsing shown in Fig. 4 as an example, which can be divided into word and render parsing, word configuration solution Analysis, text composition parsing, the lyrics occur and disappearance mode parse, Special effects mode parsing etc..
Wherein, word is rendered including word background PNG sequences, word prospect PNG sequence column and row background PNG sequence column and row prospects PNG Sequence, full frame PNG sequences, printing opacity PNG sequences and colorful word etc..PNG words background PNG sequences and word prospect PNG sequences difference are all Including PNG sequence offsets and PNG numbers；Row background PNG sequences are except including PNG sequence offsets and PNG numbers, further including the capable back of the body Scape extends；Row prospect PNG sequences are except including PNG sequence offsets and PNG numbers, further including the extension of row prospect；Full frame PNG sequences Including background PNG sequences and prospect PNG sequences；Printing opacity PNG sequences include screen mode toggle printing opacity PNG numbers and 1:1 screen pattern is saturating Light PNG numbers；Colorful word includes color array sum number group number.
Word configuration includes the configuration of first layer word, the configuration of second layer word, third layer word configures, Fill Color is matched somebody with somebody Put, fill PNG sequences, font size, operating mode and fontname etc..The configuration of first layer word includes first layer word face Color, first layer retouch side color and first layer retouches hem width degree etc..The configuration of second layer word includes second layer text color, the second layer is retouched Side color, the second layer retouch hem width degree and second layer text excursion etc..The configuration of third layer word includes third layer text color, the 3rd Layer retouches side color, third layer retouches hem width degree and third layer text excursion etc..Fill Color includes a variety of Fill Colors, such as fills face Color 1, Fill Color 2, Fill Color 3 etc., further include Fill Color number.Filling PNG sequences includes filling PNG sequences 1PNG Number, filling PNG sequence 2PNG numbers etc., further include filling PNG sequence numbers.
Text composition includes type-setting mode, alignment thereof, word wrap/row word number, word spacing, rotation angle, goes out Existing position etc..Type-setting mode includes two kinds of type-setting modes of row and column.Alignment thereof includes row alignment thereof and column alignment mode.Between Away from including column pitch, line space and word space.Rotation angle includes row rotation angle, row rotation angle, can also include word and revolve Gyration.Position occur includes 1:1 screen position and full frame position.
Special efficacy configuration includes the configuration of recognition of face special efficacy and the configuration of lyrics special efficacy；The configuration of recognition of face special efficacy includes PNG sequences Lyrics special efficacy under row special efficacy, recognition of face and there is position etc..PNG sequences special efficacy includes rotation, scaling and PNG numbers etc.. Lyrics special efficacy under recognition of face includes rotation, scaling and filling etc..Position occur includes left ear, auris dextra, face, nose, a left side The opposite offset of several key points such as eye, right eye, forehead and chin.In the case of without considering recognition of face special efficacy, the lyrics are special Effect includes rhymed dyeing, participle special efficacy, lyrics duration special efficacy, the last character dyeing special efficacy, lyrics participle dyeing special efficacy And last column dyeing special efficacy etc..Wherein, the dyeing that rhymes is divided into colors staining, the dyeing of PNG sequences again, rhyme out figure；Rhyme out Figure includes rhymed PNG dyeing, rhymed secondary PNG dyeing, the n times that rhyme PNG dyeing, and PNG sequences sum and bits of offset Put, N can be set according to actual conditions.Deviation post includes fixed position offset and opposite lyrics position offset.Segment special efficacy Including participle array, behavior PNG arrays, participle dyeing and participle scaling；Participle dyeing includes lyrics dye number and lyrics dyeing PNG sequences.Lyrics duration special efficacy includes lyrics special efficacy time threshold, lyrics dye number, lyrics dyeing PNG sequences and broadcasting Scope.The last character dyeing, the dyeing of lyrics participle and last column dyeing include colors staining, PNG sequences dye etc..
The lyrics occur and disappearance mode includes random parabola, sequentially flies into, sequentially flies out, the effect that comes out gradually, fading out effect And particle annihilation.Random parabola includes parabola parameter area, duration etc..Order, which is flown into, and order flies out includes holding Continuous time, word for word and line by line.Come out gradually effect, fade out effect and particle annihilation and include the duration.
The content that any of the above configuration information is covered is more, in practical application, can be set according to actual conditions different Configuration information, and be stored in the corresponding special efficacy configuration file of different lyrics special efficacys, by parsing different special efficacy configuration files, Obtain special effect processing information.
In step 203, during video record, selected song is played, and utilize camera collection video pictures；
After preparation Jing Guo above-mentioned each step, you can video record process is carried out, for example, detecting video Video record Touch control key on recording interface is triggered, then proceeds by video record, and during video record, plays quilt Song is selected, and utilizes camera collection video pictures.At this time, be chosen the lyrics of song with the video pictures that collect together with Music is shown.
Before playing selected song, the voice data of song can be first obtained, afterwards by the player of terminal to the sound Frequency evidence plays out.When gathering video pictures, the camera of terminal can be opened, adopting for video pictures is carried out by camera Collection.In addition, the video pictures collected are also displayed in video record interface.
In step 204, recognition of face is carried out to video pictures, obtains face recognition result；
Wherein, the mode of recognition of face can use existing very ripe face recognition technology, and the present invention is implemented Example is not specifically limited this.Face recognition result can include the positional information of face and the position of each key point in face Information, as face position coordinates and face in each key point position coordinates.
For example, according to face recognition technology obtain 90 characteristic points of face, by this 90 characteristic points be divided into left ear, auris dextra, These key points of face, nose, left eye, right eye, forehead, chin, obtain the position coordinates of each key point.
In step 205, based on face recognition result, to the currently playing lyrics according to special effect processing information at Manage, the special efficacy lyrics after display processing.
Based on face recognition result, the currently playing lyrics are handled according to special effect processing information, can be by spy Effect processing is established on the basis of face recognition result, and the lyrics or PNG sequences are put into these key points and do animation effect, such as Position or expression shape change for face etc. carry out lyrics special efficacy.
The Mobile exhibiting with the change of the display location foundation recognition of face position of the lyrics, shows and follows user's head to move Exemplified by dynamic effect, lyrics effect can be the various patterns with projection, background, by face recognition technology, obtain user five The specific coordinate setting of official's profile, the display location of the lyrics are corresponding in real time according to the offset of user's face profile progress x-axis y-axis Change, as shown in Figure 5.
In one implementation, based on face recognition result, to the currently playing lyrics according to special effect processing information into Row processing, including：Determine coordinate of the currently playing lyrics in screen display location, face mouth is determined based on face recognition result Position coordinates of the portion in screen；Calculated according to position coordinates and face mouth of the lyrics in screen display in the position coordinates of screen Movement locus；Based on movement locus, the currently playing lyrics are handled according to special effect processing information.Under this kind of mode, song Word can be slid into below video pictures since user's mouth position along track, showed from the mouth discharge lyrics of user Effect.
For above-mentioned processing mode, in one implementation, the special efficacy lyrics after display processing, including：Icon is pressed Landing is carried out according to movement locus to show, and the lyrics are shown according to position coordinates of the lyrics in screen display.Wherein, icon is word Icon or other icons.Word icon can be the lyrics in itself or other words.Other icons can be outside word Other kinds of icon, for example, icon of English alphabet icon, additional character icon, drop shape etc..
For example, by face recognition technology, the coordinate setting of user's face face, and the mouth of real-time judge user are identified Bar whether open.When user's face opens, the lyrics are since mouth position, along pre-set track or random path Track slide downward, until video pictures below, as shown in Figure 6.
In addition, in one implementation, the special efficacy lyrics after display processing, including：Determine face location coordinate, according to The distance of face location coordinate and screen frame shows the lyrics.For example, shown according to the distance of face location coordinate and screen frame When showing the lyrics, when the distance of face location coordinate and screen frame is less than threshold value, simple sentence is carried out to the special efficacy lyrics after processing Display；When the distance of face location coordinate and screen frame is more than threshold value, the special efficacy lyrics after processing are carried out with more displays. Wherein, threshold value can set or provide based on experience value setting options by user setting, and the embodiment of the present invention is to the big of threshold value It is small to be not specifically limited.
For the step, in addition to the above-mentioned mode handled the lyrics, in one implementation, the embodiment of the present invention The method of offer further includes：Obtain the reproduction time stamp of current song；The currently playing lyrics are positioned according to reproduction time stamp；Root The currently playing corresponding playing progress rate of the lyrics is calculated according to reproduction time stamp；Based on the currently playing lyrics it is corresponding play into Degree, the currently playing lyrics is handled according to special effect processing information, the special efficacy lyrics after being handled.
Wherein, the reproduction time stamp of song can be recorded in song files as audio time stamp data, and each song Word has corresponding reproduction time to stab.It can start timing after song is played, current song is obtained according to timing time Reproduction time stamp.Afterwards, the currently playing lyrics can be positioned according to reproduction time stamp.Further, since each lyrics There is corresponding broadcasting duration, and lyrics special efficacy is related to the broadcasting duration of the lyrics, therefore, is getting current song Reproduction time stamp after, the currently playing corresponding playing progress rate of the lyrics is calculated according to reproduction time stamp.It is calculated current After the corresponding playing progress rate of the lyrics of broadcasting, you can the duration of following lyrics special efficacy is known, so that according to currently playing The corresponding playing progress rate of the lyrics handles the currently playing lyrics according to special effect processing information, the special efficacy song after being handled Word.That is, the time handled according to special effect processing information the currently playing lyrics and duration can be by the lyrics Playing progress rate determines.
If for example, the broadcasting duration of a lyrics is 1S, the reproduction time stamp of the lyrics is the 2nd second, and current Reproduction time stamp is the 2.6th second, then the corresponding playing progress rate of the lyrics played 0.6 second for 1 second, residual time length 0.4 second, then The currently playing lyrics can subsequently be handled according to special effect processing information in ensuing 0.4 seconds.
When being handled according to special effect processing information the currently playing lyrics, different lyrics special efficacys corresponds to different Special effect processing information, different special effect processing information corresponds to different special effects, except in the display interface shown in above-mentioned Fig. 3 Outside a kind of lyrics special efficacy that preview is shown, lyrics special efficacy provided in an embodiment of the present invention include but not limited to lyrics static state special efficacy, At least one of lyrics typesetting special efficacy, lyrics dynamic special efficacy；
Wherein, lyrics static state special efficacy include lyrics font, word color, font size, retouch side, shade, word perspective at least one Kind special efficacy；Every kind of special efficacy can individually be implemented, and can also be superimposed use, so that the pattern of the lyrics is more abundant.For example, can be with Include the special efficacy of font, word color and font size at the same time.
Lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；Position occur can root It is configured according to effect, for example whether fixed area occurs, or occurs from diverse location.In addition, it can include appearance side Formula, such as using fly into fly out, fade out, fading in, random parabola mode occurs.Type-setting mode can be divided into capable arrangement office and row Arrangement office, can configure row, column spacing and word space, can also be configured rotation angle and realizes inclination lyrics etc..For example, word tiltedly arrange, Horizontally-arranged or vertical setting of types, if whether branch, align etc..
Lyrics dynamic special efficacy includes the appearance animation effect of the lyrics, which can be prospect background PNG animation sequences Row, or printing opacity PNG animation sequences etc..For example, the whole sentence of the lyrics comes in and goes out, word for word comes in and goes out, scales, being fade-in fade-out, displacement becomes Change, occur by track, masking-out occurs etc..
In addition to above-mentioned special efficacy, some other special effect can also be included, for example, the full line lyrics according to hot spot, participle, The modes such as rhymed, magic color are shown.
Wherein, for the special efficacy that rhymes, the phonetic of every lyrics end word can be obtained, initial consonant and simple or compound vowel of a Chinese syllable is obtained, filters out The identical continuous end of the sentence word of simple or compound vowel of a Chinese syllable, and record rhymed number.In displaying, rhymed number is more than or equal to preset times (such as 1) end of the sentence word realizes dyeing or scaling and other effects, while different rhymed PNG animations are played according to rhymed number.Default time Number can rule of thumb or the mode such as user setting determines.
For segmenting special efficacy, include but not limited to two ways：First way：According to different participle storehouses and participle storehouse Corresponding behavior PNG can be realized when occurring some participle in the lyrics, show corresponding behavior PNG animations.The Two kinds of modes：Special color is directly rendered without using behavior PNG animations.
For lyrics duration special efficacy, the duration of each lyrics of acquisition from lyrics file (or song files), Judge whether the lyrics need to do special efficacy according to pre-set threshold value afterwards.For example, it is more than the lyrics of predetermined threshold value for the duration Carry out special effect processing.Wherein, predetermined threshold value can rule of thumb or the mode such as user setting determines.
For the special efficacy of the last character dyeing, the different color of last lyrics of every lyrics can be contaminated Color.
For the special efficacy of lyrics participle dyeing, it can carry out phonetic matching by the participle storehouse configured or match whole word only, Realize participle dyeing.
For the special efficacy of last column dyeing, last column of automatic branch can be dyed.
It should be noted that above-mentioned several lyrics special efficacys are only schematic, when actually realizing, other lyrics can also be included Special efficacy, or different lyrics special efficacys are overlapped, so that the overall effect of the lyrics is more preferably abundant, beautiful, further lifting regards The effect that frequency is recorded.Special efficacy superposition list as shown in (1) in Fig. 7 and (2), the combination of various special efficacys can be with a variety of more Sample, can combine different lyrics special efficacys according to different special efficacys in advance, and be made into lyrics special efficacy template, to be recorded in video Selected during system for user.
In order to make it easy to understand, next illustrated by taking following several lyrics special efficacys as an example.
Lyrics special efficacy one：Different animation effects is presented according to the part of speech of the lyrics so that the lyrics have more rich show.
For example, by taking the display interface shown in Fig. 8 as an example, it is illustrated that verb " patting hand " be used as verb, it is special to present The visual performance clapped hands, animation effect done one applause signal, make the lyrics more lively.Certainly, it is only to illustrate herein, weight Point is that the part of speech according to the different lyrics distinguishes the effect of the lyrics, in addition, further includes font, word color, font size etc. no The same form of expression.
Lyrics special efficacy two：For the rhymed of the lyrics, different lyrics special efficacys is presented.
For example, when the lyrics rhyme, for rhyme language, different lyrics special efficacys is presented, includes but not limited to Font, word color and font size etc. change, as shown in Figure 9.
Lyrics special efficacy three：For the duration of the lyrics, different lyrics special efficacys is presented.
For example, according to the duration of the lyrics, the lyrics are constantly amplified, the visual effect for elongating sound are formed, such as Figure 10 institutes Show.
In one implementation, in order to which various lyrics special efficacys are presented, method provided in an embodiment of the present invention is also wrapped Include：Corresponding resource file, tinter and character library are loaded according to lyrics special efficacy；Then to the currently playing lyrics according to special effect processing Information is handled, including：Based on resource file, tinter and character library, to the currently playing lyrics according to special effect processing information Handled.
Wherein, different lyrics special efficacys have different resource files, and the lyrics special efficacy institute can have been recorded in resource file The resource information needed, textures, animation data as needed for realizing lyrics special efficacy etc..Tinter is used to render the lyrics, And character library includes the data such as various fonts, font size.After selected lyrics special efficacy is determined, you can load corresponding resource text Part, tinter and character library, thus according to the currently playing corresponding playing progress rate of the lyrics to the currently playing lyrics according to spy When effect processing information is handled, lyrics special efficacy can be realized according to the resource file, tinter and character library of loading.
In one implementation, further included referring to Figure 11, method provided in an embodiment of the present invention：
In step 206, the video pictures that will be displayed with the special efficacy lyrics are synthesized with the song played, after obtaining synthesis Video.
After playback of songs, which is completed or detected, stops recording signal, video pictures and the broadcasting of the special efficacy lyrics will be displayed with Song synthesized, the video after being synthesized.Wherein, stopping recording signal being triggered by button.For example, recorded in video In interface processed, except showing video record button, also show stopping and record button, when the choosing for detecting stopping recording button After middle operation, then stopping recording signal being got, so as to trigger the video pictures that will be displayed with the special efficacy lyrics and the song played Synthesized, the video after being synthesized.
In addition, method provided in an embodiment of the present invention will be displayed with the video pictures of the special efficacy lyrics and the song that plays into Row synthesizes, and after the video after being synthesized, further includes the process being shown to the video of synthesis.Video as shown in figure 12 Broadcast interface schematic diagram, the video after the synthesis of displaying not only include video pictures, are further included in the video pictures with special efficacy The lyrics so that the video has stronger expressive force, so as to improve the interest of user's recorded video, and then extends video The application range of recording.
In one implementation, while the video after displaying synthesizes, also provide and rerecord in video display interface Option and save options, to carry out subsequent treatment to the video after synthesis.When detecting after choosing operation of re-recording options, again Perform video record process.When detect save options after choosing operation, the video after synthesis is stored.For storage Video afterwards, method provided in an embodiment of the present invention also provide issuing function, and the video recorded is issued by client Into network.Alternatively, method provided in an embodiment of the present invention also provides video sharing function, by what is recorded Video is shared with other users by third-party application.
Based on the above, method provided in an embodiment of the present invention can be said by taking the method flow shown in Figure 13 as an example It is bright.As shown in figure 13, before video record, the lyrics information of song selected by acquisition and the song, there is provided the feelings of preview mode Under condition, it is also necessary to obtain the preview lyrics of acquiescence.In addition it is also necessary to obtain the audio time stamp and video requency frame data of the song Deng.On this basis, this method comprises the following steps：
Step 1, selected lyrics special efficacy is determined, the lyrics special efficacy according to selected by user, obtains the corresponding special efficacy of lyrics special efficacy Configuration file, downloads corresponding resource file, shader (tinter) and character library.
Step 2, special efficacy configuration file is parsed, acquisition renders mode, such as renders template.
Step 3, load character library, import corresponding shader, and load resource file etc..
Step 4, if the special efficacy that rhymes, then lyrics information word for word is parsed by word, extracts the meaning of a word of the lyrics, distinguish verb name The parts of speech such as word, extract rhymed relation.
Step 5, according to lyrics text message, word texture is word for word created, word is formed to independent texture, easy to render Into video frame.
Step 6, the position coordinates that the lyrics are shown in video pictures bottom (bottom of screen) is calculated.
Step 7, processing needs to apply the video frame (i.e. video pictures) of special efficacy frame by frame, when video frame reaches, obtains and works as The timestamp of preceding playback of songs, positions current sentence and word, and the progress of current word is calculated according to the time.According to rendering Mode and configuration file obtain necessary parameter information, such as rendered color value, the lyrics displaying coordinate etc., are passed to shader.
Wherein, the timestamp that current song plays can be obtained according to audio time stamp data message, can also not examined In the case of measuring audio time stamp data message, construct to obtain according to video requency frame data.
Step 8, on the basis of the above-described procedure, it is determined whether need to carry out recognition of face；If it is not required, then directly perform Step 9；If necessary to carry out recognition of face, then face location coordinate is obtained, according to face coordinate and lyrics coordinate and special efficacy Configuration file determines track；According under trajectory calculation current schedules, the position of the lyrics.
If for example, need to increase the relevant action special efficacy of recognition of face, then it needs to be determined that Trajectory Arithmetic.For example： If needing increase to spit the animation effects such as the lyrics, then need to calculate lyrics running orbit.Define lyrics variation tracks for f (C, P, R, Mp, Dp) a random parabola, wherein C is original input picture, and P is the progress of current word, and R is random factor, and Mp is The position coordinates of face, Dp are the final display location coordinate of the lyrics.According to the current progress P of the lyrics, the lyrics are calculated at this time The position coordinates that should be shown, shader is passed to as parameter.
Step 9, the lyrics are rendered according to different lyrics special efficacys.
According to each video frame picture of above-mentioned steps searching loop, until playback of songs finishes, or video record process Stop.
Method provided in an embodiment of the present invention, during video record, by selecting lyrics special efficacy, obtains lyrics special efficacy The video pictures of collection are carried out recognition of face by corresponding special effect processing information afterwards, and basis is shown based on face recognition result Special effect processing information handled after the special efficacy lyrics so that video pictures are associated with the special efficacy lyrics, enrich The video content recorded, optimizes the effect of video record.
Based on same idea, an embodiment of the present invention provides a kind of video recording device, which can be applied in terminal, The terminal includes at least one camera, for gathering video pictures.Referring to Figure 14, video record provided in an embodiment of the present invention Device includes：
Determining module 141, for determining selected lyrics special efficacy；
Acquisition module 142, lyrics special efficacy is obtained for the correspondence list according to lyrics special efficacy and special effect processing information Corresponding special effect processing information；
Module 143 is recorded, is drawn for during video record, playing selected song, and using camera collection video Face；
Identification module 144, for carrying out recognition of face to video pictures, obtains face recognition result；
Processing module 145, for based on face recognition result, being carried out to the currently playing lyrics according to special effect processing information Processing；
Display module 146, for the special efficacy lyrics after display processing.
In one implementation, further included referring to Figure 15, the device：
Synthesis module 147, for the video pictures comprising the special efficacy lyrics to be synthesized with the song played, generation synthesis Video afterwards.
In one implementation, processing module 145, for determining that the currently playing lyrics are sat in the position of screen display Mark, position coordinates of the face mouth in screen is determined based on face recognition result；According to the currently playing lyrics in screen display Position coordinates and face mouth screen position coordinates calculate movement locus；Based on movement locus, to currently playing song Word is handled according to special effect processing information.
In one implementation, display module 146, show for icon to be carried out landing according to movement locus, and root The lyrics are shown according to position coordinates of the lyrics in screen display.
In one implementation, icon is word icon or other icons.
In one implementation, display module 146, for determining face location coordinate, according to face location coordinate with The distance of screen frame shows the lyrics.
In one implementation, display module 146, are less than threshold for the distance when face location coordinate and screen frame During value, simple sentence is carried out to the special efficacy lyrics after processing and is shown；When the distance of face location coordinate and screen frame is more than threshold value, More displays are carried out to the special efficacy after processing.
In one implementation, further included referring to Figure 16, the device：
Computing module 148, the reproduction time for obtaining current song stab；It is currently playing according to reproduction time stamp positioning The lyrics；The currently playing corresponding playing progress rate of the lyrics is calculated according to reproduction time stamp；
Processing module 145, is additionally operable to, based on the currently playing corresponding playing progress rate of the lyrics, press the currently playing lyrics Handled according to special effect processing information.
In one implementation, further included referring to Figure 17, the device：
Load-on module 149, for loading corresponding resource file, tinter and character library according to lyrics special efficacy；
Processing module 145, for based on resource file, tinter and character library, to the currently playing lyrics according to special efficacy at Reason information is handled.
In one implementation, lyrics special efficacy is included in lyrics static state special efficacy, lyrics typesetting special efficacy, lyrics dynamic special efficacy At least one；
Wherein, lyrics static state special efficacy include lyrics font, word color, word weight, font size, retouch side, shade, word have an X-rayed in extremely A kind of few special efficacy；
Lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；
Lyrics dynamic special efficacy includes the appearance animation effect of the lyrics.
Device provided in an embodiment of the present invention, during video record, by selecting lyrics special efficacy, obtains lyrics special efficacy The video pictures of collection are carried out recognition of face by corresponding special effect processing information afterwards, and basis is shown based on face recognition result Special effect processing information handled after the special efficacy lyrics so that video pictures are associated with the special efficacy lyrics, enrich The video content recorded, optimizes the effect of video record.
It should be noted that：The video recording device that above-described embodiment provides is in recorded video, only with above-mentioned each function The division progress of module, can be as needed and by above-mentioned function distribution by different function moulds for example, in practical application Block is completed, i.e., the internal structure of equipment is divided into different function modules, to complete all or part of work(described above Energy.In addition, the video recording device that above-described embodiment provides belongs to same design with video recording method embodiment, it is specific real Existing process refers to embodiment of the method, and which is not described herein again.
Figure 18 shows the structure diagram of terminal 1800 provided in an embodiment of the present invention.The terminal 1800 can be intelligent hand (Moving Picture Experts Group Audio Layer III, dynamic image are special for machine, tablet computer, MP3 player Family's compression standard audio aspect 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image Expert's compression standard audio aspect 4) player, laptop or desktop computer.Terminal 1800 is also possible to be referred to as user to set Other titles such as standby, portable terminal, laptop terminal, terminal console.
In general, terminal 1800 includes：Processor 1801 and memory 1802.
Processor 1801 can include one or more processing cores, such as 4 core processors, 18 core processors etc.. Processor 1801 can use DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 1801 can also include primary processor and coprocessor, main Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state. In some embodiments, processor 1801 can be integrated with GPU (Graphics Processing Unit, image processor), GPU is used to be responsible for rendering and drawing for content to be shown needed for display screen.In some embodiments, processor 1801 can also wrap AI (Artificial Intelligence, artificial intelligence) processor is included, which is used to handle related machine learning Calculate operation.
Memory 1802 can include one or more computer-readable recording mediums, which can To be non-transient.Memory 1802 may also include high-speed random access memory, and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In certain embodiments, the non-transient computer in memory 1802 can Read storage medium to be used to store at least one instruction, which is used for performed by processor 1801 to realize this Shen Please in embodiment of the method provide video recording method.
In certain embodiments, terminal 1800 is also optional includes：Peripheral interface 1803 and at least one periphery are set It is standby.It can be connected between processor 1801, memory 1802 and peripheral interface 1803 by bus or signal wire.It is each outer Peripheral equipment can be connected by bus, signal wire or circuit board with peripheral interface 1803.Specifically, ancillary equipment includes： In radio circuit 1804, touch display screen 1805, camera 1806, voicefrequency circuit 1807, positioning component 18018 and power supply 1809 At least one.
Peripheral interface 1803 can be used for I/O (Input/Output, input/output) is relevant at least one outer Peripheral equipment is connected to processor 1801 and memory 1802.In certain embodiments, processor 1801, memory 1802 and periphery Equipment interface 1803 is integrated on same chip or circuit board；In some other embodiments, processor 1801, memory 1802 and peripheral interface 1803 in any one or two can be realized on single chip or circuit board, this implementation Example is not limited this.
Radio circuit 1804 is used to receive and launch RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal. Radio circuit 1804 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 1804 is by telecommunications Number being converted to electromagnetic signal is transmitted, alternatively, the electromagnetic signal received is converted to electric signal.Alternatively, radio circuit 1804 include：Antenna system, RF transceivers, one or more amplifiers, tuner, oscillator, digital signal processor, volume solution Code chipset, user identity module card etc..Radio circuit 1804 can by least one wireless communication protocol come with it is other Terminal communicates.The wireless communication protocol includes but not limited to：WWW, Metropolitan Area Network (MAN), Intranet, each third generation mobile communication network (2G, 3G, 4G and 5G), WLAN and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some implementations In example, it is related that radio circuit 1804 can also include NFC (Near Field Communication, wireless near field communication) Circuit, the application are not limited this.
Display screen 1805 is used to show UI (User Interface, user interface).The UI can include figure, text, Icon, video and its their any combination.When display screen 1805 is touch display screen, display screen 1805 also there is collection to exist The surface of display screen 1805 or the ability of the touch signal of surface.The touch signal can be inputted to place as control signal Reason device 1801 is handled.At this time, display screen 1805 can be also used for providing virtual push button and/or dummy keyboard, also referred to as soft to press Button and/or soft keyboard.In certain embodiments, display screen 1805 can be one, set the front panel of terminal 1800；Another In a little embodiments, display screen 1805 can be at least two, be separately positioned on the different surfaces of terminal 1800 or in foldover design； In still other embodiments, display screen 1805 can be flexible display screen, be arranged on the curved surface of terminal 1800 or fold On face.Even, display screen 1805 can also be arranged to non-rectangle irregular figure, namely abnormity screen.Display screen 1805 can be with Using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) etc. material prepare.
CCD camera assembly 1806 is used to gather image or video.Alternatively, CCD camera assembly 1806 includes front camera And rear camera.In general, front camera is arranged on the front panel of terminal, rear camera is arranged on the back side of terminal. In some embodiments, rear camera at least two, is that main camera, depth of field camera, wide-angle camera, focal length are taken the photograph respectively As any one in head, to realize main camera and background blurring function, main camera and wide are realized in the fusion of depth of field camera Pan-shot and VR (Virtual Reality, virtual reality) shooting functions or other fusions are realized in angle camera fusion Shooting function.In certain embodiments, CCD camera assembly 1806 can also include flash lamp.Flash lamp can be monochromatic temperature flash of light Lamp or double-colored temperature flash lamp.Double-colored temperature flash lamp refers to the combination of warm light flash lamp and cold light flash lamp, can be used for Light compensation under different-colour.
Voicefrequency circuit 1807 can include microphone and loudspeaker.Microphone is used for the sound wave for gathering user and environment, and Convert sound waves into electric signal and input to processor 1801 and handled, or input to radio circuit 1804 to realize that voice leads to Letter.For stereo collection or the purpose of noise reduction, microphone can be multiple, be separately positioned on the different parts of terminal 1800. Microphone can also be array microphone or omnidirectional's collection type microphone.Loudspeaker is then used to that processor 1801 or radio frequency will to be come from The electric signal of circuit 1804 is converted to sound wave.Loudspeaker can be traditional wafer speaker or piezoelectric ceramics is raised one's voice Device.When loudspeaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, can also be incited somebody to action Electric signal is converted to sound wave that the mankind do not hear to carry out the purposes such as ranging.In certain embodiments, voicefrequency circuit 1807 may be used also With including earphone jack.
Positioning component 1808 is used for the current geographic position of positioning terminal 1800, to realize navigation or LBS (Location Based Service, location Based service).Positioning component 1808 can be the GPS (Global based on the U.S. Positioning System, global positioning system), China dipper system or Russia Galileo system positioning group Part.
Power supply 1809 is used to be powered for the various components in terminal 1800.Power supply 1809 can be alternating current, direct current Electricity, disposable battery or rechargeable battery.When power supply 1809 includes rechargeable battery, which can have micro USB Battery or wireless charging battery.Wired charging battery is the battery to be charged by Wireline, and wireless charging battery is to pass through The battery of wireless coil charging.The rechargeable battery can be also used for supporting fast charge technology.
In certain embodiments, terminal 1800 has further included one or more sensors 1810.The one or more senses Device 1810 includes but not limited to：Acceleration transducer 1811, gyro sensor 1812, pressure sensor 1813, fingerprint sensing Device 1814, optical sensor 1815 and proximity sensor 1816.
Acceleration transducer 1811 can detect the acceleration in three reference axis of the coordinate system established with terminal 1800 Size.For example acceleration transducer 1811 can be used for detecting component of the acceleration of gravity in three reference axis.Processor The 1801 acceleration of gravity signals that can be gathered according to acceleration transducer 1811, control touch display screen 1805 is with transverse views Or longitudinal view carries out the display of user interface.Acceleration transducer 1811 can be also used for game or the exercise data of user Collection.
Gyro sensor 1812 can be with the body direction of detection terminal 1800 and rotational angle, gyro sensor 1812 Collection user can be cooperateed with to act the 3D of terminal 1800 with acceleration transducer 1811.Processor 1801 is according to gyro sensors The data that device 1812 gathers, it is possible to achieve following function：Action induction (for example changing UI according to the tilt operation of user), clap Image stabilization, game control and inertial navigation when taking the photograph.
Pressure sensor 1813 can be arranged on the side frame of terminal 1800 and/or the lower floor of touch display screen 1805.When When pressure sensor 1813 is arranged on the side frame of terminal 1800, gripping signal of the user to terminal 1800 can be detected, by The gripping signal that reason device 1801 is gathered according to pressure sensor 1813 carries out right-hand man's identification or prompt operation.Work as pressure sensor 1813 when being arranged on the lower floor of touch display screen 1805, and the pressure of touch display screen 1805 is grasped according to user by processor 1801 Make, realize and the operability control on UI interfaces is controlled.Operability control include button control, scroll bar control, At least one of icon control, menu control.
Fingerprint sensor 1814 is used for the fingerprint for gathering user, is collected by processor 1801 according to fingerprint sensor 1814 Fingerprint recognition user identity, alternatively, by fingerprint sensor 1814 according to the identity of the fingerprint recognition user collected.Knowing When the identity for not going out user is trusted identity, the user is authorized to perform relevant sensitive operation, sensitivity behaviour by processor 1801 Work includes solving lock screen, checks encryption information, downloads software, payment and change setting etc..Fingerprint sensor 1814 can be set Put the front, the back side or side of terminal 1800.When being provided with physical button or manufacturer Logo in terminal 1800, fingerprint sensor 1814 can integrate with physical button or manufacturer Logo.
Optical sensor 1815 is used to gather ambient light intensity.In one embodiment, processor 1801 can be according to light The ambient light intensity that sensor 1815 gathers is learned, controls the display brightness of touch display screen 1805.Specifically, ambient light intensity is worked as When higher, the display brightness of touch display screen 1805 is heightened；When ambient light intensity is relatively low, the aobvious of touch display screen 1805 is turned down Show brightness.In another embodiment, the ambient light intensity that processor 1801 can also be gathered according to optical sensor 1815, is moved State adjusts the acquisition parameters of CCD camera assembly 1806.
Proximity sensor 1816, also referred to as range sensor, are generally arranged at the front panel of terminal 1800.Proximity sensor 1816 are used to gather the distance between front of user and terminal 1800.In one embodiment, when proximity sensor 1816 is examined When measuring the distance between front of user and terminal 1800 and tapering into, by processor 1801 control touch display screen 1805 from Bright screen state is switched to breath screen state；When proximity sensor 1816 detect the distance between front of user and terminal 1800 by When gradual change is big, touch display screen 1805 is controlled to be switched to bright screen state from breath screen state by processor 1801.
, can be with it will be understood by those skilled in the art that the restriction of the structure shown in Figure 18 not structure paired terminal 1800 Including than illustrating more or fewer components, either combining some components or being arranged using different components.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing, example are additionally provided Such as include at least one instruction, the memory of at least one section of program, code set or instruction set, above-mentioned at least one instruction, at least One section of program, code set or instruction set can be performed by processor to complete all or part of step of the embodiment of the present invention.Example Such as, the non-transitorycomputer readable storage medium can be ROM, it is random access memory (RAM), CD-ROM, tape, soft Disk and optical data storage devices etc..
Those skilled in the art will readily occur to the present invention its after considering specification and putting into practice invention disclosed herein Its embodiment.This application is intended to cover the present invention any variations, uses, or adaptations, these modifications, purposes or Person's adaptive change follows the general principle of the present invention and including undocumented common knowledge in the art of the invention Or conventional techniques.Description and embodiments are considered only as exemplary, and true scope and spirit of the invention are by following Claim is pointed out.
It should be appreciated that the invention is not limited in the precision architecture for being described above and being shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is only limited by appended claim.

Claims (22)

1. a kind of video recording method, the method is applied to terminal, and the terminal includes at least one camera, for gathering Video pictures, it is characterised in that the described method includes：
Determine selected lyrics special efficacy, the song is obtained according to the correspondence list of the lyrics special efficacy and special effect processing information The corresponding special effect processing information of word special efficacy；
During video record, selected song is played, and utilize camera collection video pictures；
Recognition of face is carried out to the video pictures, obtains face recognition result；
Based on the face recognition result, the currently playing lyrics are handled according to the special effect processing information, at display The special efficacy lyrics after reason.
2. according to the method described in claim 1, it is characterized in that, the method further includes：
Video pictures comprising the special efficacy lyrics are synthesized with the song played, the video after generation synthesis.
3. according to the method described in claim 1, it is characterized in that, described be based on the face recognition result, to currently playing The lyrics handled according to the special effect processing information, including：
Determine position coordinates of the currently playing lyrics in screen display, determine that face mouth exists based on the face recognition result The position coordinates of screen；
According to the currently playing lyrics screen display position coordinates and the face mouth screen position coordinates Calculate movement locus；
Based on the movement locus, the currently playing lyrics are handled according to the special effect processing information.
4. according to the method described in claim 3, it is characterized in that, the special efficacy lyrics after the display processing, including：
Icon is carried out landing according to the movement locus to show, and according to the currently playing lyrics in the position of screen display Put coordinate and show the currently playing lyrics.
5. according to the method described in claim 4, it is characterized in that, the icon is word icon or other icons.
6. according to the method described in claim 1, it is characterized in that, the special efficacy lyrics after the display processing, including：
Determine face location coordinate, the lyrics are shown according to the distance of the face location coordinate and screen frame.
It is 7. according to the method described in claim 6, it is characterized in that, described according to the face location coordinate and screen frame Distance shows the lyrics, including：
When the distance of the face location coordinate and the screen frame is less than threshold value, to the special efficacy lyrics after the processing into Row simple sentence is shown；
When the distance of the face location coordinate and the screen frame is more than threshold value, to the special efficacy lyrics after the processing into More displays of row.
8. according to any method in claim 1 to 7, it is characterised in that the method further includes：
Obtain the reproduction time stamp of current song；
The currently playing lyrics are positioned according to reproduction time stamp；
The corresponding playing progress rate of the currently playing lyrics is calculated according to reproduction time stamp；
Based on the corresponding playing progress rate of the currently playing lyrics, to the currently playing lyrics according to the special effect processing Information is handled.
9. according to any method in claim 1 to 7, it is characterised in that the method further includes：
Corresponding resource file, tinter and character library are loaded according to the lyrics special efficacy；
Based on the resource file, tinter and character library, to the currently playing lyrics according to the special effect processing information into Row processing.
10. according to any method in claim 1 to 7, it is characterised in that it is static special that the lyrics special efficacy includes the lyrics At least one of effect, lyrics typesetting special efficacy, lyrics dynamic special efficacy；
Wherein, the lyrics static state special efficacy include lyrics font, word color, word weight, font size, retouch side, shade, word have an X-rayed in extremely A kind of few special efficacy；
The lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；
The lyrics dynamic special efficacy includes the appearance animation effect of the lyrics.
11. a kind of video recording device, described device is applied to terminal, and the terminal includes at least one camera, for adopting Collect video pictures, it is characterised in that described device includes：
Determining module, for determining selected lyrics special efficacy；
Acquisition module, the lyrics special efficacy is obtained for the correspondence list according to the lyrics special efficacy and special effect processing information Corresponding special effect processing information；
Module is recorded, for during video record, playing selected song, and utilizes camera collection video pictures；
Identification module, for carrying out recognition of face to the video pictures, obtains face recognition result；
Processing module, for based on the face recognition result, to the currently playing lyrics according to the special effect processing information into Row processing；
Display module, for the special efficacy lyrics after display processing.
12. according to the devices described in claim 11, it is characterised in that described device further includes：
Synthesis module, for the video pictures comprising the special efficacy lyrics to be synthesized with the song played, after generation synthesis Video.
13. according to the devices described in claim 11, it is characterised in that the processing module, for determining currently playing song Word determines position coordinates of the face mouth in screen in the position coordinates of screen display based on the face recognition result；According to The currently playing lyrics calculate movement in the position coordinates of screen display and the face mouth in the position coordinates of screen Track；Based on the movement locus, the currently playing lyrics are handled according to the special effect processing information.
14. device according to claim 13, it is characterised in that the display module, for by icon according to the fortune Dynamic rail mark carries out landing and shows, and is shown and described currently broadcast in the position coordinates of screen display according to the currently playing lyrics The lyrics put.
15. device according to claim 14, it is characterised in that the icon is word icon or other icons.
16. according to the devices described in claim 11, it is characterised in that the display module, for determining face location coordinate, The lyrics are shown according to the distance of the face location coordinate and screen frame.
17. device according to claim 16, it is characterised in that the display module, for being sat when the face location When mark and the distance of the screen frame are less than threshold value, simple sentence is carried out to the special efficacy lyrics after the processing and is shown；As the people When face position coordinates and the distance of the screen frame are more than threshold value, the special efficacy lyrics after the processing are carried out with more displays.
18. according to any device in claim 11 to 17, it is characterised in that described device further includes：
Computing module, the reproduction time for obtaining current song stab；Currently playing song is positioned according to reproduction time stamp Word；The corresponding playing progress rate of the currently playing lyrics is calculated according to reproduction time stamp；
The processing module, is additionally operable to based on the corresponding playing progress rate of the currently playing lyrics, to described currently playing The lyrics are handled according to the special effect processing information.
19. according to any device in claim 11 to 17, it is characterised in that described device further includes：
Load-on module, for loading corresponding resource file, tinter and character library according to the lyrics special efficacy；
The processing module, for based on the resource file, tinter and character library, to the currently playing lyrics according to institute Special effect processing information is stated to be handled.
20. according to any device in claim 11 to 17, it is characterised in that it is static that the lyrics special efficacy includes the lyrics At least one of special efficacy, lyrics typesetting special efficacy, lyrics dynamic special efficacy；
Wherein, the lyrics static state special efficacy include lyrics font, word color, word weight, font size, retouch side, shade, word have an X-rayed in extremely A kind of few special efficacy；
The lyrics typesetting special efficacy includes at least one of appearance position and the type-setting mode of lyrics special efficacy；
The lyrics dynamic special efficacy includes the appearance animation effect of the lyrics.
21. a kind of computer equipment, it is characterised in that the computer equipment includes processor and memory, the memory In be stored with least one instruction, at least one section of program, code set or instruction set, at least one instruction, described at least one Duan Chengxu, the code set or instruction set are loaded by the processor and performed to realize as described in claims 1 to 10 is any Video recording method.
22. a kind of computer-readable recording medium, it is characterised in that at least one instruction, extremely is stored with the storage medium Few one section of program, code set or instruction set, at least one instruction, at least one section of program, the code set or the instruction Collection is loaded by processor and performed to realize the video recording method as described in claims 1 to 10 is any.
CN201711209645.6A 2017-11-27 2017-11-27 Video recording method, device and computer-readable recording medium Pending CN107944397A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711209645.6A CN107944397A (en) 2017-11-27 2017-11-27 Video recording method, device and computer-readable recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711209645.6A CN107944397A (en) 2017-11-27 2017-11-27 Video recording method, device and computer-readable recording medium

Publications (1)

Publication Number Publication Date
CN107944397A true CN107944397A (en) 2018-04-20

Family

ID=61949107

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711209645.6A Pending CN107944397A (en) 2017-11-27 2017-11-27 Video recording method, device and computer-readable recording medium

Country Status (1)

Country Link
CN (1) CN107944397A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833818A (en) * 2018-06-28 2018-11-16 腾讯科技（深圳）有限公司 video recording method, device, terminal and storage medium
CN108989691A (en) * 2018-10-19 2018-12-11 北京微播视界科技有限公司 Video capture method, apparatus, electronic equipment and computer readable storage medium
CN109003633A (en) * 2018-07-27 2018-12-14 北京微播视界科技有限公司 Audio-frequency processing method, device and electronic equipment
CN110662090A (en) * 2018-06-29 2020-01-07 腾讯科技（深圳）有限公司 Video processing method and system
CN112256176A (en) * 2020-10-23 2021-01-22 北京字节跳动网络技术有限公司 Character display method and device, electronic equipment and computer readable storage medium
WO2021018178A1 (en) * 2019-08-01 2021-02-04 北京字节跳动网络技术有限公司 Method and apparatus for text effect processing
CN112380379A (en) * 2020-11-18 2021-02-19 北京字节跳动网络技术有限公司 Lyric special effect display method and device, electronic equipment and computer readable medium
CN112383810A (en) * 2020-11-10 2021-02-19 北京字跳网络技术有限公司 Lyric video display method and device, electronic equipment and computer readable medium
CN112714355A (en) * 2021-03-29 2021-04-27 深圳市火乐科技发展有限公司 Audio visualization method and device, projection equipment and storage medium
CN112906553A (en) * 2021-02-09 2021-06-04 北京字跳网络技术有限公司 Image processing method, apparatus, device and medium
CN113114970A (en) * 2018-05-07 2021-07-13 苹果公司 Creative camera
CN113515334A (en) * 2021-05-07 2021-10-19 广州酷狗计算机科技有限公司 Text data display method and device, computer equipment and storage medium
CN114333072A (en) * 2022-03-10 2022-04-12 深圳云集智能信息有限公司 Data processing method and system based on conference image communication
CN115022712A (en) * 2022-05-20 2022-09-06 北京百度网讯科技有限公司 Video processing method, device, equipment and storage medium
WO2024099353A1 (en) * 2022-11-09 2024-05-16 北京字跳网络技术有限公司 Video processing method and apparatus, electronic device, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0782338A2 (en) * 1995-12-27 1997-07-02 Amtex Corporation Karaoke system
JP2011007868A (en) * 2009-06-23 2011-01-13 Daiichikosho Co Ltd Karaoke device displaying lyric subtitle while avoiding face image in background video image
CN104702856A (en) * 2013-12-10 2015-06-10 音圆国际股份有限公司 Real-time selfie special-effect MV (music video) compositing system device and real-time selfie special-effect MV compositing method applied to karaoke machines
CN104867511A (en) * 2014-02-26 2015-08-26 苏州乐聚一堂电子科技有限公司 Karaoke interactive keyword special effect system
CN106128440A (en) * 2016-06-22 2016-11-16 北京小米移动软件有限公司 A kind of lyrics display processing method, device, terminal unit and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0782338A2 (en) * 1995-12-27 1997-07-02 Amtex Corporation Karaoke system
JP2011007868A (en) * 2009-06-23 2011-01-13 Daiichikosho Co Ltd Karaoke device displaying lyric subtitle while avoiding face image in background video image
JP5371574B2 (en) * 2009-06-23 2013-12-18 株式会社第一興商 Karaoke device that displays lyrics subtitles to avoid face images in background video
CN104702856A (en) * 2013-12-10 2015-06-10 音圆国际股份有限公司 Real-time selfie special-effect MV (music video) compositing system device and real-time selfie special-effect MV compositing method applied to karaoke machines
CN104867511A (en) * 2014-02-26 2015-08-26 苏州乐聚一堂电子科技有限公司 Karaoke interactive keyword special effect system
CN106128440A (en) * 2016-06-22 2016-11-16 北京小米移动软件有限公司 A kind of lyrics display processing method, device, terminal unit and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
冰原雪: "急！！视频特效素材。。。电视剧里内种教训别人然后嘴里有一大推字符喷出来的效果。。。最好还有音效！！", 《HTTPS://ZHIDAO.BAIDU.COM/QUESTION/398601945.HTML》 *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113114970A (en) * 2018-05-07 2021-07-13 苹果公司 Creative camera
CN108833818A (en) * 2018-06-28 2018-11-16 腾讯科技（深圳）有限公司 video recording method, device, terminal and storage medium
CN110662090A (en) * 2018-06-29 2020-01-07 腾讯科技（深圳）有限公司 Video processing method and system
CN110662090B (en) * 2018-06-29 2022-11-18 腾讯科技（深圳）有限公司 Video processing method and system
CN109003633A (en) * 2018-07-27 2018-12-14 北京微播视界科技有限公司 Audio-frequency processing method, device and electronic equipment
CN108989691A (en) * 2018-10-19 2018-12-11 北京微播视界科技有限公司 Video capture method, apparatus, electronic equipment and computer readable storage medium
WO2021018178A1 (en) * 2019-08-01 2021-02-04 北京字节跳动网络技术有限公司 Method and apparatus for text effect processing
CN112256176A (en) * 2020-10-23 2021-01-22 北京字节跳动网络技术有限公司 Character display method and device, electronic equipment and computer readable storage medium
CN112256176B (en) * 2020-10-23 2022-04-05 北京字节跳动网络技术有限公司 Character display method and device, electronic equipment and computer readable storage medium
WO2022083273A1 (en) * 2020-10-23 2022-04-28 北京字节跳动网络技术有限公司 Character display method and apparatus, electronic device, and computer readable storage medium
CN112383810A (en) * 2020-11-10 2021-02-19 北京字跳网络技术有限公司 Lyric video display method and device, electronic equipment and computer readable medium
WO2022100103A1 (en) * 2020-11-10 2022-05-19 北京字跳网络技术有限公司 Lyrics video display method and apparatus, electronic device, and computer readable medium
CN112380379A (en) * 2020-11-18 2021-02-19 北京字节跳动网络技术有限公司 Lyric special effect display method and device, electronic equipment and computer readable medium
CN112380379B (en) * 2020-11-18 2023-05-02 抖音视界有限公司 Lyric special effect display method and device, electronic equipment and computer readable medium
CN112906553A (en) * 2021-02-09 2021-06-04 北京字跳网络技术有限公司 Image processing method, apparatus, device and medium
CN112714355A (en) * 2021-03-29 2021-04-27 深圳市火乐科技发展有限公司 Audio visualization method and device, projection equipment and storage medium
CN113515334A (en) * 2021-05-07 2021-10-19 广州酷狗计算机科技有限公司 Text data display method and device, computer equipment and storage medium
CN114333072A (en) * 2022-03-10 2022-04-12 深圳云集智能信息有限公司 Data processing method and system based on conference image communication
CN114333072B (en) * 2022-03-10 2022-06-17 深圳云集智能信息有限公司 Data processing method and system based on conference image communication
CN115022712A (en) * 2022-05-20 2022-09-06 北京百度网讯科技有限公司 Video processing method, device, equipment and storage medium
CN115022712B (en) * 2022-05-20 2023-12-29 北京百度网讯科技有限公司 Video processing method, device, equipment and storage medium
WO2024099353A1 (en) * 2022-11-09 2024-05-16 北京字跳网络技术有限公司 Video processing method and apparatus, electronic device, and storage medium

Similar Documents

Publication Publication Date Title
CN107943964A (en) Lyric display method, device and computer-readable recording medium
CN107944397A (en) Video recording method, device and computer-readable recording medium
CN108337532A (en) Perform mask method, video broadcasting method, the apparatus and system of segment
CN107967706A (en) Processing method, device and the computer-readable recording medium of multi-medium data
CN110337023A (en) animation display method, device, terminal and storage medium
CN108769561A (en) video recording method and device
CN108401124A (en) The method and apparatus of video record
CN108008930A (en) The method and apparatus for determining K song score values
CN110213638A (en) Cartoon display method, device, terminal and storage medium
CN109033335A (en) Audio recording method, apparatus, terminal and storage medium
CN108965922A (en) Video cover generation method, device and storage medium
CN109756784A (en) Method for playing music, device, terminal and storage medium
CN108419113A (en) Caption presentation method and device
CN110491358A (en) Carry out method, apparatus, equipment, system and the storage medium of audio recording
WO2019127899A1 (en) Method and device for addition of song lyrics
CN108848394A (en) Net cast method, apparatus, terminal and storage medium
CN108922506A (en) Song audio generation method, device and computer readable storage medium
CN107982918A (en) Game is played a game methods of exhibiting, device and the terminal of result
CN109346111A (en) Data processing method, device, terminal and storage medium
CN109448761A (en) The method and apparatus for playing song
CN109587549A (en) Video recording method, device, terminal and storage medium
CN109862412A (en) It is in step with the method, apparatus and storage medium of video
CN109147757A (en) Song synthetic method and device
CN110300274A (en) Method for recording, device and the storage medium of video file
CN107871012A (en) Audio-frequency processing method, device, storage medium and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination