CN109621425A - A kind of video generation method, device, equipment and storage medium - Google Patents

A kind of video generation method, device, equipment and storage medium Download PDF

Info

Publication number
CN109621425A
CN109621425A CN201811588828.8A CN201811588828A CN109621425A CN 109621425 A CN109621425 A CN 109621425A CN 201811588828 A CN201811588828 A CN 201811588828A CN 109621425 A CN109621425 A CN 109621425A
Authority
CN
China
Prior art keywords
video frame
game
virtual key
region
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811588828.8A
Other languages
Chinese (zh)
Other versions
CN109621425B (en
Inventor
张庭亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201811588828.8A priority Critical patent/CN109621425B/en
Publication of CN109621425A publication Critical patent/CN109621425A/en
Application granted granted Critical
Publication of CN109621425B publication Critical patent/CN109621425B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)

Abstract

The application provides a kind of video generation method, device, equipment and computer readable storage medium, the described method includes: after detecting dancing machine game enabled instruction, the dance game video chosen is played, and the movement of sync pulse jamming user is to obtain action video frame;The game video frame of the dance game video includes at least one virtual key and at least one note point;Difference degree between position based on the specific characteristic position identified in the position of note point described in the game video frame, the position of the virtual key and corresponding action video frame generates score image;According to the game video frame, corresponding action video frame and the score image, target video frame is generated.The application, without place limitation is received, can carry out dancing machine game whenever and wherever possible, improve the game experiencing of user without preparing additional dancing equipment.

Description

A kind of video generation method, device, equipment and storage medium
Technical field
This application involves field of image processing more particularly to a kind of video generation method, device, equipment and computer-readable Storage medium.
Background technique
In the prior art, body-sensing dancing and game is typically required for relevant equipment to assist running, such as dancing machine game, It needs relevant dancing equipment such as dance rug, dancing machine to assist completing dancing machine game, so that user is by dancing Carry out corresponding limb action in equipment, identified by limb action of the dancing equipment to user, thus realize with computer or Game is completed in the interaction of game in person's mobile phone screen.
But inventor is in the implementation of the present invention, discovery: when user desires to participate in body-sensing dancing and game as danced When machine game, needs to buy relevant dancing equipment or participates in game to the play place payment for having related dancing equipment, Since related dancing equipment also has certain weight and volume, not portable, the limitation of game conditions makes user can not Whenever and wherever possible experience body-sensing dancing and game, while existing body-sensing dancing and game also increase related dancing equipment consumption and The expenditure of user, and user is when playing game, since the game process of user, in game over, Yong Huwu can not be recorded Method is intuitively watched from the performance in game process, and the participation desire of user is reduced.
Summary of the invention
In view of this, the application provides a kind of video generation method, device, equipment and computer readable storage medium.
Firstly, the first aspect of the application provides a kind of video generation method, the method is specifically included:
After detecting dancing machine game enabled instruction, the dance game video chosen is played, and sync pulse jamming user Movement is to obtain action video frame;The game video frame of the dance game video includes at least one virtual key and at least One note point;
Based on the position of note point described in the game video frame, the position of the virtual key and corresponding movement Difference degree between the position at the specific characteristic position identified in video frame generates score image;
According to the game video frame, corresponding action video frame and the score image, target video frame is generated.
Preferably, further includes:
The posture of user is shot in advance to obtain prepared video frame;
The specific characteristic position that whether there is user in the prepared video frame by identifying carries out posture school to user Just.
Preferably, the specific characteristic position is identified based on the convolutional neural networks model pre-established.
Preferably, the corresponding action video frame includes the institute being separated by preset time with the game video frame front and back There is action video frame.
Preferably, the position based on the position of note point described in the game video frame, the virtual key with And the difference degree between the position at the specific characteristic position identified in corresponding action video frame, generate score image, comprising:
When detecting that the region of note point and the region of virtual key are in same coordinate range in the game video frame When overlapping, judge the region of the virtual key Chong Die with the region of the note point, and is identified in corresponding action video frame Whether the region at specific characteristic position is overlapped in same coordinate range, to generate score image according to the result of judgement.
Preferably, by judge coordinate set included by two regions in same coordinate range intersection whether be Nonempty set, to determine whether two regions are overlapped.
Preferably, the priority of the corresponding trigger event of different virtual keys is different;
The then region of the judgement virtual key Chong Die with the region of the note point, in corresponding action video frame Whether the region at the specific characteristic position of identification is overlapped in same coordinate range, comprising:
In the game video frame, with the region at the specific characteristic position identified in the corresponding action video frame weight When folded part includes the region of at least two virtual keys, the priority based on the corresponding trigger event of the virtual key is true The fixed preferential virtual key Chong Die with the region at the specific characteristic position, and judge the preferential virtual key whether be and The virtual key of the region overlapping of the note point.
Preferably, described according to the game video frame, corresponding action video frame and the score image, generate mesh Mark video frame, comprising:
The game video frame, corresponding action video frame and the score image are overlapped processing, to generate Target video frame.
According to the second aspect of the embodiment of the present application, a kind of video-generating device is provided, described device includes:
Video playing and shooting module, for after detecting dancing machine game enabled instruction, playing the dancing chosen trip Play video, and the movement of sync pulse jamming user is to obtain action video frame;The game video frame of the dance game video includes At least one virtual key and at least one note point;
Score image generation module, for based on the position of note point described in the game video frame, described virtually press Difference degree between the position at the specific characteristic position identified in the position of key and corresponding action video frame generates score Image;
Target video frame generation module, for according to the game video frame, corresponding action video frame and described Partial image generates target video frame.
According to the third aspect of the embodiment of the present application, a kind of electronic equipment is provided, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
After detecting dancing machine game enabled instruction, the dance game video chosen is played, and sync pulse jamming user Movement is to obtain action video frame;The game video frame of the dance game video includes at least one virtual key and at least One note point;
Based on the position of note point described in the game video frame, the position of the virtual key and corresponding movement Difference degree between the position at the specific characteristic position identified in video frame generates score image;
According to the game video frame, corresponding action video frame and the score image, target video frame is generated.
According to the fourth aspect of the embodiment of the present application, a kind of computer readable storage medium is additionally provided, is stored thereon with Computer instruction, when which is executed by processor in realization first aspect the step of any the method.
The technical solution that embodiments herein provides can include the following benefits:
The application plays the dance game video chosen, and sync pulse jamming after detecting dancing machine game enabled instruction The movement of user to obtain action video frame, the game video frame of the dance game video include at least one virtual key with And at least one note point, it is then based on the position of the position of note point described in the game video frame, the virtual key And the difference degree between the position at the specific characteristic position identified in corresponding action video frame, score image is generated, most Afterwards according to the game video frame, corresponding action video frame and the score image, target video frame is generated, user is not necessarily to Prepare additional dancing equipment, without place limitation is received, only there need to be the mobile terminal of camera function can be whenever and wherever possible Dancing machine game is carried out, equipment loss is reduced, saves game expense, also improves the applicability of dancing machine game, and The game process of user can also be recorded, so that the game of user's direct feel itself shows, improve user to game Sense of participation and feeling of immersion.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The application can be limited.
Detailed description of the invention
Fig. 1 is a kind of the application embodiment flow chart of video generation method shown according to an exemplary embodiment;
Fig. 2 is the schematic diagram of the application target video frame shown according to an exemplary embodiment;
Fig. 3 is the process signal that the application electronic equipment shown according to an exemplary embodiment carries out score judgement Figure;
Fig. 4 is the embodiment flow chart of the application another video generation method shown according to an exemplary embodiment;
Fig. 5 is a kind of the application schematic diagram of the embodiment of video-generating device shown according to an exemplary embodiment;
Fig. 6 provides the schematic diagram of a kind of electronic equipment according to an exemplary embodiment for the application.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the application.
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application. It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from In the case where the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ... When " or " in response to determination ".
Body-sensing dancing and game is typically required for relevant equipment to assist running in the prior art, but related dancing equipment Also there is certain weight and volume, not portable, the limitation of game conditions makes user that can not experience body-sensing whenever and wherever possible Dancing and game, while existing body-sensing dancing and game also increases the consumption of related dancing equipment and the expenditure of user, and User is when playing game, and due to that can not record the game process of user, in game over, user can not intuitively watch itself Performance in game process reduces the participation desire of user.
Therefore, this application provides a kind of video generation methods, and the flow chart of this method is as shown in Figure 1, it is used to solve The existing problem above of body-sensing dancing and game in the prior art, the video generation method can be integrated in an electronic equipment In, it is executed by the electronic equipment, the electronic equipment can be mobile phone, computer, Intelligent flat, PDA (PersonalDigital Assistant, personal digital assistant) etc. has the calculating equipment of video capture function.
Fig. 1 is a kind of the application embodiment flow chart of video generation method shown according to an exemplary embodiment, institute The method of stating specifically includes:
Step S101 plays the dance game video chosen, and synchronous bat after detecting dancing machine game enabled instruction The movement of user is taken the photograph to obtain action video frame;The game video frame of the dance game video includes at least one virtual key And at least one note point.
Step S102, based on the position of note point described in the game video frame, the position of the virtual key and Difference degree between the position at the specific characteristic position identified in corresponding action video frame generates score image.
Step S103 generates target according to the game video frame, corresponding action video frame and the score image Video frame.
In step s101, the electronic equipment plays what user chose after detecting dancing machine game enabled instruction Dance game video, while the movement of the picture pick-up device sync pulse jamming user by itself, so that user is according to being played on The picture that dance game video does corresponding actions can be synchronized to record, and judge convenient for subsequent marking, wherein described to take the photograph As equipment can be video camera.
In one possible implementation, the triggering of the dancing machine game enabled instruction includes but is not limited to detect Confirmation receives the enabled instruction of dancing machine game or recognizes true when the required movement that user makes when programmable button is triggered Recognize receive the enabled instruction of dancing machine game or receive user voice confirmation message when confirmation receive dancing machine game Enabled instruction etc..
In one possible implementation, the process of dance game video, the application of electronic equipment are selected for user The trigger condition that the selection of a dance game video can be set in program, for example, the trigger condition can be a dancing Game video selects control, and user can select control by triggering the dance game, into dance game video selection interface The selection for carrying out dance game video, thus the dance game video that the available user of the electronic equipment chooses;As another A kind of possibility, the trigger condition are also possible to when receiving the dancing machine game enabled instruction, and the electronic equipment can With automatically into dance game video selection interface, user can be according to itself demand, from the dance game video selection One of dance game video is selected in interface, as the dance game video that itself is selected, then the electronic equipment can It is played out with obtaining the dance game video that user chooses.
In step s 102, the dance game video chosen in broadcasting user, and clapped by the way that the picture pick-up device of itself is synchronous During the movement for taking the photograph user, the electronic equipment obtains the game video frame of the dance game video played, and obtains Corresponding action video frame including user action carries out score judgement, as shown in Fig. 2, the game of the dance game video regards Frequency frame may include at least one virtual key and at least one note point, and the virtual key can be rectangle, circle, ellipse The round perhaps shapes such as hexagon note shop can be shapes, the present invention such as round, star or strip and not appoint to this What is limited, and the electronic equipment identifies the specific characteristic position of the user in the action video frame, then according to the game The specified spy identified in the position of the point of note described in video frame, the position of the virtual key and corresponding action video frame The difference degree between the position at position is levied, score image is generated;Wherein, the specific characteristic position, which can be, is based on building in advance Vertical convolutional neural networks model is identified that the specific characteristic position can be foot, hand, head, waist or shoulder The positions such as portion, the convolutional neural networks model are stored with a series of specific characteristic position data by the process of training, In use process, the electronic equipment leads to using the action video frame as the input parameter of the convolutional neural networks model The convolution algorithm of the convolutional neural networks model is crossed, thus output specific characteristic number positional corresponding with the action video frame According to.
It should be noted that since human body is from the dance movement seen in dance game video to the end according to the dancing Movement makes the process acted accordingly and needs certain human body reflection interval, when the application certain delay is arranged thus judges Between, action video frame corresponding with the game video frame is set to include when being separated by default with the game video frame front and back In everything video frame, for example, the electronic equipment is when getting a game video frame, by the game video frame Score judgement is carried out one by one with all action video frames for being separated by 0.2s before and after the game video frame respectively, embodies hommization Design requirement.
In the present embodiment, described as shown in figure 3, Fig. 3 is the flow diagram that the electronic equipment carries out score judgement Electronic equipment detects the region of note point and virtual key in the game video frame in the process for carrying out score judgement first Whether region is overlapped in same coordinate range, coordinate set and the virtual key included by the region of the note point Region included by the intersection of coordinate set when being nonempty set, determine in the game video frame region of note point and empty The region of quasi- key is overlapped in same coordinate range, then the electronic equipment further judges and the region of note point weight The region of folded virtual key, with the region at the specific characteristic position identified in corresponding action video frame in same coordinate range Inside whether it is overlapped, the coordinate set included by the region of the virtual key described in same coordinate range is regarded with corresponding movement When to specify coordinate set included by the region of characteristic portion in frequency frame be nonempty set, determine the region of the virtual key with The region at the specific characteristic position identified in corresponding action video frame is overlapped in same coordinate range, means user at this time Score is hit, the electronic equipment generates new score image according to pre-set bonus point number;If in same coordinate range Coordinate set included by the region of the virtual key specifies the region of characteristic portion to be wrapped with corresponding action video frame The coordinate set included is empty set, determines the specific characteristic portion identified in the region and corresponding action video frame of the virtual key The region of position is not overlapped in same coordinate range, means that user loses points at this time, and the electronic equipment is according in advance The deduction number of setting generates new score image.
In addition, working as seat included by the region of coordinate set included by the region of the note point and the virtual key When mark intersection of sets is integrated as empty set, determine that the region of note point and the region of virtual key are in same seat in the game video frame Mark range is not overlapped, and without further interacting judgement with user video frame, present score does not have the game video frame at this time It changes, the electronic equipment obtains the score image of upper game video frame as current score image.
As a kind of possible implementation, the region of note point and virtual key in determining the game video frame After region is overlapped in same coordinate range, the electronic equipment further judges Chong Die with the region of the note point virtual Whether the region of key weighs in same coordinate range with the region at the specific characteristic position identified in corresponding action video frame It is folded, game video frame may have been detected the presence of at this time, with the region weight for specifying characteristic portion in corresponding action video frame Folded part includes the case where the region of at least two virtual keys, and as an example, such as the specific characteristic position is Foot, user make and stepping on accordingly according to the position of note point in the game video frame and the position of the virtual key When middle movement, the electronic equipment detect in same coordinate range in the action video frame foot areas of user with it is described The region overlapping of two virtual keys in game video frame, this means that the foot of user step in two virtual keys situation, For such situation, different priority is set for the corresponding trigger event of virtual key in the application, so as to according to void Different priority determines the virtual key of hit between the quasi- corresponding trigger event of key, then the electronic equipment is encountering this It, can be based on the determining area with the specific characteristic position of the priority of the corresponding trigger event of the virtual key when kind situation The preferential virtual key of domain overlapping, and judge whether the preferential virtual key is the void Chong Die with the region of the note point Quasi- key, if so, meaning that user hits score at this time, the electronic equipment generates new obtain according to pre-set bonus point number Partial image;If it is not, meaning that user loses points at this time, the electronic equipment generates new obtain according to pre-set deduction number Partial image.
As alternatively possible implementation, for above-mentioned situation, the application can also be according to the specific characteristic The size that the region at position is formed by least two intersecting areas with the region of at least two virtual keys respectively comes true Surely the virtual key in stepping on as an example can be corresponding at least by obtaining at least two intersecting area Two minimum circumscribed rectangles, then compare the size between at least two minimum circumscribed rectangles determine hit it is virtual by Key improves program operational efficiency to reduce calculation amount.
In one embodiment, the dance game video further includes corresponding game ratings, and user is in the corresponding dance of selection When stepping game video, corresponding game ratings have also been selected, in different game ratings, included void in game video frame The quantity of quasi- key is also different, and correspondingly, the electronic equipment needs the specified spy identified from corresponding action video frame It is also different to levy position, as an example, game ratings 1 are set, included void in the video frame of dance game video The quantity of quasi- key is 3, and the electronic equipment needs to identify foot's key point;Game ratings 2, the view of dance game video are set The quantity of included virtual key is 5 in frequency frame, and the electronic equipment needs to identify foot's key point and hand key point; Game ratings 3 are set, and the quantity of included virtual key is 6 in the video frame of dance game video, and the electronic equipment needs Identify foot's key point, hand key point and header key point etc., concrete condition can carry out specific according to actual needs Setting, the application do not do any restrictions to this, the present embodiment for the setting of game ratings can increase the interest of game with Diversity improves the game experiencing of user.
In step 103, after obtaining the score image, Fig. 2 shows the schematic diagram of a target video frame, the electricity The game video frame, corresponding action video frame and the score image are overlapped processing by sub- equipment, to generate mesh Video frame is marked, after the dance game video terminates, the electronic equipment integrates all target video frames, generates record The target dancing video of user's dance movement and scoring event.
In one possible implementation, after the dance game video terminates, the electronic equipment is according to institute Some score images generate overall merit image, then in conjunction with all target video frames, generate record user's dance movement and obtain Divide the target dancing video of situation.
In one possible implementation, the electronic equipment also has sharing function, divides when detecting that user triggers When enjoying control, the target dancing video is shared, to improve the popularization of dancing machine game.
The application plays the dance game video chosen, and sync pulse jamming after detecting dancing machine game enabled instruction The movement of user to obtain action video frame, the game video frame of the dance game video include at least one virtual key with And at least one note point, it is then based on the position of the position of note point described in the game video frame, the virtual key And the difference degree between the position at the specific characteristic position identified in corresponding action video frame, score image is generated, most Afterwards according to the game video frame, corresponding action video frame and the score image, target video frame is generated, user is not necessarily to Prepare additional dancing equipment, without place limitation is received, only there need to be the mobile terminal of camera function can be whenever and wherever possible Dancing machine game is carried out, equipment loss is reduced, saves game expense, also improves the applicability of dancing machine game, and The game process of user can also be recorded, so that the game of user's direct feel itself shows, improve user to game Sense of participation and feeling of immersion.
As shown in figure 4, the method specifically includes the present invention also provides another video generation method:
Step S201 in advance shoots the posture of user to obtain prepared video frame.
Step S202 whether there is the specific characteristic position of user by identifying in the prepared video frame, to user into Row attitude updating.
Step S203 plays the dance game video chosen, and synchronous bat after detecting dancing machine game enabled instruction The movement of user is taken the photograph to obtain action video frame;The game video frame of the dance game video includes at least one virtual key And at least one note point.Similar with attached step S101 shown in FIG. 1, details are not described herein again.
Step S204, based on the position of note point described in the game video frame, the position of the virtual key and Difference degree between the position at the specific characteristic position identified in corresponding action video frame generates score image.With attached drawing 1 Shown step S102 is similar, and details are not described herein again.
Step S205 generates target according to the game video frame, corresponding action video frame and the score image Video frame.Similar with attached step S103 shown in FIG. 1, details are not described herein again.
In step s 201, the electronic equipment can be when user opens dancing machine game preparation interface, and starting is certainly Then the picture pick-up device of body is shot by backswing of the picture pick-up device of itself to user to obtain prepared video frame, To carry out attitude updating.
In step S202, the electronic equipment whether there is the specified spy of user by identifying in the prepared video frame Position is levied, attitude updating is carried out to user, the specific characteristic position can be based on the convolutional neural networks mould pre-established Type is identified that the convolutional neural networks model is stored with a series of specific characteristic position data by the process of training, In use, the electronic equipment is using the prepared video frame as the input parameter of the convolutional neural networks model, By the convolution algorithm of the convolutional neural networks model, thus output specific characteristic position corresponding with the prepared video frame Data, if confirming that posture can correctly dance there are the specific characteristic position of user in the confirmation prepared video frame Machine game;If not recognizing the specific characteristic position of user in the prepared video frame, user is reminded to adjust posture again It is corrected, for example, can prepare show corresponding contour area on interface in the dancing machine game, so that user can be with The backswing of itself is quickly adjusted according to the contour area, the time before saving game, attitude updating process guarantees It specifies characteristic portion in effective coverage in next game process, and can be accurately identified, avoid identifying Fault less than specific characteristic position occurs.
It is described according to the difference of the game ratings of the dancing and game video of user's selection in a possible implementation Electronic equipment identifies that the specific characteristic position of user in the prepared video frame is also different, for example user has selected game etc. Grade 1 then needs to identify the foot's key point that whether there is user in the prepared video frame;If user has selected game ratings 2, It then needs to identify with the presence or absence of foot's key point of user and hand key point etc. in the prepared video frame, so that it is guaranteed that User is effectively shooting at specific characteristic position during carrying out game using the dancing and game video of different game ratings In range, and it can be accurately identified.
Corresponding with the embodiment of the application video generation method, present invention also provides video-generating device, electronics to set Standby and computer readable storage medium embodiment.
Referring to Fig. 5, being one embodiment block diagram of the application video-generating device, which includes:
Video playing and shooting module 11, for playing the dancing chosen after detecting dancing machine game enabled instruction Game video, and the movement of sync pulse jamming user is to obtain action video frame;The game video frame packet of the dance game video Include at least one virtual key and at least one note point.
Score image generation module 12, for based on the position of note point described in the game video frame, described virtual Difference degree between the position at the specific characteristic position identified in the position of key and corresponding action video frame, generates Partial image.
Target video frame generation module 13, for according to the game video frame, corresponding action video frame and described Score image generates target video frame.
Preferably, further includes:
Preparation video frame obtains module, for being shot to the posture of user in advance to obtain prepared video frame.
Attitude updating module, for whether there is the specific characteristic position of user in the prepared video frame by identifying, Attitude updating is carried out to user.
Preferably, the specific characteristic position is identified based on the convolutional neural networks model pre-established.
Preferably, the corresponding action video frame includes the institute being separated by preset time with the game video frame front and back There is action video frame.
Preferably, the score image generation module 12 includes:
When detecting that the region of note point and the region of virtual key are in same coordinate range in the game video frame When overlapping, judge the region of the virtual key Chong Die with the region of the note point, and is identified in corresponding action video frame Whether the region at specific characteristic position is overlapped in same coordinate range, to generate score image according to the result of judgement.
Preferably, by judge coordinate set included by two regions in same coordinate range intersection whether be Nonempty set, to determine whether two regions are overlapped.
Preferably, the priority of the corresponding trigger event of different virtual keys is different.
Then the score image generation module 12 includes:
First judging unit, for judging that the region of note point and the region of virtual key are same in the game video frame Whether it is overlapped in one coordinate range;If overlapping, executes the second judgment unit.
Second judgment unit, for working as in the game video frame, with the finger identified in the corresponding action video frame It is corresponding based on the virtual key when part for determining the region overlapping of characteristic portion includes the region of at least two virtual keys The priority of trigger event determines the preferential virtual key Chong Die with the region at the specific characteristic position, and judges that this is preferential Virtual key whether be the virtual key Chong Die with the region of the note point.
Preferably, the target video frame generation module 13 includes:
The game video frame, corresponding action video frame and the score image are overlapped processing, to generate Target video frame.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein being used as separate part description Unit may or may not be physically separated, component shown as a unit may or may not be Physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to the actual needs Some or all of the modules therein is selected to realize the purpose of the present invention program.Those of ordinary skill in the art are not paying wound In the case that the property made is worked, it can understand and implement.
Correspondingly, the present invention also provides a kind of electronic equipment 30 as shown in Figure 6, it include processor 31;It can for storing The memory 32 executed instruction, the memory 32 include computer program 33;Wherein, processor 31 is configured as:
After detecting dancing machine game enabled instruction, the dance game video chosen is played, and sync pulse jamming user Movement is to obtain action video frame;The game video frame of the dance game video includes at least one virtual key and at least One note point.
Based on the position of note point described in the game video frame, the position of the virtual key and corresponding movement Difference degree between the position at the specific characteristic position identified in video frame generates score image.
According to the game video frame, corresponding action video frame and the score image, target video frame is generated.
The processor 31 executes the computer program 33 for including in the memory 32, during the processor 31 can be Central Processing Unit (Central Processing Unit, CPU), can also be other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other can Programmed logic device, discrete gate or transistor logic, discrete hardware components etc..General processor can be microprocessor Or the processor is also possible to any conventional processor etc..
The memory 32 stores the computer program of the video generation method, and the memory 32 may include at least A type of storage medium, storage medium include flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX storage Device etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), electric erasable Programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..And And equipment can cooperate with the network storage device for the store function for executing memory by network connection.Memory 32 can be with It is the internal storage unit of equipment 30, such as the hard disk or memory of equipment 30.It deposits the outside that memory 32 is also possible to equipment 30 The plug-in type hard disk being equipped in storage equipment, such as equipment 30, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, memory 32 can also both include equipment 30 internal storage unit also includes External memory equipment.Memory 32 is for storing needed for computer program 33 and equipment Other programs and data.Memory 32 can be also used for temporarily storing the data that has exported or will export.
The computer of such as computer software, hardware or any combination thereof can be used in various embodiments described herein Readable medium is implemented.Hardware is implemented, embodiment described herein can be by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can Programming gate array (FPGA), controller, microcontroller, microprocessor, is designed to execute function described herein processor At least one of electronic unit is implemented.For software implementation, the embodiment of such as process or function can with allow to hold The individual software modules of at least one functions or operations of row is implemented.Software code can be by with any programming language appropriate The software application (or program) write is implemented, and software code can store in memory and be executed by controller.
Electronic equipment 30 includes but is not limited to exist below form: (1) mobile communication equipment: the characteristics of this kind of equipment is tool Standby mobile communication function, and to provide speech, data communication as main target.This Terminal Type include: smart phone (such as IPhone), multimedia handset, functional mobile phone and low-end mobile phone etc.;(2) super mobile personal computer equipment: this kind of equipment The scope for belonging to personal computer has calculating and processing function, generally also has mobile Internet access characteristic.This Terminal Type includes: PDA, MID and UMPC equipment etc., such as iPad;(3) portable entertainment device: this kind of equipment can show and play in multimedia Hold.Such equipment includes: audio, video player (such as iPod), handheld device, e-book and intelligent toy and just Take formula in-vehicle navigation apparatus;(4) other electronic equipments with data interaction function.Equipment may include, but be not limited only to, processing Device 31, memory 32.It will be understood by those skilled in the art that Fig. 6 is only the example of electronic equipment 30, not structure paired electrons The restriction of equipment 30 may include perhaps combining certain components or different components than illustrating more or fewer components, Such as equipment can also include input-output equipment, network access equipment, bus, picture pick-up device etc..
The function of each unit and the realization process of effect are specifically detailed in the above method and correspond to step in above equipment Realization process, details are not described herein.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory of instruction, above-metioned instruction can be executed by the processor of device to complete the above method.For example, non-transitory meter Calculation machine readable storage medium storing program for executing can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage and set It is standby etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in storage medium is executed by the processor of terminal When, it enables the terminal to execute above-mentioned video generation method.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its Its embodiment.The present invention is directed to cover any variations, uses, or adaptations of the invention, these modifications, purposes or Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the present invention Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following Claim is pointed out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.
The above is merely preferred embodiments of the present invention, be not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.

Claims (11)

1. a kind of video generation method, which is characterized in that the described method includes:
After detecting dancing machine game enabled instruction, the dance game video chosen, and the movement of sync pulse jamming user are played To obtain action video frame;The game video frame of the dance game video include at least one virtual key and at least one Note point;
Based on the position of note point described in the game video frame, the position of the virtual key and corresponding action video Difference degree between the position at the specific characteristic position identified in frame generates score image;
According to the game video frame, corresponding action video frame and the score image, target video frame is generated.
2. video generation method according to claim 1, which is characterized in that further include:
The posture of user is shot in advance to obtain prepared video frame;
The specific characteristic position that whether there is user in the prepared video frame by identifying carries out attitude updating to user.
3. video generation method according to claim 2, which is characterized in that the specific characteristic position is based on pre-establishing Convolutional neural networks model identified.
4. video generation method according to claim 1, which is characterized in that the corresponding action video frame includes and institute State the everything video frame that game video frame front and back is separated by preset time.
5. video generation method according to claim 1, which is characterized in that described based on described in the game video frame The position at the specific characteristic position identified in the position of note point, the position of the virtual key and corresponding action video frame Between difference degree, generate score image, comprising:
When the region with the region of virtual key that detect note point in the game video frame are be overlapped in same coordinate range When, judge the region of the virtual key Chong Die with the region of the note point, it is specified with being identified in corresponding action video frame Whether the region of characteristic portion is overlapped in same coordinate range, to generate score image according to the result of judgement.
6. video generation method according to claim 5, which is characterized in that by judging two in same coordinate range Whether the intersection of coordinate set included by a region is nonempty set, to determine whether two regions are overlapped.
7. video generation method according to claim 5, which is characterized in that the corresponding trigger event of different virtual keys Priority is different;
The then region of the judgement virtual key Chong Die with the region of the note point, and identifies in corresponding action video frame The region at specific characteristic position whether be overlapped in same coordinate range, comprising:
In the game video frame, with the overlapping of the region at the specific characteristic position identified in the corresponding action video frame Part include at least two virtual keys region when, based on the corresponding trigger event of the virtual key priority determine with The specific characteristic position region overlapping preferential virtual key, and judge the preferential virtual key whether be with it is described The virtual key of the region overlapping of note point.
8. video generation method according to claim 1, which is characterized in that described according to the game video frame, correspondence Action video frame and the score image, generate target video frame, comprising:
The game video frame, corresponding action video frame and the score image are overlapped processing, to generate target Video frame.
9. a kind of video-generating device, which is characterized in that the described method includes:
Video playing and shooting module, for after detecting dancing machine game enabled instruction, playing the dance game chosen view Frequently, and the movement of sync pulse jamming user is to obtain action video frame;The game video frame of the dance game video includes at least One virtual key and at least one note point;
Score image generation module, for based on the position of note point described in the game video frame, the virtual key Difference degree between the position at the specific characteristic position identified in position and corresponding action video frame generates shot chart Picture;
Target video frame generation module, for according to the game video frame, corresponding action video frame and the shot chart Picture generates target video frame.
10. a kind of electronic equipment characterized by comprising
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
After detecting dancing machine game enabled instruction, the dance game video chosen, and the movement of sync pulse jamming user are played To obtain action video frame;The game video frame of the dance game video include at least one virtual key and at least one Note point;
Based on the position of note point described in the game video frame, the position of the virtual key and corresponding action video Difference degree between the position at the specific characteristic position identified in frame generates score image;
According to the game video frame, corresponding action video frame and the score image, target video frame is generated.
11. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the instruction is by processor The step of claim 1 to 8 any the method is realized when execution.
CN201811588828.8A 2018-12-25 2018-12-25 Video generation method, device, equipment and storage medium Active CN109621425B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811588828.8A CN109621425B (en) 2018-12-25 2018-12-25 Video generation method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811588828.8A CN109621425B (en) 2018-12-25 2018-12-25 Video generation method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109621425A true CN109621425A (en) 2019-04-16
CN109621425B CN109621425B (en) 2023-08-18

Family

ID=66077271

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811588828.8A Active CN109621425B (en) 2018-12-25 2018-12-25 Video generation method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109621425B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110572686A (en) * 2019-08-05 2019-12-13 广州华多网络科技有限公司 Interaction method, live broadcast system, electronic equipment and storage device
CN113543862A (en) * 2021-06-24 2021-10-22 商汤国际私人有限公司 Detection method, device, equipment and system for game prop operation event
CN113678137A (en) * 2019-08-18 2021-11-19 聚好看科技股份有限公司 Display device
CN113992974A (en) * 2021-10-14 2022-01-28 咪咕视讯科技有限公司 Method and device for simulating competition, computing equipment and computer-readable storage medium
CN114549706A (en) * 2022-02-21 2022-05-27 成都工业学院 Animation generation method and animation generation device
EP4140551A4 (en) * 2020-05-21 2023-08-09 Beijing Bytedance Network Technology Co., Ltd. Game effect generation method and apparatus, electronic device, and computer readable medium
CN117085315A (en) * 2023-07-25 2023-11-21 北京维艾狄尔信息科技有限公司 AR interactive game method, system and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW592753B (en) * 2000-09-25 2004-06-21 Inst Information Industry Dance training device
CN101304476A (en) * 2008-06-19 2008-11-12 深圳创维-Rgb电子有限公司 Method for implementing dance function and television
CN101306249A (en) * 2008-05-30 2008-11-19 北京中星微电子有限公司 Motion analysis device and method
CN101681493A (en) * 2007-04-12 2010-03-24 纽里恩软件公司 Method for dance game and the recording media therein readable by computer
JP2011188920A (en) * 2010-03-12 2011-09-29 Konami Digital Entertainment Co Ltd Game device, game processing method, and program
CN105228708A (en) * 2013-04-02 2016-01-06 日本电气方案创新株式会社 Body action scoring apparatus, dancing scoring apparatus, Caraok device and game device
US9358456B1 (en) * 2010-06-11 2016-06-07 Harmonix Music Systems, Inc. Dance competition game
CN107920269A (en) * 2017-11-23 2018-04-17 乐蜜有限公司 Video generation method, device and electronic equipment
CN107952238A (en) * 2017-11-23 2018-04-24 乐蜜有限公司 Video generation method, device and electronic equipment
CN107968921A (en) * 2017-11-23 2018-04-27 乐蜜有限公司 Video generation method, device and electronic equipment
CN108371814A (en) * 2018-01-04 2018-08-07 乐蜜有限公司 Implementation method, device, electronic equipment and the storage medium of more human body sense dancings

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW592753B (en) * 2000-09-25 2004-06-21 Inst Information Industry Dance training device
CN101681493A (en) * 2007-04-12 2010-03-24 纽里恩软件公司 Method for dance game and the recording media therein readable by computer
CN101306249A (en) * 2008-05-30 2008-11-19 北京中星微电子有限公司 Motion analysis device and method
CN101304476A (en) * 2008-06-19 2008-11-12 深圳创维-Rgb电子有限公司 Method for implementing dance function and television
JP2011188920A (en) * 2010-03-12 2011-09-29 Konami Digital Entertainment Co Ltd Game device, game processing method, and program
US9358456B1 (en) * 2010-06-11 2016-06-07 Harmonix Music Systems, Inc. Dance competition game
CN105228708A (en) * 2013-04-02 2016-01-06 日本电气方案创新株式会社 Body action scoring apparatus, dancing scoring apparatus, Caraok device and game device
CN107920269A (en) * 2017-11-23 2018-04-17 乐蜜有限公司 Video generation method, device and electronic equipment
CN107952238A (en) * 2017-11-23 2018-04-24 乐蜜有限公司 Video generation method, device and electronic equipment
CN107968921A (en) * 2017-11-23 2018-04-27 乐蜜有限公司 Video generation method, device and electronic equipment
CN108371814A (en) * 2018-01-04 2018-08-07 乐蜜有限公司 Implementation method, device, electronic equipment and the storage medium of more human body sense dancings

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李世杰,夏斌: "基于Kinect的体感康复游戏系统设计", 《微型机与应用》 *
李世杰,夏斌: "基于Kinect的体感康复游戏系统设计", 《微型机与应用》, 25 November 2017 (2017-11-25), pages 96 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110572686A (en) * 2019-08-05 2019-12-13 广州华多网络科技有限公司 Interaction method, live broadcast system, electronic equipment and storage device
CN110572686B (en) * 2019-08-05 2022-05-10 广州方硅信息技术有限公司 Interaction method, live broadcast system, electronic equipment and storage device
CN113678137A (en) * 2019-08-18 2021-11-19 聚好看科技股份有限公司 Display device
CN113678137B (en) * 2019-08-18 2024-03-12 聚好看科技股份有限公司 Display apparatus
EP4140551A4 (en) * 2020-05-21 2023-08-09 Beijing Bytedance Network Technology Co., Ltd. Game effect generation method and apparatus, electronic device, and computer readable medium
US12023578B2 (en) 2020-05-21 2024-07-02 Beijing Bytedance Network Technology Co., Ltd. Game effect generating method and apparatus, electronic device, and computer readable medium
CN113543862A (en) * 2021-06-24 2021-10-22 商汤国际私人有限公司 Detection method, device, equipment and system for game prop operation event
CN113992974A (en) * 2021-10-14 2022-01-28 咪咕视讯科技有限公司 Method and device for simulating competition, computing equipment and computer-readable storage medium
CN113992974B (en) * 2021-10-14 2023-12-08 咪咕视讯科技有限公司 Method, device, computing equipment and computer readable storage medium for simulating competition
CN114549706A (en) * 2022-02-21 2022-05-27 成都工业学院 Animation generation method and animation generation device
CN117085315A (en) * 2023-07-25 2023-11-21 北京维艾狄尔信息科技有限公司 AR interactive game method, system and storage medium
CN117085315B (en) * 2023-07-25 2024-06-25 北京维艾狄尔信息科技有限公司 AR interactive game method, system and storage medium

Also Published As

Publication number Publication date
CN109621425B (en) 2023-08-18

Similar Documents

Publication Publication Date Title
CN109621425A (en) A kind of video generation method, device, equipment and storage medium
US8882591B2 (en) Storage medium having image display program stored therein, image display apparatus, image display system, and image display method
JP5639830B2 (en) GAME DEVICE, GAME PROGRAM, GAME SYSTEM, AND GAME CONTROL METHOD
CN109194879A (en) Photographic method, device, storage medium and mobile terminal
CN107967706A (en) Processing method, device and the computer-readable recording medium of multi-medium data
US11144187B2 (en) Storage medium having stored therein game program, information processing system, information processing apparatus, and game processing method
CN109729297A (en) The method and apparatus of special efficacy are added in video
CN110113523A (en) Intelligent photographing method, device, computer equipment and storage medium
CN109925713B (en) Object control method and device, storage medium and electronic device
CN113487709A (en) Special effect display method and device, computer equipment and storage medium
WO2017166629A1 (en) Method for starting application program, and terminal device
CN109600559A (en) A kind of special video effect adding method, device, terminal device and storage medium
WO2023065676A1 (en) Method and device for controlling air conditioner, and air conditioner
CN106075913A (en) A kind of information processing method and terminal
JP2022010175A (en) Information processor and information processing program
CN108786108A (en) Target object control method, device, storage medium and equipment
CN108600924B (en) Loudspeaker drainage method and wearable equipment
CN105797376A (en) Method and terminal for controlling role model behavior according to expression of user
CN109740511A (en) A kind of human face expression matching process, device, equipment and storage medium
CN111870932A (en) Interactive processing method, device and equipment based on game
JP2013141543A (en) Game system
JP2022505002A (en) Augmented reality data display methods, devices, equipment, storage media and programs
US8784205B2 (en) Game device, method for controlling game device, program, and information storage medium
EP2490367B1 (en) Information processing program, information processing apparatus, information processing method and information processing system
JP6193301B2 (en) Game machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210112

Address after: 511442 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 511442 24 floors, B-1 Building, Wanda Commercial Square North District, Wanbo Business District, 79 Wanbo Second Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant