TWI724518B - System for simulating displaying video according to storyboard to generate multimedia resume and method thereof - Google Patents

Abstract

A system for simulating displaying a video according to a storyboard to generate a multimedia resume and a method thereof are provided. By simulating displaying a video to generate video signal in accordance with a sequence in time of a storyboard, generating a caption signal based on words contained in lines, and mixing the caption signal in the video signal to generate a multimedia resume according to time message contained in the lines, the system and the method can achieve the effect of producing multimedia resume by word description and without video editing software.

Description

System and method for simulating video and audio playback based on script to generate multimedia resume

A multimedia resume generation system and method, in particular, refers to a system and method for generating multimedia resumes by simulating video and audio playback based on scripts.

Multimedia resume is a personal resume that describes how job seekers use video recording equipment to record their own image and work ability, edit the recorded content and convert the playback format, so that the recorded content can be played through a multimedia playback device.

At present, there are some job search websites or some job positions that allow job seekers to upload multimedia resumes. Since multimedia resumes can contain a large amount of information and can also present sufficient audiovisual effects, it can quickly shorten the distance between job seekers and recruiters, making recruiters It is possible to have a more comprehensive understanding of the external image and work ability of job applicants in a relatively short period of time.

Since multimedia resumes require the use of audio-visual editing software for image editing and format conversion, however, the current audio-visual editing software has many functions. For job seekers who do not or rarely use audio-visual editing software, learn to operate audio-visual editing software to create multimedia resumes. It’s not easy, whether you want to play two different videos on the same screen at the same time or one after the other, or add them to your multimedia resume. Entering subtitles may take a period of exploration. Therefore, even if job seekers have various ideas for making multimedia resumes, if they cannot operate the audio-visual editing software effectively, they cannot complete the multimedia resumes according to their ideas.

In summary, it can be seen that there has been a long-standing problem in the prior art that the production of multimedia resumes requires familiarity with audio-visual editing software. Therefore, it is necessary to propose improved technical means to solve this problem.

In view of the problem in the prior art that it is necessary to be familiar with audio-visual editing software to make multimedia resumes, the present invention discloses a system and method for simulating audio-visual playback based on scripts to generate multimedia resumes, wherein: the present invention discloses simulating audio-visual playback based on scripts to generate multimedia The resume system includes at least: an input module for inputting resume scripts and resume lines. The resume script records audio and video files. The resume lines include text messages and corresponding time information; a simulation playback module is used to follow the resume scripts. Load and simulate audio and video files in time sequence to output audio and video signals; subtitle generation module to generate subtitle signals based on text messages; resume generation module to add subtitle signals to audio and video signals based on time information to generate multimedia resumes.

The method for generating multimedia resumes by simulating video playback based on scripts disclosed in the present invention includes at least: inputting resume scripts and resume lines, recording video files in resume scripts, resume lines including text messages and corresponding time information; according to resumes The sequence of the script loads and simulates the playback of audio and video files to output audio and video signals; generates subtitle signals based on text messages; adds subtitle signals to audio and video signals based on time information to generate multimedia resumes.

The system and method disclosed in the present invention are as above. The difference with the prior art is that the present invention loads and simulates playing audio-visual files according to the timing of the resume script to generate audio-visual signals, and generates subtitle signals based on the text messages in the resume lines. According to the time information in the resume line, the subtitle signal is added to the video and audio signal to generate a multimedia resume, so as to solve the problems of the prior art and achieve the technical effect of creating a multimedia resume with text description.

110: Input module

120: Analog playback module

130: Subtitle generation module

140: Voice generation module

150: resume generation module

170: Trait Judgment Module

180: Image Collection Module

190: Resume Adjustment Module

Step 210: Enter the resume script and resume lines

Step 220: According to the timing of the resume script to simulate the playback of audio and video files to output audio and video signals

Step 230: Generate a subtitle signal based on the text message in the resume line

Step 240: Add the subtitle signal to the video and audio signal according to the time information in the resume line to generate a multimedia resume

Step 281: Enter the target position

Step 283: Collect the image information of the target position

Step 285: Determine whether the resume script and/or resume lines match the image data

Step 287: Generate resume scripts and/or adjustment messages of resume lines based on the image data

Figure 1 is a system architecture diagram of the present invention for simulating video and audio playback based on scripts to generate multimedia resumes.

Figure 2A is a flow chart of the method of simulating video and audio playback based on scripts to generate multimedia resumes according to the present invention.

Figure 2B is a flow chart of the method for adjusting resume scripts or resume lines according to the image of the target post according to the present invention.

In the following, the features and implementation of the present invention will be described in detail with the drawings and embodiments. The content is sufficient to enable any person familiar with the relevant art to easily and fully understand the technical means used by the present invention to solve the technical problems and implement them accordingly. The achievable effect of the present invention.

The invention can generate multimedia resumes based on resume scripts and resume lines. Among them, multimedia resumes are audio-visual files.

Hereinafter, the system structure diagram of the simulation of video and audio playback based on scripts to generate multimedia resumes mentioned in the present invention is used to illustrate the operation of the system of the present invention. As shown in "Figure 1", the system of the present invention includes an input module 110, an analog playback module 120, a subtitle generation module 130, a resume generation module 150, and an additional voice generation module 140, a feature judgment module Group 170, image collection module 180, and history adjustment module 190.

The input module 110 is responsible for inputting the history script and the history lines. The input module 110 may provide an editing interface to edit the resume script and/or resume lines, and may also provide a selection to complete the editing of the resume script and/or resume lines.

One or more audiovisual files are recorded in the history script input by the input module 110. More specifically, the storage location of the audiovisual files can be recorded in the history script. Among them, the audio-visual files include but are not limited to video files, dynamic objects, sound effect files, special effects files, etc., and the audio-visual files can be stored in the computing device implementing the present invention or stored on a storage host external to the present invention.

The resume lines input by the input module 110 include one or more lines, and each line includes a text message and a time message corresponding to the text message. The text message contained in the resume line can be a single word, phrase, or sentence, but the present invention is not limited to this. Any text that can express a specific message can be used as the text message of the present invention; the time contained in the resume line The data is the time point when the corresponding text data is sent out and/or displayed in the video signal.

The input module 110 can also edit the video and audio files recorded in the resume script.

The input module 110 can also input the target position. The input module 110 can select the user to input the target position through one or more menus, and the target position input by the input module 110 is the job position that the user wants to apply for.

The simulation playback module 120 is responsible for loading the audiovisual files recorded in the resume script. The analog playback module 120 can obtain the audiovisual file from the storage location of the audiovisual file recorded in the resume script, thereby loading the audiovisual file.

The simulation playing module 120 is also responsible for simulating playing the audiovisual files recorded by the history script according to the timing of the history script input by the input module 110, and outputting the audiovisual signals generated by the simulated playing of the audiovisual files to the history generating module 150. For example, the analog playback module 120 can continuously generate blank video and audio signals and send the generated video and audio signals to the history generation module 150. At the same time, the simulation playback module 120 can also decode the corresponding video and audio files according to the timing of the history script. In order to generate file audio and video signals, the audio and video signals generated by decoding the audio and video files can be superimposed on the specific area of the generated blank audio and video signals according to the settings of the audio and video files in the resume script, instead of directly decoding the files generated by the audio and video files The video and audio signal is provided to the video and audio playback module (not shown in the figure) of the computing device implementing the present invention, so that the file video and audio signal is generated but not actually played. However, the analog playback module 120 simulates the playback of the video and audio files in a manner other than the above Is limited.

It should be specially noted that the simulation playback module 120 can simulate playing multiple audiovisual files at the same time according to the timing of the resume script, or it can simulate playing one or more audiovisual files first, and complete the simulation playback on one or more audiovisual files among them. Before simulating, play one or more other video and audio files. In other words, the analog playback module 120 can decode multiple audio and video files at the same time to generate multiple different file audio and video signals, and can superimpose each file audio and video signal into different areas of the generated blank audio and video signals, so as to output to The video and audio signal of the history generating module 150 includes a plurality of different file video and audio signals generated by the analog playback module 120 simultaneously decoding multiple video and audio files.

The subtitle generation module 130 is responsible for generating subtitle signals based on each text message contained in the resume line and the corresponding time message. For example, the subtitle generation module 130 can be used in the analog playback module When the elapsed time 120 for analog playback matches the time message corresponding to the text message, the text message corresponding to the time message that matches the elapsed time of the analog playback is provided to the history generating module 150.

The voice generation module 140 can generate a voice signal according to each text message contained in the resume line and the corresponding time message. For example, the voice generating module 140 can sequentially read the voice signals representing the pronunciation of the text contained in the text message, and connect the read voice signals one by one into voice signals. Among them, the voice generating module 140 can also read the voice signals in the text messages. When the text arranged before and after in the message satisfies certain conditions (for example, the rehearsed text is a word), the interval of connecting the sound signal indicating the pronunciation of the word is shortened, but the way of generating the speech signal by the speech generating module 140 is not The above is limited.

The voice generating module 140 may also indicate the voice of the text message corresponding to the time message corresponding to the time message corresponding to the elapsed time of the analog playback when the elapsed time for the analog playback module 120 to perform the simulation matches the time message corresponding to the text message. The signal is provided to the history generating module 150.

The history generation module 150 is responsible for adding the subtitle signal generated by the subtitle generation module 130 to the video and audio signal output by the analog playback module 120 to generate a multimedia history. In other words, the multimedia resume generated by the resume generating module 150 can present the text messages contained in the resume lines.

The history generation module 150 can also add the voice signal generated by the voice generation module 140 to the audiovisual signal output by the analog playback module 120 to generate a multimedia history. That is to say, the text messages contained in the resume lines can be included in the multimedia resume generated by the resume generation module 150 through voice expressions.

The trait judging module 170 can judge personal traits through question and answer tests.

The image collection module 180 can collect the image data of the target position input by the input module 110. The image data of the target position collected by the image collection module 180 includes, but is not limited to, the dressing style, speech tone, and action posture of the person whose job is the target position.

The image collection module 180 can read pre-stored image data of the target position from the storage medium (not shown on the way) of the computing device implementing the present invention, or it can connect to the external storage host of the present invention to download the image data of the target position , Or you can connect to the search engine to query the image of the person whose job is the target position, and perform image recognition on the queried image, so as to obtain image data such as the person's dress, movement and/or posture in the image. However, the way in which the image collection module 180 obtains the image data is not limited to the above.

The resume adjustment module 190 can also determine whether the resume script and/or resume lines match the image data collected by the image collection module 180, and can generate a resume based on the image data when the resume script and/or resume lines do not conform to the image data Script and/or resume line adjustment information.

For example, the resume adjustment module 190 can compare the image data with the actions and/or postures of the characters in each scene recorded in the resume script, and can also compare the image data with each video and audio file recorded in the resume script. The clothes, movements, and/or postures of the characters in it can be used to determine whether the resume script matches the image data. Among them, the resume adjustment module 190 can perform image recognition on the frames in the audio and video files, so as to obtain the images of the characters in the frames, and then generate characteristic information based on the obtained images of the characters, and compare the generated characteristic information and calculations. The characteristic data of various clothing stored in the device 100 can be used to determine the person’s wear. Similarly, the resume adjustment module 190 can also compare the generated characteristic information with the characteristic information pre-stored in the computing device implementing the present invention or external to the present invention. The feature data of various actions/postures on the storage host is used to determine the action and/or posture of the character, but the way that the resume adjustment module 190 obtains the wear, action and/or posture of the character from the audio-visual file is not based on the above limit.

Next, an embodiment is used to explain the operating system and method of the present invention, and please refer to "Figure 2A" for the flow chart of the method of simulating video and audio playback based on scripts in the present invention to generate multimedia resumes.

First, the input module 110 can provide the user to input a resume script and resume lines (step 210). In this embodiment, it is assumed that the input module 110 can provide a user interface, so that the user can select the edited resume script and/or resume lines in the user interface, or edit the resume script and the resume script in the user interface. / Or resume lines, even, the user can also choose to use pre-stored audio and video files in the resume script in the user interface, or the currently uploaded self-photographed or edited audio and video files.

After the input module 110 inputs the resume script and resume lines (step 210), the simulation playback module 120 can simulate the audio and video files used in the resume script according to the time sequence recorded in the resume script input by the input module 110, thereby Output audio and video signals (step 220). In this embodiment, it is assumed that the analog playback module 120 can decode one or more audio and video files one by one according to the time sequence recorded in the history script to generate the file audio and video signal, and can perform file audio and video signals according to the time sequence recorded in the history script. The file setting defines the display area of the generated file video and audio signal, and provides the video and audio signal to the history generation module 150.

Similarly, after the input module 110 inputs the resume script and resume lines (step 210), the subtitle generation module 130 can generate a subtitle signal according to the text information in the resume lines input by the input module 110 (step 230).

In fact, the analog playback module 120 simulates the audio and video files used in the history script to output the audio and video signals (step 220) and the subtitle generation module 130 generates the subtitle signals based on the history lines (step 220). Step 230) The two steps are not related in sequence, that is, the subtitle generating module 130 may first generate the subtitle signal, and then the analog playback module 120 may output the video and audio signal.

After the analog playback module 120 simulates the audio and video files used in the resume script to output the audio and video signals (step 220) and the subtitle generation module 130 generates the subtitle signals according to the resume lines (step 230), the resume generation module 150 can use the resume lines Add the subtitle signal generated by the subtitle generating module 130 to the video and audio signal output by the analog playback module 120 (step 240). In this way, through the present invention, a history script can be used to generate a multimedia history.

In the above embodiment, if the voice generation module 140 is further included, after the input module 110 inputs the resume script and the resume lines (step 210), the voice generation module 130 can be based on the resume lines input by the input module 110 The text message generates a voice signal, and the history generation module 150 can also add the subtitle signal generated by the subtitle generation module 130 to the video and audio signal output by the analog playback module 120 according to the time information of the history line (step 240). The time message of the resume line adds the voice signal to the video signal.

In addition, if the above embodiment further includes the image collection module 180 and the history adjustment module 190, the process shown in "Figure 2B" can be performed before the input module 110 inputs the history script and the history lines (step 210) Or afterwards, the input module 110 can provide the user to input the target position (step 281), and the image collection module 180 can collect the image data of the target position (step 283). In this embodiment, it is assumed that the image collection module 180 can connect to the website of the company that provides the target position to search for the name of the employee belonging to the target position, and search for the employee’s photo containing the target position and the target position based on the employee’s name through the search engine. Documents related to the speech or performance of the employees, image analysis of the searched photos and contextual analysis of the searched related documents, in order to obtain the image data of the target position.

Then, after the input module 110 inputs the history script and the history lines (step 210), the history adjustment module 190 can determine whether the history script and/or the history lines output by the input module 110 match those obtained by the image collection module 170 Image data (step 285). If so, the history adjustment module 190 may not generate the adjustment message; and if the history adjustment module 190 determines that the history script and/or the history lines do not conform to the image data, the history adjustment module 190 may generate the history script and/or based on the image data The adjustment message of the history line (step 287).

To sum up, it can be seen that the difference between the present invention and the prior art is that it has the ability to load and simulate audio-visual files according to the timing of the resume script to generate audio-visual signals, and generate subtitle signals based on the text messages in the resume lines, and then according to the resume lines The time information in is a technical means to add subtitle signals to the audio and video signal to generate multimedia resumes. This technical means can solve the problem of the prior art that requires familiarity with audio-visual editing software to make multimedia resumes, and then achieve the creation of multimedia with text descriptions. The technical effect of the resume.

Furthermore, the method of simulating video and audio playback based on scripts of the present invention to generate multimedia resumes can be implemented in hardware, software, or a combination of hardware and software, and can also be implemented in a centralized manner in a computer system or distributed in different components. Several interconnected computer systems are implemented in a decentralized manner.

Although the embodiments of the present invention are disclosed as above, the content described is not intended to directly limit the scope of patent protection of the present invention. Any person with ordinary knowledge in the technical field to which the present invention belongs, without departing from the spirit and scope of the present invention, makes slight modifications to the form and details of the implementation of the present invention, all belong to the patent protection of the present invention. range. The scope of patent protection of the present invention shall still be determined by the scope of the attached patent application.

Step 210 Enter the resume script and resume lines Step 220 Simulate playback of audio and video files according to the timing of the resume script to output audio and video signals Step 230 Generate a subtitle signal based on the text message in the resume line Step 240 Add the subtitle signal to the video and audio signal according to the time information in the resume line to generate a multimedia resume

Claims (10)

A method for generating multimedia resumes by simulating video and audio playback based on scripts is applied to a computing device. The method includes at least the following steps: inputting a resume script and a resume line, the resume script records at least one audiovisual file, and the resume line includes at least A text message and a corresponding time message; a blank video and audio signal is continuously generated, and when the blank video and audio signal is generated, the file video and audio signal generated by decoding the at least one video and audio file according to the timing of the resume script is superimposed on the blank video and audio In the signal, an audio-visual signal is output; a subtitle signal is generated according to the at least one text message; and the subtitle signal is added to the audio-visual signal according to the time information to generate a multimedia history. As described in item 1 of the scope of patent application, the method for generating multimedia history by simulating video and audio playback based on a script, wherein the method further includes based on the at least one text message before the step of adding the subtitle signal to the video and audio signal based on the time information Generating a voice signal, and adding the subtitle signal to the audio-visual signal according to the time message, further includes adding the audio signal to the audio-visual signal according to the time message. As described in item 1 of the scope of patent application, the method for generating multimedia resumes by simulating audio-visual playback based on a script, wherein the file audio-visual signal generated by decoding the at least one audio-visual file according to the timing of the resume script is superimposed on the blank audio-visual signal The step is to superimpose the at least one file video signal in the specific area of the blank video signal according to the setting of the at least one video file in the resume script. As described in item 1 of the scope of patent application, the method of simulating video and audio playback based on scripts to generate multimedia resumes, wherein the method further includes inputting a target position and reading it from the computing device or recognizing the image downloaded from the outside. The image of the person in the target position, and/or the external download based on the textual analysis The speech and/or related documents of the person in the target position are contained to collect an image data of the target position, and image recognition is performed on an image of a person in the at least one audiovisual file to obtain a characteristic information of the person image , And compare the image data and the characteristic information to determine whether the resume script and/or resume lines match the image data. When the resume script and/or resume lines do not match the image data, generate based on the image data The steps of the resume script and/or the adjustment message of the resume lines. For example, the method of simulating video and audio playback based on a script to generate a multimedia resume as described in item 1 of the scope of patent application, wherein the step of inputting the resume script and the resume lines further includes editing the resume script, the resume lines, and/or the at least one Steps for audio and video files. A system for generating multimedia resumes by simulating video playback based on scripts is applied to a computing device. The system at least includes: an input module for inputting a resume script and a resume line, and at least one video file is recorded in the resume script, The resume line includes at least one text message and a corresponding time message; an analog playback module for decoding the at least one audiovisual file according to the timing of the resume script to generate at least one file audiovisual signal, and for continuously generating a blank A video and audio signal, and when generating the blank video and audio signal, superimpose the at least one file video and audio signal on the blank video and audio signal to output a video and audio signal; a subtitle generation module for generating a subtitle signal based on the at least one text message; And a history generation module for adding the subtitle signal to the video and audio signal according to the time information to generate a multimedia history. As described in item 6 of the scope of patent application, the system for generating multimedia resumes by simulating video and audio playback based on a script, wherein the system further includes a voice generation module for generating a voice based on the at least one text message A voice signal is generated based on the information, and the history generation module is further used for adding the voice signal to the video and audio signal according to the time information to generate a multimedia history. For example, the system for generating multimedia history by simulating audio and video playback based on a script as described in item 6 of the scope of patent application, wherein the simulation playback module superimposes the at least one file audio and video signal on the at least one audio and video file based on the setting of the history script for the at least one audio and video file In the specific area of the blank video and audio signal, the video and audio signal is generated. For example, the system for generating multimedia resumes by simulating video and audio playback based on scripts described in item 6 of the scope of patent application, wherein the system further includes an image judging module and a resume adjustment module, and the image collection module is used by the computing device Read or use the image to identify the image of a person in the target position input by the input module downloaded from the outside, and/or analyze the speech and/or related documents of the person in the target position downloaded from the outside with the context , In order to collect an image data of the target position, the resume adjustment module is further used to perform image recognition on a character image in the at least one audio-visual file to obtain a characteristic information of the character image, and compare the image data And the characteristic information to determine whether the resume script and/or resume lines match the image data, and when it is determined that the resume script and/or resume lines do not match the image data, generate the resume script and/or based on the image data Or the adjustment message of the resume line. For example, the system for generating multimedia resumes by simulating video and audio playback based on scripts described in item 6 of the scope of patent application, wherein the input module is further used to edit the resume script, the resume lines, and/or the at least one video file.

Images