CN105681713A

CN105681713A - Video recording method, video recording device and mobile terminal

Info

Publication number: CN105681713A
Application number: CN201610005052.7A
Authority: CN
Inventors: 吴林波
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2016-01-04
Filing date: 2016-01-04
Publication date: 2016-06-15

Abstract

The invention discloses a video recording method. The video recording method comprises the following steps of: after a mobile terminal starts a recording function, obtaining video data and audio data, marking a recorded first timestamp for the video data, coding the video data to generate a video data packet, marking a recorded second timestamp for the audio data, and coding the audio data to generate an audio data packet; obtaining geographical position information recorded by the mobile terminal every a preset time, and marking a recorded third timestamp for the geographical position information; and writing the video data packet, the audio data packet and the geographical position information in a recorded file, such that the mobile terminal plays back the recorded file according to the sequence of the first timestamp, the second timestamp and the third timestamp. The invention further discloses a video recording device and the mobile terminal. According to the invention, the continuous geographical position information of the mobile terminal is recorded when a video is recorded; and thus, the association convenience of the recorded audio/video and the geographical position is improved.

Description

Video recording method, device and mobile terminal

Technical field

The present invention relates to mobile terminal device technical field, particularly relate to a kind of video recording method, device and mobile terminal.

Background technology

Video record is usually mobile terminal and obtains video data by photographic head, and obtains voice data by mike, and video data is encoded with voice data post package respectively becomes a video file. This video file is generally only with video and two kinds of information of audio frequency, or adds caption information, and can not record more information. Such as, when user needs to record geographical location information passed during video record, the video record technology of existing mobile terminal can provide the method for one geo point of a videograph, but easily the audio frequency and video of recording and geographical position can not be associated, and the multiple geographical track that whole shooting is experienced can not be recorded.

Summary of the invention

Present invention is primarily targeted at a kind of video recording method of offer, device and mobile terminal, it is intended to realize recording the continuous geographical location information that mobile terminal is passed when carrying out video record.

For achieving the above object, the invention provides a kind of video recording device, including:

Audio frequency and video acquisition module, for after mobile terminal opens recording function, obtain video data and voice data, for the very first time stamp that described video data labelling is recorded, and described coding video data is generated video data bag, and for the second timestamp that described voice data labelling is recorded, and it is encoded described voice data generating packets of audio data;

Position information acquisition module, for obtaining, every Preset Time, the geographical location information that described mobile terminal is recorded, for the 3rd timestamp that described geographical location information labelling is recorded;

Mixing generation module, for described video data bag, described packets of audio data and described geographical location information are write recorded file, to record with the video of continuous geographical location information, for described mobile terminal according to the described very first time stab, the sequencing described recorded file of playback of described second timestamp and described 3rd timestamp.

Alternatively, described mixing generation module is additionally operable to, based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, by described video data bag, described packets of audio data and described geographical location information according to time order and function order mixing write recorded file.

Alternatively, described mixing generation module is additionally operable to, stab and described second timestamp based on the described very first time corresponding to described video data and described voice data, by described video data bag and described packets of audio data according to time order and function order mixing write video file, described geographical location information is sequentially written in geographical location information file according to described 3rd timestamp; And after receiving end record command, described video file and described geographical location information file are carried out splicing write recorded file.

Alternatively, described video recording device also includes:

Module is set, is used for receiving user setup instruction, according to described user setup instruction, the described prefixed time interval obtaining described geographical location information is configured.

Additionally, for achieving the above object, present invention also offers a kind of mobile terminal, described mobile terminal includes the video recording device of said structure.

Additionally, for achieving the above object, present invention also offers a kind of video recording method, including:

After mobile terminal opens recording function, obtain video data and voice data, for the very first time stamp that described video data labelling is recorded, and described coding video data is generated video data bag, and for the second timestamp that described voice data labelling is recorded, and it is encoded described voice data generating packets of audio data;

The geographical location information that described mobile terminal is recorded is obtained, for the 3rd timestamp that described geographical location information labelling is recorded every Preset Time;

Described video data bag, described packets of audio data and described geographical location information are write recorded file, to record with the video of continuous geographical location information, for described mobile terminal according to the described very first time stab, the sequencing described recorded file of playback of described second timestamp and described 3rd timestamp.

Alternatively, described video data bag, described packets of audio data and described geographical location information are write recorded file to include:

Based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, by described video data bag, described packets of audio data and described geographical location information according to time order and function order mixing write recorded file.

Alternatively, based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, described video data bag, described packets of audio data and described geographical location information are included according to after time order and function order mixing write recorded file:

Judge whether to detect end record command;

If so, then terminate to record;

If not, then continue obtain video data, voice data and geographical location information and indicate the timestamp of correspondence respectively, to continuing the video data that acquires and voice data is encoded obtaining video data bag and packets of audio data, the video data bag, packets of audio data and the geographical location information that obtain are sequentially written in described recorded file according to time order and function.

Stab and described second timestamp based on the described very first time corresponding to described video data and described voice data, by described video data bag and described packets of audio data according to time order and function order mixing write video file, described geographical location information is sequentially written in geographical location information file according to described 3rd timestamp;

After receiving end record command, described video file and described geographical location information file are carried out splicing write recorded file.

Alternatively, the described geographical location information obtaining the recording of described mobile terminal every Preset Time, include for before the 3rd timestamp that described geographical location information labelling is recorded:

Receive user setup instruction, according to described user setup instruction, the described prefixed time interval obtaining described geographical location information is configured.

The video recording method of embodiment of the present invention offer or device, carry out in the process of video record at mobile terminal, the very first time stamp that the video data labelling got is recorded, and this coding video data is generated video data bag, and to the second timestamp that the voice data labelling got is recorded, and it is encoded this voice data generating packets of audio data. Simultaneously, the geographical location information that mobile terminal is recorded is obtained every Preset Time, for the 3rd timestamp that geographical location information labelling is recorded, then video data bag, packets of audio data and geographical location information are write recorded file, to record with the video of continuous geographical location information, mobile terminal can stab according to the very first time, the sequencing playback recorded file of the second timestamp and the 3rd timestamp. It is achieved thereby that record the passed continuous geographical location information of mobile terminal when carrying out video record, and improve mobile terminal the audio frequency and video of recording and geographical position are associated ground convenience.

Accompanying drawing explanation

Fig. 1 is the hardware architecture diagram realizing each one optional mobile terminal of embodiment of the present invention;

Fig. 2 is the radio communication device schematic diagram of mobile terminal as shown in Figure 1;

Fig. 3 is the high-level schematic functional block diagram of video recording device one embodiment of the present invention;

Fig. 4 is that video data bag, packets of audio data and geographical location information are write the first structural representation of recorded file by the present invention;

Fig. 5 is that video data bag, packets of audio data and geographical location information are write the second structural representation of recorded file by the present invention;

Fig. 6 is the high-level schematic functional block diagram of another embodiment of video recording device of the present invention;

Fig. 7 is the schematic flow sheet of video recording method one embodiment of the present invention;

Fig. 8 is the schematic flow sheet of another embodiment of video recording method of the present invention.

The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.

Detailed description of the invention

Should be appreciated that specific embodiment described herein is only in order to explain the present invention, is not intended to limit the present invention.

The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing. In follow-up description, use the suffix being used for representing such as " module ", " parts " or " unit " of element only for being conducive to the explanation of the present invention, itself do not have specific meaning. Therefore, " module " and " parts " can mixedly use.

Mobile terminal can be implemented in a variety of manners. Such as, the terminal described in the present invention can include the mobile terminal of such as mobile phone, smart phone, notebook computer, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as numeral TV, desk computer etc. Hereinafter it is assumed that terminal is mobile terminal. However, it will be understood by those skilled in the art that, except being used in particular for the element of mobile purpose, structure according to the embodiment of the present invention can also apply to the terminal of fixed type.

Fig. 1 is the hardware architecture diagram realizing each one optional mobile terminal of embodiment of the present invention.

Mobile terminal 100 can include wireless communication unit 110, A/V input block 120, user input unit 130, output unit 140, memorizer 150, controller 160, power subsystem 170 and interface unit 180 etc. Fig. 1 illustrates the mobile terminal with various assembly, it should be understood that be not required for implementing all assemblies illustrated. Can alternatively implement more or less of assembly. Will be discussed in more detail below the element of mobile terminal.

Wireless communication unit 110 generally includes one or more assembly, and it allows the radio communication between mobile terminal 100 and radio communication device or network. Such as, wireless communication unit can include at least one in mobile communication module 111, wireless Internet module 112, short range communication module 113 and positional information module 114.

Mobile communication module 111 sends radio signals at least one in base station (such as, access point, node B etc.), exterior terminal and server and/or receives from it radio signal. Such radio signal can include voice call signal, video calling signal or the various types of data sending according to text and/or Multimedia Message and/or receiving.

Wireless Internet module 112 supports the Wi-Fi (Wireless Internet Access) of mobile terminal. This module can internally or externally be couple to terminal. Wi-Fi (Wireless Internet Access) technology involved by this module can include WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.

Short range communication module 113 is the module for supporting junction service. Some examples of short-range communication technology include bluetooth^TM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee^TMEtc..

Positional information module 114 is the module of positional information for checking or obtain mobile terminal. The typical case of positional information module 114 is GPS (global pick device). According to current technology, positional information module 114 calculates from the range information of three or more satellites and correct time information and the Information application triangulation for calculating, thus according to longitude, latitude with highly accurately calculate three-dimensional current location information. Currently, the method for calculating position and temporal information uses three satellites and the error by the position using an other satellite correction to calculate and temporal information. Additionally, positional information module 114 can calculate velocity information by Continuous plus current location information in real time.

A/V input block 120 is used for receiving audio or video signal. A/V input block 120 can include camera 121 and mike 122, and the view data of the camera 121 static images to being obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes. Picture frame after process may be displayed on display unit 141. Picture frame after camera 121 processes can be stored in memorizer 150 (or other storage medium) or be transmitted via wireless communication unit 110, it is possible to provide two or more cameras 121 according to the structure of mobile terminal. Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by mike 122.Audio frequency (voice) data after process can be converted to the form output that can be sent to mobile communication base station via mobile communication module 111 when telephone calling model. Mike 122 can implement various types of noise elimination (or suppression) algorithm to eliminate (or suppression) in the noise received and produce in the process of transmission audio signal or interference.

User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input. User input unit 130 allows user to input various types of information, and can include keyboard, metal dome, trigger board (such as, detection due to touched and cause resistance, pressure, electric capacity etc. the sensitive component of change), roller, rocking bar etc. Especially, when trigger board is superimposed upon on display unit 141 as a layer, it is possible to formed and trigger screen.

Interface unit 180 is used as at least one external device (ED) and is connected, with mobile terminal 100, the interface that can pass through. Such as, external device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port of the device with identification module, audio frequency input/output (I/O) port, video i/o port, ear port etc. Identification module can be that storage is for verifying that user uses the various information of mobile terminal 100 and can include subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc. It addition, the device (hereinafter referred to " identification device ") with identification module can take the form of smart card, therefore, identify that device can be connected with mobile terminal 100 via port or other connecting device. Interface unit 180 may be used for receiving from the input (such as, data message, electric power etc.) of external device (ED) and the one or more elements being transferred in mobile terminal 100 by the input received or may be used for transmission data between mobile terminal and external device (ED).

Additionally, when mobile terminal 100 is connected with external base, interface unit 180 can serve as and allows to provide the path of mobile terminal 100 or can serve as to allow to be transferred to the path of mobile terminal from the various command signals of base input by it from base electric power by it. May serve as whether identification mobile terminal is accurately fitted within the signal base from the various command signals of base input or electric power. Output unit 140 is configured to provide output signal (such as, audio signal, video signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.

Output unit 140 can include display unit 141 and dio Output Modules 142 etc., and display unit 141 may be displayed on the information processed in mobile terminal 100. Such as, when mobile terminal 100 is in telephone calling model, display unit 141 can show the user interface (UI) relevant with call or other communicate (such as, text messaging, multimedia file download etc.) or graphic user interface (GUI). When being in video calling pattern or image capture mode when mobile terminal 100, display unit 141 can show the image of image and/or the reception caught, UI or GUI illustrating video or image and correlation function etc.

Meanwhile, when display unit 141 and trigger board as a layer superposed on one another with formed triggering screen time, display unit 141 can serve as input equipment and output device.Display unit 141 can include at least one in liquid crystal display (LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. Some in these display may be constructed such that transparence is to allow user to watch from outside, and this is properly termed as transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc. According to the specific embodiment wanted, mobile terminal 100 can include two or more display units (or other display device), such as, mobile terminal can include outernal display unit (not shown) and inner display unit (not shown). Trigger screen can be used for detection triggering input pressure and trigger input position and trigger input area.

Dio Output Modules 142 can mobile terminal be in call signal receive under the isotype such as pattern, call mode, logging mode, speech recognition mode, broadcast reception mode time, that wireless communication unit 110 is received or storage in memorizer 150 voice data transducing audio signal and be output as sound. And, dio Output Modules 142 can provide the audio frequency output (such as, call signal receive sound, message sink sound etc.) relevant to the specific function of mobile terminal 100 execution. Dio Output Modules 142 can include pick up, buzzer etc.

Memorizer 150 can store the process performed by controller 160 and the software program controlling operation etc., or can temporarily store the data (such as, telephone directory, message, still image, video etc.) that oneself maybe will export through output. And, memorizer 150 can store the vibration about the various modes exported when triggering and being applied to and trigger screen and the data of audio signal.

Memorizer 150 can include the storage medium of at least one type, described storage medium includes flash memory, hard disk, multimedia card, card-type memorizer (such as, SD or DX memorizer etc.), random access storage device (RAM), static random-access memory (SRAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc. And, mobile terminal 100 can be connected the network storage device cooperation of the storage function performing memorizer 150 with by network.

Controller 160 generally controls the overall operation of mobile terminal. Such as, controller 160 performs the control relevant to voice call, data communication, video calling etc. and process. It addition, controller 160 can include the multi-media module 161 for reproducing (or playback) multi-medium data, multi-media module 161 can construct in controller 160, or it is so structured that separates with controller 160. Controller 160 can perform pattern recognition process, to be identified as character or image by drawing input in the handwriting input or picture that trigger execution on screen.

Power subsystem 170 receives external power or internal power under the control of controller 160 and provides the suitable electric power operated needed for each element and assembly.

Various embodiment described herein can to use such as computer software, hardware or its any combination of computer-readable medium to implement. Hardware is implemented, embodiment described herein can pass through to use application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, at least one that is designed to perform in the electronic unit of function described herein to implement, in some cases, such embodiment can be implemented in controller 160.Implementing for software, the embodiment of such as process or function can be implemented with allowing the independent software module performing at least one function or operation. Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in memorizer 150 and be performed by controller 160.

So far, oneself is through describing mobile terminal according to its function. Below, for the sake of brevity, by the slide type mobile terminal in the various types of mobile terminals describing such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily. Therefore, the present invention can be applied to any kind of mobile terminal, and is not limited to slide type mobile terminal.

Mobile terminal 100 as shown in Figure 1 may be constructed such that utilization operates via such as wired and radio communication device and the satellite-based communicator of frame or packet transmission data.

The communicator being wherein operable to according to the mobile terminal of the present invention is described referring now to Fig. 2.

Such communicator can use different air interfaces and/or physical layer. Such as, the air interface used by communicator includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications device (UMTS) (especially, Long Term Evolution (LTE)), global mobile communication device (GSM) etc. As non-limiting example, as explained below relates to cdma communication device, but such instruction is equally applicable to other type of device.

With reference to Fig. 2, cdma wireless communication device can include multiple mobile terminal 100, multiple base station (BS) 270, base station controller (BSC) 275 and mobile switching centre (MSC) 280. MSC280 is configured to form interface with Public Switched Telephony Network (PSTN) 290. MSC280 is also structured to and the BSC275 formation interface that can be couple to base station 270 via back haul link. Back haul link can construct according to any one in some interfaces that oneself knows, described interface includes such as E1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL. It will be appreciated that device as shown in Figure 2 can include multiple BSC275.

Each BS270 can service one or more subregion (or region), by each subregion of multidirectional antenna or the antenna covering pointing to specific direction radially away from BS270. Or, each subregion can be covered by two or more antennas for diversity reception. Each BS270 may be constructed such that support multiple frequencies distribution, and the distribution of each frequency has specific frequency spectrum (such as, 1.25MHz, 5MHz etc.).

Intersecting that subregion and frequency are distributed can be referred to as CDMA Channel. BS270 can also be referred to as the sub-device of base station transceiver (BTS) or other equivalent terms. In this case, term " base station " may be used for broadly representing single BSC275 and at least one BS270. Base station can also be referred to as " cellular station ". Or, each subregion of specific BS270 can be referred to as multiple cellular station.

As shown in Figure 2, broadcast singal is sent in device the mobile terminal 100 of operation by broadcsting transmitter (BT) 295. In fig. 2 it is shown that several global pick devices (GPS) satellite 300. Satellite 300 helps to position at least one in multiple mobile terminals 100.

In fig. 2, depict multiple satellite 300, but it is understood that, it is possible to use any number of satellite obtains useful location information. Substitute GPS tracking technique or outside GPS tracking technique, it is possible to use other technology of the position of mobile terminal can be followed the tracks of.It addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.

As a typical operation of radio communication device, BS270 receives the reverse link signal from various mobile terminals 100. Mobile terminal 100 generally participates in call, information receiving and transmitting communicates with other type of. Each reverse link signal that certain base station 270 receives is processed in specific BS270. The data obtained are forwarded to relevant BSC275. BSC provides call resource distribution and the mobile management function of the coordination of soft switching process included between BS270. The data received also are routed to MSC280 by BSC275, and it provides the extra route service for forming interface with PSTN290. Similarly, PSTN290 and MSC280 forms interface, and MSC and BSC275 forms interface, and BSC275 correspondingly controls BS270 so that forward link signals to be sent to mobile terminal 100.

Structure based on above-mentioned mobile terminal hardware configuration, communicator, it is proposed to each embodiment of the inventive method.

As shown in Figure 3, it is shown that one video recording device first embodiment of the present invention. The video recording device of this embodiment includes:

Audio frequency and video acquisition module 10, for after mobile terminal opens recording function, obtain video data and voice data, for the very first time stamp that described video data labelling is recorded, and described coding video data is generated video data bag, and for the second timestamp that described voice data labelling is recorded, and it is encoded described voice data generating packets of audio data;

In the present embodiment, the type of mobile terminal can be configured according to actual needs, for instance, this mobile terminal can be drive recorder, mobile phone, iPad, aerial photography device, camera etc. Mobile terminal is provided with photographic head, mike, navigation system, encoder, blender, memorizer etc., wherein, photographic head is used for gathering image information, and carries out analog digital conversion formation original video data (RAW data), plus timestamp and sends into video encoder for RAW data. Mike is used for gathering acoustic information, forms voice data (PCM data), plus timestamp and send into audio coder for PCM data after carrying out analog digital conversion. Encoder is divided into video encoder and audio coder, the coding video data that photographic head is sent into by video encoder, H.264 video encoder include, H.265, MPEG-4, VP8 etc., the video data after coding is sent into blender by video encoder. The voice data that mike is sent into by audio coder is encoded, and audio coder includes AAC, MP3, AMR etc., and the audio, video data after coding is sent into blender by audio coder. The navigation system geographical location information for being regularly taken in recording process mobile terminal place, i.e. latitude and longitude information (x, y), stamping timestamp for geographical location information and send into blender, navigation system can include GPS, Beidou navigation, GLONASS etc. The geographical location information that blender is sent into for the audio, video data sent into by encoder and navigation system, is packaged packing and writes file, and preserving in memory.

It should be noted that, in very first time stamp that the present invention mentions, the second timestamp, the 3rd timestamp first, second, third is for only for ease of to distinguish and obtains the timestamp that video data, voice data and geographical location information are each corresponding, not very first time stamp, the second timestamp, the 3rd timestamp are sort according to the sequencing of timestamp, obtain video data, voice data and geographical location information these three part are asynchronous to carry out simultaneously, each own respective timestamp, each partial interior just has the order of oneself.

After mobile terminal opens recording function, before starting recorded video, first do a little preparation for whole recording flow process, for instance, initialize photographic head, mike etc. After preparation completes, mobile terminal calls audio frequency and video acquisition module 10 to start to obtain image information by photographic head, the image information collected is carried out analog digital conversion is original video data, the very first time stamp recorded for video data labelling, and adopt and H.264 or H.265 wait video encoder to coding video data generation video data bag. Audio frequency and video acquisition module 10 starts to obtain acoustic information by mike simultaneously, and the acoustic information collected is carried out analog digital conversion is voice data, then the second timestamp recorded for audio, video data labelling, and be encoded generating packets of audio data to voice data by audio coders such as AAC or AMR.

It should be noted that very first time stamp and the second timestamp can be by the Beijing time of video record, for instance, when being from 8:00 to 10:00 between when recording, very first time stamp or the second timestamp can be 8:30. Can also be from the relative time that the time started when recording is 0 beginning timing, for instance, when being from the 0th to 10 minute between when recording, very first time stamp or the second timestamp can be the 5th minute that carries out recording.

Position information acquisition module 20, for obtaining, every Preset Time, the geographical location information that described mobile terminal is recorded, for the 3rd timestamp that described geographical location information labelling is recorded;

After proceeding by video record, while above-mentioned acquisition audio, video data, mobile terminal calling station data obtaining module 20 by the navigation system such as GPS or Beidou navigation to carry out the extraction of geographical location information every Preset Time, this geographical location information can be latitude and longitude information, and this Preset Time can be arranged as the case may be and flexibly. Such as, the mobile terminal currently carrying out recording is in " Shenzhen University ", and the geographical location information that navigation system acquires is (113.943044,22.5407). Simultaneously by the 3rd current recorded for the geographical location information mark of acquisition timestamp, the 3rd timestamp and the very first time mentioned above stamp and the second timestamp to arrange form consistent, may be configured as the relative time of Beijing time or recording.

Mixing generation module 30, for described video data bag, described packets of audio data and described geographical location information are write recorded file, to record with the video of continuous geographical location information, for described mobile terminal according to the described very first time stab, the sequencing described recorded file of playback of described second timestamp and described 3rd timestamp.

Mobile terminal is by video data bag obtained above, packets of audio data and geographical location information, encapsulated in write recorded file by mixing generation module 30 according to the format standard of video container, and carry out being stored in memorizer, to facilitate preservation and transmission, the format standard of this video container can include the forms such as mp4, mkv, rmvb, avi. Then judge whether to detect the instruction terminating to record, record, if not detecting, the instruction terminated, then circulation performs above-mentioned steps S10 to step S30, carries out the acquisition of audio, video data and geographical location information, and indicate corresponding timestamp respectively, write recorded file. If detecting recording END instruction, then terminating to record, terminating photographic head, mike, navigation system etc. and no longer carrying out data acquisition.

The recorded file obtained contains continuous print audio track (AudioTrack), video track (VideoTrack), geographical location information rail (LocTrack) etc., it is achieved that record the video with continuous geographical location information.Mobile terminal, when carrying out video playback, plays back this recorded file according to the sequencing of very first time stamp, the second timestamp and the 3rd timestamp. Making to contain, in the video file generated, the continuous geographical location information sequence that mobile terminal is passed in recording process, so when playing back video, user can check geographical location information passed during recorded video.

Hereinafter will be illustrated, in one embodiment, as shown in Figure 4, it it is a structural representation carrying out video record generation recorded file, video data bag, packets of audio data and geographical location information these three data, by the standard of video container, are carried out intersection and deposit to recorded file by mobile terminal, and video file head is write in the beginning in recorded file, after receiving the instruction terminating to record, finally write video file tail in recorded file. Specifically, in Fig. 4, Video represents video data bag, and Audio represents that packets of audio data, Loc represent geographical location information data bag. According to the time order and function order obtained, in the process obtaining video data, voice data and geographical location information, first the video data bag Video got is write recorded file, again the geographical location information Loc got is write recorded file, then the packets of audio data Audio got by future time writes recorded file, constantly it is circulated acquisition data and mixes write recorded file, until just stopping when receiving end record command recording. When making route passed during user needs record video record, can so that checking the geographical location information that recorded video associates, such as, after drive recorder utilizes the method that this programme provides to carry out recorded video, traffic route can be checked very easily when playback, and can know the picture of certain time point of video is recorded on which geographical position.

In another embodiment, as shown in Figure 5, carry out video record for another and generate the structural representation of recorded file, mobile terminal is by the standard of video container, first by video data bag and voice data mixed storage to video file, video file head is write in beginning at video file, finally writes video file tail at video file. Geographical location information is deposited to geographical location information file, then the afterbody by geographical location information file splicing to video file, forms recorded file. Specifically, in Fig. 5, Video represents video data bag, and Audio represents that packets of audio data, Loc represent geographical location information data bag. According to the time order and function order obtained, in obtaining video data and voice data process, first the video data bag Video got is write video file, again the packets of audio data Audio got is write video file, then the packets of audio data Audio got by future time writes video file, is constantly circulated acquisition data and mixes write video file. Similarly, geographical location information Loc is write geographical location information file according to the sequencing of time by circulation successively. Until stopping recording when receiving end record command, and geographical location information file is spliced after video file, to form recorded file. It is understood that also geographical location information file can be spliced before video file, when playing back recorded file, transfer out audio, video data successively according to the sequencing of time or geographical location information file plays out. Achieve recording with continuous geographical location information video, solve the problem that existing mobile terminal cannot record the geographical position variation track of captured video process.

It should be noted that, the order of Fig. 4 and Fig. 5 is only an example, in practical situation can according to video data, voice data, this three part of geographical location information is simultaneously asynchronous carries out, which first asks write file, then lock write, write after action completes, then discharge locking, other partial write request below just can be allowed to, and namely Video, Audio, Loc enter the order of write recorded file is indefinite.

The embodiment of the present invention carries out in the process of video record at mobile terminal, the very first time stamp that the video data labelling got is recorded, and this coding video data is generated video data bag, and to the second timestamp that the voice data labelling got is recorded, and it is encoded this voice data generating packets of audio data. Simultaneously, the geographical location information that mobile terminal is recorded is obtained every Preset Time, for the 3rd timestamp that geographical location information labelling is recorded, then video data bag, packets of audio data and geographical location information are write recorded file, to record with the video of continuous geographical location information, mobile terminal can stab according to the very first time, the sequencing playback recorded file of the second timestamp and the 3rd timestamp. Thus enriching the information that mobile terminal is carried by when carrying out video record, in the process carrying out video record, the geographical location information at recordable mobile terminal place while acquisition audio frequency and video, and undertaken geographical location information and audio, video data combining formation recorded file. Make the recorded file generated contain the continuous geographical location information sequence of mobile terminal, geographical location information passed during recorded video can be checked when playing back video. Achieve and record the passed continuous geographical location information of mobile terminal when carrying out video record, and improve mobile terminal the audio frequency and video of recording and geographical position are associated ground convenience.

Further, based on above-mentioned first embodiment, propose video recording device the second embodiment of the present invention, in this embodiment, above-mentioned mixing generation module 30 is additionally operable to, based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, by described video data bag, described packets of audio data and described geographical location information according to time order and function order mixing write recorded file.

In the present embodiment, when the video data bag obtained, packets of audio data and geographical location information are write recorded file, mixing generation module 30 can stab based on the very first time corresponding to video data, the second timestamp corresponding to voice data, and the 3rd timestamp corresponding to geographical location information, by video data, voice data and geographical location information according to the time order and function order obtained, the format standards such as mp4, mkv, rmvb, the avi according to video container are packaged, and mixing writes in recorded file and stores.

Further, mobile terminal is in the process carrying out video record, and mixing generation module 30 is additionally operable to, it may be judged whether detect end record command; If so, then terminate to record; If not, then continue obtain video data, voice data and geographical location information and indicate the timestamp of correspondence respectively, to continuing the video data that acquires and voice data is encoded obtaining video data bag and packets of audio data, the video data bag, packets of audio data and the geographical location information that obtain are sequentially written in described recorded file according to time order and function.

When carrying out video playback, mobile terminal can be sequentially carried out broadcasting according to the time order and function order of storage, to realize recording the video with continuous geographical location information. as shown in Figure 4, by video data bag, packets of audio data and geographical location information these three data carry out intersection and deposit to recorded file, video file head is write in beginning in recorded file, first the video data bag Video got is write recorded file, again the geographical location information Loc got is write recorded file, then the packets of audio data Audio got by future time writes recorded file, constantly it is circulated acquisition data and mixes write recorded file, until stopping recording when receiving end record command, video file tail is finally write in recorded file.

Video data, voice data and geographical location information according to each corresponding timestamp, are write recorded file according to the mixing of time order and function sequence crossover by the present embodiment. Improve mobile terminal and the audio frequency and video of recording and geographical position are associated ground convenience, it is achieved that record with continuous geographical location information video, solve the problem that existing mobile terminal cannot record the geographical position variation track of captured video process.

Further, based on above-mentioned first embodiment, propose video recording device the 3rd embodiment of the present invention, in this embodiment, above-mentioned mixing generation module 30 is additionally operable to, stab and described second timestamp based on the described very first time corresponding to described video data and described voice data, by described video data bag and described packets of audio data according to time order and function order mixing write video file, described geographical location information is sequentially written in geographical location information file according to described 3rd timestamp; And after receiving end record command, described video file and described geographical location information file are carried out splicing write recorded file.

In the present embodiment, mobile terminal, by the voice data got and video data, carries out separating process with geographical location information. Specifically, mixing generation module 30 stabbed based on the very first time corresponding to video data, the second timestamp corresponding to voice data, video data bag and packets of audio data are write video file according to the mixing of time order and function order, now no longer geographical location information is carried out mixed processing, namely according to being packaged by format standards such as mp4, mkv, rmvb, avi of video container, packets of audio data and video data bag are write video file and carry out storing (not comprising geographical location information). It addition, the geographical location information got every Preset Time is sequentially written in geographical location information file according to the 3rd timestamp. Judge whether to detect end record command, if not detecting end record command, then continue cycling through acquisition data and carry out respective handling and store. When detecting end record command, terminate to record, and the video file obtained and geographical location information file are carried out splicing write recorded file. Geographical location information file can be spliced after video file, thus not affecting the stored various information of former video file. As it is shown in figure 5, by video data bag and voice data mixed storage to video file, video file head is write in the beginning at video file, finally write video file tail at video file. Geographical location information is deposited to geographical location information file, after completion of recording again by the afterbody of geographical location information file splicing to video file, forms recorded file.

The present embodiment is in recorded video process, by the voice data got and video data, merges carry out separating process with geographical location information after. Acquisition time sequencing mixing write video file according to video data bag and packets of audio data, interval Preset Time is got geographical location information and is stored into geographical location information file, video file and geographical location information file are being spliced in write recorded file. Improve mobile terminal and the audio frequency and video of recording and geographical position are associated ground convenience, it is achieved that record the continuous geographical location information that mobile terminal is passed when carrying out video record.

Further, as shown in Figure 6, based on above-mentioned first embodiment, it is proposed that video recording device the 4th embodiment of the present invention, in this embodiment, above-mentioned video recording device also includes:

Module 40 is set, is used for receiving user setup instruction, according to described user setup instruction, the described prefixed time interval obtaining described geographical location information is configured.

In the present embodiment, before carrying out video record, geographical location information is obtained by the optional Preset Time utilizing acquiescence, or according to practical situation when needing to change the prefixed time interval obtaining geographical location information, user can be arranged interface can this Preset Time be set what specify, in order to arranges module 40 and according to the user setup instruction received, this Preset Time is set. For example, it is assumed that user's hand-held mobile terminal is walked carries out video record, can being set to by Preset Time 1 minute, now navigation system obtained a geographical location information every one minute. When mobile terminal carry carries out long video record on unmanned plane, this Preset Time can be updated to 1 second by user, and now navigation system obtained a geographical location information every one second. Make rationally to be arranged according to different situations by the interval of acquisition geographical location information, achieve recording with continuous geographical location information video, during user needs record video record during passed route, it is possible to be easy to check the geographical location information that recorded video associates. Certainly, the present embodiment may be based on above-mentioned second or the 3rd implement propose.

The present embodiment is by arranging flexibly the prefixed time interval obtaining geographical location information, make mobile terminal can obtain geographical location information according to different recording situations in good time, achieve and record the continuous geographical location information that mobile terminal is passed when carrying out video record, enrich the information that mobile terminal is carried by when carrying out video record.

Accordingly, it is proposed to one mobile terminal of the present invention, this mobile terminal includes the video recording device of said structure, namely includes audio frequency and video acquisition module 10, position information acquisition module 20 and mixing generation module 30 etc. This mobile terminal can be mobile phone, iPad, camera etc.

Accordingly, as shown in Figure 7, it is proposed to one video recording method first embodiment of the present invention. The video recording method of this embodiment includes:

Step S10, open after recording function at mobile terminal, obtain video data and voice data, for the very first time stamp that described video data labelling is recorded, and described coding video data is generated video data bag, and for the second timestamp that described voice data labelling is recorded, and it is encoded described voice data generating packets of audio data;

In the present embodiment, the type of mobile terminal can be configured according to actual needs, for instance, this mobile terminal can be drive recorder, mobile phone, iPad, aerial photography device, camera etc. Mobile terminal is provided with photographic head, mike, navigation system, encoder, blender, memorizer etc., wherein, photographic head is used for gathering image information, and carries out analog digital conversion formation original video data (RAW data), plus timestamp and sends into video encoder for RAW data. Mike is used for gathering acoustic information, forms voice data (PCM data), plus timestamp and send into audio coder for PCM data after carrying out analog digital conversion. Encoder is divided into video encoder and audio coder, the coding video data that photographic head is sent into by video encoder, H.264 video encoder include, H.265, MPEG-4, VP8 etc., the video data after coding is sent into blender by video encoder. The voice data that mike is sent into by audio coder is encoded, and audio coder includes AAC, MP3, AMR etc., and the audio, video data after coding is sent into blender by audio coder.The navigation system geographical location information for being regularly taken in recording process mobile terminal place, i.e. latitude and longitude information (x, y), stamping timestamp for geographical location information and send into blender, navigation system can include GPS, Beidou navigation, GLONASS etc. The geographical location information that blender is sent into for the audio, video data sent into by encoder and navigation system, is packaged packing and writes file, and preserving in memory.

After mobile terminal opens recording function, before starting recorded video, first do a little preparation for whole recording flow process, for instance, initialize photographic head, mike etc. After preparation completes, mobile terminal starts to obtain image information by photographic head, the image information collected is carried out analog digital conversion is original video data, the very first time stamp recorded for video data labelling, and adopt and H.264 or H.265 wait video encoder to coding video data generation video data bag. Start to obtain acoustic information by mike simultaneously, and the acoustic information collected is carried out analog digital conversion is voice data, then the second timestamp recorded for audio, video data labelling, and be encoded generating packets of audio data to voice data by audio coders such as AAC or AMR.

Step S20, the geographical location information recorded every the Preset Time described mobile terminal of acquisition, for the 3rd timestamp that described geographical location information labelling is recorded;

After proceeding by video record, while above-mentioned acquisition audio, video data, mobile terminal by the navigation system such as GPS or Beidou navigation to carry out the extraction of geographical location information every Preset Time, this geographical location information can be latitude and longitude information, and this Preset Time can be arranged as the case may be and flexibly. Such as, the mobile terminal currently carrying out recording is in " Shenzhen University ", and the geographical location information that navigation system acquires is (113.943044,22.5407). Simultaneously by the 3rd current recorded for the geographical location information mark of acquisition timestamp, the 3rd timestamp and the very first time mentioned above stamp and the second timestamp to arrange form consistent, may be configured as the relative time of Beijing time or recording.

Step S30, by described video data bag, described packets of audio data and described geographical location information write recorded file, to record with the video of continuous geographical location information, for described mobile terminal according to the described very first time stab, the sequencing described recorded file of playback of described second timestamp and described 3rd timestamp.

Mobile terminal is by video data bag obtained above, packets of audio data and geographical location information, according in the format standard encapsulation write recorded file of video container, and carry out being stored in memorizer, to facilitate preservation and transmission, the format standard of this video container can include the forms such as mp4, mkv, rmvb, avi.Then judge whether to detect the instruction terminating to record, record, if not detecting, the instruction terminated, then circulation performs above-mentioned steps S10 to step S30, carries out the acquisition of audio, video data and geographical location information, and indicate corresponding timestamp respectively, write recorded file. If detecting recording END instruction, then terminating to record, terminating photographic head, mike, navigation system etc. and no longer carrying out data acquisition.

The recorded file obtained contains continuous print audio track (AudioTrack), video track (VideoTrack), geographical location information rail (LocTrack) etc., it is achieved that record the video with continuous geographical location information. Mobile terminal, when carrying out video playback, plays back this recorded file according to the sequencing of very first time stamp, the second timestamp and the 3rd timestamp. Making to contain, in the video file generated, the continuous geographical location information sequence that mobile terminal is passed in recording process, so when playing back video, user can check geographical location information passed during recorded video.

Hereinafter will be illustrated, in one embodiment, as shown in Figure 4, it it is a structural representation carrying out video record generation recorded file, video data bag, packets of audio data and geographical location information these three data, by the standard of video container, are carried out intersection and deposit to recorded file by mobile terminal, and video file head is write in the beginning in recorded file, after receiving the instruction terminating to record, finally write video file tail in recorded file. Specifically, in Fig. 4, Video represents video data bag, and Audio represents that packets of audio data, Loc represent geographical location information data bag. According to the time order and function order obtained, in the process obtaining video data, voice data and geographical location information, first the video data bag Video got is write recorded file, again the geographical location information Loc got is write recorded file, then the packets of audio data Audio got by future time writes recorded file, constantly continue obtain data and mix write recorded file, until just stopping when receiving end record command recording. When making route passed during user needs record video record, can so that checking the geographical location information that recorded video associates, such as, after drive recorder utilizes the method that this programme provides to carry out recorded video, traffic route can be checked very easily when playback, and can know the picture of certain time point of video is recorded on which geographical position.

In another embodiment, as shown in Figure 5, carry out video record for another and generate the structural representation of recorded file, mobile terminal is by the standard of video container, first by video data bag and voice data mixed storage to video file, video file head is write in beginning at video file, finally writes video file tail at video file. Geographical location information is deposited to geographical location information file, then the afterbody by geographical location information file splicing to video file, forms recorded file. Specifically, in Fig. 5, Video represents video data bag, and Audio represents that packets of audio data, Loc represent geographical location information data bag. According to the time order and function order obtained, in obtaining video data and voice data process, first the video data bag Video got is write video file, again the packets of audio data Audio got is write video file, then the packets of audio data Audio got by future time writes video file, is constantly circulated acquisition data and mixes write video file.Similarly, geographical location information Loc is write geographical location information file according to the sequencing of time by circulation successively. Until stopping recording when receiving end record command, and geographical location information file is spliced after video file, to form recorded file. It is understood that also geographical location information file can be spliced before video file, when playing back recorded file, transfer out audio, video data successively according to the sequencing of time or geographical location information file plays out. Achieve recording with continuous geographical location information video, solve the problem that existing mobile terminal cannot record the geographical position variation track of captured video process.

Further, based on above-mentioned video recording method first embodiment, propose video recording method the second embodiment of the present invention, in this embodiment, above-mentioned steps S30 comprises the steps that based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, by described video data bag, described packets of audio data and described geographical location information according to time order and function order mixing write recorded file.

In the present embodiment, when the video data bag obtained, packets of audio data and geographical location information are write recorded file, mobile terminal can stab based on the very first time corresponding to video data, the second timestamp corresponding to voice data, and the 3rd timestamp corresponding to geographical location information, by video data, voice data and geographical location information according to the time order and function order obtained, the format standards such as mp4, mkv, rmvb, the avi according to video container are packaged, and mixing writes in recorded file and stores.

Further, mobile terminal is in the process carrying out video record, it may be judged whether detect end record command; If so, then terminate to record; If not, then continue obtain video data, voice data and geographical location information and indicate the timestamp of correspondence respectively, to continuing the video data that acquires and voice data is encoded obtaining video data bag and packets of audio data, the video data bag, packets of audio data and the geographical location information that obtain are sequentially written in described recorded file according to time order and function.

Further, based on above-mentioned video recording method first embodiment, propose video recording method the 3rd embodiment of the present invention, in this embodiment, above-mentioned steps S30 comprises the steps that and stabs and described second timestamp based on the described very first time corresponding to described video data and described voice data, by described video data bag and described packets of audio data according to time order and function order mixing write video file, described geographical location information is sequentially written in geographical location information file according to described 3rd timestamp;

In the present embodiment, mobile terminal, by the voice data got and video data, carries out separating process with geographical location information. Specifically, stab based on the very first time corresponding to video data, the second timestamp corresponding to voice data, video data bag and packets of audio data are write video file according to the mixing of time order and function order, now no longer geographical location information is carried out mixed processing, namely according to being packaged by format standards such as mp4, mkv, rmvb, avi of video container, packets of audio data and video data bag are write video file and carry out storing (not comprising geographical location information). It addition, the geographical location information got every Preset Time is sequentially written in geographical location information file according to the 3rd timestamp. Judge whether to detect end record command, if not detecting end record command, then continue cycling through acquisition data and carry out respective handling and store. When detecting end record command, terminate to record, and the video file obtained and geographical location information file are carried out splicing write recorded file. ?ountain ? Ji Zhai is extensive to narrow side ? lip glaze of (10) raising and teases long-drawn-out ? Zhu at the dusk Gui ? that raises that drips and hire ? and wave that postscript stir-frying ? is long-drawn-out to drip in ? ? Wa 5. female bangs of raising shown in the I H Bin ? of side, by video data bag and voice data mixed storage to video file, video file head is write in beginning at video file, finally writes video file tail at video file. Geographical location information is deposited to geographical location information file, after completion of recording again by the afterbody of geographical location information file splicing to video file, forms recorded file.

Further, as shown in Figure 8, based on above-mentioned video recording method first embodiment, propose video recording method the 4th embodiment of the present invention, this embodiment comprises the steps that before above-mentioned steps S20 reception user setup instruction, according to described user setup instruction, the described prefixed time interval obtaining described geographical location information is configured.

In the present embodiment, before carrying out video record, geographical location information is obtained by the optional Preset Time utilizing acquiescence, or according to practical situation when needing to change the prefixed time interval obtaining geographical location information, user can be arranged interface can this Preset Time be set what specify. For example, it is assumed that user's hand-held mobile terminal is walked carries out video record, can being set to by Preset Time 1 minute, now navigation system obtained a geographical location information every one minute. When mobile terminal carry carries out long video record on unmanned plane, this Preset Time can be updated to 1 second by user, and now navigation system obtained a geographical location information every one second. Make rationally to be arranged according to different situations by the interval of acquisition geographical location information, achieve recording with continuous geographical location information video, during user needs record video record during passed route, it is possible to be easy to check the geographical location information that recorded video associates. Certainly, the present embodiment may be based on above-mentioned second or the 3rd implement propose.

Through the above description of the embodiments, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to above-described embodiment method and realize, hardware can certainly be passed through, but in a lot of situation, the former is embodiment more preferably. Based on such understanding, the part that prior art is contributed by technical scheme substantially in other words can embody with the form of software product, this computer software product is stored in a storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, server, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.

These are only optional embodiment of the present invention; not thereby the scope of the claims of the present invention is limited; every equivalent structure utilizing description of the present invention and accompanying drawing content to make or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, all in like manner include in the scope of patent protection of the present invention.

Claims

1. a video recording device, it is characterised in that described video recording device includes:

2. video recording device as claimed in claim 1, it is characterized in that, described mixing generation module is additionally operable to, based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, by described video data bag, described packets of audio data and described geographical location information according to time order and function order mixing write recorded file.

3. video recording device as claimed in claim 1, it is characterized in that, described mixing generation module is additionally operable to, stab and described second timestamp based on the described very first time corresponding to described video data and described voice data, by described video data bag and described packets of audio data according to time order and function order mixing write video file, described geographical location information is sequentially written in geographical location information file according to described 3rd timestamp; And after receiving end record command, described video file and described geographical location information file are carried out splicing write recorded file.

4. the video recording device as according to any one of claim 1-3, it is characterised in that described video recording device also includes:

5. a mobile terminal, it is characterised in that described mobile terminal includes the video recording device as according to any one of Claims 1-4.

6. a video recording method, it is characterised in that described video recording method comprises the following steps:

7. video recording method as claimed in claim 6, it is characterised in that described video data bag, described packets of audio data and described geographical location information are write recorded file and includes:

8. video recording method as claimed in claim 7, it is characterized in that, based on the stamp of the described very first time corresponding to described video data bag, described packets of audio data and described geographical location information difference, described second timestamp and described 3rd timestamp, described video data bag, described packets of audio data and described geographical location information are included according to after time order and function order mixing write recorded file:

Judge whether to detect end record command;

If so, then terminate to record;

9. video recording method as claimed in claim 6, it is characterised in that described video data bag, described packets of audio data and described geographical location information are write recorded file and includes:

10. the video recording method as according to any one of claim 6-9, it is characterised in that the described geographical location information obtaining the recording of described mobile terminal every Preset Time, includes for before the 3rd timestamp that described geographical location information labelling is recorded: