WO2017118320A1

WO2017118320A1 - Mobile terminal, video processing apparatus and method thereof

Info

Publication number: WO2017118320A1
Application number: PCT/CN2016/112360
Authority: WO
Inventors: 林月贡; 吴林波
Original assignee: 努比亚技术有限公司
Priority date: 2016-01-04
Filing date: 2016-12-27
Publication date: 2017-07-13

Abstract

A mobile terminal, a video processing apparatus and a method thereof are provided, wherein, the mobile terminal comprises: a camera, configured to perform a video acquisition to obtain video data; a controller, configured to control the camera to perform the acquisition and obtain the video data, and further configured to write, upon acquiring the video data by the camera, a geographical location where the mobile terminal is located into the video data, and generate a video document from the video data having the geographical location written therein; the controller is further configured to determine a granularity of a geographical location interval used when dividing up the video document, determine the geographical location interval to which the geographical location of the video data of the video document belongs and corresponding to the granularity, determine, on the basis of a timeline of the video document, a time interval corresponding to the geographical location interval of the video data of the video document, and perform, on the basis of the determined time interval, a division processing on the video document to obtain a video document clip corresponding to the geographical location interval. The invention achieves recording of continuous information of geographical locations passed by the mobile terminal when performing video recording, and performs, on the basis of the different geographical regions of the collected video document, a precise division of the video document.

Description

Mobile terminal and video processing device and method thereof

Technical field

The present application relates to the field of video processing, and in particular, to a mobile terminal and a video processing apparatus and method thereof.

Background technique

Mobile terminals (such as smart phones, tablets, etc.) crop the video, requiring the user to manually select or input the starting position and ending position of the cropping. It is often not possible to crop the video clips required by the user very accurately, for example, for different spans. For video captured in a geographical area, the user manually sets the time point at which the video is segmented, and often the video cannot be segmented into video file segments taken in different geographic regions. Video recording is usually performed by a mobile terminal acquiring video data through a camera, and acquiring audio data through a microphone, and encoding the video data and the audio data separately into a video file. The video file usually only has two kinds of information, video and audio, or you can add subtitle information instead of recording more information. For example, when a user needs to record geographic location information that passes during video recording, the existing mobile terminal's video recording technology can provide a method for recording a geographic point, but cannot easily record the recorded audio and video and geography. The location is associated, and multiple geographic trajectories experienced by the entire shot cannot be recorded.

Summary of the invention

In view of this, the present invention provides a mobile terminal and a video processing apparatus and method thereof, which are intended to record continuous geographic location information that a mobile terminal passes during video recording, and perform video file based on different geographic regions of the collected video file. Precise segmentation.

The technical solution adopted by the embodiment of the present invention to solve the technical problem thereof is:

In a first aspect, a mobile terminal is provided, where the mobile terminal includes:

a camera configured to perform video capture to obtain video data;

The controller is configured to control the camera to acquire the video data, and write the geographic location where the mobile terminal is located when the camera collects the video data, and write the video data based on the Writing video data of the geographical location to generate a video file;

The controller is further configured to determine a granularity of a geographic location interval used for segmenting the video file, and determine a geographic location interval corresponding to the granularity to which the geographic location of the video data in the video file belongs, based on The time axis of the video file determines a time interval corresponding to a geographic location interval of the video data in the video file, and the video file is segmented according to the determined time interval to obtain a video file corresponding to the geographic location interval. Fragment.

In an embodiment, the controller is further configured to identify the time interval based on a time axis of the video file, and divide the video file according to the identified time interval to obtain a video file segment, which will have the same The video file segments of the geographic location are merged to obtain a video file segment corresponding to the geographic location interval.

In an embodiment, the controller is further configured to acquire a preset first geographic location interval corresponding to the granularity, and determine a first time corresponding to the first geographic location interval on a time axis of the video file. a time interval; filtering, according to a time axis of the video file, the video file segment corresponding to the first time interval in the video file to be updated, and updating the video file to perform segmentation processing A video file fragment corresponding to the geographic location interval.

As an implementation manner, the controller is further configured to acquire a geographic location of the mobile terminal in each collection period of the camera, and write the acquired geographic location to the camera, where the camera collects in a corresponding collection period. Video data; wherein each of the acquisition periods includes at least one video frame.

As an implementation manner, the mobile terminal is provided with a location information module and a mobile communication module. At least one of a block and a wireless internet module;

The location information module is configured to receive a positioning signal and output a geographic location of the mobile terminal;

The mobile communication module is configured to receive a geographic location of the mobile terminal determined by the wireless communication system based on the resident cell information of the mobile communication module;

The wireless internet module is configured to detect a device identifier of the network access device, and send the device identifier of the network access device to the server side, where each collection period of the environment is collected based on the device of the network access device Identifying, by the server side, a geographical location associated with the device identifier as a geographic location of the mobile terminal;

The controller is further configured to read geographic location information output by the location information module during each acquisition period of the camera and write video data obtained by the camera to collect the environment during a corresponding collection period.

In a second aspect, a video processing method is provided, the method comprising:

Perform video capture to obtain video data;

Writing, to the video data, a geographic location where the mobile terminal is located when the video data is collected, and generating a video file based on the video data written in the geographic location;

Determining the granularity of the geographic location interval used to segment the video file;

Determining a geographical interval corresponding to the granularity to which the geographic location of the video data in the video file belongs;

Determining a time interval to which the geographic location interval of each video data belongs based on a time axis of the video file;

The video file is segmented based on the determined time interval to obtain a video file segment corresponding to the geographic location interval.

As an embodiment, the segmentation process of the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval includes:

Identifying the time interval based on the time axis of the video file, segmenting the video file based on the identified time interval to obtain a video file segment, and combining video file segments having the same geographic location to obtain the geographic location A video file fragment corresponding to the interval.

Obtaining a preset first geographic location interval corresponding to the granularity, and determining a first time interval corresponding to the first geographic location interval on a time axis of the video file;

And filtering the video file segment corresponding to the first time interval to obtain the updated video file based on a time axis of the video file, and updating the video file to perform segmentation processing to obtain a video file segment corresponding to the geographic location interval. .

As an implementation manner, the collecting, by the environment, the video data, and writing the geographic location where the mobile terminal is located when the environment is collected, includes:

Acquiring a geographic location of the mobile terminal in each acquisition period of the camera, and writing the acquired geographic location to video data collected by the camera in a corresponding collection period; wherein each of the collection periods includes at least one Video frame.

As an implementation manner, the method further includes:

Obtaining the geographic location of the mobile terminal:

Reading the geographical position information of the output during each acquisition period of the camera and writing the video data obtained by the camera collecting the environment during the corresponding collection period;

The geographic location of the mobile terminal is obtained by using at least one of the following manners:

Receiving a positioning signal, and outputting a geographic location of the mobile terminal based on the positioning signal;

Receiving, by the wireless communication system, a geographic location of the mobile terminal determined based on the mobile terminal camping cell information;

Detecting a device identifier of the network access device, and transmitting, to the server side, a device identifier of the network access device, where the device identifier of the network access device is acquired and The geographical location associated with the device identification is the geographic location of the mobile terminal.

In a third aspect, a video processing apparatus is provided, including:

The audio and video acquisition module is configured to: after the mobile terminal starts the recording function, acquire video data and audio data, mark the recorded first time stamp for the video data, and encode the video data to generate a video data packet, and Marking the recorded second time stamp for the audio data, and encoding the audio data to generate an audio data packet;

The location information obtaining module is configured to acquire the geographical location information recorded by the mobile terminal every preset time, and mark the third time stamp recorded by the geographical location information;

a hybrid generation module, configured to write the video data packet, the audio data packet, and the geographic location information into a recording file, to record a video with continuous geographic location information, for the mobile terminal to follow the first The recording file is played back in the order of the timestamp, the second timestamp, and the third timestamp.

As an implementation manner, the hybrid generation module is further configured to: the first timestamp and the second timestamp corresponding to the video data packet, the audio data packet, and the geographic location information respectively And the third timestamp, the video data packet, the audio data packet, and the geographic location information are mixed into the recording file in chronological order.

In an embodiment, the hybrid generation module is further configured to: according to the video data and the first timestamp and the second timestamp corresponding to the audio data, the video data packet and the The audio data packet is mixed into the video file in chronological order, and the geographical location information is written into the geographic location information file according to the third timestamp; and after receiving the end recording instruction, the video file is And splicing and writing the recording file with the geographical location information file.

As an implementation manner, the video processing device further includes:

And a setting module configured to receive a user setting instruction, and set the preset time interval for acquiring the geographical location information according to the user setting instruction.

In a fourth aspect, another mobile terminal is provided, the mobile terminal comprising the video processing device of the above structure.

In a fifth aspect, another video processing method is provided, including:

After the mobile terminal starts the recording function, acquiring video data and audio data, marking the recorded first time stamp for the video data, encoding the video data to generate a video data packet, and marking the audio data for the audio data Recording a second timestamp and encoding the audio data to generate an audio data packet;

Obtaining the geographical location information recorded by the mobile terminal every preset time, and marking the recorded third time stamp for the geographical location information;

Writing the video data packet, the audio data packet, and the geographic location information into a recording file, to record a video with continuous geographic location information, for the mobile terminal to follow the first timestamp, the first The recording file is played back in the order of the second time stamp and the third time stamp.

As an implementation manner, writing the video data packet, the audio data packet, and the geographic location information into the recording file includes:

And the video data packet, based on the first timestamp, the second timestamp, and the third timestamp corresponding to the video data packet, the audio data packet, and the geographic location information, respectively. The audio data packet and the geographical location information are mixed and written into the recording file in chronological order.

As an implementation manner, the first timestamp, the second timestamp, and the third timestamp corresponding to the video data packet, the audio data packet, and the geographic location information respectively After the video data packet, the audio data packet, and the geographical location information are mixed and written into the recording file in chronological order, the method includes:

Determine whether an end recording command is detected;

If yes, the recording ends;

If not, continue to obtain video data, audio data and geographical location information and mark the pair separately The time stamp of the image is obtained by encoding the video data and the audio data obtained by continuing to obtain the video data packet and the audio data packet, and the obtained video data packet, the audio data packet and the geographical location information are sequentially written into the recording file in chronological order. .

And synthesizing the video data packet and the audio data packet into a video file according to the first time stamp and the second time stamp corresponding to the video data and the audio data, and The geographical location information is written into the geographic location information file in the order of the third timestamp;

After receiving the end recording instruction, the video file and the geographical location information file are spliced into the recording file.

As an implementation manner, the acquiring, by the preset time, the geographical location information recorded by the mobile terminal, before the third timestamp recorded by the geographical location information mark, includes:

Receiving a user setting instruction, and setting the preset time interval for acquiring the geographical location information according to the user setting instruction.

The mobile terminal and the video processing apparatus and method thereof for implementing the embodiments of the present invention have the following beneficial effects: recording continuous geographic location information that the mobile terminal passes during video recording, and improving audio and video and geographic location that the mobile terminal will record The convenience of association is performed, and the video files are accurately segmented based on different geographical regions of the collected video files.

DRAWINGS

1 is a schematic diagram of an optional hardware structure of a mobile terminal embodying various embodiments of the present invention;

2 is a schematic diagram of an alternative electrical structure of a camera in a mobile terminal embodying various embodiments of the present invention;

3 is a schematic diagram of splitting a video file according to an embodiment of the present invention;

4 is a schematic diagram of still another optional hardware structure of a mobile terminal implementing various embodiments of the present invention;

FIG. 5 is a schematic diagram of another optional hardware structure of a mobile terminal implementing various embodiments of the present invention; FIG.

6 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 5;

FIG. 7 is a schematic flowchart of a video processing method according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a functional module of a video processing apparatus according to an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of a first structure for writing a video data packet, an audio data packet, and geographic location information into a recording file according to the present invention;

10 is a schematic diagram of a second structure for writing a video data packet, an audio data packet, and geographic location information into a recording file according to the present invention;

FIG. 11 is a schematic diagram of another functional module of a video processing apparatus according to an embodiment of the present disclosure;

FIG. 12 is another schematic flowchart of a video processing method according to an embodiment of the present disclosure;

FIG. 13 is still another schematic flowchart of a video processing method according to an embodiment of the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the present invention can be packaged Mobile terminals such as mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (tablets), PMPs (portable multimedia players), navigation devices, and the like, and such as digital TVs, desktops A fixed terminal such as a computer. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

Embodiment 1

This embodiment describes a mobile terminal. As shown in FIG. 1 , the mobile terminal may include a wireless communication unit 110, an A/V (audio/video) input unit 120, an output unit 150, a memory 10, an interface unit 170, and a controller 180. And a power supply unit 190. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between the mobile terminal and a wireless communication system or network. For example, the wireless communication unit can include a location information module 115.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module 115 is a GPS (Global Positioning System) module. According to the current technology, the location information module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the location information module 115 can calculate the speed information by continuously calculating the current location information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 that is loaded by an image capture in a video capture mode or an image capture mode. The obtained image data of the still picture or video is processed. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 1210 may be provided according to the configuration of the mobile terminal.

2 is a block diagram showing the electrical structure of the camera 121.

The photographic lens 1211 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is for capturing an image of a subject and acquiring captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.

The imaging element 1212 is connected to the imaging circuit 1213. The imaging circuit 1213 performs charge accumulation control and image signal readout control in the imaging element 1212, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.

The imaging circuit 1213 is connected to an A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.

The bus 1227 is a transmission path for transmitting various data read or generated inside the camera. path. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, a SDRAM (Synchronous Dynamic Random Access Memory) 1218, and a memory interface are also connected. (hereinafter referred to as memory I/F) 1219, LCD (Liquid Crystal Display) driver 1220.

The image processor 1215 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 1212. deal with. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button The operation controls such as various input buttons and various input keys detect the operation state of these operation controls.

The detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. Micro The computer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. The LCD 1226 LCD is not limited thereto, and various display panels (LCD 1226) such as an organic EL may be used. However, the present invention is not limited thereto, and various display panels such as an organic EL may be used.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user to use the mobile terminal and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identification Module (USIM) and many more. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal or can be used in the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal or may be used as a form through which various command signals input from the base are allowed to be transmitted to the mobile terminal. path. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base.

The output unit 150 is configured to visually output a signal (eg, a video signal). The output unit 150 may include a display unit 151.

The display unit 151 can display information processed in the mobile terminal. For example, when the mobile terminal is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal is in the video call mode or the image capturing mode, the display unit 151 may display the captured image and/or the received image, a UI or GUI showing the video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal may comprise two or more display units (or other display devices), for example, the mobile terminal may comprise an external display unit (not shown) And an internal display unit (not shown). The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The memory 160 may store a software program or the like that performs processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, and the like) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, the software code can It is stored in the memory 160 and executed by the controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The location information module 115 can be implemented as a GPS module that receives the positioning signal and outputs the geographic location of the mobile terminal, such as a geographic location in the form of latitude and longitude, plane coordinates, and spherical coordinates. The camera performs video capture on the environment to obtain video data, such as video data in AVI, MP4, etc., and stores it in the memory 160. The controller 180 writes the geographic location to the video data obtained by the camera in the corresponding acquisition cycle collection environment in the geographic location output by the read location information module 115 of each acquisition cycle of the camera, wherein each acquisition cycle of the camera and at least one video Frame correspondence (that is, the camera captures at least one video frame in one acquisition cycle); generates a video file based on the video data written to the geographic location.

The controller 180 determines the granularity of the geographic location interval used for segmenting the video file (for example, an urban area, a county, and the like. In actual implementation, the granularity may be determined based on an instruction of the user, or may be determined according to a historical moving range of the mobile terminal), and determined. The geographical location corresponding to the granularity to which the geographic location of the video data belongs in the video file (the geographical location area here corresponds to the foregoing granularity, and if the granularity is the urban area, the video data of each collection period in the video file is determined to belong to The geographical location interval, that is, the geographical location interval in which the mobile terminal is located when determining the video data of each collection period in the video file, and determining the geographic location of the video data in the video file (corresponding to different collection periods) based on the time axis of the video file The time interval of the interval attribution, the video file is segmented based on the determined time interval to obtain a video file segment corresponding to the geographic location interval.

The controller 180 performs a segmentation process on the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval, if at least two video file segments exist In the case of the same geographical location interval, the video file segments belonging to the same geographical location are merged to obtain a video file segment corresponding to the geographical location interval; for example, referring to FIG. 3, four video file segments are obtained by segmentation, corresponding to belonging to Baoan. In the four geographical locations of the district, Nanshan District, Baoan District and Futian District, the first and third video file segments are combined to obtain three video file segments corresponding to Baoan District, Nanshan District and Futian District (only shown in Figure 3). The merged video file corresponding to Baoan District is selected. Optionally, the video file segment is named after the geographical location of the video file. An example of the video file segment obtained after the segmentation is: Baoan District. MP4; Nanshan District .MP4 and Futian District IV. MP4. In actual implementation, optionally, the controller 180 reads whether the user sets the function of combining the video file segments belonging to the same geographical location interval, and if so, merges the video file segments belonging to the same geographic location to obtain A video file segment corresponding to the geographic location interval; if not, the video file segment obtained after the segmentation is output.

When a user obtains a video by using a camera to acquire a plurality of geographical interval collection environments, there may be a case where a video file segment of a part of the geographical interval is required, and no other geographical interval (here, the first geographical interval) is required. The video file segment is obtained. Then, the controller 180 acquires a preset first geographic location interval corresponding to the granularity. For example, when the user uses the camera to collect environment generated video files in the Baoan District, Nanshan District, and Futian District, the control display unit 151 displays Geographical location of video data in video files: Baoan District, Nanshan District and Futian District. For the user to select a video file segment that requires that geographical interval, where the user selects Baoan District and Nanshan District, the controller 180 corresponds to the Futian District (the first geographic location interval) on the time axis of the determined video file. A time interval; the video file segment corresponding to the first time interval is filtered based on the time axis of the video file to obtain an updated video file, and the updated video file segment only includes video data collected by Baoan District and Nanshan District, and the video file is updated. The video file segment corresponding to the geographical location interval (Baoan District, Nanshan District) is processed.

In this embodiment, the geographic location of each slave acquisition period is detected based on the GPS mode, and the geographic location corresponding to the video data (such as video data of each collection period) in the video file is determined. The time interval used for segmentation of the video file, the video file is segmented based on the time interval, and the geographic location interval corresponding to the location of the video data in the video file can be divided, for example, when the mobile terminal is implemented as a driving recorder, The video files are divided according to different geographical interval information, and it is possible to quickly know which areas have passed, and play the corresponding video to know what is happening in the area.

Embodiment 2

FIG. 2 is a schematic diagram showing the hardware structure of the mobile terminal according to the embodiment. As shown in FIG. 4, the mobile terminal may include a wireless communication unit 110, an A/V (audio/video) input unit 120, an output unit 150, a memory 160, and an interface unit. 170, controller 180 and power supply unit 190, and the like. Figure 4 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between the mobile terminal and a wireless communication system or network. For example, the wireless communication unit 110 can include a wireless internet module 113.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the mobile terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The wireless internet module 113 can be implemented as a wireless compatibility (WiFi) module for detecting a device identifier (such as a MAC address) of a network access device (such as a wireless router, a wireless access point) used by the wireless internet module 113 to access the network. And so on, because the terminal device accessing the network through the network access device inevitably uses the location service, the server side can collect the geographical location when the terminal device uses the location service and associate with the identifier of the network access device; Once the mobile terminal can send the device identifier of the network access device to the server side, the collection is performed. The location of the network access device is obtained based on the device identifier of the network access device, and the geographic location associated with the device identifier is obtained as the geographic location of the mobile terminal. Even if the geographic location of the network access device is updated, the network access can be obtained in time. The latest geographic location of the device as the geographic location of the mobile terminal.

The camera 121 performs video capture on the environment to obtain video data, such as video data in a format such as AVI, MP4, and the like, and stores it in the memory 160. The controller 180 writes the geographic location to the video data obtained by the camera 121 in the corresponding collection period in the geographic location output by the reading wireless internet module 113 of each acquisition cycle of the camera 121, wherein each acquisition cycle of the camera 121 is At least one video frame corresponds (that is, the camera 121 acquires at least one video frame in one acquisition cycle); and generates a video file based on the video data written to the geographic location.

The controller 180 performs a segmentation process on the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval, and if there are at least two video file segments belonging to the same geographical location interval, the controller will belong to the same The video file segments of the geographic location are merged to obtain a video file segment corresponding to the geographical interval; for example, four video file segments are obtained by segmentation, corresponding to four geographic locations belonging to Baoan District, Baoan District, Nanshan District and Futian District. In the interval, the first two video file segments are merged to obtain three video file segments corresponding to Baoan District, Nanshan District and Futian District. Optionally, the video file segment is named after the geographical location to which it belongs, and is obtained after segmentation. An example of the naming of video file fragments is: Baoan District. MP4; Nanshan District. MP4 and Futian District IV. MP4. In actual implementation, optionally, the controller 180 reads whether the user sets the function of combining the video file segments belonging to the same geographical location interval, and if so, merges the video file segments belonging to the same geographic location to obtain A video file segment corresponding to the geographic location interval; if not, the video file segment obtained after the segmentation is output.

When the user obtains a video by using the camera 121 to obtain a plurality of geographic location collection environments, there may be a case where a video file segment of a part of the geographic location interval is required, and no other geographic location interval (here, the first geographical location interval) is required. Corresponding video file segment, the controller 180 acquires a preset first geographic location interval corresponding to the granularity, for example, when the user uses the camera 121 to collect environment generated video files in Baoan District, Nanshan District and Futian District, and controls the display unit. 151 shows the geographical location of the video data in the video file: Baoan District, Nanshan District and Futian District. For the user to select a video file segment that requires that geographical interval, where the user selects Baoan District and Nanshan District, the controller 180 corresponds to the Futian District (the first geographic location interval) on the time axis of the determined video file. A time interval; the video file segment corresponding to the first time interval is filtered based on the time axis of the video file to obtain an updated video file, and the updated video file segment only includes video data collected by Baoan District and Nanshan District, and the video file is updated. The video file segment corresponding to the geographical location interval (Baoan District, Nanshan District) is processed.

In this embodiment, the geographic location of each slave acquisition period is detected based on the WiFi mode, and the GPS module is not required to be set in the mobile terminal, and the video is determined based on the geographic location of the video data (such as video data of each collection period) in the video file. The time interval used for segmentation of the file, the video file is segmented based on the time interval, and the geographic location interval corresponding to the location of the video data in the video file can be divided, for example, the mobile terminal is implemented as a driving recorder. When the collected video files are divided according to different geographical interval information, it is possible to quickly know which areas have passed, and play the corresponding video to know what is happening in the area.

Embodiment 3

5 is a schematic structural diagram of hardware of a mobile terminal according to the embodiment. As shown in FIG. 5, the mobile terminal may include a wireless communication unit 110, an A/V (audio/video) input unit 120, an output unit 150, a memory 160, and an interface unit. 170, controller 180 and power supply unit 190, and the like. Figure 5 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between the mobile terminal and a wireless communication system or network. For example, the wireless communication unit can include a mobile communication module 112.

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The mobile terminal as shown in FIG. 5 can be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which a mobile terminal according to the present invention can be operated will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), code. Divisional Multiple Access (CDMA) and Universal Mobile Telecommunications System (UMTS) (particularly, Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), and the like. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 6, a CDMA wireless communication system may include a plurality of mobile terminals, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be understood that the system as shown in Figure 4 can include multiple BSC 2750s.

Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.

As shown in FIG. 6, a broadcast transmitter (BT) 295 transmits a broadcast signal to a mobile terminal operating within the system. A broadcast receiving module 111 as shown in FIG. 5 is provided at the mobile terminal to receive a broadcast signal transmitted by the BT 295. In Figure 6, several Global Positioning System (GPS) satellites 300 are shown. Satellite 300 helps locate at least one of a plurality of mobile terminals.

In Figure 6, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically constructed to The satellite 300 cooperates to obtain the desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals. Mobile terminals typically participate in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to the mobile terminal.

The present embodiment is proposed based on the above-described mobile terminal hardware structure and communication system.

The mobile communication module 112 receives the geographic location of the mobile terminal determined by the wireless communication system based on the camped cell information of the mobile communication module 112, and the wireless communication system determines the mobile terminal based on the cell identification number (Cell-ID number) of the cell in which the mobile terminal resides. Geographic location. As long as the wireless communication system can collect the geographical location of the cell base station where the mobile terminal is located on the map and the coverage radius of the cell, when the mobile terminal registers with the cell, the wireless communication system can determine which cell the mobile terminal is in, and move. The positioning accuracy of the terminal in the cell depends on the cell radius.

The controller 180 determines the granularity of the geographic location interval used to segment the video file (eg, For example, in an urban area, a county, or the like, the actual implementation granularity may be determined based on a user's instruction, or may be determined according to a historical mobile range of the mobile terminal, and determine a geographical interval corresponding to the granularity of the geographic location of the video data in the video file. (The geographical area here corresponds to the foregoing granularity. If the granularity is the urban area, the geographical location of the video data in each collection period in the video file is determined, that is, the video data of each collection period in the video file is determined to be moved. The geographic location interval in which the terminal is located, based on the time axis of the video file, determines a time interval to which the geographic location of the video data in the video file belongs (corresponding to different acquisition periods), and divides the video file based on the determined time interval. A video file fragment corresponding to the geographic location interval is obtained.

The controller 180 performs a segmentation process on the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval, and if there are at least two video file segments belonging to the same geographical location interval, the controller will belong to the same The video file segments of the geographic location are merged to obtain a video file segment corresponding to the geographic location interval; for example, four video file segments are obtained by segmentation, corresponding to four geographic location ranges belonging to Baoan District, Baoan District, Nanshan District and Futian District, Combine the first two video file segments to obtain three video file segments corresponding to Baoan District, Nanshan District and Futian District. Optionally, the video file segment is named after the geographical location segment to which it belongs, and the video file segment obtained after segmentation is obtained. An example of the naming is: Baoan District. MP4; Nanshan District. MP4 and Futian District IV. MP4. In actual implementation, optionally, the controller 180 reads whether the user sets the function of combining the video file segments belonging to the same geographical location interval, and if so, merges the video file segments belonging to the same geographic location to obtain A video file segment corresponding to the geographic location interval; if not, the video file segment obtained after the segmentation is output.

When the user obtains a video by using the camera 121 to obtain a plurality of geographic location collection environments, there may be a case where a video file segment of a part of the geographic location interval is required, and no other geographic location interval (here, the first geographical location interval) is required. Corresponding video file fragment, Then, the controller 180 acquires a preset first geographic location interval corresponding to the granularity. For example, when the user uses the camera 121 to collect environment generated video files in the Baoan District, Nanshan District, and Futian District, the control display unit 151 displays the video in the video file. Geographical location of the data: Baoan District, Nanshan District and Futian District. For the user to select a video file segment that requires that geographical interval, where the user selects Baoan District and Nanshan District, the controller 180 corresponds to the Futian District (the first geographic location interval) on the time axis of the determined video file. A time interval; the video file segment corresponding to the first time interval is filtered based on the time axis of the video file to obtain an updated video file, and the updated video file segment only includes video data collected by Baoan District and Nanshan District, and the video file is updated. The video file segment corresponding to the geographical location interval (Baoan District, Nanshan District) is processed.

In this embodiment, the geographic location of each slave acquisition period is detected based on the WiFi mode, and the GPS module is not required to be set in the mobile terminal, and the video is determined based on the geographic location of the video data (such as video data of each collection period) in the video file. The time interval used for the segmentation of the file, the video file is segmented based on the time interval, and the geographic location interval corresponding to the location of the video data in the video file can be divided, for example, when the mobile terminal is implemented as a driving recorder, the collected The video file is divided according to different geographical interval information, and it is possible to quickly know which areas have passed, and play the corresponding video to know what is happening in the area.

The first embodiment to the third embodiment respectively use the location information module 115, the wireless internet module 113, and the mobile communication module 112 to obtain the geographic location of the mobile terminal, and of course, any two modules or all three may be used in the implementation. The manner of modules to cooperate to determine the geographic location of the mobile terminal ensures that the geographic location of the mobile terminal can always be obtained, for example, when the location information module 115 cannot receive the GPS signal, the geographic location output by the wireless internet module 113 and the mobile communication module 112 can be utilized. To comprehensively determine the geographic location of the mobile terminal, such as using the wireless internet module 113 and the mobile communication module 112 to output the intermediate location of the geographic location as the geographic location of the mobile terminal.

Embodiment 4

Corresponding to the description of the foregoing embodiment, this embodiment describes a video processing method. Referring to FIG. 7, the following steps are included:

In step 101, video recording is performed to obtain video data.

Step 102: Write the geographic location where the mobile terminal is located when the video data is collected to the video data, and generate a video file based on the video data written in the geographic location.

Reading the geographic location information output by the location information module in each acquisition cycle of the camera and writing the video data obtained by the camera in the corresponding collection period acquisition environment;

The geographic location of the mobile terminal is obtained by using at least one of the following methods:

Receiving a positioning signal, and outputting a geographical location of the mobile terminal based on the positioning signal;

Receiving a geographic location of the mobile terminal determined by the wireless communication system based on the mobile terminal camping cell information;

The device identifier of the network access device is detected, and the device identifier of the network access device is sent to the server side, and the geographical location associated with the device identifier on the server side is obtained as the geographic location of the mobile terminal based on the device identifier of the network access device.

Step 103: Determine a granularity of a geographic location interval used for segmenting the video file, and determine a geographic location interval corresponding to the granularity to which the geographic location of the video data in the video file belongs.

Step 104: Determine a time interval corresponding to a geographic location interval of each video data based on a time axis of the video file, and perform segmentation processing on the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval.

Determining the granularity of the geographic location interval used for segmenting the video file (for example, urban area, county, etc., in actual implementation, the granularity may be determined based on the user's instruction or divided according to the historical moving range of the mobile terminal), and the video file is determined. The geographical location corresponding to the granularity to which the geographic location of the video data belongs (the geographical location here corresponds to the foregoing granularity, and if the granularity is the urban area, the geographical location of the video data of each collection period in the video file is determined. , that is, when determining the video data of each collection period in the video file, the mobile terminal The geographic location interval of the video file is determined based on the time axis of the video file to determine the time interval of the geographic location interval with the video data in the video file (corresponding to different acquisition periods), and the video file is segmented based on the determined time interval. A video file fragment corresponding to the geographic location interval.

Performing a segmentation process on the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval, if there are at least two video file segments belonging to the same geographical location interval, then belonging to the same geographical location The video file segments are merged to obtain a video file segment corresponding to the geographical interval; for example, four video file segments are obtained by segmentation, corresponding to the four geographic regions belonging to Baoan District, Baoan District, Nanshan District and Futian District, and the first two are The video file segments are merged to obtain three video file segments corresponding to Baoan District, Nanshan District and Futian District. Optionally, the video file segment is named after the geographical location of the video file segment, and one of the video file segments obtained after the segmentation is named. Examples are: Baoan District. MP4; Nanshan District. MP4 and Futian District IV. MP4. In actual implementation, optionally, the reading user sets a function to merge the video file segments belonging to the same geographical location interval, and if so, merges the video file segments belonging to the same geographical location to obtain the geographical location. The video file segment corresponding to the interval; if not, the video file segment obtained after the segmentation is output.

When a user obtains a video by using a camera to acquire a plurality of geographical interval collection environments, there may be a case where a video file segment of a part of the geographical interval is required, and no other geographical interval (here, the first geographical interval) is required. The video file fragment, then, obtains a preset first geographic location interval corresponding to the granularity, for example, when the user uses the camera to generate a video file in the collection environment of Baoan District, Nanshan District and Futian District, the geographic data of the video data in the video file is displayed. Location range: Baoan District, Nanshan District and Futian District. For the user to select the video file segment that needs the geographical interval, where the user selects Baoan District and Nanshan District, the first time interval corresponding to the Futian District (the first geographical interval) on the time axis of the determined video file is determined. ; based on the timeline of the video file, filtering the video file segment corresponding to the first time interval to be updated The video file and the updated video file segment only include the video data collected in Baoan District and Nanshan District, and the video file is segmented to obtain a video file segment corresponding to the geographical interval (Baoan District, Nanshan District).

In summary, the video processing method described in this embodiment has the following beneficial effects:

1. automatically detecting a corresponding time interval in the video according to the geographical location interval, and then cutting the video file into video file segments collected in different geographical intervals according to the time interval;

2. According to the user's choice, the video of a certain geographical interval in the video is removed, and the remaining video files are segmented into video file segments corresponding to different geographical locations.

Based on the hardware structure of the mobile terminal and the structure of the wireless communication system of the mobile terminal, the present invention also provides a video processing device and a video processing method corresponding to the video processing device.

Embodiment 5

As shown in Figure 8, a first embodiment of a video processing device of the present invention is shown. The video processing device of this embodiment includes:

The audio and video acquisition module 10 is configured to acquire video data and audio data after the mobile terminal starts the recording function, mark the recorded first time stamp for the video data, and encode the video data to generate a video data packet. And marking the recorded second time stamp for the audio data, and encoding the audio data to generate an audio data packet;

In this embodiment, the type of the mobile terminal may be set according to actual needs. For example, the mobile terminal may be a driving recorder, a mobile phone, an iPad, an aerial camera, a camera, or the like. The mobile terminal is provided with a camera, a microphone, a navigation system, an encoder, a mixer, a memory, etc., wherein the camera is used for acquiring image information, and performing analog-to-digital conversion to form original video data (RAW data), and time stamping the RAW data. And sent to the video encoder. The microphone is used to collect sound information, perform analog-to-digital conversion to form audio data (PCM data), time stamp the PCM data and send it to the audio encoder. The encoder is divided into a video encoder and an audio encoder. The video encoder encodes the video data sent by the camera. The video encoder includes H.264, H.265, MPEG-4, VP8, etc., and the video encoder will encode the video data. The video data is sent to the mixer. The audio encoder encodes the audio data sent by the microphone, and the audio encoder includes AAC, MP3, AMR, etc., and the audio encoder sends the encoded audio and video data to the mixer. The navigation system is used to periodically take the geographical location information of the mobile terminal during the recording process, that is, the latitude and longitude information (x, y), time stamp the geographical location information and send it to the mixer, and the navigation system may include GPS, Beidou navigation, GLONASS, etc. . The mixer is used for encapsulating the audio and video data sent by the encoder and the geographical location information sent by the navigation system, packaging and writing the file, and storing it in the memory.

It should be noted that the first, second, and third of the first timestamp, the second timestamp, and the third timestamp mentioned in the present invention are only for facilitating the distinction between acquiring video data, audio data, and geographic location information. The corresponding timestamp is not the first timestamp, the second timestamp, and the third timestamp are sorted according to the timest order, and the three parts of obtaining video data, audio data, and geographic location information are asynchronously performed simultaneously. Each has its own timestamp, and each part has its own internal order.

After the mobile terminal starts the recording function, before starting to record the video, first make some preparations for the entire recording process, for example, initializing the camera, microphone, and so on. After the preparation work is completed, the mobile terminal invokes the audio and video acquisition module 10 to start acquiring image information through the camera, and performs analog-to-digital conversion of the collected image information into original video data, which is the first recorded for the video data mark. The time stamp is used, and the video data is encoded by a video encoder such as H.264 or H.265 to generate a video data packet. At the same time, the audio and video acquisition module 10 starts to acquire sound information through the microphone, and performs analog-to-digital conversion of the collected sound information into audio data, and then marks the recorded second time stamp for the audio and video data, and encodes the audio through AAC or AMR. The device encodes the audio data to generate an audio data packet.

It should be noted that the first timestamp and the second timestamp may be Beijing time for video recording. For example, when the recording time is from 8:00 to 10:00, the first timestamp or the second timestamp may be 8:30. It may also be a relative time from the start of recording to a time of 0. For example, when the recording time is from 0 to 10 minutes, the first time stamp or the second time stamp may be the 5th minute of recording.

The location information obtaining module 20 is configured to acquire the geographical location information recorded by the mobile terminal every preset time, and mark the recorded third time stamp for the geographical location information;

After the video recording is started, the mobile terminal invokes the location information acquiring module 20 to extract the geographic location information by using a navigation system such as GPS or Beidou navigation at the preset time. For latitude and longitude information, the preset time can be flexibly set according to the specific situation. For example, the mobile terminal currently recording is in "Shenzhen University", and the geographical location information obtained by the navigation system is (113.943044, 22.5407). At the same time, the obtained geographical location information marks the currently recorded third timestamp, and the third timestamp is consistent with the setting format of the first timestamp and the second timestamp mentioned above, and can be set as the relative time of Beijing time or recording. time.

The hybrid generation module 30 is configured to write the video data packet, the audio data packet, and the geographic location information into a recording file to record a video with continuous geographic location information, for the mobile terminal to follow the The recording file is played back in the order of a time stamp, the second time stamp, and the third time stamp.

The mobile terminal obtains the video data packet, the audio data packet and the geographical location information obtained by the above The hybrid generation module 30 encapsulates the write recording file according to the format standard of the video container, and stores it in the memory for convenient storage and transmission. The format standard of the video container may include mp4, mkv, rmvb, avi, and the like. Then, it is determined whether the instruction to end the recording is detected. If the instruction to end the recording is not detected, the above steps S10 to S30 are cyclically executed to acquire the audio and video data and the geographical location information, and respectively mark the corresponding time stamp. Write to the recording file. If the recording end command is detected, the recording ends, and the camera, microphone, navigation system, etc. are terminated, and data acquisition is no longer performed.

The obtained recording file includes a continuous audio track (Audio Track), a video track (Video Track), a Loc Track, and the like, and realizes recording a video with continuous geographical position information. When the video terminal performs video playback, the mobile terminal plays back the recorded file in the order of the first timestamp, the second timestamp, and the third timestamp. The generated video file includes a sequence of continuous geographic location information that the mobile terminal passes during the recording process, so that when the video is played back, the user can view the geographical location information when the video is recorded.

The following is an example. In an embodiment, as shown in FIG. 9, a schematic diagram of generating a recording file for video recording, the mobile terminal according to the standard of the video container, the video data packet, the audio data packet, and the geographical location information. These three kinds of data are cross-stored to the recording file, and the video file header is written at the beginning of the recording file. After receiving the instruction to end the recording, the video file end is written at the end of the recording file. Specifically, in FIG. 9, Video represents a video data packet, Audio represents an audio data packet, and Loc represents a geographic location information data packet. According to the chronological order of acquisition, in the process of acquiring video data, audio data and geographical location information, the first obtained video data packet Video is written into the recording file, and then the obtained geographical location information Loc is written into the recording file. Then, the audio data packet Audio acquired in the next time is written into the recording file, and the data is continuously looped and mixed and written into the recording file until the end of the recording instruction is received. When the user needs to record the route that passes during the video recording, it is convenient to view the geographical location information associated with the recorded video, for example, the driving recorder utilizes the method provided by the solution. After recording the video, you can easily view the driving route during playback, and you can know where the video is recorded at a certain point in time.

In another embodiment, as shown in FIG. 10, a schematic diagram of generating a recording file for another video recording, the mobile terminal first mixes the video data packet and the audio data into a video file according to the standard of the video container, in the video. Write the video file header at the beginning of the file and the video file end at the end of the video file. The geographical location information is stored in the geographic location information file, and then the geographical location information file is spliced to the end of the video file to form a recording file. Specifically, in FIG. 10, Video represents a video data packet, Audio represents an audio data packet, and Loc represents a geographic location information data packet. According to the chronological order of acquisition, in the process of acquiring video data and audio data, the first obtained video data packet Video is written into the video file, and then the obtained audio data packet Audio is written into the video file, and then the next time is obtained. The acquired audio data packet Audio is written to the video file, and the data is continuously looped and mixed and written to the video file. Similarly, the loop sequentially writes the geographical location information Loc into the geographic location information file in chronological order. The recording is stopped until the end of the recording instruction is received, and the geographical location information file is stitched behind the video file to form a recording file. It can be understood that the geographic location information file can also be spliced in front of the video file. When the recorded file is played back, the audio and video data or the geographical location information file is sequentially retrieved and played according to the time sequence. The recording of the video with continuous geographical location information is realized, which solves the problem that the existing mobile terminal cannot record the geographical change track of the captured video process.

It should be noted that the sequence of FIG. 9 and FIG. 10 is only an example. In actual cases, the three parts of the video data, the audio data, and the geographical location information are simultaneously asynchronously performed, and which one is requested to be written to the file, then the write is locked. After the write operation is completed, the lock is released, and other subsequent partial write requests are allowed, that is, the order in which Video, Audio, and Loc enter the write recording file is indefinite.

In the process of video recording by the mobile terminal, the number of acquired videos in the embodiment of the present invention The video data is encoded according to the first timestamp recorded, and the video data is encoded to generate a video data packet, and the recorded second audio data is marked with the second timestamp, and the audio data is encoded to generate an audio data packet. At the same time, the geographical location information recorded by the mobile terminal is obtained every preset time, the third time stamp recorded by the geographical location information is marked, and then the video data packet, the audio data packet and the geographical location information are written into the recording file to record the tape. For a video with continuous geographical location information, the mobile terminal can play back the recorded file in the order of the first timestamp, the second timestamp, and the third timestamp. Therefore, the information that the mobile terminal can carry when performing video recording is enriched. In the process of video recording, the geographic location information of the mobile terminal can be recorded while acquiring the audio and video, and the geographical location information is combined with the audio and video data. Form a recording file. The generated recording file includes a sequence of continuous geographical location information of the mobile terminal, and the geographical location information of the recorded video can be viewed when the video is played back. The continuous geographical location information recorded by the mobile terminal during video recording is realized, and the convenience of the mobile terminal to associate the recorded audio and video with the geographical location is improved.

Further, based on the first embodiment of the video processing device, a second embodiment of the video processing device of the present invention is proposed. In the embodiment, the hybrid generation module 30 is further configured to: based on the video data packet, the audio. The first time stamp, the second timestamp, and the third timestamp corresponding to the data packet and the geographic location information respectively, the video data packet, the audio data packet, and the geographic location Information is mixed into the recording file in chronological order.

In this embodiment, when the obtained video data packet, the audio data packet, and the geographical location information are written into the recording file, the hybrid generation module 30 may be based on the first time stamp corresponding to the video data, and the second time stamp corresponding to the audio data. And the third timestamp corresponding to the geographical location information, and the video data, the audio data, and the geographical location information are encapsulated according to the chronological order of the obtained video, according to the format standard of the video container, such as mp4, mkv, rmvb, avi, etc. Record the file and store it.

Further, in the process of performing video recording by the mobile terminal, the hybrid generation module 30 is further configured Set to determine whether the end of the recording command is detected; if so, then end the recording; if not, continue to obtain video data, audio data and geographic location information and respectively mark the corresponding timestamp, to continue to obtain the obtained video data and audio The data is encoded to obtain a video data packet and an audio data packet, and the obtained video data packet, audio data packet, and geographical location information are sequentially written into the recording file in chronological order.

During video playback, the mobile terminal can sequentially play according to the stored chronological order to record a video with continuous geographical location information. As shown in FIG. 9, the video data packet, the audio data packet, and the geographical location information are cross-stored to the recording file, and the video file header is written at the beginning of the recording file, and the first obtained video data packet Video is written. After entering the recording file, the acquired geographical location information Loc is written into the recording file, and then the audio data packet Audio acquired at the next time is written into the recording file, and the data is continuously looped and mixed and written into the recording file until received. Stop recording when the recording command ends, and write the end of the video file at the end of the recording file.

In this embodiment, the video data, the audio data, and the geographical location information are cross-mixed and written into the recording file according to the timestamps corresponding thereto. The convenience of the mobile terminal to associate the recorded audio and video with the geographical location is improved, and the recording of the video with continuous geographical location information is realized, which solves the problem that the existing mobile terminal cannot record the geographically changed track of the captured video process.

Further, based on the first embodiment of the video processing apparatus, a third embodiment of the video processing apparatus of the present invention is proposed. In the embodiment, the hybrid generation module 30 is further configured to: based on the video data and the audio data. Corresponding to the first timestamp and the second timestamp, the video data packet and the audio data packet are mixed into a video file in chronological order, and the geographical location information is in accordance with the third The order of the time stamps is written into the geographic location information file; and after receiving the end recording instruction, the video file and the geographical location information file are spliced into the recording file.

In this embodiment, the mobile terminal separates the acquired audio data and video data from the geographic location information. Specifically, the hybrid generation module 30 mixes the video data packet and the audio data packet into the video file in chronological order based on the first time stamp corresponding to the video data and the second time stamp corresponding to the audio data. The geographical location information is mixed, that is, according to the format of the video container mp4, mkv, rmvb, avi, etc., the audio data package and the video data package are written into the video file and stored (excluding the geographical location information). In addition, the geographical location information acquired every preset time is written into the geographic location information file in the order of the third timestamp. It is judged whether the end recording instruction is detected, and if the end recording instruction is not detected, the data is continuously looped for corresponding processing and storage. When the end of the recording instruction is detected, the recording is ended, and the obtained video file and the geographical location information file are spliced into the recording file. The geographic location information file can be spliced behind the video file so as not to affect the various information stored in the original video file. As shown in FIG. 10, the video data package and the audio data are mixed and stored in the video file, the video file header is written at the beginning of the video file, and the video file end is written at the end of the video file. The geographical location information is stored in the geographic location information file, and after the recording is completed, the geographical location information file is stitched to the end of the video file to form a recording file.

In the process of recording a video, the obtained audio data and video data are separately processed from the geographical location information and then combined. The video file is mixed and written according to the acquisition time sequence of the video data packet and the audio data packet, and the geographical location information is acquired into the geographical location information file by the preset time interval, and the video file and the geographical location information file are spliced into the recording file. . The convenience of the mobile terminal to associate the recorded audio and video with the geographical location is improved, and the continuous geographical location information recorded by the mobile terminal is recorded during the video recording.

Embodiment 6

Further, as shown in FIG. 11, based on the first embodiment of the video processing apparatus, a fourth embodiment of the video processing apparatus of the present invention is proposed. The video processing apparatus further includes:

The setting module 40 is configured to receive a user setting instruction, and set the preset time interval for acquiring the geographical location information according to the user setting instruction.

In this embodiment, before the video recording is performed, the location information may be acquired by using the default preset time, or the preset time interval for obtaining the geographical location information may be changed according to the actual situation, and the user may be in the specified setting. The interface may set the preset time so that the setting module 40 sets the preset time according to the received user setting instruction. For example, if the user walks the mobile terminal to perform video recording, the preset time can be set to 1 minute, and the navigation system acquires the geographical location information every minute. When the mobile terminal is mounted on the drone for long-term video recording, the user can update the preset time to 1 second, and the navigation system acquires the geographical location information every second. The time interval for obtaining the geographical location information is reasonably set according to different situations, and the video with continuous geographical location information is recorded. When the user needs to record the route that passes during the video recording, the geographical location associated with the recorded video can be conveniently viewed. information. Of course, this embodiment can also be proposed based on the above second or third implementation.

In this embodiment, the preset time interval for acquiring the geographic location information is flexibly set, so that the mobile terminal can obtain the geographical location information according to different recording situations, and realize the continuous geographical location information recorded by the mobile terminal during video recording. It enriches the information that the mobile terminal can carry when recording video.

Example 7

Corresponding to the video processing device according to the foregoing fifth embodiment and the sixth embodiment, the embodiment of the present invention further provides another mobile terminal, where the mobile terminal includes the video processing device of the above structure, that is, includes the audio and video acquiring module 10, and location information. The acquisition module 20, the hybrid generation module 30, and the like. The mobile terminal can be a mobile phone, an iPad, a camera, or the like.

Example eight

Corresponding to the video processing apparatus according to the fifth embodiment and the sixth embodiment, as shown in FIG. 12, a first embodiment of the video processing method of the present invention is proposed. The video processing method of this embodiment includes:

Step S10: After the mobile terminal starts the recording function, acquiring video data and audio data, marking the recorded first time stamp for the video data, and encoding the video data to generate a video data packet, and for the audio Data tagging the recorded second timestamp and encoding the audio data to generate an audio data packet;

It should be noted that the first, second, and third of the first timestamp, the second timestamp, and the third timestamp mentioned in the present invention are only for facilitating the distinction between acquiring video data, audio data, and geographic location information. The corresponding timestamp is not the first timestamp, the second timestamp, and the third timestamp are sorted according to the timest order, and the video data, the audio data, and the geographical location letter are acquired. The three parts of the information are asynchronous at the same time, each with its own timestamp, and each part has its own internal order.

After the mobile terminal starts the recording function, before starting to record the video, first make some preparations for the entire recording process, for example, initializing the camera, microphone, and so on. After the preparation work is completed, the mobile terminal starts to acquire image information through the camera, and performs analog-to-digital conversion of the collected image information into original video data, and marks the first time stamp recorded by the video data, and adopts H.264 or H. A video encoder such as 265 encodes the video data to generate a video data packet. At the same time, the sound information is obtained through the microphone, and the collected sound information is analog-to-digital converted into audio data, and then the recorded second time stamp is marked for the audio and video data, and the audio data is performed by an audio encoder such as AAC or AMR. The code generates an audio packet.

Step S20: Obtain the geographical location information recorded by the mobile terminal every preset time, and mark the third timestamp recorded by the geographical location information;

After the video recording is started, the mobile terminal obtains the geographic location information by using a navigation system such as GPS or Beidou navigation, and the geographic location information may be latitude and longitude information. Set the time to be flexible according to the specific situation. For example, the mobile terminal currently recording is in "Shenzhen University", and the geographical location information obtained by the navigation system is (113.943044, 22.5407). At the same time, the obtained geographical location information marks the currently recorded third timestamp, and the third timestamp is consistent with the setting format of the first timestamp and the second timestamp mentioned above, and can be set as the relative time of Beijing time or recording. time.

Step S30, writing the video data packet, the audio data packet, and the geographical location information Recording a file to record a video with continuous geographic location information, for the mobile terminal to play back the recorded file in the order of the first timestamp, the second timestamp, and the third timestamp.

The mobile terminal encapsulates the video data packet, the audio data packet and the geographical location information obtained in the above according to the format standard of the video container into a recording file, and stores it in a memory for convenient storage and transmission, and the format standard of the video container Can include mp4, mkv, rmvb, avi and other formats. Then, it is determined whether the instruction to end the recording is detected. If the instruction to end the recording is not detected, the above steps S10 to S30 are cyclically executed to acquire the audio and video data and the geographical location information, and respectively mark the corresponding time stamp. Write to the recording file. If the recording end command is detected, the recording ends, and the camera, microphone, navigation system, etc. are terminated, and data acquisition is no longer performed.

The following is an example. In an embodiment, as shown in FIG. 9, a schematic diagram of generating a recording file for video recording, the mobile terminal according to the standard of the video container, the video data packet, the audio data packet, and the geographical location information. These three kinds of data are cross-stored to the recording file, and the video file header is written at the beginning of the recording file. After receiving the instruction to end the recording, the video file end is written at the end of the recording file. Specifically, in FIG. 9, Video is represented by V, and Audio is represented by A; wherein Video represents a video packet, Audio represents an audio packet, and Loc represents a geographical location information packet. According to the obtained chronological order, in the process of acquiring video data, audio data and geographical location information, the first obtained video data packet Video is written into the recording file, and then the obtained geographical location information Loc is written into the recording file. Then the next time The acquired audio data packet Audio is written to the recording file, and the data is continuously acquired and mixed and written to the recording file until the end of the recording instruction is received. When the user needs to record the route that passes during the video recording, it is convenient to view the geographical location information associated with the recorded video. For example, after the driving recorder uses the method provided by the solution to record the video, the driving can be conveniently viewed during playback. The route, as well as the location in which the video is recorded at a certain point in time.

In another embodiment, as shown in FIG. 10, a schematic diagram of generating a recording file for another video recording, the mobile terminal first mixes the video data packet and the audio data into a video file according to the standard of the video container, in the video. Write the video file header at the beginning of the file and the video file end at the end of the video file. The geographical location information is stored in the geographic location information file, and then the geographical location information file is spliced to the end of the video file to form a recording file. Specifically, in FIG. 10, Video is represented by V, and Audio is represented by A; wherein Video represents a video packet, Audio represents an audio packet, and Loc represents a geographical location information packet. According to the chronological order of acquisition, in the process of acquiring video data and audio data, the first obtained video data packet Video is written into the video file, and then the obtained audio data packet Audio is written into the video file, and then the next time is obtained. The acquired audio data packet Audio is written to the video file, and the data is continuously looped and mixed and written to the video file. Similarly, the loop sequentially writes the geographical location information Loc into the geographic location information file in chronological order. The recording is stopped until the end of the recording instruction is received, and the geographical location information file is stitched behind the video file to form a recording file. It can be understood that the geographic location information file can also be spliced in front of the video file. When the recorded file is played back, the audio and video data or the geographical location information file is sequentially retrieved and played according to the time sequence. The recording of the video with continuous geographical location information is realized, which solves the problem that the existing mobile terminal cannot record the geographical change track of the captured video process.

It should be noted that the sequence of FIG. 9 and FIG. 10 is only an example. In actual situations, the three parts of the video data, the audio data, and the geographical location information are simultaneously asynchronously performed, which one is requested first. If the file is written, the write is locked. After the write operation is completed, the lock is released, and other subsequent partial write requests are allowed. That is, the order in which Video, Audio, and Loc enter the write record is indefinite.

In the process of video recording by the mobile terminal, the first timestamp recorded by the obtained video data is marked, and the video data is encoded to generate a video data packet, and the obtained audio data mark is used. Recording the second timestamp and encoding the audio data to generate an audio data packet. At the same time, the geographical location information recorded by the mobile terminal is obtained every preset time, the third time stamp recorded by the geographical location information is marked, and then the video data packet, the audio data packet and the geographical location information are written into the recording file to record the tape. For a video with continuous geographical location information, the mobile terminal can play back the recorded file in the order of the first timestamp, the second timestamp, and the third timestamp. Therefore, the information that the mobile terminal can carry when performing video recording is enriched. In the process of video recording, the geographic location information of the mobile terminal can be recorded while acquiring the audio and video, and the geographical location information is combined with the audio and video data. Form a recording file. The generated recording file includes a sequence of continuous geographical location information of the mobile terminal, and the geographical location information of the recorded video can be viewed when the video is played back. The continuous geographical location information recorded by the mobile terminal during video recording is realized, and the convenience of the mobile terminal to associate the recorded audio and video with the geographical location is improved.

Further, based on the first embodiment of the video processing method corresponding to the video processing apparatus according to the fifth embodiment and the sixth embodiment, a second embodiment of the video processing method of the present invention is proposed. Step S30 may include: based on the first time stamp, the second timestamp, and the third timestamp corresponding to the video data packet, the audio data packet, and the geographic location information, respectively The video data packet, the audio data packet, and the geographic location information are mixed and written into the recording file in chronological order.

In this embodiment, when the obtained video data packet, the audio data packet, and the geographical location information are written into the recording file, the mobile terminal may be based on the first time stamp corresponding to the video data, and the audio data Corresponding second timestamp and the third timestamp corresponding to the geographical location information, the video data, the audio data and the geographical location information are in accordance with the chronological order of the acquisition, according to the format standard of the video container such as mp4, mkv, rmvb, avi, etc. Encapsulate, mix and write to the recording file and store it.

Further, in the process of performing video recording, the mobile terminal determines whether an end recording instruction is detected; if yes, ends the recording; if not, continues to acquire video data, audio data, and geographic location information, and respectively marks the corresponding timestamp And encoding the obtained video data and audio data to obtain a video data packet and an audio data packet, and writing the obtained video data packet, the audio data packet, and the geographical location information into the recording file in chronological order.

Further, based on the first embodiment of the video processing method corresponding to the video processing apparatus according to the fifth embodiment and the sixth embodiment, a third embodiment of the video processing method of the present invention is proposed. Step S30 may include, according to the video data and the first time stamp and the second time stamp corresponding to the audio data, the video data packet and the The audio data packet is mixed and written into the video file in chronological order, and the geographical location information is written into the geographic location information file according to the third timestamp;

In this embodiment, the mobile terminal separates the acquired audio data and video data from the geographic location information. Specifically, based on the first timestamp corresponding to the video data, and the second timestamp corresponding to the audio data, the video data packet and the audio data packet are mixed into the video file in chronological order, and the geographic location information is no longer used. The hybrid processing is performed according to the format standard of mp4, mkv, rmvb, avi, etc. of the video container, and the audio data package and the video data package are written into the video file and stored (excluding geographical location information). In addition, the geographical location information acquired every preset time is written into the geographic location information file in the order of the third timestamp. It is judged whether the end recording instruction is detected, and if the end recording instruction is not detected, the data is continuously looped for corresponding processing and storage. When the end of the recording instruction is detected, the recording is ended, and the obtained video file and the geographical location information file are spliced into the recording file. The geographic location information file can be spliced behind the video file so as not to affect the various information stored in the original video file. As shown in FIG. 10, the video data package and the audio data are mixed and stored in the video file, the video file header is written at the beginning of the video file, and the video file end is written at the end of the video file. The geographical location information is stored in the geographic location information file, and after the recording is completed, the geographical location information file is stitched to the end of the video file to form a recording file.

Example nine

Further, as shown in FIG. 13, based on the first embodiment of the video processing method corresponding to the video processing apparatus according to the fifth embodiment and the sixth embodiment, the fourth embodiment of the video processing method of the present invention is proposed. The foregoing step S20 in the embodiment may include: receiving a user setting instruction, and setting the preset time interval for acquiring the geographical location information according to the user setting instruction.

In this embodiment, before the video recording is performed, the location information may be acquired by using the default preset time, or the preset time interval for obtaining the geographical location information may be changed according to the actual situation, and the user may be in the specified setting. The interface can set the preset time. For example, if the user walks the mobile terminal to perform video recording, the preset time can be set to 1 minute, and the navigation system acquires the geographical location information every minute. When the mobile terminal is mounted on the drone for long-term video recording, the user can update the preset time to 1 second, and the navigation system acquires the geographical location information every second. The time interval for obtaining the geographical location information is reasonably set according to different situations, and the video with continuous geographical location information is recorded. When the user needs to record the route that passes during the video recording, the geographical location associated with the recorded video can be conveniently viewed. information. Of course, this embodiment can also be proposed based on the above second or third implementation.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention may be a software product in essence or in part contributing to the prior art. In the form of a computer software product stored in a storage medium (such as ROM / RAM, disk, CD), including a number of instructions to make a terminal device (can be a mobile phone, computer, server, air conditioner, or Network devices, etc.) perform the methods described in various embodiments of the present invention.

The above is only an alternative embodiment of the present invention, and thus does not limit the scope of the invention, and the equivalent structure or equivalent process transformation made by using the specification and the drawings of the present invention, or directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Industrial applicability

In the embodiment of the present invention, after the mobile terminal starts the recording function, the video data and the audio data are acquired, the first time stamp recorded by the video data is marked, and the video data is encoded to generate a video data packet, and the audio data is marked. Recording the second timestamp, and encoding the audio data to generate an audio data packet; acquiring the geographical location information recorded by the mobile terminal every preset time, marking the third timestamp recorded by the geographical location information; and the video data packet, The audio data packet and the geographical location information are written into the recording file, and the mobile terminal plays back the recording file in the order of the first timestamp, the second timestamp, and the third timestamp. In this way, the continuous geographical location information that the mobile terminal passes through during the video recording is recorded, which improves the convenience of the mobile terminal to associate the recorded audio and video with the geographic location.

Claims

A mobile terminal, the mobile terminal comprising:

a camera configured to perform video capture to obtain video data;

The controller is configured to control the camera to acquire the video data, and write the geographic location where the mobile terminal is located when the camera collects the video data, and write the video data based on the Writing video data of the geographical location to generate a video file;

The controller is further configured to determine a granularity of a geographic location interval used for segmenting the video file, and determine a geographic location interval corresponding to the granularity to which the geographic location of the video data in the video file belongs, based on The time axis of the video file determines a time interval corresponding to a geographic location interval of the video data in the video file, and the video file is segmented according to the determined time interval to obtain a video file corresponding to the geographic location interval. Fragment.
The mobile terminal of claim 1, wherein

The controller is further configured to identify the time interval based on a time axis of the video file, and divide the video file according to the identified time interval to obtain a video file segment, and the video file segment having the same geographic location Merging, obtaining a video file segment corresponding to the geographic location interval.
The mobile terminal of claim 1, wherein

The controller is further configured to acquire a preset first geographic location interval corresponding to the granularity, and determine a first time interval corresponding to the first geographic location interval on a time axis of the video file; The time axis of the video file filters out the video file segment corresponding to the video file segment corresponding to the first time interval in the video file, and updates the video file to perform segmentation processing to obtain a correspondence corresponding to the geographic location interval. Video file fragment.
The mobile terminal of claim 1, wherein

The controller is further configured to acquire the mobile terminal in each acquisition cycle of the camera The geographic location of the end is written to the acquired video data of the camera during the corresponding collection period; wherein each of the collection periods includes at least one video frame.
The mobile terminal of claim 1, wherein

The mobile terminal is provided with at least one of a location information module, a mobile communication module, and a wireless internet module;

The location information module is configured to receive a positioning signal and output a geographic location of the mobile terminal;

The mobile communication module is configured to receive a geographic location of the mobile terminal determined by the wireless communication system based on the resident cell information of the mobile communication module;

The wireless internet module is configured to detect a device identifier of the network access device, and send the device identifier of the network access device to the server side, where each collection period of the environment is collected based on the device of the network access device Identifying, by the server side, a geographical location associated with the device identifier as a geographic location of the mobile terminal;

The controller is further configured to read geographic location information output by the location information module during each acquisition period of the camera and write video data obtained by the camera to collect the environment during a corresponding collection period.
A video processing method, the method comprising:

Perform video capture to obtain video data;

Writing, to the video data, a geographic location where the mobile terminal is located when the video data is collected, and generating a video file based on the video data written in the geographic location;

Determining the granularity of the geographic location interval used to segment the video file;

Determining a geographical interval corresponding to the granularity to which the geographic location of the video data in the video file belongs;

Determining a time interval to which the geographic location interval of each video data belongs based on a time axis of the video file;

The video file is segmented based on the determined time interval to obtain a video file segment corresponding to the geographic location interval.
The method of claim 6, wherein the segmenting the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval comprises:

Identifying the time interval based on the time axis of the video file, segmenting the video file based on the identified time interval to obtain a video file segment, and combining video file segments having the same geographic location to obtain the geographic location A video file fragment corresponding to the interval.
The method of claim 6, wherein the segmenting the video file based on the determined time interval to obtain a video file segment corresponding to the geographic location interval comprises:

Obtaining a preset first geographic location interval corresponding to the granularity, and determining a first time interval corresponding to the first geographic location interval on a time axis of the video file;

And filtering the video file segment corresponding to the first time interval to obtain the updated video file based on a time axis of the video file, and updating the video file to perform segmentation processing to obtain a video file segment corresponding to the geographic location interval. .
The method of claim 6, wherein the collecting the video data to obtain the video data, and writing the geographic location of the mobile terminal to the video data when the environment is collected comprises:

Acquiring a geographic location of the mobile terminal in each acquisition period of the camera, and writing the acquired geographic location to video data collected by the camera in a corresponding collection period; wherein each of the collection periods includes at least one Video frame.
The method of claim 6 wherein the method further comprises:

Obtaining the geographic location of the mobile terminal:

Geographically read information of the read output at each acquisition cycle of the camera and written to the phase Collecting video data obtained by the environment in a corresponding collection period;

The geographic location of the mobile terminal is obtained by using at least one of the following manners:

Receiving a positioning signal, and outputting a geographic location of the mobile terminal based on the positioning signal;

Receiving, by the wireless communication system, a geographic location of the mobile terminal determined based on the mobile terminal camping cell information;

Detecting a device identifier of the network access device, and transmitting, to the server side, a device identifier of the network access device, and acquiring, according to the device identifier of the network access device, a geographical location associated with the device identifier on the server side The geographic location of the mobile terminal.
A video processing device, the video processing device comprising:

The audio and video acquisition module is configured to: after the mobile terminal starts the recording function, acquire video data and audio data, mark the recorded first time stamp for the video data, and encode the video data to generate a video data packet, and Marking the recorded second time stamp for the audio data, and encoding the audio data to generate an audio data packet;

The location information obtaining module is configured to acquire the geographical location information recorded by the mobile terminal every preset time, and mark the third time stamp recorded by the geographical location information;

a hybrid generation module, configured to write the video data packet, the audio data packet, and the geographic location information into a recording file, to record a video with continuous geographic location information, for the mobile terminal to follow the first The recording file is played back in the order of the timestamp, the second timestamp, and the third timestamp.
The video processing device of claim 11, wherein the hybrid generation module is further configured to: the first timestamp corresponding to the video data packet, the audio data packet, and the geographic location information respectively And the second timestamp and the third timestamp, the video data packet, the audio data packet, and the geographic location information are mixed into the recording file in chronological order.
The video processing device of claim 11 wherein said hybrid generation module further And configuring, according to the video data and the first timestamp and the second timestamp corresponding to the audio data, to mix the video data packet and the audio data packet into a video in chronological order a file, the geographic location information is written into the geographic location information file according to the third timestamp; and after receiving the end recording instruction, the video file and the geographical location information file are spliced and recorded. file.
The video processing device according to any one of claims 11 to 13, wherein the video processing device further comprises:

And a setting module configured to receive a user setting instruction, and set the preset time interval for acquiring the geographical location information according to the user setting instruction.
A mobile terminal comprising the video processing device according to any one of claims 11 to 14.
A video processing method, the video processing method comprising the following steps:

After the mobile terminal starts the recording function, acquiring video data and audio data, marking the recorded first time stamp for the video data, encoding the video data to generate a video data packet, and marking the audio data for the audio data Recording a second timestamp and encoding the audio data to generate an audio data packet;

Obtaining the geographical location information recorded by the mobile terminal every preset time, and marking the recorded third time stamp for the geographical location information;

Writing the video data packet, the audio data packet, and the geographic location information into a recording file, to record a video with continuous geographic location information, for the mobile terminal to follow the first timestamp, the first The recording file is played back in the order of the second time stamp and the third time stamp.
The video processing system of claim 16, wherein the writing the video data packet, the audio data packet, and the geographic location information to a recording file comprises:

And the number of the video is based on the first timestamp, the second timestamp, and the third timestamp corresponding to the video data packet, the audio data packet, and the geographic location information respectively The recording file is mixed in a chronological order according to the packet, the audio data packet, and the geographical location information.
The video processing system according to claim 17, wherein the first time stamp and the second time stamp corresponding to the video data packet, the audio data packet, and the geographic location information respectively The third timestamp, after the video data packet, the audio data packet, and the geographical location information are mixed into the recording file in chronological order, includes:

Determine whether an end recording command is detected;

If yes, the recording ends;

If not, the video data, the audio data and the geographical location information are continuously obtained and the corresponding time stamps are respectively marked, and the video data and the audio data obtained by the acquisition are encoded to obtain a video data packet and an audio data packet, and the obtained video data packet is obtained. The audio data package and the geographical location information are written into the recording file in chronological order.
The video processing system of claim 16, wherein the writing the video data packet, the audio data packet, and the geographic location information to a recording file comprises:

And synthesizing the video data packet and the audio data packet into a video file according to the first time stamp and the second time stamp corresponding to the video data and the audio data, and The geographical location information is written into the geographic location information file in the order of the third timestamp;

After receiving the end recording instruction, the video file and the geographical location information file are spliced into the recording file.
The video processing system according to any one of claims 16 to 19, wherein the location information recorded by the mobile terminal is acquired every preset time, and the third location recorded for the geographical location information mark Before the timestamp includes:

Receiving a user setting instruction, and setting the preset time interval for acquiring the geographical location information according to the user setting instruction.