WO2017054704A1

WO2017054704A1 - Method and device for generating video image

Info

Publication number: WO2017054704A1
Application number: PCT/CN2016/100334
Authority: WO
Inventors: 刘林汶; 何耀平; 苗雷; 里强
Original assignee: 努比亚技术有限公司
Priority date: 2015-09-28
Filing date: 2016-09-27
Publication date: 2017-04-06
Also published as: CN105245777A

Abstract

A method and device for generating a video image. The device comprises: an image data acquisition unit configured to acquire image data; a video data acquisition unit configured to acquire video data; and a synthesizing unit configured to encapsulate the image data acquired by the image data acquisition unit and the video data acquired by the video acquisition unit in one file.

Description

Method and device for generating video picture

Technical field

This application relates to, but is not limited to, the field of photography.

Background technique

With the increasing popularity of smart terminals (such as smart phones), shooting functions have become an indispensable function of smart terminals, and people can record the life's bit by bit, record good moments, and so on. Although the smart terminal in the related art has been photographed using a camera, and the image processing function of the smart terminal is also very powerful, the picture and the video are usually two independent storage data, each having independent storage files and display effects.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

In this paper, a method and a device for generating a video picture are proposed to solve the problem that the picture and the video respectively have independent storage files and display effects in the related art, and the display effect is relatively simple.

An apparatus for generating a video picture, comprising: a picture data acquiring unit, a video data acquiring unit, and a synthesizing unit;

The image data acquiring unit is configured to: acquire image data;

The video data acquiring unit is configured to: acquire video data;

The synthesizing unit is configured to encapsulate the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit into one file.

Optionally, the synthesizing unit is configured to encapsulate the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit into a file, including:

Create an image file;

Writing the picture data and the video data into the created picture file;

An identifier is written in the picture file.

Optionally, the picture data acquiring unit is further configured to: acquire a data length of the picture data;

The synthesizing unit is configured to write the picture data and the video data into the created picture file, including:

And the data length of the picture data and the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit are written into the created picture file.

Optionally, the picture file further includes one or more of the following: a data length of the picture data, a start location identifier of the picture data, and a start location identifier of the video data.

Optionally, the device further includes:

The photographing unit is configured to: when receiving the photographing instruction, take a picture and trigger the picture data acquiring unit to acquire the picture data.

Optionally, the device further includes:

The storage unit is configured to: when the photographing unit is activated to perform framing, store the acquired image data.

Optionally, the device further includes:

a shooting time acquisition unit, configured to: acquire a time T at which the shooting unit takes a picture;

The video data acquiring unit is configured to acquire video data, including:

Acquiring data in the image data stored by the storage unit from a time T-T1 to a time T+T2;

Image data of the image data from time T-T1 to time T+T2 is encoded to generate video data in a video format.

Optionally, the device further includes:

a storage unit, configured to: when the shooting unit is activated to perform framing, storing the acquired image data;

An audio data collecting unit, configured to: collect audio data synchronized with the image data stored by the storage unit;

The storage unit is further configured to: store audio data collected by the audio data collection unit.

Optionally, the device further includes:

The video data acquiring unit is configured to acquire video data, including:

Obtaining data of the image data stored by the storage unit from a time T-T1 to a time T+T2, and acquiring audio data of the audio data stored by the storage unit from a time T-T1 to a time T+T2;

The image data of the image data from the T-T1 time to the T+T2 time and the audio data of the audio data from the T-T1 time to the T+T2 time are encoded to generate video data in a video format.

Optionally, the T1 is a first preset time interval, and the T2 is a second preset time interval.

A method of generating a video picture, comprising:

Get image data;

Obtain video data;

Encapsulating the picture data and the video data into a file.

Optionally, the encapsulating the picture data and the video data into a file includes:

Create an image file;

Writing the picture data and the video data into the created picture file;

An identifier is written in the picture file.

Optionally, before the writing the picture data and the video data into the created picture file, the method further includes:

Obtaining a data length of the picture data;

The writing the picture data and the video data into the created picture file includes:

The data length of the picture data, the video data, and the picture data is written into the created picture file.

Optionally, the acquiring image data includes:

When a photographing instruction is received, a picture is taken and the picture data is acquired.

Optionally, the method further includes:

When the shooting unit is activated for framing, the acquired image data is stored.

Optionally, the method further includes:

Obtain the time T at which the picture was taken;

The obtaining video data includes:

Obtaining data of the image data from the time T-T1 to the time T+T2;

The image data of the image data from the time T-T1 to the time T+T2 is encoded to generate video data in a video format.

Optionally, the method further includes:

When the shooting unit is activated for framing, the acquired image data is stored;

Audio data synchronized with the image data is acquired, and the collected audio data is stored.

Optionally, the method further includes:

Obtain the time T at which the picture was taken;

The obtaining video data includes:

Obtaining data of the image data from a time T-T1 to a time T+T2, and acquiring audio data of the audio data from a time T-T1 to a time T+T2;

Optionally, the T1 is a first preset time interval, and T2 is a second preset time interval.

The method and device for generating a video picture according to the present invention acquires picture data by a picture data acquiring unit; and acquires video data by using a video data acquiring unit; thereby obtaining, by the synthesizing unit, the picture data and video data acquiring unit acquired by the picture data acquiring unit The video data is encapsulated into a file. The technical solution provided by the embodiment of the present invention solves the problem that the picture and the video respectively have independent storage files and display effects in the related art, and the display effect is relatively simple, and the function of synthesizing the picture and the video into one file is implemented for the user. Bring more joy and improve The experience of the household.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present invention;

2 is a schematic flowchart of a method for generating a video picture according to an embodiment of the present invention;

FIG. 3 is a schematic flowchart diagram of another method for generating a video picture according to an embodiment of the present disclosure;

FIG. 4 is a schematic flowchart diagram of still another method for generating a video picture according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of time selection of a video data in a method for generating a video picture according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic flowchart diagram of still another method for generating a video picture according to an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a photographing interface of a mobile terminal in a method for generating a video picture according to an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of another recorded video interface of a mobile terminal in a method for generating a video picture according to an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of an apparatus for generating a video picture according to an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of another apparatus for generating a video picture according to an embodiment of the present disclosure;

FIG. 11 is a schematic diagram of an electrical structure of a camera in an apparatus for generating a video picture according to an embodiment of the present invention.

Embodiments of the invention

It is to be understood that the embodiments described below are merely illustrative of the invention and are not intended to limit the invention.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments herein may be arbitrarily combined with each other.

The steps illustrated in the flowchart of the figures may be executed in a computer system in accordance with a set of computer executable instructions. And, although the logical order is shown in the flowchart, in some cases The steps shown or described may be performed in an order different from that herein.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

FIG. 1 is a schematic diagram showing the hardware structure of a mobile terminal embodying various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication device or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may also include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. Broadcast signals can exist in various forms, for example, they can be widely used in digital multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), etc. exist. The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast apparatuses. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting device of the @) data broadcasting device, the terrestrial digital broadcasting integrated service (ISDB-T), or the like receives the digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast apparatuses suitable for providing broadcast signals as well as the above-described digital broadcast apparatuses. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technologies include BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), ZigbeeTM, and the like.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of a location information module is a GPS (Global Positioning Device). According to the related art, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information according to longitude, latitude, and altitude. In the related art, the method for calculating position and time information uses three satellites and corrects the error of the calculated position and time information by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122, the camera 121 being imaged in a video capture mode or an image capture mode The image data of the still picture or video obtained by the capture device is processed. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration of the mobile terminal 100 or the speed of movement and direction, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 141 which will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter referred to as "identification device") may take the form of a smart card. Therefore, the identification device can be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a pickup, a buzzer, and the like.

The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides Operate the appropriate power required for each component and component.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

FIG. 2 is a schematic flowchart of a method for generating a video picture according to an embodiment of the present invention. The method for generating a video picture provided in this embodiment is applied to an intelligent terminal, where the smart terminal includes, for example, a smart phone, a tablet computer, and the like. The method may include the following steps, namely, S110 to S130:

S110. Acquire image data.

In the embodiment of the present invention, the source of the picture data may be the picture data captured by the shooting unit, the picture saved in the terminal, or the picture stored on the server. For example, the user can open the camera of the mobile terminal, take a photo by the camera to obtain the image data, or select the image saved in the mobile terminal, obtain the image data through the corresponding module, and obtain the image of the server through the network to read the image. data.

S120. Acquire video data.

In the embodiment of the present invention, the source of the video data may be diverse. For example, the video data may be collected through the camera preview data of the mobile terminal, or may be the camera function through the mobile terminal. The video data that can be captured can also be video data that has been saved in the mobile terminal (or other memory).

S130. Encapsulate picture data and video data into a file.

In S130, in S130, the image data and the video data are encapsulated into a file, and the image data and the video data are associated with each other to generate a new file, and the associated image can be played when the photo is viewed. The effect of video data.

The method for generating a video picture according to the present invention, the picture data and the video data are encapsulated into a file by acquiring the picture data, and the picture data and the video data are encapsulated into a file; the technical solution provided by the embodiment of the invention solves the picture in the related art The video has independent storage files and display effects, which leads to a single display effect. The function of synthesizing pictures and videos into one file brings more joy to the user and improves the user experience.

Optionally, FIG. 3 is a schematic flowchart of another method for generating a video picture according to an embodiment of the present invention. In this embodiment, an implementation manner of encapsulating picture data and video data into a file is specifically described in FIG. 2 . On the basis of the illustrated embodiment, S130 in this embodiment may include the following steps, namely, S131 to S133:

S131. Create an image file.

Create an image file, the created image file is saved in standard image format, for example, can be saved as: .jpg, .jpeg, .gif, .png, .bmp and other formats.

S132. Write image data and video data into the created image file.

This embodiment adds additional data based on the data of the picture file, and may include, for example, video data, and the data length of the picture data, or the start position identifier of the picture data, or the start position identifier of the video data, which is guaranteed. The standard format of the image file is not destroyed and saved in the standard image format, for example, can be saved as: .jpg, .jpeg, .gif, .Png, .bmp, etc., so that any terminal can preview before adding additional data. Original image file.

S133. Write an identifier in the picture file.

In this embodiment, the identifier is used to indicate that the picture file is a video picture. If the file format information of the image file includes an identifier of the video data, the image file is a video image file; The file format information of the image file contains only the header of the file and the related information of the image data, and the image file is a normal image file. In this way, when the terminal reads the identifier to determine that a picture file is a video picture file, the picture data can be read from the video picture file, and the picture data of the read picture file is sent to the picture player and the picture player is prompted. Playing; and, according to the data length of the picture data and/or the start position identifier of the picture data, moving to the start position of the video data, reading the video file data, and reading the video file The data is sent to the video player and prompted to the video player for playback.

Optionally, before the S132, the embodiment may further include: acquiring a data length of the picture data; correspondingly, the S132 in the embodiment may include: writing the data length of the picture data, the video data, and the picture data to be created. In the picture file. In addition, in the picture file in the embodiment of the present invention, the start position identifier of the picture data or/and the start position identifier of the video data may also be written.

Optionally, FIG. 4 is a schematic flowchart of a method for generating a video picture according to an embodiment of the present invention. The method provided in this embodiment may include the following steps, that is, S210-S260:

S210. Store the acquired image data when the shooting unit is activated to perform framing.

When detecting that the mobile terminal is in the shooting framing state, the shooting unit may acquire image data of the photographic subject, and the capturing unit acquires the image data by sending the image data to the storage unit in the mobile terminal through the internal interface for subsequent Perform step utilization. It can be understood that, in this embodiment, the image data may be stored in the memory card of the mobile terminal, or may be temporarily stored in the cache of the mobile terminal, which is not limited in this embodiment of the present invention.

FIG. 7 is a schematic diagram of a photographing interface of a mobile terminal in a method for generating a video image according to an embodiment of the present invention, and FIG. 8 is a recording video interface of another mobile terminal in a method for generating a video image according to an embodiment of the present disclosure; The schematic diagram, as shown in FIG. 7, shows that the display interface of the mobile terminal is a photographing interface in the image capturing mode. As shown in FIG. 8 , the display interface of the mobile terminal is shown as a recorded video interface in the image capturing mode.

S220. When receiving a photographing instruction, take a picture and obtain picture data.

When the mobile terminal receives the photographing instruction, the photograph is taken, and the image is obtained according to the photographed image. data.

S230. Obtain a time T at which a picture is taken.

When the mobile terminal receives the photographing instruction to take a picture, the mobile terminal records the time T at which the picture is taken, and when necessary, the recording file can be read to obtain the data.

S240. Acquire image data of the image data from the time T-T1 to the time T+T2.

When the user triggers the photographing instruction, it is usually because the currently photographed scene is like it. In order to avoid the situation in the related art that the missed highlight picture is missed due to the shooting delay, the photographing time (ie, the time T) may be selected for a period of time. Image data is added to the image file as video data.

FIG. 5 is a schematic diagram of time selection of a video data in a method for generating a video picture according to an embodiment of the present invention. In the embodiment, in S210, the image data acquired by the shooting unit of the mobile terminal is stored, and the image data from the time T-T1 to the time T+T2 is intercepted according to the time T of the captured picture acquired in S230. . The T1 in this embodiment is a first preset value, and T2 is a second preset value.

S250: Encode image data in the image data from T-T1 time to T+T2 time to generate video data in a video format.

After acquiring the image data from the time T-T1 to the time T+T2, the image data may be encoded into video data in a video format by an encoding tool in the mobile terminal, and the encoded video data may be output. In this embodiment, in S250, the image data may be encoded into a common video format, for example, including: video/avc, video/3gpp, video/mp4v-es, etc., and the video coding mode may be universal in the related art. Coding technology.

S260. Encapsulate image data and video data into a file.

For the implementation of S260 in this embodiment, reference may be made to S131 to S133 in the embodiment shown in FIG. 3, and details are not described herein again.

Optionally, FIG. 6 is a schematic flowchart of a method for generating a video picture according to an embodiment of the present disclosure. The method for generating a video picture in this embodiment may include the following steps, that is, S310 to S360:

S310. When the photographing unit is activated to perform framing, the acquired image data is stored, audio data synchronized with the image data is collected, and the collected audio data is stored.

When detecting that the mobile terminal is in the shooting framing state, the shooting unit may acquire image data of the photographic subject, and the capturing unit acquires the image data by sending the image data to the storage unit in the mobile terminal through the internal interface for subsequent Perform step utilization. In this embodiment, while acquiring image data, audio data synchronized with the video data may be collected by an audio device (such as a microphone) of the mobile terminal, and the collected audio data may be stored.

It can be understood that, in this embodiment, the image data may be stored in the memory card of the mobile terminal, or may be temporarily stored in the cache of the mobile terminal, which is not limited in this embodiment of the present invention.

S320. When receiving a photographing instruction, take a picture and obtain image data.

When the mobile terminal receives the photographing instruction, the photograph is taken, and the image data is obtained according to the photographed image.

S330. Obtain a time T at which a picture is taken.

S340. Acquire image data of the image data from T-T1 time to T+T2 time, and acquire audio data of the audio data from T-T1 time to T+T2 time.

When the user triggers the photographing instruction, it is usually because the currently photographed scene is like it. In order to avoid the situation in the related art that the missed highlight picture is missed due to the shooting delay, the photographing time (ie, the time T) may be selected for a period of time. Image data and audio data The composite video data is added to the image file.

Referring to the schematic diagram of the video data time selection shown in FIG. 5, the audio data time selection is the same as the video data time selection method shown in FIG. 5, and therefore will not be described herein. In this embodiment, in S310, the image data acquired by the shooting unit of the mobile terminal is stored, and the image data from the time T-T1 to the time T+T2 is intercepted according to the time T of the captured picture acquired in S330. And audio data from the T-T1 time to the T+T2 time. The T1 in this embodiment is a first preset value, and T2 is a second preset value.

S350. Encode the image data in the image data from the T-T1 time to the T+T2 time and the audio data in the audio data from the T-T1 time to the T+T2 time to generate the video data in the video format.

After acquiring the image data and the audio data from the T-T1 time to the T+T2 time, the image data and the audio data can be encoded into the video data in the video format by the coding tool in the mobile terminal, and the coded output is obtained. Video data. In this embodiment, in S350, the foregoing data may be encoded into a common video format, for example, including: video/avc, video/3gpp, video/mp4v-es, etc., and the video coding mode used may be a general-purpose coding in the related art. technology.

S360, encapsulating picture data and video data into a file.

For the implementation of S360 in this embodiment, reference may be made to S131 to S133 in the embodiment shown in FIG. 3, and details are not described herein again.

According to the above method embodiment provided by the embodiment of the present invention, an embodiment of the present invention further provides an apparatus for generating a video picture. As shown in FIG. 9 , a schematic structural diagram of an apparatus for generating a video picture according to an embodiment of the present invention may be configured in a smart terminal, where the smart terminal may be a smart phone, a tablet computer, or the like. The apparatus for generating a video picture may include a picture data acquiring unit 10, a video data acquiring unit 20, and a synthesizing unit 30.

The picture data obtaining unit 10 is configured to: obtain picture data;

The video data acquiring unit 20 is configured to: acquire video data;

The synthesizing unit 30 is configured to encapsulate the picture data acquired by the picture data acquiring unit 10 and the video data acquired by the video data acquiring unit 20 into one file.

In the embodiment of the present invention, the source of the image data acquired by the image data acquiring unit 10 may be the image data captured by the shooting unit, the image saved in the terminal, or the image stored on the server. For example, the user can open the camera of the terminal, take a photo by the camera to obtain the image data, or select the image saved in the terminal, obtain the image data through the corresponding module, and obtain the image of the server through the network to read the image data.

The source of the video data acquired by the video data acquiring unit 20 may be various. For example, the video data may be collected through the camera preview data of the terminal, or may be video data captured by the camera function of the terminal, or may be saved in the terminal. Video data (or other memory).

The synthesizing unit 30 encapsulates the acquired picture data and video data into a file, associates the picture data with the video data, and generates a new file, so that the effect of playing the associated video data can be played when the photo is viewed.

Optionally, in the embodiment of the present invention, the synthesizing unit 30 is configured to encapsulate the image data acquired by the image data acquiring unit 10 and the video data acquired by the video data acquiring unit 20 into a file, including:

A. Create an image file.

Create an image file, the created image file is saved in standard image format, for example, can be saved as: .jpg, .jpeg, .gif, .png, .bmp, etc.

B. Write picture data and video data into the created image file.

C. Write an identifier in the image file.

In this embodiment, the identifier is used to indicate that the picture file is a video picture. If the file format information of the image file includes an identifier of the video data, the image file is a video image file; if the file format information of the image file includes only the file header and related information of the image data, the image file is a normal image. file. In this way, when the terminal reads the identifier to determine that a picture file is a video picture file, the picture data can be read from the video picture file, and the picture data of the read picture file is sent to the picture player and the picture player is prompted. Playing; and, according to the data length of the picture data and/or the start position identifier of the picture data, moving to the start position of the video data, reading the video file data, and reading the video file The data is sent to the video player and prompted to the video player for playback.

Optionally, the picture data acquiring unit 10 in this embodiment is further configured to: obtain a data length of the picture data; correspondingly, the synthesizing unit 30 in the embodiment writes the picture data and the video data. The picture file may include: the data length of the picture data and the picture data acquired by the picture data obtaining unit 10, and the video data acquired by the video data acquiring unit 20 are written into the created picture file. In addition, in the picture file in the embodiment of the present invention, the start position identifier of the picture data or/and the start position identifier of the video data may also be written.

Optionally, FIG. 10 is a schematic structural diagram of another apparatus for generating a video picture according to an embodiment of the present invention. The device for generating a video picture according to the embodiment of the present disclosure may further include:

The photographing unit 40 is configured to: when receiving the photographing instruction, take a picture and trigger the picture data acquiring unit 10 to acquire the picture data.

In an optional implementation manner of the embodiment of the present invention, the apparatus provided in this embodiment may further include: a storage unit 50 configured to store the acquired image data when the photographing unit 40 is activated to perform the framing.

Optionally, the apparatus provided in this embodiment may further include:

The photographing time acquisition unit 60 is configured to: acquire the time T at which the photographing unit 40 takes a picture;

Correspondingly, the video data acquiring unit 20 in this embodiment is configured to acquire video data, including:

Obtaining data of the image data stored by the storage unit 50 from the time T-T1 to the time T+T2;

In another optional implementation manner of the embodiment of the present invention, the apparatus provided in this embodiment may further include: an audio data collecting unit 70;

The storage unit 50 in this embodiment is further configured to: when the shooting unit 40 is activated to perform framing, store the acquired image data;

The audio data collecting unit 70 is configured to: collect audio data synchronized with the image data stored by the storage unit 50;

The storage unit 50 is further configured to store the audio data collected by the audio data collection unit 70.

The shooting time acquisition unit 60 in this embodiment is configured to: acquire the time T at which the shooting unit 40 captures a picture;

Acquiring data in the image data stored in the storage unit 50 from the time T-T1 to the time T+T2, and acquiring the audio data in the audio data stored by the storage unit 50 from the time T-T1 to the time T+T2;

The image data in the image data from the T-T1 time to the T+T2 time and the audio data in the audio data from the T-T1 time to the T+T2 time are encoded to generate video data in the video format.

FIG. 11 is a schematic diagram showing the electrical structure of a camera in an apparatus for generating a video picture according to an embodiment of the present invention.

The photographic lens 1211 may include a plurality of optical lenses that form a subject image, and may be a single focus lens or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 drives and controls the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is provided to image the subject image and acquire captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of red, green, blue (abbreviation: RGB) color filters.

The imaging element 1212 is connected to an imaging circuit 1213 that performs charge accumulation control and image signal readout control in the imaging element 1212, and reduces the reset noise after the read image signal (for example, an analog image signal). The shaping is performed, and the gain is increased to obtain an appropriate signal level.

The imaging circuit 1213 is connected to an analog-to-digital conversion (A/D) converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal to the bus 1227 (hereinafter referred to as It is image data).

The bus 1227 is configured to transmit a transmission path of various data read or generated inside the camera. path. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, and a Synchronous Dynamic Random Access Memory (SDRAM) 1218 are connected. A memory interface (hereinafter referred to as a memory I/F) 1219 and a liquid crystal display (LCD) driver 1220.

The image processor 1215 performs output buffering (Output Buffer, abbreviated as: OB) subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, and the image data based on the output of the imaging element 1212. Various image processing such as simultaneous processing and edge processing. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button The operation controls such as various input buttons and various input keys detect the operation state of these operation controls.

The detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is provided as an electrically rewritable volatile memory that temporarily stores image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. The LCD 1226 may be an LCD, but is not limited thereto, and the LCD 1226 may be implemented by other display panels such as organic electroluminescence (EL), but is not limited thereto.

The above are only the embodiments and the optional embodiments of the present invention, and are not intended to limit the scope of the embodiments of the present invention. Any equivalent structure or equivalent process transformations made by the contents of the specification and the drawings herein, or directly or indirectly In other related technical fields, the same is included in the scope of patent protection of the present invention.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium on a corresponding hardware platform (according to The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Industrial applicability

In the embodiment of the present invention, the image data is acquired by the image data acquiring unit; and the video data is acquired by the video data acquiring unit; the image data acquired by the image data acquiring unit and the video data obtained by the video data acquiring unit are encapsulated into a file by the synthesizing unit. . The technical solution provided by the embodiment of the present invention solves the problem that the picture and the video respectively have independent storage files and display effects in the related art, and the display effect is relatively simple, and the function of synthesizing the picture and the video into one file is implemented for the user. Bring more joy and improve the user experience.

Claims

An apparatus for generating a video picture, comprising: a picture data acquiring unit, a video data acquiring unit, and a synthesizing unit;

The image data acquiring unit is configured to: acquire image data;

The video data acquiring unit is configured to: acquire video data;

The synthesizing unit is configured to encapsulate the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit into one file.
The apparatus according to claim 1, wherein the synthesizing unit is configured to package the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit into a file, including:

Create an image file;

Writing the picture data and the video data into the created picture file;

An identifier is written in the picture file.
The device according to claim 2, wherein the picture data obtaining unit is further configured to: acquire a data length of the picture data;

The synthesizing unit is configured to write the picture data and the video data into the created picture file, including:

And the data length of the picture data and the picture data acquired by the picture data acquiring unit and the video data acquired by the video data acquiring unit are written into the created picture file.
The device according to claim 2, wherein the picture file further comprises one or more of the following: a data length of the picture data, a start position identifier of the picture data, and a start of the video data. Start location identifier.
The apparatus according to any one of claims 1 to 4, further comprising:

The photographing unit is configured to: when receiving the photographing instruction, take a picture and trigger the picture data acquiring unit to acquire the picture data.
The apparatus of claim 5 further comprising:

The storage unit is configured to: when the photographing unit is activated to perform framing, store the acquired image data.
The apparatus of claim 6 further comprising:

a shooting time acquisition unit, configured to: acquire a time T at which the shooting unit takes a picture;

The video data acquiring unit is configured to acquire video data, including:

Acquiring data in the image data stored by the storage unit from a time T-T1 to a time T+T2;

Image data of the image data from time T-T1 to time T+T2 is encoded to generate video data in a video format.
The apparatus of claim 5 further comprising:

a storage unit, configured to: when the shooting unit is activated to perform framing, storing the acquired image data;

An audio data collecting unit, configured to: collect audio data synchronized with the image data stored by the storage unit;

The storage unit is further configured to: store audio data collected by the audio data collection unit.
The apparatus of claim 8 further comprising:

a shooting time acquisition unit, configured to: acquire a time T at which the shooting unit takes a picture;

The video data acquiring unit is configured to acquire video data, including:

Obtaining data of the image data stored by the storage unit from a time T-T1 to a time T+T2, and acquiring audio data of the audio data stored by the storage unit from a time T-T1 to a time T+T2;

The image data of the image data from the T-T1 time to the T+T2 time and the audio data of the audio data from the T-T1 time to the T+T2 time are encoded to generate video data in a video format.
The device according to claim 7 or 9, wherein the T1 is a first preset time interval, and the T2 is a second preset time interval.
A method of generating a video picture, comprising:

Get image data;

Obtain video data;

Encapsulating the picture data and the video data into a file.
The method of claim 11 wherein said encapsulating said picture data and said video data into a file comprises:

Create an image file;

Writing the picture data and the video data into the created picture file;

An identifier is written in the picture file.
The method of claim 12, wherein before the writing the picture data and the video data into the created picture file, the method further comprises:

Obtaining a data length of the picture data;

The writing the picture data and the video data into the created picture file includes:

The data length of the picture data, the video data, and the picture data is written into the created picture file.
The method according to claim 12, wherein the picture file further comprises one or more of the following: a data length of the picture data, a start position identifier of the picture data, and a start of the video data. Start location identifier.
The method according to any one of claims 11 to 14, wherein the acquiring picture data comprises:

When a photographing instruction is received, a picture is taken and the picture data is acquired.
The method of claim 15 further comprising:

When the shooting unit is activated for framing, the acquired image data is stored.
The method of claim 16 further comprising:

Obtain the time T at which the picture was taken;

The obtaining video data includes:

Obtaining data of the image data from the time T-T1 to the time T+T2;

The image data of the image data from the time T-T1 to the time T+T2 is encoded to generate video data in a video format.
The method of claim 15 further comprising:

When the shooting unit is activated for framing, the acquired image data is stored;

Audio data synchronized with the image data is acquired, and the collected audio data is stored.
The method of claim 18, further comprising:

Obtain the time T at which the picture was taken;

The obtaining video data includes:

Obtaining data of the image data from a time T-T1 to a time T+T2, and acquiring audio data of the audio data from a time T-T1 to a time T+T2;

The image data of the image data from the T-T1 time to the T+T2 time and the audio data of the audio data from the T-T1 time to the T+T2 time are encoded to generate video data in a video format.
The method according to claim 17 or 19, wherein the T1 is a first preset time interval, and the T2 is a second preset time interval.