WO2017185808A1

WO2017185808A1 - Data processing method, electronic device, and storage medium

Info

Publication number: WO2017185808A1
Application number: PCT/CN2016/113980
Authority: WO
Inventors: 刘林汶
Original assignee: 努比亚技术有限公司
Priority date: 2016-04-27
Filing date: 2016-12-30
Publication date: 2017-11-02
Also published as: CN105898158B; CN105898158A

Abstract

Disclosed is a data processing method. The method comprises: an electronic device captures at least one piece of video data in real time in an image capturing region corresponding to at least one image capturing means by using the at least one image capturing means; process, by at least using a first video processing policy and a second video processing policy, at least some sub-data in the at least one piece of video data captured in real time, so as to obtain at least two pieces of target sub-video data, the first video processing policy being different from the second video processing policy; and generate target video data on the basis of the at least two pieces of target sub-video data, so that the target video data comprises video data that can be presented by means of at least two different presentation approaches. Also disclosed are an electronic device and a storage medium.

Description

Data processing method, electronic device and storage medium

Technical field

The present invention relates to electronic technologies, and in particular, to a data processing method, an electronic device, and a storage medium.

Background technique

The functions of existing electronic devices are more and more, and more and more functions have become the standard configuration of electronic devices, for example, the camera function of electronic devices; users can use the camera function of electronic devices to take photos or video recording; When the video recording is performed by using the photographing function, the electronic device usually processes the collected video data in the same video processing strategy, and is presented in the same presentation manner on the display screen of the electronic device when presented. Can not meet the user's demand for diversified presentation methods, reducing the user experience.

Summary of the invention

In view of the above, in order to solve the existing technical problems, the embodiments of the present invention provide a data processing method, an electronic device, and a storage medium, which can at least solve the problems existing in the prior art and enrich the user experience. Improved user experience.

The technical solution of the embodiment of the present invention is implemented as follows:

A first aspect of the embodiments of the present invention provides a data processing method, including:

The electronic device acquires at least one video data in real time in an image capturing area corresponding to the at least one image capturing device by using at least one image capturing device;

Processing at least part of the at least one of the at least one video data collected in real time to obtain at least two target sub video data by using at least a first video processing policy and a second video processing policy; Different from the second video processing strategy;

Generating target video data based on the at least two target sub-video data to make the target Video data is included in the video data that can be rendered in at least two different presentations.

In the above solution, when the video data of different presentation modes included in the target video data is data of the same video source, the video data processed by the first video processing policy and the second video processing policy may be all The same video data can also be partially identical video data, and can also be completely different video data.

In the above solution, the image processing unit is further configured to select different or the same video processing policies for the video data of different display areas by using a user operation implemented in the framing interface of the electronic device.

In the above solution, the different presentation manners represent different video feature parameters of the presented video data.

In the above solution, the image processing unit is further configured to acquire a video feature parameter input by the user through a user interaction interface, and determine a video processing policy based on the video feature parameter input by the user; or

The video feature parameter matching the size of the area of the display area is selected from the preset relationship list by the size of the area of the display area selected by the user, and the video processing policy is determined based on the selected video feature parameter; the preset relationship list A list of correspondences between the size of the area of the display area and the video feature parameters.

In the above solution, the processing, by using the first video processing policy, the at least part of the at least one piece of the video data collected in real time, includes:

And reducing a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter characterizing a number of video frames per unit time;

And at least part of the at least one piece of video data that is reduced by the video feature parameter is used as the first target sub-video data; wherein the first target sub-video data is included in the at least two target sub-video data The first target sub-video data can be presented in a first presentation.

In the above solution, the using the second video processing policy to collect the at least one in real time Processing at least some of the sub-data in the video data, including:

And adjusting a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter characterizing a number of video frames per unit time;

At least part of the at least one piece of video data whose audio feature parameter is increased is used as the second target sub-video data; wherein the second target sub-video data is included in the at least two target sub-video data The second target sub-video data can be presented in a second presentation.

In the above solution, the adjusting the video feature parameters of at least part of the at least one of the at least one video data collected in real time includes:

Determining a video storage feature parameter based on the acquisition feature parameter; the video storage feature characterizing a number of video frames to be saved in a unit time;

And deleting, according to the determined video storage feature parameter, the captured video frame in the video data, and adjusting a video feature parameter in the video data collected in real time.

In the above solution, the method further includes:

Storing the target video data;

The at least two target sub-video data in the target video data are presented in different presentation manners in at least a first display area and a second display area of the electronic device based on a user operation.

A second aspect of the embodiments of the present invention provides an electronic device, including:

The image acquisition unit is configured to acquire at least one video data in real time in an image collection area corresponding to the at least one image acquisition device by using at least one image acquisition device;

The image processing unit is configured to process at least part of the at least one of the at least one video data collected in real time by using at least the first video processing policy and the second video processing policy to obtain at least two target sub video data; The first video processing policy is different from the second video processing strategy;

a video data generating unit configured to generate a mesh based on the at least two target sub video data The video data is marked such that the target video data includes video data that can be presented in at least two different presentations.

In the above solution, the method further includes:

Selecting different or the same video processing strategies for video data of different display areas by user operations implemented in the view interface of the electronic device.

In the above solution, the video processing policy is a preset processing policy or a processing policy set according to a user operation.

In the above solution, the method further includes:

Obtaining a video feature parameter input by the user through a user interaction interface, and determining a video processing strategy based on a video feature parameter input by the user; or

In the above solution, the image processing unit is further configured to reduce a video feature parameter corresponding to at least a part of the at least one piece of the video data collected in real time; the video feature parameter is used to represent a video frame in a unit time. number;

And configuring, as the first target sub-video data, at least part of the at least one video data that is reduced by the video feature parameter; wherein the first target sub-video data is included in the at least two target sub- In the video data; the first target sub video data can be the first Presented in a presentation.

In the above solution, the image processing unit is further configured to: adjust a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; and the video feature parameter represents a video frame in a unit time number;

And configuring, as the second target sub-video data, at least part of the at least one video data that is adjusted by the video feature parameter; wherein the second target sub-video data is included in the at least two target sub- In the video data; the second target sub-video data can be presented in a second presentation.

In the above solution, the image processing unit is further configured to determine a video storage feature parameter based on the collected feature parameter, and delete the captured video frame in the video data according to the determined video storage feature parameter. And adjusting the video feature parameters in the video data collected in real time; wherein the video storage feature represents the number of video frames to be saved in a unit time.

In the above solution, the electronic device further includes a storage unit and a video display unit;

The storage unit is configured to store the target video data;

The video display unit is configured to present the at least two target sub-video data in the target video data in different presentation manners according to a user operation in at least a first display area and a second display area of the electronic device.

A third aspect of the embodiments of the present invention provides a computer storage medium, wherein the computer storage medium stores a computer program for executing the data processing method described above.

The data processing method and the electronic device and the storage medium according to the embodiment of the present invention collect at least one video data in real time in the image collection area corresponding to the at least one image capturing device by using at least one image capturing device, and at least utilize the first a video processing strategy and a second video processing policy, processing at least part of the at least one of the at least one video data collected in real time to obtain at least two target sub video data, and further based on the at least two target sub- The video data generates the target video data, so that the video data included in the target video data can be presented in different presentation manners. Therefore, the method described in the embodiment of the present invention enriches the user experience and improves the user experience; It also satisfies the user's need for diversification of presentation methods.

DRAWINGS

1 is a schematic structural diagram of hardware of an optional mobile terminal embodying various embodiments of the present invention;

2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;

3 is a schematic flowchart of an implementation process of a data processing method according to an embodiment of the present invention;

4 is a schematic diagram 1 of a specific application of a data processing method according to an embodiment of the present invention;

FIG. 5 is a second schematic diagram of a specific application of a data processing method according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

detailed description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the scope of the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminals described in the present invention may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), navigation devices, and the like. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that in addition to being specifically used for mobile In addition to the elements of the object, the configuration according to an embodiment of the present invention can also be applied to a fixed type of terminal.

1 is a schematic diagram showing the hardware structure of an optional mobile terminal embodying various embodiments of the present invention. As shown in FIG. 1, the mobile terminal 100 may include a wireless communication unit 110, an audio/video (A/V) input unit 120, and user input. The unit 130, the sensing unit 140, the output unit 150, the memory 160, the interface unit 170, the controller 180, the power supply unit 190, and the like. FIG. 1 illustrates a mobile terminal 100 having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal 100 will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems. In particular, the broadcast receiving module 111 can use a data broadcasting system such as Multimedia Broadcast-Turround (DMB-T), Digital Multimedia Broadcast-Satellite (DMB-S), DVB-H, Forward Link Media (MediaFLO ^@ ), Digital broadcasting systems such as the terrestrial digital broadcasting integrated service (ISDB-T) and the like receive digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal 100. The wireless internet module 113 can be internally or externally coupled to the terminal. The wireless internet access technologies involved in the wireless internet module 113 may include wireless local area network (WLAN), wireless compatibility authentication (Wi-Fi), wireless broadband (Wibro), global microwave interconnection access (Wimax), and high speed downlink. Packet Access (HSDPA) and more.

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal 100. A typical example of the location information module 115 is a location information module 115 as a global positioning system (GPS). According to the current technology, the position information module 115 as a GPS calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate the three-dimensional current based on longitude, latitude, and altitude. location information. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the position information module 115 as a GPS can calculate the speed information by continuously calculating the current position information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. Processed map The image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal 100. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal 100. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port (a typical example is a universal serial bus USB port), for connection having The port of the device that identifies the module, the audio input/output (I/O) port, the video I/O port, the headphone port, and so on. The identification module can be stored for storage The user is authenticated with various information of the mobile terminal 100 and may include a User Identity Module (UIM), a Customer Identity Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device.

The interface unit 170 can be configured to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal 100 and externally Data is transferred between devices.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path of the terminal 100. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal 100 is accurately mounted on the base.

Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays can be constructed to be transparent to allow the user to view from the outside, which can be referred to as transparent display A typical transparent display can be, for example, a transparent organic light emitting diode (TOLED) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) ). The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may output audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is converted and output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a speaker, a buzzer, and the like.

The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.

The memory 160 may store a software program or the like that performs processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, and the like) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), random. Access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. Wait. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing or playing back multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal 100 has been described in terms of its function. Hereinafter, for the sake of brevity, the slide type mobile terminal 100 in various types of mobile terminals 100 such as a folding type, a bar type, a swing type, a slide type mobile terminal 100, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal 100, and is not limited to the slide type mobile terminal 100.

The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which the mobile terminal 100 according to the present invention can operate will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the BS 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 can include multiple BSCs 275.

Each BS 270 can serve one or more partitions (or regions), with each partition covered by a multi-directional antenna or an antenna pointing in a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally mean a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as multiple cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the system for operation. The mobile terminal 100 is made. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several satellites 300 are shown, for example GPS satellites 300 may be employed. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The position information module 115 as a GPS as shown in FIG. 1 is generally configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking techniques or in addition to GPS tracking techniques, other techniques that can track the location of the mobile terminal 100 can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular BS 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC 275 provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, MSC 280 interfaces with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.

The mobile communication module 112 of the wireless communication unit 110 in the mobile terminal accesses the mobile based on necessary data (including user identification information and authentication information) of the mobile communication network (such as 2G/3G/4G mobile communication network) built in the mobile terminal. The communication network transmits mobile communication data (including uplink mobile communication data and downlink mobile communication data) for services such as web browsing and network multimedia playback of the mobile terminal user.

The wireless internet module 113 of the wireless communication unit 110 implements a function of a wireless hotspot by operating a related protocol function of a wireless hotspot, and the wireless hotspot supports access of a plurality of mobile terminals (any mobile terminal other than the mobile terminal) by multiplexing the mobile communication module. 112 and mobile communication networks The mobile communication connection transmits mobile communication data (including uplink mobile communication data and downlink mobile communication data) for mobile terminal users such as web browsing and network multimedia broadcasting, since the mobile terminal is substantially a multiplexed mobile terminal and a communication network. The mobile communication connection between the mobile communication data is transmitted, so that the traffic of the mobile communication data consumed by the mobile terminal is included in the communication tariff of the mobile terminal by the charging entity on the communication network side, thereby consuming the communication tariff included in the subscription of the mobile terminal. Data traffic for mobile communication data.

Based on the above-described hardware structure of the mobile terminal 100 and the communication system, various embodiments of the method of the present invention are proposed.

Embodiment 1

The embodiment of the present invention provides a data processing method. Specifically, FIG. 3 is a schematic flowchart of an implementation of a data processing method according to an embodiment of the present invention; the method is applied to an electronic device, and the electronic device may be specifically described above. a mobile terminal; the electronic device is configured or linked with a display screen and at least one image acquisition device; as shown in FIG. 3, the method includes:

Step 301: The electronic device acquires at least one video data in real time in an image capturing area corresponding to the at least one image capturing device by using at least one image capturing device;

In an embodiment, the electronic device may use an image capturing device, such as a first camera to collect video data in real time in an image capturing area corresponding to the first camera. At this time, only one video data is collected; Further, the electronic device processes the same video data collected by the first camera by using at least the first video processing policy and the second video processing policy, thereby obtaining at least two target sub-video data, to finally obtain the The at least two target sub-video data generate target video data, that is, the video data of different presentation modes included in the target video data is data of the same video source.

Further, when the video data of different presentation modes included in the target video data is data of the same video source, the video data processed by the first video processing policy and the second video processing policy may be all the same Video data, which may also be partially identical video data, or may be completely different video data; for example, using the first camera to collect The obtained video data is the first video data, and the electronic device may process all the data of the first video data by using the first video processing policy and the second video processing policy, and may also Part of the first video data is processed; when the electronic device processes part of the data in the first video data by using the first video processing policy and the second video processing policy, different video processing policy processing Some of the video data may be the same or different. Here, in practical applications, it may be arbitrarily set according to actual conditions and user requirements, for example, by performing user operations in the framing interface of the electronic device, selecting different or the same videos for video data of different display areas. Processing strategy.

Specifically, FIG. 4 is a schematic diagram 1 of a specific application of the data processing method according to an embodiment of the present invention; as shown in FIG. 4, when the electronic device presents the collected video data in the first display area, the electronic device receives the display on the display. The user operation of the screen, and the dashed box shown in the left figure of FIG. 4 is popped up. Here, the size of the dotted frame can be enlarged or reduced by a user dragging, stretching, etc.; after the user determines the dotted frame, the dotted line The sub-video data corresponding to the frame is presented in the second display area of the electronic device in a small screen presentation manner. At this time, the electronic device may use the first video processing policy to view the first display area. The video data is processed, and the video data in the second display area is processed by using a second video processing strategy to obtain two target sub-video data, wherein the first target of the two target sub-video data The sub video data is normal video data, and the second target sub video data of the two target sub video data is video data of the slow motion, and further based on the Target sub-video data to obtain video data target, the target video data contains both ordinary video data playing speed, but also contains video data have slow motion, thereby enriching the user experience, but also enhance the user experience.

In another embodiment, the electronic device may acquire video data in real time in an image capturing area corresponding to the at least two second cameras by using at least two image capturing devices, such as at least two second cameras. The collected video data has at least two; further, the electronic device processes the different video data collected by the at least two second cameras by using at least the first video processing policy and the second video processing policy, and further Get at least two targets The video data is used to generate target video data based on the at least two target sub-video data, that is, the video data of different presentation modes included in the target video data is data of different video sources.

Specifically, FIG. 5 is a second schematic diagram of a specific application of the data processing method according to the embodiment of the present invention; as shown in FIG. 5, the electronic device uses the first camera (not shown in FIG. 5) set by itself to collect the first video data. And displaying the second display data in the first display area of the electronic device in real time. At the same time, the electronic device collects the second video data by using an external second camera (not shown in FIG. 5), and presents the second video data in real time to the second device. a display area; further, the electronic device may select and “magnify” different video data presented for each display area according to a gesture of “zooming in” or “zooming out” of the first display area and the second display area by the user in real time. a video processing strategy that matches the gesture of the "reduction", for example, processing the corresponding first video data in the first display area by using the first video processing policy, and using the second video processing policy to the second Processing corresponding second video data in the display area, thereby obtaining at least two target sub-video data, to finally be based on the at least two target sub-video numbers Generating target video data; here, the first target sub-video data in the target video data (ie, the video data processed by using the first video processing policy on the first video data) is video data of slow motion playback, and second The target sub-video data (ie, the video data processed by the second video processing strategy using the second video processing strategy) may be video data played by the fast lens.

It should be noted that those skilled in the art should know that the “zoom in” or “zoom out” gestures described in this embodiment can be arbitrarily set according to actual needs, for example, can be compared with existing “zoom in” or “zoom out” images. The same gestures.

Step 302: Process at least part of the sub-data in the at least one video data collected in real time by using at least a first video processing policy and a second video processing policy to obtain at least two target sub-video data; The video processing strategy is different from the second video processing strategy;

Step 303: Generate target video data based on the at least two target sub-video data, so that the target video data includes video data that can be presented in at least two different presentation manners.

In this embodiment, the different presentation manners may specifically represent different video feature parameters of the presented video data; where the video feature parameters specifically represent the number of video frames per unit time. That is to say, the different presentation manners may specifically characterize the speed of the presentation, for example, in a slow motion manner, or in a fast lens manner, or in a normal lens manner.

In this way, the data processing method in the embodiment of the present invention collects at least one video data in real time in the image collection area corresponding to the at least one image capturing device by using at least one image capturing device, and at least utilizes the first video processing strategy. And processing, by the second video processing strategy, at least part of the at least one of the at least one video data collected in real time to obtain at least two target sub-video data, and generating a target video based on the at least two target sub-video data The data, in this way, enables the video data contained in the target video data to be presented in different presentation manners. Therefore, the method described in the embodiment of the present invention enriches the user experience and enhances the user experience; The need to present a diverse approach.

Embodiment 2

Based on the method in the first embodiment, the embodiment of the present invention provides three specific video processing strategies. Here, in a video collection process, the following three specific video processing strategies may be used simultaneously or may be selected. Any two of the three specific video processing strategies, thus laying the foundation for rich presentation. Further, the video processing policy in this embodiment may be preset, or may be set at any time according to user operations, for example, acquiring video feature parameters input by the user through the user interaction interface, thereby determining a video processing policy; or Selecting, by the size of the area of the display area selected by the user, a video feature parameter that matches the size of the area of the display area from the preset relationship list (ie, the correspondence between the size of the area representing the display area and the video feature parameter), and further Determining a video processing strategy; here, those skilled in the art are aware that the embodiments of the present invention aim to emphasize that different video processing strategies are used to process the same video data, or different video data, and the processed video data is used to generate target video data. The target video data is included with video data that can be rendered in different presentation manners, so The setting process of the video processing strategy described above is for explanation only and is not intended to limit the present invention.

The first video processing strategy; specifically,

The electronic device reduces a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter represents a number of video frames per unit time; that is, the electronic The device reduces the number of video frames that are expected to be displayed in a unit time, and further delays the display time interval of the adjacent video frames to implement a slow lens processing strategy. Further, the electronic device reduces the video feature parameters by At least part of the at least one piece of video data as the first target sub-video data; wherein the first target sub-video data is included in the at least two target sub-video data; the first target sub-video data can Presented in a first presentation, such as in the form of a slow motion.

a second video processing strategy; specifically,

The electronic device adjusts a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter represents a number of video frames per unit time; that is, the electronic The device increases the number of video frames that are expected to be displayed in a unit time, thereby shortening the display time interval of the adjacent video frames, and implementing a processing strategy of the fast lens. Further, the electronic device adjusts the video feature parameters. At least part of the at least one piece of video data as the second target sub-video data; wherein the second target sub-video data is included in the at least two target sub-video data; the second target sub-video data can Presented in a second presentation, for example in the form of a fast shot.

In a specific embodiment, due to the masking property of the human eye on the time domain, that is, the details of the fast moving object are often difficult to detect by the human eye, the present embodiment reduces the video data by using the frame loss processing method based on the above features. The amount of data, in order to achieve the purpose of saving storage space. Specifically, the electronic device determines a video storage feature parameter based on the collected feature parameter (eg, a video capture duration, etc.); the video storage feature represents a number of video frames to be saved in a unit time; and according to the determined Video storage feature parameters for the collected video data The video frame is subjected to deletion processing, and the video feature parameters in the video data collected in real time are adjusted, thereby achieving the purpose of reducing the data amount of the target video data. Here, as the length of the video capture is extended, the number of video frames processed by the frame loss is increased; for example, when the video capture is started, the video as the target video data is selected from the currently collected video data per unit time. The number of frames is N; the N is a positive integer greater than or equal to 1; and the N is less than or equal to the number of video frames per unit time in a normal video, for example, 20 or 30. As the length of the video capture is extended, for example, when the video capture duration exceeds the first threshold, the number of video frames selected as the target video data from the currently collected video data becomes M in assuming ten minutes. The M is a positive integer greater than or equal to 1, and M is less than N; that is, when the video acquisition duration exceeds a certain threshold, the video frame as the target video data is selected from the currently collected video data per unit time. The number of the number is small, thereby achieving the purpose of saving storage space. Here, the unselected video frame is the discarded video frame.

The third video processing strategy may be specifically an existing common video processing strategy, which is not described here.

In this way, the embodiment of the present invention can process the collected same or different video data by using the above three video processing strategies, thereby obtaining a plurality of types of video data that can be presented in different presentation manners; The strategy can be arbitrarily combined in two or two, or three video processing strategies appear in one video collection process at the same time, thus satisfying the user's demand for diversified presentation modes, and enriching the user experience and improving the user experience.

Embodiment 3

The method according to the first embodiment or the second embodiment, in the embodiment, after the electronic device generates the target video data, the electronic device stores the target video data; and based on the user operation in the electronic The at least first display area and the second display area of the device present the at least two target sub-video data in the target video data in different presentation manners.

Here, in practical applications, the first display area and the second display area may be preset The area may be a display area determined according to a user operation; further, when the first display area and the second display area are display areas determined according to a user operation, the first display area and The size of the area of the second display area can be arbitrarily set according to user operations.

In an embodiment, the electronic device may further determine a rendering speed of the video data presented in the local area according to the size of the area of the display area, that is, the area size of the display area corresponds to a video processing policy; for example, The video data presented in the larger display area corresponds to a common video processing strategy, and the video data presented in the smaller display area corresponds to a video processing strategy of a fast lens or a slow motion.

In this way, by presenting video data of different presentation modes in different presentation areas, the user's perceived experience is enriched. At the same time, the above-mentioned presentation area may be an area determined according to user operations, thereby improving the user's participation and satisfying the user's. Control desire, which in turn enhances the user experience.

Here, it should be noted that the functions implemented by the methods in the first embodiment to the third embodiment can be implemented by using a processor in the electronic device to call the program code. Of course, the program code can be saved in a computer storage medium, and the electronic device can be seen. At least the processor and the storage medium are included.

The embodiment of the invention further describes a computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is used to execute the data processing method described in the embodiment of the invention.

Embodiment 4

The embodiment of the present invention provides an electronic device according to the method of any one of Embodiments 1 to 3; the electronic device may be specifically the mobile terminal described above; specifically, as shown in FIG. The electronic device includes:

The image capturing unit 61 is configured to acquire at least one video data in real time in an image capturing area corresponding to the at least one image capturing device by using at least one image capturing device;

The image processing unit 62 is configured to perform at least part of the at least one of the at least one video data collected in real time by using at least the first video processing policy and the second video processing policy And obtaining at least two target sub-video data; the first video processing policy is different from the second video processing strategy;

The video data generating unit 63 is configured to generate target video data based on the at least two target sub-video data such that the target video data includes video data that can be presented in at least two different presentation manners.

In an embodiment, the image processing unit is further configured to: reduce a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; and the video feature parameter represents a video frame in a unit time And the at least part of the at least one piece of video data that is reduced by the video feature parameter is configured as the first target sub-video data; wherein the first target sub-video data is included in the at least one In the two target sub-video data; the first target sub-video data can be presented in a first presentation manner.

In another embodiment, the image processing unit is further configured to: adjust a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter represents a video in a unit time The number of frames is further configured to use at least part of the at least one piece of video data that is adjusted by the video feature parameter as the second target sub-video data; wherein the second target sub-video data is included in the In at least two target sub-video data; the second target sub-video data can be presented in a second presentation.

In another embodiment, the image processing unit is further configured to determine a video storage feature parameter based on the collected feature parameter, and collect the video frame in the captured video data according to the determined video storage feature parameter. And performing a deletion process, and adjusting a video feature parameter in the video data collected in real time; wherein the video storage feature represents a number of video frames to be saved in a unit time.

In a specific embodiment, the electronic device further includes a storage unit and a video display unit; wherein

The storage unit is configured to store the target video data;

The video display unit is configured to operate at least first of the electronic device based on a user operation The display area and the second display area present the at least two target sub-video data in the target video data in different presentation manners.

It should be noted here that the description of the above electronic device embodiment item is similar to the above method description, and has the same beneficial effects as the method embodiment, and therefore will not be described again. For the technical details that are not disclosed in the embodiment of the present invention, those skilled in the art should understand that the description of the method embodiment of the present invention is omitted, and the details are not described herein.

In practical applications, the image processing unit 62 and the video data generating unit 63 may each be implemented by a central processing unit (CPU), or a microprocessor (MPU), or a DSP, or an FPGA. The image acquisition unit 61 can be implemented by a camera; the storage unit is implemented by a memory; and the video display unit is implemented by a display screen.

Further, when the electronic device is specifically a mobile terminal as shown in FIG. 1, the image processing unit 62 and the video data generating unit 63 may each be specifically implemented by a controller; the image capturing unit 61 may be implemented by the camera 121. The storage unit is implemented by a memory 160, and the video display unit may correspond to the display unit 151.

It is to be understood that the phrase "an embodiment" or "an embodiment" is intended to mean that a particular feature, structure, or characteristic that is associated with an embodiment is included in at least one embodiment of the invention. Thus, "a" or "an" In addition, these particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present invention, the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be directed to the embodiments of the present invention. The implementation process constitutes any limitation. The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. No more In the case of a limitation, an element defined by the phrase "comprising a ..." does not exclude the presence of the same element in the process, method, article, or device that comprises the element.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.

The units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units; they may be located in one place or distributed on multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; The unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

It will be understood by those skilled in the art that all or part of the steps of implementing the foregoing method embodiments may be performed by hardware related to program instructions. The foregoing program may be stored in a computer readable storage medium, and when executed, the program includes The foregoing steps of the method embodiment; and the foregoing storage medium includes: a removable storage device, a ROM, a magnetic disk, or an optical disk, and the like, which can store program codes.

Alternatively, the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a software product. The storage medium includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Industrial applicability

The embodiment of the present invention collects at least one video data in real time in the image capturing area corresponding to the at least one image capturing device by using at least one image capturing device, and uses at least the first video processing strategy and the second video processing strategy to perform real-time Processing at least part of the collected at least one piece of video data to obtain at least two target sub-video data, thereby generating target video data based on the at least two target sub-video data, such that the target video is caused The video data included in the data can be presented in different presentation manners. Therefore, the method described in the embodiment of the present invention enriches the user experience and enhances the user experience. At the same time, it also satisfies the user's demand for diversified presentation modes.

Claims

An electronic device, the electronic device comprising:

The image acquisition unit is configured to acquire at least one video data in real time in an image collection area corresponding to the at least one image acquisition device by using at least one image acquisition device;

The image processing unit is configured to process at least part of the at least one of the at least one video data collected in real time by using at least the first video processing policy and the second video processing policy to obtain at least two target sub video data; The first video processing policy is different from the second video processing strategy;

The video data generating unit is configured to generate target video data based on the at least two target sub-video data such that the target video data includes video data that can be presented in at least two different presentation manners.
The electronic device according to claim 1, wherein when the video data of different presentation modes included in the target video data is data of the same video source, the first video processing policy and the second video processing The video data processed by the policy may be all the same video data, or may be partially the same video data, or may be completely different video data.
The electronic device according to claim 1, wherein the image processing unit is further configured to select different or the same for video data of different display areas by a user operation implemented in a view interface of the electronic device. Video processing strategy.
The electronic device of claim 1, wherein the different presentation modes characterize different video feature parameters of the presented video data.
The electronic device according to claim 1, wherein the image processing unit is further configured to acquire a video feature parameter input by the user through a user interaction interface, and determine a video processing policy based on the video feature parameter input by the user; or

The video feature parameter matching the size of the area of the display area is selected from the preset relationship list by the size of the area of the display area selected by the user, based on the selected video feature parameters. Determining a video processing policy; the preset relationship list characterizing a correspondence list between the area size of the display area and the video feature parameter.
The electronic device according to claim 1, wherein the image processing unit is further configured to reduce a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter Characterizing the number of video frames per unit time;

And configuring, as the first target sub-video data, at least part of the at least one video data that is reduced by the video feature parameter; wherein the first target sub-video data is included in the at least two target sub- In the video data; the first target sub-video data can be presented in a first presentation manner.
The electronic device according to claim 1, wherein the image processing unit is further configured to: adjust a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter Characterizing the number of video frames per unit time;

And configuring, as the second target sub-video data, at least part of the at least one video data that is adjusted by the video feature parameter; wherein the second target sub-video data is included in the at least two target sub- In the video data; the second target sub-video data can be presented in a second presentation.
The electronic device according to claim 7, wherein the image processing unit is further configured to determine a video storage feature parameter based on the collected feature parameter; and the captured video according to the determined video storage feature parameter The video frame in the data is deleted, and the video feature parameters in the video data collected in real time are adjusted; wherein

The video storage feature characterizes the number of video frames to be saved in a unit of time.
The electronic device according to claim 6 or 7, wherein the electronic device further comprises a storage unit and a video display unit;

The storage unit is configured to store the target video data;

The video display unit is configured to present the target video data in different presentation manners in at least a first display area and a second display area of the electronic device based on a user operation Describe at least two target sub-video data.
A data processing method, the method comprising:

The electronic device acquires at least one video data in real time in an image capturing area corresponding to the at least one image capturing device by using at least one image capturing device;

Processing at least part of the at least one of the at least one video data collected in real time to obtain at least two target sub video data by using at least a first video processing policy and a second video processing policy; Different from the second video processing strategy;

Generating target video data based on the at least two target sub-video data such that the target video data includes video data that can be presented in at least two different presentation manners.
The method according to claim 10, wherein when the video data of different presentation modes included in the target video data is data of the same video source, the first video processing policy and the second video processing strategy The processed video data may be all the same video data, or may be partially the same video data, or may be completely different video data.
The method of claim 10, wherein the method further comprises:

Selecting different or the same video processing strategies for video data of different display areas by user operations implemented in the view interface of the electronic device.
The method of claim 10, wherein the different presentations characterize different video feature parameters of the presented video data.
The method according to claim 10, wherein the video processing policy is a processing policy set in advance, or a processing policy set according to a user operation.
The method of claim 14, wherein the method further comprises:

Obtaining a video feature parameter input by the user through a user interaction interface, and determining a video processing strategy based on a video feature parameter input by the user; or

The video feature parameter matching the size of the area of the display area is selected from the preset relationship list by the size of the area of the display area selected by the user, and the video processing policy is determined based on the selected video feature parameter; the preset relationship list Characterize the size of the display area and the video A list of correspondences of the parameters.
The method of claim 10, wherein the processing, by the first video processing strategy, at least a portion of the at least one of the at least one video data collected in real time comprises:

And reducing a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter characterizing a number of video frames per unit time;

And at least part of the at least one piece of video data that is reduced by the video feature parameter is used as the first target sub-video data; wherein the first target sub-video data is included in the at least two target sub-video data The first target sub-video data can be presented in a first presentation.
The method of claim 10, wherein the processing, by the second video processing strategy, at least a portion of the at least one of the at least one video data collected in real time comprises:

And adjusting a video feature parameter corresponding to at least part of the at least one of the at least one video data collected in real time; the video feature parameter characterizing a number of video frames per unit time;

At least part of the at least one piece of video data whose audio feature parameter is increased is used as the second target sub-video data; wherein the second target sub-video data is included in the at least two target sub-video data The second target sub-video data can be presented in a second presentation.
The method according to claim 12, wherein the adjusting the video feature parameters of at least part of the at least one of the at least one video data collected in real time comprises:

Determining a video storage feature parameter based on the acquisition feature parameter; the video storage feature characterizing a number of video frames to be saved in a unit time;

And deleting, according to the determined video storage feature parameter, the captured video frame in the video data, and adjusting a video feature parameter in the video data collected in real time.
The method of claim 11 or 12, wherein the method further comprises:

Storing the target video data;

The at least two target sub-video data in the target video data are presented in different presentation manners in at least a first display area and a second display area of the electronic device based on a user operation.
A computer storage medium storing a computer program for performing the data processing method according to any one of the preceding claims 10 to 19.