CN109669783B - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN109669783B CN109669783B CN201710953537.3A CN201710953537A CN109669783B CN 109669783 B CN109669783 B CN 109669783B CN 201710953537 A CN201710953537 A CN 201710953537A CN 109669783 B CN109669783 B CN 109669783B
- Authority
- CN
- China
- Prior art keywords
- image data
- data
- path
- processing
- paths
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 230
- 238000000034 method Methods 0.000 claims abstract description 56
- 230000008569 process Effects 0.000 claims description 31
- 230000009466 transformation Effects 0.000 claims description 6
- 238000011161 development Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 15
- 238000001514 detection method Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 238000002372 labelling Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/545—Interprogram communication where tasks reside in different layers, e.g. user- and kernel-space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/543—Local
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the invention provides a data processing method and device, wherein the method comprises the following steps: receiving multipath image data sent by a hardware abstraction layer; selecting at least one path of first image data from the plurality of paths of image data; and processing the selected at least one path of first image data according to the set data processing mode. The multi-path image data is processed in the application program framework layer, so that development difficulty of an application program is reduced, and in the application program framework layer, only one path of most suitable image data is selected from the multi-path image data for processing in the data processing mode, but not all the multi-path image data are processed in the data processing mode, so that data processing cost is reduced, namely consumption of processing resources is reduced.
Description
Technical Field
The present invention relates to the field of operating systems, and in particular, to a data processing method and apparatus.
Background
A camera (camera) function is generally provided in a terminal device such as a mobile phone, and some application programs may use data collected by the camera, such as a video call application, an image processing application, and the like, in the terminal device.
Generally, when a camera is used, multiple paths of data, such as preview, photographing, video recording, callback, etc., are output at the same time, and an application program that needs to use the image data often needs to perform various processes on the multiple paths of data at the same time: for example, the three image data of previewing, photographing and video recording are processed by beautifying, filtering, specific object recognition and the like. Such as adding a cosmetic effect to the preview data while hopefully synchronizing the effect to the photo data.
Currently, in an operating system such as Android, processing of image data generally involves an Application layer (Application), an Application framework layer (Application Framework), a hardware abstraction layer (Hardware Abstraction Layer), and the like. The process can be described simply as: the hardware abstraction layer transmits the multiple paths of image data acquired by the image to the application program framework layer, so as to, as shown in fig. 1, the application program framework layer respectively sends the multiple paths of image data to the application program through respective independent interfaces, and the application program respectively and repeatedly processes the multiple paths of image data, for example: assuming that the application program needs to perform the beautifying process on the received image data, and assuming that two paths of image data are received, the application program needs to perform the beautifying process on the two paths of image data respectively, which can increase the resource consumption by times, for example, increase the CPU operation and the bandwidth consumption by times, and the power consumption can also increase greatly. In addition, in order to realize various processing of the multi-path image data by the application program and ensure the processing synchronism of the multi-path image data, the application program needs to develop a complex software scheme to ensure the parallelization processing of the multi-path image data, and the processing of important threads such as a UI and the like cannot be influenced when the image data is processed, so that the development difficulty of the application program is high.
Disclosure of Invention
In view of the above, the embodiments of the present invention provide a data processing method and apparatus for reducing the processing cost of image data and the development difficulty of application programs.
In a first aspect, an embodiment of the present invention provides a data processing method, applied to an application framework layer, including:
receiving multipath image data sent by a hardware abstraction layer;
selecting at least one path of first image data from the plurality of paths of image data;
and processing the at least one path of first image data according to the set data processing mode.
In a second aspect, an embodiment of the present invention provides a data processing apparatus, applied to an application framework layer, including:
the receiving module is used for receiving the multipath image data sent by the hardware abstraction layer;
the selection module is used for selecting at least one path of first image data from the plurality of paths of image data;
and the processing module is used for processing the at least one path of first image data according to the set data processing mode.
In a third aspect, an embodiment of the present invention provides an electronic device, which may be implemented as a user terminal device, including a processor and a memory, where the memory is configured to store a program for supporting the user terminal device to execute the data processing method in the first aspect, and the processor is configured to execute the program stored in the memory. A communication interface may also be included in the electronic device for communicating with other devices or communication networks.
In addition, an embodiment of the present invention provides a computer storage medium storing computer software instructions for use in the electronic device, which includes a program for executing the data processing method according to the first aspect.
In a fourth aspect, an embodiment of the present invention provides a data processing method, which is applied to an application program, including:
transmitting the data processing mode to an application program framework layer, so that the application program framework layer processes at least one path of image data in the multipath image data received from the hardware abstraction layer according to the data processing mode;
and receiving the processed image data sent by the application framework layer.
In a fifth aspect, an embodiment of the present invention provides a data processing apparatus, applied to an application program, including:
the sending module is used for sending the data processing mode to the application program framework layer so that the application program framework layer processes at least one path of image data in multiple paths of image data according to the data processing mode, and the multiple paths of image data are sent to the application program framework layer by the hardware abstraction layer;
and the receiving module is used for receiving the processed image data sent by the application program framework layer.
In a sixth aspect, an embodiment of the present invention provides an electronic device, which may be implemented as a user terminal device, such as a smart phone or the like, including a processor and a memory, where the memory is configured to store a program for supporting the electronic device to execute the data processing method in the fourth aspect, and the processor is configured to execute the program stored in the memory. A communication interface may also be included in the electronic device for communicating with other devices or communication networks.
In addition, an embodiment of the present invention provides a computer storage medium storing computer software instructions for use in the electronic device, which includes a program for executing the data processing method according to the fourth aspect.
The data processing method and the data processing equipment provided by the embodiment of the invention are used for processing the multipath image data in an application program framework layer. Specifically, optionally, an application program at the application layer may send a data processing manner for multiple paths of image data to the application program framework layer, so that after receiving multiple paths of image data sent by the hardware abstraction layer, the application program framework layer selects at least one path of first image data from the multiple paths of image data, and further performs processing of the at least one path of first image data in the data processing manner. According to the scheme, the processing of the multi-path image data is realized in the application program framework layer, the development difficulty of an application program is reduced, and in the application program framework layer, the multi-path image data is not processed in the data processing mode, for example, only one path of most suitable image data is selected from the multi-path image data to be processed in the data processing mode, so that the data processing cost is reduced, namely the consumption of processing resources is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an image data processing method according to the prior art;
fig. 2 is a schematic diagram of a data processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 4 is a flowchart of another data processing method according to an embodiment of the present invention;
FIG. 5 is an interaction diagram of a data processing method according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a data processing apparatus corresponding to the embodiment shown in FIG. 3;
FIG. 7 is a schematic diagram of an electronic device corresponding to the data processing apparatus shown in FIG. 6;
FIG. 8 is a schematic diagram of a data processing apparatus corresponding to the embodiment shown in FIG. 4;
fig. 9 is a schematic structural view of an electronic device corresponding to the data processing apparatus shown in fig. 8.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, the "plurality" generally includes at least two, but does not exclude the case of at least one.
It should be understood that the term "and/or" as used herein is merely one relationship describing the association of the associated objects, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
It should be understood that although the terms first, second, third, etc. may be used in embodiments of the present invention to describe XXX, these XXX should not be limited to these terms. These terms are only used to distinguish between XXX. For example, a first XXX may also be referred to as a second XXX, and similarly, a second XXX may also be referred to as a first XXX, without departing from the scope of embodiments of the invention.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a product or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such product or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a commodity or system comprising such elements.
In addition, the sequence of steps in the method embodiments described below is only an example and is not strictly limited.
Fig. 2 is a schematic diagram of a data processing method according to an embodiment of the present invention, which is used for performing the same processing on multiple paths of image data. As shown in fig. 2, processing of image data in an operating system such as Android generally involves an Application layer, an Application framework layer (Application Framework) layer, a hardware abstraction layer (Hardware Abstraction Layer), and the like. The data processing method provided by the embodiment of the invention realizes the processing of the multipath image data in the application program framework layer so as to reduce the development difficulty of the application program and avoid developing related processing logic in the application program; and optionally, when one or more kinds of processing is needed to be performed on the multi-path image data, only the most suitable path of image data is needed to be selected from the multi-path image data for each kind of processing, and the processing result is synchronously or multiplexed to other paths of image data, so that the parallel processing of the multi-path image data is completed, the problem that the processing cost is increased due to the fact that the same processing is needed to be repeatedly performed on the multi-path image data is solved, and the CPU (Central processing Unit) computing cost, power consumption, bandwidth and other costs are reduced.
It should be noted that the multiple paths of image data may be considered to be generated simultaneously, and the difference is mainly that the image resolution of each path of image data is different, for example, the image resolution corresponding to the preview image data is smaller than the image resolution corresponding to the photographed image data. In addition, taking a more common photographing scene in practical application as an example, in the actual photographing process, only one path of photographing image data is generated, but preview image data is generated at the same time. The multiple paths of image data generated simultaneously can be generated directly by hardware or by software.
Optionally, the application framework layer may include three components of a controller, a selector, and a synthesizer, where the three components cooperate to complete processing of multiple paths of image data received from the hardware abstraction layer, and may feed back processing results of the multiple paths of image data (e.g., video image data, photo image data, and preview image data) to the application. The three components may be understood as three functional modules in the application framework layer, each having different processing logic, and in the embodiment shown in fig. 3, how the three components in the application framework layer cooperate with each other to complete the processing of the multi-path image data will be described below.
It should be noted that the above three components are only one example for easy understanding for the sake of classification, and are not strictly limited to the fact that the three components are necessarily present in the form of an actual product.
Fig. 3 is a flowchart of a data processing method according to an embodiment of the present invention, where the data processing method provided in the embodiment is implemented in the application framework layer shown in fig. 2. As shown in fig. 3, the method comprises the steps of:
101. and receiving the multipath image data sent by the hardware abstraction layer.
102. At least one path of first image data is selected from the plurality of paths of image data.
103. And processing at least one path of first image data according to the set data processing mode.
The multiple paths of image data can be collected by an image collecting device in the user terminal equipment at the same time and transmitted to an application framework layer through a hardware abstraction layer.
In practical applications, applications that require a camera, such as some image processing applications, some instant messaging applications, and so on, are often installed in a user terminal device. The user may operate the application to activate the camera to capture the multiple paths of image data.
In addition, optionally, the user may set shooting parameters in the relevant interface of the application program, such as setting which paths of image data need to be collected by the camera, such as collecting preview image data and shooting image data; such as capturing preview image data and video image data, etc., to control the camera to capture corresponding multiple image data. In addition, the interface may also provide a setting item of a data processing mode, so that a user may select a desired data processing mode, for example, one or more kinds of processing such as filtering, beautifying, augmented Reality (AR), and face detection need to be performed on the multiple paths of image data.
Of course, the above data processing manner may be from a user setting on an application program interface, or alternatively, may be a data processing manner configured by default for an operating system, or the like.
When the user sets a data processing mode in the interface of the application program, the application program sends the data processing mode set by the user and aiming at the currently acquired multi-path image data to the application program framework layer, and a controller in the application program framework layer receives the data processing mode, so that the controller triggers a selector to select at least one path of first image data from the multi-path image data so as to process the at least one path of first image data according to the data processing mode. The number of the selected at least one path of first image data is smaller than that of the plurality of paths of image data.
In an alternative embodiment, selecting at least one path of the first image data from the multiple paths of image data may be implemented as: at least one path of first image data corresponding to the set data processing mode is selected from the plurality of paths of image data, and at this time, the data processing mode not only indicates what data processing needs to be performed on the image data, but also can be used as a basis for selecting the image data.
At this time, selection of at least one type of first image data corresponding to any one data processing method may be performed according to a preset correspondence between the data processing method and the image data, where one data processing method may correspond to one or more types of image data.
Since the data processing modes set for the multiple paths of image data acquired at the same time at present may be one or more, at least one path of first image data is selected from the multiple paths of image data for each data processing mode to process the data processing mode. At least one path of first image data corresponding to different data processing modes may be different or the same.
In an alternative embodiment, after processing the selected at least one path of first image data according to the set data processing manner, the application framework layer may send a processing result of the at least one path of first image data to the application program, or may send a processing result of the at least one path of first image data and other paths of unprocessed image data in the multiple paths of image data to the application program.
For example, assuming that the current multi-path image data includes preview image data and video image data, the set data processing mode is a beautifying process, and assuming that at least one path of first image data selected from the current multi-path image data is video image data, the current multi-path image data may be subjected to a beautifying process, and the video image data after being beautified may be fed back to the application program, and the preview image data may be directly fed back to the application program for viewing by a user without being processed.
In another optional embodiment, after the selected at least one first image data is processed according to the set data processing manner, at least one second image data in the multiple image data may be processed according to a processing result of the at least one first image data, where the at least one second image data is all or part of image data remaining in the multiple image data except the first image data. Thus, optionally, following step 103, the following steps may be included:
104. and processing at least one path of second image data in the multiple paths of image data according to the processing result of the at least one path of first image data.
105. Transmitting the processed image data to an application program; or transmitting the processed image data and unprocessed image data in the plurality of paths of image data to an application program.
At this time, the processed image data includes the processed first image data and the processed second image data.
It should be noted that, in this embodiment, the processing result of the at least one path of the first image data is used to process the at least one path of the second image data, instead of directly adopting the set data processing manner to process the at least one path of the second image data. The processing of the at least one second image data according to the processing result of the at least one first image data may be simply understood as multiplexing or synchronizing the processing result of the at least one first image data with the at least one second image data.
With reference to fig. 2, the controller may process at least one path of the first image data, and the synthesizer may synchronize the processing result to the at least one path of the second image data.
For example, assuming that the currently collected multiple paths of image data include preview image data and video image data, the data processing manner includes three processing manners including sequentially performing a filter, a beautifying and a certain preset object detection, and further assuming that at least one path of first image data corresponding to the filter and the beautifying processing manner is the preview image data and at least one path of first image data corresponding to the certain preset object detection processing manner is the video image data, the filter and the beautifying processing may be performed on the preview image data first, the certain preset object detection processing may be performed on the video image data, semantic information corresponding to the preset object is added to an image frame including the preset object detected, then the processing result of the preview image data is synchronized with the video image data after adding the semantic, and the processing result of the video image data is synchronized with the preview image data after the filter and the beautifying processing, so that the preview image data and the video image data have the processing effects of the filter, the beautifying and the preset object detection.
In combination with the above examples, in an alternative embodiment, for each data processing mode, only one path of image data is selected from multiple paths of image data to perform processing in the data processing mode, and the processing result of the one path of image data is multiplexed to the remaining other paths of image data, so that parallel processing of the multiple paths of image data is achieved, and multiple paths of image data have the same processing effect.
In addition, in combination with the above example, according to the processing result of at least one path of first image data, processing at least one path of second image data in multiple paths of image data may include image processing in two ways: size transformation and adding image semantics.
The size transformation is specifically as follows: and performing size transformation processing on the processing result of the at least one path of first image data according to the image resolution corresponding to the at least one path of first image data and the image resolution corresponding to the at least one path of second image data, and replacing the at least one path of second image data by the size transformed result. Specifically, the size conversion processing may be performed on the processing result of at least one path of the first image data according to a ratio between the image resolution corresponding to at least one path of the first image data and the image resolution corresponding to at least one path of the second image data.
Alternatively, when the number of at least one first image data is not 1, one first image data may be selected at random, or the first image data having the highest or lowest resolution may be selected, so that the size conversion processing, such as the down-sampling or interpolation processing, is performed on the processing result of the selected first image data based on the resolution ratio between the selected first image data and each second image data, respectively.
The added image semantics specifically include: and if the set data processing mode comprises object recognition processing, adding image semantic information corresponding to the object recognition result into at least one path of second image data according to the object recognition result in at least one path of first image data. In practical applications, optionally, the user may set the object to be identified, for example, set face recognition. The image semantic information corresponding to the object recognition result may be related description information of the recognized object, or may be simply a labeling frame for labeling the recognized object.
For example, it is assumed that there are two paths of image data, where the resolution of the first image data is 640×480, the resolution of the other path of the second image data is 320×240, and the data processing mode is assumed to be a beautifying process, after the first image data is subjected to the beautifying process, the beautifying result may be synchronized to the second image data by a downsampling mode, for example, pixel values of two adjacent pixels in the first image data after the beautifying process are calculated on a line-by-line basis to form a pixel point, so that 320×240 paths of image data with a beautifying effect are obtained, and the original second image data is replaced by the image data.
For another example, it is assumed that there are two paths of image data, in which the resolution as the first image data is 640×480, and the resolution as the second image data is 320×240, and the data processing manner is a preset object detection process, and the preset object detection process is performed on the first image data to mark the preset object in an image frame containing the preset object, for example, the detected preset object is marked by a rectangular frame. Then, based on the proportional relation between the resolutions 320×240 and 640×480, the first image data after labeling is firstly subjected to downsampling, and then the rectangular frame is reduced by two times, so that the object detection result is synchronized to the second image data. Of course, in this example, the processing result of marking the preset object in the first image data may be multiplexed, that is, synchronized, directly to the second image data, that is, the first image data after marking may be directly substituted for the original second image data, instead of performing the downsampling processing.
In the foregoing optional embodiment, it may be mentioned that at least one path of the first image data may be selected according to a certain data selection basis, and the acquiring manner of the data selection basis may be implemented in two optional manners as follows:
First, the user sets up the mode by oneself. At this time, the user may select a data selection basis in the relevant interface of the application program. In an alternative embodiment, the application program may not only provide a selection interface of a data processing manner, but also provide a setting interface according to which data is selected. Therefore, the user can select one or more data processing modes in the data processing mode selection interface, and after the user selects a certain data processing mode, the data selection basis setting interface can be popped up, wherein the options of various data selection basis are displayed for the user to select. When the user sets a plurality of data processing modes, the user can set data selection bases corresponding to the data processing modes respectively, so that at least one path of first image data corresponding to the data processing modes can be selected from the plurality of paths of image data according to the data selection bases corresponding to the data processing modes set by the user.
In this manner, optionally, the data selection basis includes one of: the performance meets the set condition, the quality meets the set condition, the set specific camera data, the preset corresponding relation between the data processing mode and the image data.
And secondly, the application framework layer can dynamically determine the data selection basis by combining the resource use state of the user terminal equipment. The resource utilization state of the terminal equipment is obtained, the data selection basis is determined according to the resource utilization state of the terminal equipment, and at least one path of first image data is selected from the multiple paths of image data according to the determined data selection basis.
The resource usage state of the terminal device is represented by one or a combination of a plurality of CPU load degree, residual electric quantity and the like. Alternatively, at this time, the data selection basis may satisfy the set condition for the performance or the quality satisfies the set condition.
Alternatively, for example, the resource usage state of the terminal device may be simply divided into two cases of large resource consumption and small resource consumption based on a certain threshold; alternatively, the resource usage state of the terminal device is divided into a plurality of sections in advance according to the extent to which the resource consumption amount exceeds or falls below the threshold. Thus, when the actual resource consumption amount of the terminal device is greater than the threshold or within a certain section corresponding to a large resource consumption, it is determined that the data selection criterion at this time satisfies the set condition for performance, whereas if the resource consumption amount of the terminal device is less than the threshold or within a certain section corresponding to a small resource consumption, it is determined that the data selection criterion at this time satisfies the set condition for quality.
Alternatively, when the metrics of the resource usage state include a plurality of kinds, the contribution weights of different metrics to the resource usage state may be set, for example, when the resource usage state uses the CPU load degree and the residual power as metrics, the contribution weight of the CPU load degree may be set to 0.7, and the contribution degree of the residual power may be set to 0.3, so that the resource usage state is evaluated by a weighted sum of the two.
Alternatively, the determination of the data selection basis may be further performed in combination with the respective preset resource consumption amounts corresponding to the respective data processing modes (may also be referred to as the algorithm complexity corresponding to the respective data processing modes) in addition to the determination of the data selection basis according to the resource usage state of the terminal device. The resource consumption amounts corresponding to the various commonly used data processing methods can be preset. The resource consumption amount corresponding to each data processing mode can be set in advance by a test mode. Alternatively, the resource consumption may be embodied as a specific value; the method can also be embodied in a degree, such as large resource consumption and small resource consumption, for example, a data processing mode with the resource consumption larger than a certain threshold value can be set as large resource consumption; the data processing mode with the resource consumption less than a certain threshold is set to be small in resource consumption. Therefore, the data selection basis can be determined according to the resource utilization state of the terminal equipment and the resource consumption corresponding to the preset data processing mode.
Alternatively, at this time, the determination of the basis of data selection may be implemented as: the resource usage state of the terminal device may be divided into a plurality of sections in advance according to the extent that the resource consumption of the terminal device exceeds or falls below a certain threshold, for example, three sections a, B, and C in sequence according to the order of the resource consumption. And accumulating the resource consumption corresponding to the various data processing modes currently set by the user, so as to determine the data selection basis corresponding to all the data processing modes currently set by the user according to the accumulated resource consumption and the interval where the resource use state of the current terminal equipment is located. Specifically, the data selection basis may be determined according to the accumulated resource consumption amount and whether the interval in which the current resource usage state of the terminal device is located may cause the interval in which the resource usage state of the terminal device is located to be changed. For example, assuming that the cumulative resource consumption corresponding to all the data processing manners set by the current user is X, and the resource consumption of the current terminal device is such that the resource usage state of the terminal device is located in the interval B, if the range of the interval B is exceeded and falls within the range of the interval a after adding the X to the resource consumption of the current terminal device, the data selection basis is determined to satisfy the setting condition, and conversely, if the range of the interval B is not exceeded, the data selection basis is determined to satisfy the setting condition.
That is, if the accumulated resource consumption amount of the data processing manner makes the resource consumption amount of the terminal device heavy, the performance satisfies the set condition as the data selection basis, and conversely, the quality satisfies the set condition as the data selection basis, so as to balance between the image quality after the image data processing and the resource consumption condition of the terminal device.
It is understood that when the resource usage state of the terminal device or the preset resource consumption amount combined with the resource usage state of the terminal device and each data processing mode is used as the data selection basis, it can be considered that each data processing mode set at this time corresponds to the same data selection basis.
The specific implementation of selecting at least one first image data according to the several data selections mentioned above is specifically described below:
the performance meets the set conditions: and selecting the image data from the plurality of paths of image data according to the sequence from low to high of the corresponding image resolution as at least one path of first image data. A simple scenario may be: the image data corresponding to the lowest image resolution is selected from among the plurality of paths of image data as the first image data.
The quality meets the set conditions: and selecting the image data from the plurality of paths of image data according to the sequence from high to low of the corresponding image resolution as at least one path of first image data. A simple scenario may be: the image data corresponding to the highest image resolution is selected from among the plurality of paths of image data as the first image data.
Specific image data is set. The specific image data is selected from the plurality of paths of image data to serve as at least one path of first image data.
Correspondence between preset data processing modes and image data: the correspondence may be user-defined in an application-related interface. Therefore, at least one path of first image data can be selected from the plurality of paths of image data according to the corresponding relation.
The performance or quality satisfying the set condition is understood to have the smallest influence on the processing performance of the terminal device or the best quality of the processed image data.
For the above data selection bases, assuming that one path of first image data is selected and at least one path of second image data is assumed to be the other path of image data remaining in the multiple paths of image data, only taking size transformation as an example, according to the processing result of the first image data, processing the other path of image data can be implemented as follows:
If the data selection basis is that the performance meets the set condition, after the data processing is performed on the first image data corresponding to the lowest image resolution in the multi-path image data, interpolation processing can be performed on the processing results of the first image data according to the ratio between the image resolution corresponding to each of the other path image data and the resolution of the first image data, and the corresponding other path image data can be replaced by the first image data after interpolation.
If the data selection basis is that the quality meets the set condition, after the data processing is performed on the first image data corresponding to the highest image resolution in the multi-path image data, the processing results of the first image data can be respectively subjected to downsampling processing according to the ratio between the image resolution corresponding to each of the other path image data and the resolution of the first image data, and the downsampled first image data can be used for replacing the corresponding other path image data.
If the data selection is based on the set specific image data or the corresponding relation between the preset data processing mode and the image data, after the data processing is performed on the first image data selected from the multiple paths of image data, the processing result of the first image data can be respectively subjected to downsampling or difference processing according to the ratio between the image resolution corresponding to each of the other paths of image data and the resolution of the first image data, and the corresponding other paths of image data can be respectively replaced by the downsampling or difference processing result.
In summary, in the embodiment of the present invention, various processing of multiple paths of image data is implemented in an application framework layer. Specifically, an application program at an application layer sends a data processing mode for multiple paths of image data to an application program framework layer, so that the application program framework layer selects to-be-processed image data corresponding to the data processing mode from the multiple paths of image data after receiving the multiple paths of image data from a hardware abstraction layer, and then processes the to-be-processed image data in the data processing mode, then synchronizes the processing result of the to-be-processed image data to other paths of image data, so that other paths of image data also have the processing effect corresponding to the data processing mode, and finally transmits the processed multiple paths of image data to the application program. According to the scheme, the processing of the multi-path image data is realized in the application program framework layer, the development difficulty of an application program is reduced, and in the application program framework layer, only one path of most suitable image data is selected from the multi-path image data for processing in the data processing mode, but not all the multi-path image data are processed in the data processing mode, so that the data processing cost is reduced, namely the consumption of processing resources is reduced.
Fig. 4 is a flowchart of another data processing method according to an embodiment of the present invention, where the data processing method according to the embodiment may be implemented by an application program in the application program layer shown in fig. 2, where image data is required to be used. As shown in fig. 4, the method may include the steps of:
201. and sending the data processing mode to the application program framework layer so that the application program framework layer processes at least one path of image data in the multipath image data received from the hardware abstraction layer according to the data processing mode.
202. And receiving the processed image data sent by the application framework layer.
Optionally, the application program may include a data acquisition setting interface and a data processing mode selection interface. The user can set which paths of image data need to be started by the camera in the data acquisition setting interface, for example: if the user sets the camera to a photographing mode, collecting preview image data and photographing image data; if the user sets the camera to a video mode, preview image data and video image data are collected. After the user completes the acquisition setting of the image data, a data processing mode selection interface can be displayed, wherein the selection interface comprises a plurality of data processing modes for the user to select. When the user selects one or more data processing modes corresponding to the multiple paths of image data, the application program sends the one or more data processing modes to the application program framework layer, so that the application program framework layer selects at least one path of first image data from the multiple paths of image data according to the method described in the previous embodiment, and processes the at least one path of first image data according to each set data processing mode.
In addition, alternatively, as mentioned in the foregoing embodiment, the user may set a data selection basis corresponding to each data processing mode in the application program to supply the application program framework layer to select the first image data corresponding to each data processing mode from among the plurality of image data. Therefore, optionally, when the user selects one data processing mode, the data selection basis setting interface is popped up, wherein the data selection basis setting interface comprises a plurality of data selection basis for the user to select.
Because the processing logic of the multipath image data is realized in the application program framework layer, the application program only needs to input setting information into the application program framework layer and receive the processing result of the application program framework layer, thereby reducing the development difficulty of the application program.
The data processing method provided by the embodiment of the invention will be described below with reference to the embodiment shown in fig. 5, taking the case that the actually collected multiple paths of image data include preview image data and photographed image data, and the processing of the multiple paths of image data includes filter and beauty treatment as an example.
Fig. 5 is an interaction diagram of a data processing method according to an embodiment of the present invention, as shown in fig. 5, may include the following steps:
301. The application program responds to the user setting, and triggers the camera to be started to collect preview image data and photographing image data.
302. The application program sends the filters and the beautifying modes set by the user to an application program framework layer.
303. The application framework layer receives preview image data and photo image data from the hardware abstraction layer.
304. The application program framework layer selects photographed image data to perform filter and beautifying processing.
305. The application framework layer synchronizes the filter and the beautifying result of the photographed image data to the preview image data.
For example, interpolation or downsampling is performed on the processed photographed image data according to the resolution ratio of the pre-image data to the photographed image data, and the original preview image data is replaced by the interpolation or downsampling result.
306. The application framework layer transmits the processed preview image data and photographed image data to an application.
The user can thus see the preview image data after the filter and the beautifying process.
A data processing apparatus of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that these data processing devices may be configured using commercially available hardware components through the steps taught by the present solution.
FIG. 6 is a schematic diagram of a data processing apparatus corresponding to the embodiment shown in FIG. 3, the data processing apparatus corresponding to an application framework layer, as shown in FIG. 6, the apparatus comprising: a receiving module 11, a selecting module 12, a processing module 13, and a transmitting module 14.
And the receiving module 11 is used for receiving the multipath image data sent by the hardware abstraction layer.
A selecting module 12, configured to select at least one path of first image data from the multiple paths of image data.
And the processing module 13 is used for processing the selected at least one path of first image data according to a set data processing mode.
The number of the paths of the at least one path of first image data is smaller than that of the plurality of paths of image data.
Optionally, the processing module 13 is further configured to process at least one second image data in the multiple paths of image data according to a processing result of the at least one first image data.
The apparatus further comprises: a transmitting module 14 for transmitting the processed image data to an application program; or transmitting the processed image data and unprocessed image data in the plurality of paths of image data to an application program.
Optionally, the processing module 13 is specifically configured to:
And performing size transformation processing on the processing result of the at least one path of first image data according to the image resolution corresponding to the at least one path of first image data and the image resolution corresponding to the at least one path of second image data, and replacing the at least one path of second image data by the size transformed result.
Optionally, when the set data processing manner includes object recognition processing, the processing module 13 is specifically configured to: and adding image semantic information corresponding to the object identification result in the at least one path of second image data according to the object identification result in the at least one path of first image data.
Optionally, the receiving module 11 is further configured to: and receiving the data selection basis sent by the application program.
Accordingly, the selection module 12 is specifically configured to: and selecting the at least one path of first image data from the multiple paths of image data according to the data selection basis.
Wherein, the data selection basis comprises one of the following: the performance meets the set condition, the quality meets the set condition, the set specific camera data, the preset corresponding relation between the data processing mode and the image data.
Optionally, the selection module 12 is further configured to:
Acquiring a resource use state of terminal equipment; determining a data selection basis according to the resource use state of the terminal equipment; and selecting the at least one path of first image data from the multiple paths of image data according to the data selection basis.
Wherein, the selection module 12 is specifically configured to:
and determining a data selection basis according to the resource use state of the terminal equipment and the preset resource consumption corresponding to the data processing mode.
Wherein, the data selection basis is that the performance meets the set condition or the quality meets the set condition.
Specifically, the data selection basis is that the performance meets a set condition, and the selection module 12 is specifically configured to:
and selecting image data from the plurality of paths of image data according to the sequence from low to high of corresponding image resolution as at least one path of first image data.
Specifically, the data selection basis is that the quality meets a set condition, and the selection module 12 is specifically configured to:
and selecting image data from the plurality of paths of image data according to the sequence from high to low of corresponding image resolution as at least one path of first image data.
The apparatus shown in fig. 6 may perform the method of fig. 3, and reference is made to the relevant description of the embodiment shown in fig. 3 for parts of this embodiment not described in detail. The implementation process and the technical effect of this technical solution are described in the embodiment shown in fig. 3, and are not described herein.
In one possible design, the structure of the data processing apparatus shown in fig. 6 may be implemented as an electronic device, where the electronic device is a user terminal device, such as a smart phone, as shown in fig. 7, and the user terminal device may include: a processor 21 and a memory 22. Wherein the memory 22 is for storing a program for supporting the user terminal device to execute the data processing method provided in each of the above-described illustrated embodiments, and the processor 21 is configured to execute the program stored in the memory 22.
The program comprises one or more computer instructions which, when executed by the processor 21, are capable of carrying out the steps of:
receiving multipath image data sent by a hardware abstraction layer;
selecting at least one path of first image data from the plurality of paths of image data;
and processing the at least one path of first image data according to the set data processing mode.
Optionally, the processor 21 is further configured to perform all or part of the steps of each of the methods described above.
The structure of the ue may further include a communication interface 23, which is used for the ue to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium storing computer software instructions for a user terminal device, which includes a program for executing the data processing method in each of the above-described illustrated method embodiments.
Fig. 8 is a schematic structural view of a data processing apparatus corresponding to the embodiment shown in fig. 4, and as shown in fig. 8, the apparatus includes: a transmitting module 31, a receiving module 32.
The sending module 31 is configured to send a data processing manner to an application framework layer, so that the application framework layer processes at least one path of image data in multiple paths of image data according to the data processing manner, where the multiple paths of image data are sent to the application framework layer by a hardware abstraction layer.
And a receiving module 32, configured to receive the processed image data sent by the application framework layer.
Optionally, the sending module 31 is further configured to:
and sending the data selection basis to the application program framework layer so that the application program framework layer can select the at least one path of image data.
The apparatus shown in fig. 8 may perform the method of the embodiment shown in fig. 4, and reference is made to the relevant description of the embodiment shown in fig. 4 for parts of this embodiment not described in detail. The implementation process and the technical effect of this technical solution are described in the embodiment shown in fig. 4, and are not described herein.
In one possible design, the structure of the data processing apparatus shown in fig. 8 may be implemented as an electronic device, where the electronic device is a user terminal device, such as a smart phone, as shown in fig. 9, and the user terminal device may include: a processor 41 and a memory 42. Wherein the memory 42 is for storing a program for supporting the user terminal device to execute the data processing method provided in each of the above-described illustrated embodiments, and the processor 41 is configured for executing the program stored in the memory 42.
The program comprises one or more computer instructions which, when executed by the processor 41, are capable of carrying out the steps of:
transmitting a data processing mode to an application program framework layer, so that the application program framework layer processes at least one path of image data in multiple paths of image data according to the data processing mode, and the multiple paths of image data are transmitted to the application program framework layer by a hardware abstraction layer;
and receiving the processed image data sent by the application framework layer.
Optionally, the processor 41 is further configured to perform all or part of the steps of each of the aforementioned illustrated method steps.
The structure of the ue may further include a communication interface 43, which is used for the ue to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium storing computer software instructions for a user terminal device, which includes a program for executing the data processing method in each of the above-described illustrated method embodiments.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by adding necessary general purpose hardware platforms, or may be implemented by a combination of hardware and software. Based on such understanding, the foregoing aspects, in essence and portions contributing to the art, may be embodied in the form of a computer program product, which may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (14)
1. A data processing method, applied to an application framework layer, comprising:
receiving multipath image data sent by a hardware abstraction layer;
selecting at least one path of first image data from the plurality of paths of image data, wherein the plurality of paths of image data are generated simultaneously and the image resolution of each path of image data is different;
processing the at least one path of first image data according to a set data processing mode;
processing at least one path of second image data in the multiple paths of image data according to the processing result of the at least one path of first image data;
wherein, the processing at least one path of second image data in the multiple paths of image data according to the processing result of the at least one path of first image data includes:
Performing size transformation processing on the processing result of the at least one path of first image data according to the image resolution corresponding to the at least one path of first image data and the image resolution corresponding to the at least one path of second image data, and replacing the at least one path of second image data by the size transformed result;
or when the set data processing mode is object recognition processing, adding image semantic information corresponding to the object recognition result in the at least one path of second image data according to the object recognition result in the at least one path of first image data.
2. The method of claim 1, wherein the at least one first image data has a smaller number of ways than the plurality of ways of image data.
3. The method according to any one of claims 1 to 2, further comprising;
transmitting the processed image data to an application program; or alternatively
And transmitting the processed image data and unprocessed image data in the plurality of paths of image data to an application program.
4. The method of claim 1, wherein selecting at least one first image data from the plurality of image data comprises:
Receiving a data selection basis;
and selecting the at least one path of first image data from the multiple paths of image data according to the data selection basis.
5. The method of claim 4, wherein the data selection criteria comprises one of:
the performance meets the set condition, the quality meets the set condition, the set camera data, the preset data processing mode and the corresponding relation of the image data.
6. The method of claim 1, wherein selecting at least one first image data from the plurality of image data comprises:
acquiring a resource use state of terminal equipment;
determining a data selection basis according to the resource use state of the terminal equipment;
and selecting the at least one path of first image data from the multiple paths of image data according to the data selection basis.
7. The method of claim 6, wherein determining a data selection basis according to the resource usage status of the terminal device comprises:
and determining a data selection basis according to the resource use state of the terminal equipment and the preset resource consumption corresponding to the data processing mode.
8. The method of claim 6, wherein the data is selected based on whether a performance meets a set condition or a quality meets a set condition.
9. The method according to claim 5 or 8, wherein the data selection is based on the performance meeting a set condition, and the selecting at least one path of first image data from the plurality of paths of image data includes:
and selecting image data from the plurality of paths of image data according to the sequence from low to high of corresponding image resolution as at least one path of first image data.
10. The method according to claim 5 or 8, wherein the data selection is based on the quality meeting a set condition, and the selecting at least one path of first image data from the plurality of paths of image data comprises:
and selecting image data from the plurality of paths of image data according to the sequence from high to low of corresponding image resolution as at least one path of first image data.
11. An electronic device comprising a memory and a processor; wherein,,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data processing method of any of claims 1 to 10.
12. A data processing method, applied to an application program, comprising:
transmitting a data processing mode to the application framework layer according to claim 1, so that the application framework layer processes at least one path of image data in multiple paths of image data according to the data processing mode, wherein the multiple paths of image data are transmitted to the application framework layer by a hardware abstraction layer;
and receiving the processed image data sent by the application framework layer.
13. The method according to claim 12, wherein the method further comprises:
and sending the data selection basis to the application program framework layer so that the application program framework layer can select the at least one path of image data.
14. An electronic device comprising a memory and a processor; wherein,,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data processing method of claim 12 or 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710953537.3A CN109669783B (en) | 2017-10-13 | 2017-10-13 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710953537.3A CN109669783B (en) | 2017-10-13 | 2017-10-13 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109669783A CN109669783A (en) | 2019-04-23 |
| CN109669783B true CN109669783B (en) | 2023-09-22 |
Family
ID=66138983
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710953537.3A Active CN109669783B (en) | 2017-10-13 | 2017-10-13 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109669783B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110290288B (en) * | 2019-06-03 | 2022-01-04 | Oppo广东移动通信有限公司 | Image processor, image processing method, photographing device, and electronic apparatus |
| CN112437224B (en) * | 2019-08-26 | 2022-11-11 | 腾讯科技（深圳）有限公司 | Camera data processing method and device, computer equipment and storage medium |
| CN112492193B (en) * | 2019-09-12 | 2022-02-18 | 华为技术有限公司 | Method and equipment for processing callback stream |
| CN114443894A (en) * | 2022-01-05 | 2022-05-06 | 荣耀终端有限公司 | Data processing method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101699868A (en) * | 2009-10-30 | 2010-04-28 | 深圳创维数字技术股份有限公司 | Method and equipment for providing and processing multi-path video of digital television programs |
| CN104702909A (en) * | 2014-04-17 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Video data processing method and video data processing device |
| CN106165391A (en) * | 2014-05-21 | 2016-11-23 | 谷歌技术控股有限责任公司 | The image capturing strengthened |
| CN106454186A (en) * | 2016-11-02 | 2017-02-22 | 深圳瑞芯通智能科技有限公司 | Multi-channel video recording and platform interaction method and device based on Android system |
| US20170199642A1 (en) * | 2014-05-30 | 2017-07-13 | Huawei Technologies Co., Ltd. | Display method of terminal device and terminal device |
-
2017
- 2017-10-13 CN CN201710953537.3A patent/CN109669783B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101699868A (en) * | 2009-10-30 | 2010-04-28 | 深圳创维数字技术股份有限公司 | Method and equipment for providing and processing multi-path video of digital television programs |
| CN104702909A (en) * | 2014-04-17 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Video data processing method and video data processing device |
| CN106165391A (en) * | 2014-05-21 | 2016-11-23 | 谷歌技术控股有限责任公司 | The image capturing strengthened |
| US20170199642A1 (en) * | 2014-05-30 | 2017-07-13 | Huawei Technologies Co., Ltd. | Display method of terminal device and terminal device |
| CN106454186A (en) * | 2016-11-02 | 2017-02-22 | 深圳瑞芯通智能科技有限公司 | Multi-channel video recording and platform interaction method and device based on Android system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109669783A (en) | 2019-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109669783B (en) | Data processing method and device | |
| EP3228075B1 (en) | Sensor configuration switching for adaptation of video capturing frame rate | |
| CN110753187B (en) | Camera control method and device | |
| CN109672884B (en) | Image hardware coding processing method and device | |
| US10721414B2 (en) | All-in-focus implementation | |
| US20140092272A1 (en) | Apparatus and method for capturing multi-focus image using continuous auto focus | |
| CN105005597A (en) | Photograph sharing method and mobile terminal | |
| CN110177215A (en) | Image processing method, image processor, filming apparatus and electronic equipment | |
| CN110300240B (en) | Image processor, image processing method, photographing device and electronic equipment | |
| CN103152489A (en) | Showing method and device for self-shooting image | |
| CN104509092B (en) | Control the method and related computing devices and computer-readable recording medium of camera | |
| CN111385475B (en) | Image acquisition method, photographing device, electronic equipment and readable storage medium | |
| US20160247257A1 (en) | Method of transmitting moving image and surveillance system using the method | |
| CN105005599A (en) | Photograph sharing method and mobile terminal | |
| CN110300268A (en) | Camera switching method and equipment | |
| CN109523456B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN105120153B (en) | A kind of image capturing method and device | |
| CN114125400A (en) | Multi-channel video analysis method and device | |
| US9485420B2 (en) | Video imaging using plural virtual image capture devices | |
| JP6232828B2 (en) | Still image providing device | |
| CN110602359B (en) | Image processing method, image processor, photographing device and electronic equipment | |
| US10313625B2 (en) | Method, apparatus, and storage medium for video file processing | |
| CN109218597A (en) | Method and device for shooting image by intelligent terminal | |
| US10491797B2 (en) | Apparatus and method for controlling imaging devices | |
| CN113297889A (en) | Object information processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201222 Address after: Room 603, 6 / F, Roche Plaza, 788 Cheung Sha Wan Road, Kowloon, China Applicant after: Zebra smart travel network (Hong Kong) Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |