CN110191314A - Camera data processing method, device and mobile unit based on android system - Google Patents
Camera data processing method, device and mobile unit based on android system Download PDFInfo
- Publication number
- CN110191314A CN110191314A CN201910375186.1A CN201910375186A CN110191314A CN 110191314 A CN110191314 A CN 110191314A CN 201910375186 A CN201910375186 A CN 201910375186A CN 110191314 A CN110191314 A CN 110191314A
- Authority
- CN
- China
- Prior art keywords
- thread
- image data
- camera
- interface information
- run
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
The present invention proposes a kind of camera data processing method based on android system, device and mobile unit, wherein, method includes: the interface information for obtaining form, when getting interface information, create the first thread run in central processor CPU, and according to interface information, create the second thread run in image processor GPU, run first thread, to obtain acquired image data from camera, and image data is transferred to the second thread, run the second thread, to carry out rendering processing to image data according to interface information, obtain the image for being shown in form, the processing of image data is carried out by the cooperative cooperating of CPU and GPU, the parallel processing capability of GPU is given full play to, alleviate the load of CPU, realize the access of multiple cameras, solve in the prior art by CPU come The technical issues of progress image real time transfer, CPU is occupied excessively, can not be accessed multiple cameras simultaneously.
Description
Technical field
The present invention relates at image data processing technology field more particularly to a kind of camera data based on android system
Manage method, apparatus and mobile unit.
Background technique
In current onboard system, vehicle mostly uses greatly Android android system, and the CPU in Android system is negative
Duty obtains the image data of camera and is handled, however in vehicle-mounted Android system, as soon as every increase camera, CPU are needed
It to run a thread more, and open thread and make the data volume of CPU processing very big, occupy excessive CPU, therefore, Android
System is using the number for limiting camera, that is to say, that current vehicle-mounted Android system is to prevent cpu load too many, influence property
Can, it can not support the access of multiple cameras.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.
For this purpose, the first purpose of this invention is to propose a kind of camera data processing method based on android system,
The processing that image data is carried out by CPU and GPU cooperative cooperating, has given full play to the parallel processing capability of GPU, has alleviated CPU
Load, realize the access of multiple cameras.
Second object of the present invention is to propose a kind of camera data processing equipment based on android system.
Third object of the present invention is to propose a kind of mobile unit.
Fourth object of the present invention is to propose a kind of computer readable storage medium.
In order to achieve the above object, first aspect present invention embodiment proposes at a kind of camera data based on android system
Reason method, comprising:
Obtain the interface information of form；
When getting the interface information, the first thread run in central processor CPU is created, and according to described
Interface information creates the second thread run in image processor GPU；
The first thread is run, to obtain acquired image data from camera, and described image data are transmitted
To second thread；
Second thread is run to be shown to carry out rendering processing to described image data according to the interface information
Show the image in the form.
In order to achieve the above object, second aspect of the present invention embodiment proposes at a kind of camera data based on android system
Manage device, comprising:
Module is obtained, for obtaining the interface information of form；
Creation module creates the first thread run in CPU for when getting the interface information, and according to
The interface information creates the second thread run in GPU；
First operation module, for running the first thread, to obtain acquired image data from camera, and will
Described image data are transferred to the first thread；
Second operation module, for running second thread, with according to the interface information to described image data into
Row rendering processing, obtains the image for being shown in the form.
In order to achieve the above object, third aspect present invention embodiment proposes a kind of mobile unit, including multiple cameras, deposit
Reservoir, processor and storage on a memory and the computer program that can run on a processor, the processor with it is described more
A camera connection realizes camera shooting based on android system as described in relation to the first aspect when the processor executes described program
Head data processing method.
To achieve the goals above, fourth aspect present invention embodiment proposes a kind of computer readable storage medium,
On be stored with computer program, when which is executed by processor, that realizes as described in relation to the first aspect based on android system is taken the photograph
As head data processing method.
Technical solution provided by the embodiment of the present invention, may include it is following the utility model has the advantages that
The interface information for obtaining form creates the First Line run in central processor CPU when getting interface information
Journey, and according to interface information, creates the second thread run in image processor GPU, operation first thread, with from camera
Acquired image data are obtained, and image data is transferred to the second thread, the second thread are run, according to interface information pair
Image data carries out rendering processing, obtains the image for being shown in form, carries out image data by the cooperative cooperating of CPU and GPU
Processing, given full play to the parallel processing capability of GPU, alleviated the load of CPU, realized the access of multiple cameras.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 shows for a kind of process of camera data processing method based on android system provided by the embodiment of the present invention
It is intended to；
Fig. 2 is a kind of structural representation of camera data processing equipment based on android system provided in an embodiment of the present invention
Figure；
Fig. 3 is a kind of structural schematic diagram of mobile unit provided by the embodiment of the present invention；And
Fig. 4 shows the block diagram for being suitable for the exemplary on board equipment for being used to realize the application embodiment.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to is used to explain the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings describe the camera data processing method based on android system of the embodiment of the present invention, device and
Mobile unit.
Fig. 1 shows for a kind of process of camera data processing method based on android system provided by the embodiment of the present invention
It is intended to.
As shown in Figure 1, method includes the following steps:
Step 101, the interface information of form is obtained.
In the embodiment of the present invention, the number of form is 1, is to operate in the application software of CPU to create, takes the photograph for multiple
As the image of head is shown.
Specifically, pass through local interface (the Java Native of the interface between application software, such as Java
Interface, JIN), the interface information for the form that application software is created is obtained, specifically can be the object for obtaining form, example
For example object object, parses object, obtains interface information.Wherein, interface information include form display position and
Display size, the display position of form and display size are to be determined by application software when creating form, different using soft
The corresponding display position of form of part creation and display size can be different, and be also possible to identical.
Step 102, when getting interface information, the first thread that creation is run in central processor CPU, and according to
Interface information creates the second thread run in image processor GPU.
It is that the multiple of acquisition are handled by central processor CPU and image processor GPU collaboration in the embodiment of the present invention
The image data of camera, to realize the access of multiple cameras, specifically, when getting interface information, creation is transported in CPU
Capable first thread, and the second thread run in GPU is created according to interface information, that is to say, that by being run in CPU
First thread and the second thread for being run in GPU cooperate with processing, given full play to the ability of the parallel processing of GPU,
Under the premise of not increasing cpu load, the processing of the image data to multiple cameras of access is realized.
Step 103, first thread is run, to obtain acquired image data from camera, and image data is transmitted
To the second thread.
Specifically, the first thread created in CPU is operated in, wherein first thread, for by between camera
Virtual channel obtains image data, wherein corresponded between virtual channel and camera, by be arranged multiple virtual channels with
Realize and obtain the image datas of multiple cameras parallel, and by open graphic library OpenGL interface by image data from CPU
GPU is copied to, storage address is obtained, and storage address is sent to the second thread, so that the second thread is read according to storage address
Image data is taken, image data is handled in GPU to realize.
Step 104, the second thread of operation is shown in carrying out rendering processing to image data according to interface information
The image of form.
Specifically, the second thread created in GPU is operated in, the second thread turns for carrying out colour gamut according to image data
It changes with after splicing, to treated, image data is rendered to obtain the figure for being in display position and meeting display size
Picture, that is to say, that after the completion of the image real time transfer that the second thread run in GPU will acquire, which can directly be used
In showing over the display, that is to say, that do not need application software and obtain image data to synthesize display with the interface information of form again
, since application software operates in CPU, CPU is also avoided in this way and replicates and handles the image data acquired
Process, reduce the load of CPU, realize the access of multiple cameras.
In the camera data processing method based on android system of the embodiment of the present invention, the interface information of form is obtained,
When getting interface information, the first thread run in central processor CPU is created, and according to interface information, creation exists
Second thread of image processor GPU operation, runs first thread, to obtain acquired image data from camera, and will
Image data is transferred to the second thread, and the second thread of operation is obtained with carrying out rendering processing to image data according to interface information
It is shown in the image of form, the processing of image data is carried out by the cooperative cooperating of CPU and GPU, has given full play to the parallel of GPU
Processing capacity alleviates the load of CPU, realizes the access of multiple cameras.
For an embodiment in clear explanation, the present embodiment is assisted with the image data in mobile unit according to acquisition
For Driving Scene, above-mentioned camera data processing method based on android system is illustrated.
In the present embodiment, driver can understand driving situation according to the image data of multiple cameras of display in time, mention
The safety of high traveling is illustrated in the present embodiment by taking the camera of access is 4 as an example, specifically, by with apply journey
JIN interface between sequence obtains the object of the form to be shown of the application program creation run in mobile unit, for example, mesh
Mark object object, wherein form is one, the image of 4 cameras acquisition for showing access simultaneously, in turn, to obtaining
The object for the form got is parsed to obtain the corresponding interface information of form, interface information contain form display position and
Display size when getting interface information, creates the first thread run in CPU in turn, and run in GPU
Second thread runs first thread, passes through the corresponding image of virtual channel acquisition one-to-one between 4 cameras respectively
Data to realize the image data for obtaining 4 cameras parallel, and pass through open graphic library OpenGL interface for 4 cameras
Image data copy to GPU, obtain storage address, and storage address is sent to the second thread run in GPU, operation
Second thread reads the image data of 4 cameras according to storage address, and according to the image data of 4 cameras got
Color gamut conversion is carried out, as a kind of possible implementation, carries out color gamut conversion using tinter Shader, such as YUV422
The image data of format is converted into the image data of YUV420 format, and according to the interface information of form, color domain is converted
The image data of 4 cameras afterwards carries out splicing again, when the data to 4 cameras carry out splicing, as
A kind of possible implementation can carry out the image for 4 cameras to show in form by the way of 4 split screens
Splicing realizes 4 split screen display availables to realize in the display interface of form；It, can also root as alternatively possible implementation
According to the primary and secondary or priority of the access camera of setting, the display area in form is divided, for example, priority is higher,
The region of corresponding display is then bigger in form, and similarly, the display area of main camera can then be greater than the display of time camera
Region carries out splicing to the data for 4 cameras to show in form to realize, in order to which user passes through form
When being checked, important image information can be obtained with quick obtaining.
Further, the image after splicing is rendered, obtain in corresponding display position and meets display ruler
Very little image realizes through the cooperative cooperating of CPU and GPU for example, carrying out 4 split screen display availables after splicing and carries out image procossing,
By the parallel processing capability of GPU, so that the access of multiple cameras is realized in the case where not increasing cpu load, so that
The available image for obtaining different perspectives of driver is obtained, the processing of mobile unit application image is realized, improves vehicle and drive
The safety sailed.
Optionally, the CPU in the present embodiment and GPU, which can be, belongs to same processor, it is achieved thereby that passing through
The collaborative work of CPU and GPU realizes the access of multiple cameras in the case where not increasing hardware cost.
It should be noted that application program operates in CPU, the number of the form of application program creation is fewer, CPU
The corresponding image data of the form for needing to replicate then can be fewer, especially the case where the camera of access is high-definition camera
Under, the load of CPU is reduced, therefore, in the present embodiment, the number of form is 1.It is to be appreciated that the object of form
The interface information parsed can also be used to the output for controlling each camera, for example, the pixel of camera is 200
Ten thousand pixels can reduce the output of the pixel of camera under application scenes, such as output is only 300,000 pixels, with full
The access of multiple cameras not only may be implemented in the demand of sufficient practical application scene, can also control the output of multiple cameras.
In order to realize above-described embodiment, the present invention also proposes a kind of camera data processing equipment based on android system.
Fig. 2 is a kind of structural representation of camera data processing equipment based on android system provided in an embodiment of the present invention
Figure.
As shown in Fig. 2, the device includes: to obtain module 21, the operation module 23 of creation module 22, first and the second operation mould
Block 24.
Module 21 is obtained, for obtaining the interface information of form.
Creation module 22, for creating the first thread run in CPU, and according to boundary when getting interface information
Face information creates the second thread run in GPU.
First operation module 23, for running first thread, to obtain acquired image data from camera, and will figure
As data are transferred to the second thread.
Second operation module 24, for running the second thread, to carry out rendering processing to image data according to interface information,
Obtain the image for being shown in form.
Further, in a kind of possible implementation of the embodiment of the present invention, above-mentioned first operation module 23, specifically
For:
Run the first thread, wherein the first thread, for being obtained by the virtual channel between camera
Described image data are copied to the GPU by open graphic library OpenGL interface by described image data, obtain storage ground
Location, and the storage address is sent to second thread, so that second thread reads institute according to the storage address
State image data, wherein correspond between the virtual channel and the camera.
As a kind of possible implementation, above-mentioned acquisition module 21, comprising: acquiring unit.
Acquiring unit, for obtaining the boundary of the created form of the application software by the interface between application software
Face information.
As a kind of possible implementation, acquiring unit is specifically used for:
The object for obtaining form, parses the object, obtains the interface information.
As a kind of possible implementation, the number of form is one, is the application software creation for operating in the CPU
, the image for multiple cameras is shown.
As a kind of possible implementation, interface information includes display position and the display size of form, and above-mentioned second
Module 24 is run, is specifically used for:
Run second thread, wherein second thread, for according to described image data carry out color gamut conversion and
After splicing, to treated, image data rendered obtains in the display position and meet the display size
Image.
It should be noted that the aforementioned explanation to camera processing method embodiment is also applied for taking the photograph for the embodiment
As head processing unit, principle is identical, and details are not described herein again.
In the camera data processing equipment based on android system of the embodiment of the present invention, the interface information of form is obtained,
When getting interface information, the first thread run in central processor CPU is created, and according to interface information, creation exists
Second thread of image processor GPU operation, runs first thread, to obtain acquired image data from camera, and will
Image data is transferred to the second thread, and the second thread of operation is obtained with carrying out rendering processing to image data according to interface information
It is shown in the image of form, by the cooperative cooperating of CPU and GPU, the load of CPU is alleviated, realizes connecing for multiple cameras
Enter.
Based on the above embodiment, the embodiment of the invention also provides a kind of mobile units, including multiple cameras, storage
Device, processor and storage are on a memory and the computer program that can run on a processor, processor and multiple cameras company
It connects, when processor executes program, realizes the camera data processing side based on android system as described in preceding method embodiment
Method.
On the basis of a upper embodiment, Fig. 3 is a kind of structural representation of mobile unit provided by the embodiment of the present invention
Figure, as shown in figure 3, mobile unit 12 further includes image-signal processor 26 (Image Signal Processor, ISP), place
Managing device 27 includes central processor CPU 271 and image processor GPU272, wherein and ISP26 is connect with multiple cameras 25,
Multiple virtual channels 29 are provided between ISP26 and processor 27, wherein one is a pair of between virtual channel 29 and camera 25
It answers, the CPU271 in processor 27 obtains the picture number of multiple cameras 25 of access by the virtual channel between ISP26
According to.
It should be noted that the explanation of aforementioned camera data processing method embodiment based on android system,
Suitable for the mobile unit of the present embodiment, principle is identical, and details are not described herein again.
Based on the above embodiment, Fig. 4 shows the exemplary on board equipment for being suitable for being used to realize the application embodiment
Block diagram.The mobile unit 12 that Fig. 4 is shown is only an example, should not function to the embodiment of the present application and use scope bring
Any restrictions.
As shown in figure 4, mobile unit 12 is showed in the form of universal computing device.The component of mobile unit 12 may include
But be not limited to: one or more processor or processing unit 27, system storage 28, connect different system components (including
System storage 28 and processor 27) bus 18.
Bus 18 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller,
Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts
For example, these architectures include but is not limited to industry standard architecture (Industry Standard
Architecture；Hereinafter referred to as: ISA) bus, microchannel architecture (Micro Channel Architecture；Below
Referred to as: MAC) bus, enhanced isa bus, Video Electronics Standards Association (Video Electronics Standards
Association；Hereinafter referred to as: VESA) local bus and peripheral component interconnection (Peripheral Component
Interconnection；Hereinafter referred to as: PCI) bus.
Mobile unit 12 typically comprises a variety of computer system readable media.These media can be it is any can be by vehicle
Carry the usable medium that equipment 12 accesses, including volatile and non-volatile media, moveable and immovable medium.
Memory 28 may include the computer system readable media of form of volatile memory, such as random access memory
Device (Random Access Memory；Hereinafter referred to as: RAM) 30 and/or cache memory 32.Mobile unit 12 can be into
One step includes other removable/nonremovable, volatile/non-volatile computer system storage mediums.Only as an example, it deposits
Storage system 34 can be used for reading and writing immovable, non-volatile magnetic media, and (Fig. 4 do not show, commonly referred to as " hard drive
Device ").Although not shown in fig 4, the disk for reading and writing removable non-volatile magnetic disk (such as " floppy disk ") can be provided to drive
Dynamic device, and to removable anonvolatile optical disk (such as: compact disc read-only memory (Compact Disc Read Only
Memory；Hereinafter referred to as: CD-ROM), digital multi CD-ROM (Digital Video Disc Read Only
Memory；Hereinafter referred to as: DVD-ROM) or other optical mediums) read-write CD drive.In these cases, each driving
Device can be connected by one or more data media interfaces with bus 18.Memory 28 may include that at least one program produces
Product, the program product have one group of (for example, at least one) program module, and it is each that these program modules are configured to perform the application
The function of embodiment.
Program/utility 40 with one group of (at least one) program module 42 can store in such as memory 28
In, such program module 42 include but is not limited to operating system, one or more application program, other program modules and
It may include the realization of network environment in program data, each of these examples or certain combination.Program module 42 is usual
Execute the function and/or method in embodiments described herein.
Mobile unit 12 can also be with one or more external equipments 14 (such as keyboard, display 24, camera 25 etc.)
Communication, can also be enabled a user to one or more equipment interact with the mobile unit 12 communicate, and/or with make the vehicle
Carry any equipment (such as network interface card, modem etc.) that equipment 12 can be communicated with one or more of the other calculating equipment
Communication.This communication can be carried out by input/output (I/O) interface 22.Also, mobile unit 12 can also be suitable by network
Orchestration 20 and one or more network (such as local area network (Local Area Network；Hereinafter referred to as: LAN), wide area network
(Wide Area Network；Hereinafter referred to as: WAN) and/or public network, for example, internet) communication.As shown, network is suitable
Orchestration 20 is communicated by bus 18 with other modules of mobile unit 12.It should be understood that although not shown in the drawings, vehicle can be combined
It carries equipment 12 and uses other hardware and/or software module, including but not limited to: microcode, device driver, redundancy processing are single
Member, external disk drive array, RAID system, tape drive and data backup storage system etc..
The program that processor 27 is stored in system storage 28 by operation, thereby executing various function application and number
According to processing, such as realize the method referred in previous embodiment.
In order to realize above-described embodiment, the present invention also proposes a kind of computer readable storage medium, is stored thereon with calculating
Machine program when the program is executed by processor, realizes the camera number based on android system as described in preceding method embodiment
According to processing method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present invention, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
The embodiment of the present invention is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as to limit of the invention
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of the invention
Type.
Claims (16)
1. a kind of camera data processing method based on android system, which is characterized in that the described method comprises the following steps:
Obtain the interface information of form；
When getting the interface information, the first thread run in central processor CPU is created, and according to the interface
Information creates the second thread run in image processor GPU；
The first thread is run, to obtain acquired image data from camera, and described image data are transferred to institute
State the second thread；
Second thread is run to be shown in carry out rendering processing to described image data according to the interface information
The image of the form.
2. camera data processing method according to claim 1, which is characterized in that the operation first thread,
To obtain acquired image data from camera, and described image data are transferred to second thread, comprising:
Run the first thread；
Wherein, the first thread passes through opening for obtaining described image data by the virtual channel between camera
Described image data are copied to the GPU by shape library OpenGL interface, obtain storage address, and the storage address is sent
To second thread, so that second thread reads described image data according to the storage address；Wherein, described virtual
It is corresponded between channel and the camera.
3. camera data processing method according to claim 1, which is characterized in that the interface letter for obtaining form
Breath, comprising:
By the interface between application software, the interface information of the created form of the application software is obtained.
4. camera data processing method according to claim 3, which is characterized in that described to obtain the created form
Interface information, comprising:
Obtain the object of form；
The object is parsed, the interface information is obtained.
5. camera data processing method according to claim 1-4, which is characterized in that the number of the form
It is one, is to operate in the application software of the CPU to create, the image for multiple cameras is shown.
6. camera data processing method according to claim 5, which is characterized in that the interface information includes form
Display position and display size；Operation second thread, to be carried out according to the interface information to described image data
Rendering processing, obtains the image for being shown in the form, comprising:
Run second thread；
Wherein, second thread, after carrying out color gamut conversion and splicing according to described image data, to treated
Image data is rendered to obtain in the display position and meet the image of the display size.
7. a kind of camera data processing equipment based on android system, which is characterized in that described device the following steps are included:
Module is obtained, for obtaining the interface information of form；
Creation module, for creating the first thread run in CPU, and according to described when getting the interface information
Interface information creates the second thread run in GPU；
First operation module, for running the first thread, to obtain acquired image data from camera, and will be described
Image data is transferred to second thread；
Second operation module, for running second thread, to carry out wash with watercolours to described image data according to the interface information
Dye processing, obtains the image for being shown in the form.
8. camera data processing equipment according to claim 7, which is characterized in that the first operation module, specifically
For:
Run the first thread；
Wherein, the first thread passes through opening for obtaining described image data by the virtual channel between camera
Described image data are copied to the GPU by shape library OpenGL interface, obtain storage address, and the storage address is sent
To second thread, so that second thread reads described image data according to the storage address；Wherein, described virtual
It is corresponded between channel and the camera.
9. camera data processing equipment according to claim 7, which is characterized in that the acquisition module, comprising:
Acquiring unit, for obtaining the interface letter of the created form of the application software by the interface between application software
Breath.
10. camera data processing equipment according to claim 9, which is characterized in that the acquiring unit is specific to use
In:
Obtain the object of form；
The object is parsed, the interface information is obtained.
11. according to the described in any item camera data processing equipments of claim 7-10, which is characterized in that of the form
Number is one, is to operate in the application software of the CPU to create, the image for multiple cameras is shown.
12. camera data processing equipment according to claim 11, which is characterized in that the interface information includes form
Display position and display size；The second operation module, is specifically used for:
Run second thread；
Wherein, second thread, after carrying out color gamut conversion and splicing according to described image data, to treated
Image data is rendered to obtain in the display position and meet the image of the display size.
13. a kind of mobile unit, which is characterized in that including multiple cameras, memory, processor and store on a memory simultaneously
The computer program that can be run on a processor, the processor are connect with the multiple camera, and the processor executes institute
When stating program, such as camera data processing method based on android system as claimed in any one of claims 1 to 6 is realized.
14. mobile unit according to claim 13, which is characterized in that the processor is taken the photograph by ISP with the multiple
As head connects, wherein be provided with multiple virtual channels between the ISP and the processor；Wherein, the virtual channel and institute
It states and is corresponded between camera.
15. mobile unit according to claim 13, which is characterized in that the processor include central processor CPU and
Image processor GPU.
16. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Such as camera data processing method based on android system as claimed in any one of claims 1 to 6 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910375186.1A CN110191314A (en) | 2019-05-07 | 2019-05-07 | Camera data processing method, device and mobile unit based on android system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910375186.1A CN110191314A (en) | 2019-05-07 | 2019-05-07 | Camera data processing method, device and mobile unit based on android system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110191314A true CN110191314A (en) | 2019-08-30 |
Family
ID=67715732
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910375186.1A Pending CN110191314A (en) | 2019-05-07 | 2019-05-07 | Camera data processing method, device and mobile unit based on android system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110191314A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111681179A (en) * | 2020-05-22 | 2020-09-18 | 浙江大华技术股份有限公司 | Screen-side display method and device, computer equipment and computer-readable storage medium |
| CN112788291A (en) * | 2020-12-28 | 2021-05-11 | 安徽寒武纪信息科技有限公司 | Method for presenting dual-channel image and related product |
| WO2023245494A1 (en) * | 2022-06-22 | 2023-12-28 | 云智联网络科技(北京)有限公司 | Method and apparatus for acquiring texture data from rendering engine, and electronic device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350908A (en) * | 2008-08-28 | 2009-01-21 | 广东威创视讯科技股份有限公司 | Video data transmission system and method for network video conference |
| CN103365620A (en) * | 2013-06-03 | 2013-10-23 | 陈飞生 | Intelligent split screen display available mobile terminal |
| CN105488835A (en) * | 2014-09-15 | 2016-04-13 | Tcl集团股份有限公司 | Circular screen-switching method and system based on texture space GPU acceleration |
| CN105678680A (en) * | 2015-12-30 | 2016-06-15 | 魅族科技（中国）有限公司 | Image processing method and device |
| US20170032486A1 (en) * | 2015-07-28 | 2017-02-02 | Intel Corporation | Packet Processing on Graphics Processing Units Using Continuous Threads |
| CN106394407A (en) * | 2016-11-04 | 2017-02-15 | 重庆优擎科技有限公司 | Vehicle-mounted intelligent rearview mirror system and control method thereof |
| CN107993183A (en) * | 2017-11-24 | 2018-05-04 | 暴风集团股份有限公司 | Image processing apparatus, method, terminal and server |
| CN109474784A (en) * | 2018-11-21 | 2019-03-15 | 维沃移动通信有限公司 | A kind of preview image processing method and terminal device |
-
2019
- 2019-05-07 CN CN201910375186.1A patent/CN110191314A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350908A (en) * | 2008-08-28 | 2009-01-21 | 广东威创视讯科技股份有限公司 | Video data transmission system and method for network video conference |
| CN103365620A (en) * | 2013-06-03 | 2013-10-23 | 陈飞生 | Intelligent split screen display available mobile terminal |
| CN105488835A (en) * | 2014-09-15 | 2016-04-13 | Tcl集团股份有限公司 | Circular screen-switching method and system based on texture space GPU acceleration |
| US20170032486A1 (en) * | 2015-07-28 | 2017-02-02 | Intel Corporation | Packet Processing on Graphics Processing Units Using Continuous Threads |
| CN105678680A (en) * | 2015-12-30 | 2016-06-15 | 魅族科技（中国）有限公司 | Image processing method and device |
| CN106394407A (en) * | 2016-11-04 | 2017-02-15 | 重庆优擎科技有限公司 | Vehicle-mounted intelligent rearview mirror system and control method thereof |
| CN107993183A (en) * | 2017-11-24 | 2018-05-04 | 暴风集团股份有限公司 | Image processing apparatus, method, terminal and server |
| CN109474784A (en) * | 2018-11-21 | 2019-03-15 | 维沃移动通信有限公司 | A kind of preview image processing method and terminal device |
Non-Patent Citations (1)
| Title |
|---|
| 张晓燕，刘振霞，马志强编著: "《网络多媒体技术》", 30 September 2009 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111681179A (en) * | 2020-05-22 | 2020-09-18 | 浙江大华技术股份有限公司 | Screen-side display method and device, computer equipment and computer-readable storage medium |
| CN112788291A (en) * | 2020-12-28 | 2021-05-11 | 安徽寒武纪信息科技有限公司 | Method for presenting dual-channel image and related product |
| WO2023245494A1 (en) * | 2022-06-22 | 2023-12-28 | 云智联网络科技(北京)有限公司 | Method and apparatus for acquiring texture data from rendering engine, and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110191314A (en) | Camera data processing method, device and mobile unit based on android system | |
| DE69725057T2 (en) | Floating point processor for a three-dimensional graphic accelerator | |
| US6825844B2 (en) | System and method for optimizing a graphics intensive software program for the user's graphics hardware | |
| JP3678428B2 (en) | Method and apparatus for chroma key, transparency, and fog operation | |
| US6115050A (en) | Object-based anti-aliasing | |
| US7742050B2 (en) | System and method for optimizing a graphics intensive software program for the user's graphics hardware | |
| US20030206316A1 (en) | Creation and use of complex image templates | |
| CN108632641A (en) | Method for processing video frequency and device | |
| CN108549643A (en) | translation processing method and device | |
| US7688317B2 (en) | Texture mapping 2-D text properties to 3-D text | |
| CN108632668A (en) | Method for processing video frequency and device | |
| CN109121009A (en) | Method for processing video frequency, client and server | |
| US7864197B2 (en) | Method of background colour removal for porter and duff compositing | |
| CN108765315A (en) | Image completion method, apparatus, computer equipment and storage medium | |
| CN107391295A (en) | The processing method and processing device of application exception | |
| CN109191552A (en) | Threedimensional model processing method, device, electronic equipment and storage medium | |
| CN109255990A (en) | A kind of tutoring system based on AR augmented reality | |
| US20100039562A1 (en) | Source and output device-independent pixel compositor device adapted to incorporate the digital visual interface (DVI) | |
| US8817013B2 (en) | Method for processing a spatial image | |
| CN110166700A (en) | The virtual long exposure image of creation selectivity | |
| CN109766006A (en) | Display methods, device and the equipment of virtual reality scenario | |
| JPWO2004093043A1 (en) | Drawing apparatus and display control apparatus | |
| US9459819B2 (en) | Method, apparatus and system for associating an intermediate fill with a plurality of objects | |
| US20090033679A1 (en) | Visual integration hub | |
| CN109711335A (en) | The method and device that Target Photo is driven by characteristics of human body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211013 Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing Applicant after: Apollo Zhilian (Beijing) Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190830 |
|
| RJ01 | Rejection of invention patent application after publication |