CN116402935B - Image synthesis method and device based on ray tracing algorithm - Google Patents
Image synthesis method and device based on ray tracing algorithm Download PDFInfo
- Publication number
- CN116402935B CN116402935B CN202310314895.5A CN202310314895A CN116402935B CN 116402935 B CN116402935 B CN 116402935B CN 202310314895 A CN202310314895 A CN 202310314895A CN 116402935 B CN116402935 B CN 116402935B
- Authority
- CN
- China
- Prior art keywords
- light
- image
- threshold
- ray tracing
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004422 calculation algorithm Methods 0.000 title claims abstract description 18
- 238000001308 synthesis method Methods 0.000 title claims abstract description 12
- 238000000605 extraction Methods 0.000 claims abstract description 109
- 239000011159 matrix material Substances 0.000 claims abstract description 88
- 238000012545 processing Methods 0.000 claims abstract description 43
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000012216 screening Methods 0.000 claims abstract description 27
- 238000000354 decomposition reaction Methods 0.000 claims abstract description 25
- 230000000694 effects Effects 0.000 claims abstract description 19
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 18
- 230000008569 process Effects 0.000 claims abstract description 16
- 230000008521 reorganization Effects 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 12
- 230000007613 environmental effect Effects 0.000 claims description 3
- 230000003068 static effect Effects 0.000 abstract description 8
- 238000004891 communication Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 6
- 230000015572 biosynthetic process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000003786 synthesis reaction Methods 0.000 description 4
- 239000013598 vector Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
Abstract
The invention discloses an image synthesis method and device based on a ray tracing algorithm. Wherein the method comprises the following steps: acquiring a ray tracing threshold parameter and original image information; decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement; and extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result. The invention solves the technical problems that in the image screening process in the prior art, only the static features of the image are screened, for example, the flaw points of the image are screened, or the gray threshold of the image is clamped and screened, the light ray tracing cannot be carried out under different light rays, and the light ray tracing results meeting the requirements are combined to obtain the image data set with higher quality.
Description
Technical Field
The invention relates to the field of optical image optimization processing, in particular to an image synthesis method and device based on a ray tracing algorithm.
Background
Along with the continuous development of intelligent science and technology, intelligent equipment is increasingly used in life, work and study of people, and the quality of life of people is improved and the learning and working efficiency of people is increased by using intelligent science and technology means.
At present, when a high-precision camera array or a high-precision camera is used for real-time monitoring of sports fields such as basketball, football and the like, in order to increase the consistency display effect of multi-pixel images and multi-angle image data, the images are required to be screened and recombined so as to obtain target image data extracted based on certain screening rules, but in the image screening process in the prior art, the static characteristics of the images are screened, for example, flaw points of the images are screened, or gray thresholds of the images are blocked and screened, light tracking cannot be performed under different light conditions, and the light tracking results meeting the requirements are combined so as to obtain a set of image data with higher quality.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the invention provides an image synthesis method and device based on a ray tracing algorithm, which at least solve the technical problems that in the prior art, an image screening process is only to screen static features of an image, for example, flaw points of the image are screened, or gray level thresholds of the image are blocked and screened, ray tracing cannot be performed under different light conditions, and the ray tracing results meeting requirements are combined to obtain a set of image data with higher quality.
According to an aspect of an embodiment of the present invention, there is provided an image synthesis method based on a ray tracing algorithm, including: acquiring a ray tracing threshold parameter and original image information; decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement; and extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result.
Optionally, the acquiring the ray tracing threshold parameter includes: acquiring a light processing demand parameter and an environment real-time light parameter; and carrying out merging fitting calculation on the environment real-time light parameter and the light demand processing parameter to obtain the light ray tracing threshold parameter, wherein the light ray tracing threshold parameter comprises: ray weight parameters and ray extraction limit parameters.
Optionally, the generating a light threshold extraction matrix according to the light tracing threshold parameter, where the light threshold extraction matrix is used to extract and process image data in the image set to be recombined, which meets the requirement of the light tracing effect, includes: acquiring a ray weight parameter and a ray extraction limit parameter in the ray tracing threshold parameter;
according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter.
Optionally, the extracting and synthesizing the image data meeting the matrix matching relationship in the image set to be recombined by using the light threshold extraction matrix to obtain a recombined image result includes: acquiring each decomposed image data in the image set to be recombined; matching and extracting each decomposed image data and the light threshold extraction matrix according with threshold requirements to obtain screening image data; and splicing all the screening image data to obtain the recombined image result.
According to another aspect of the embodiment of the present invention, there is also provided an image synthesizing apparatus based on a ray tracing algorithm, including: the acquisition module is used for acquiring the ray tracing threshold parameters and the original image information; the decomposition module is used for decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; the generation module is used for generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which meets the requirement of the light ray tracing effect; and the reorganization module is used for extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be reorganized by utilizing the light threshold extraction matrix to obtain a reorganization image result.
Optionally, the acquiring the ray tracing threshold parameter includes: the acquisition unit is used for acquiring the light processing demand parameters and the environment real-time light parameters; the fitting unit is configured to perform a merging fitting calculation on the environmental real-time light parameter and the light demand processing parameter to obtain the light tracking threshold parameter, where the light tracking threshold parameter includes: ray weight parameters and ray extraction limit parameters.
Optionally, the generating module includes: the acquisition unit is used for acquiring the light weight parameter and the light extraction limit parameter in the light tracking threshold parameter;
a generation unit for according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter.
Optionally, the reorganization module includes: the acquisition unit is used for acquiring each piece of decomposed image data in the image set to be recombined; the extraction unit is used for carrying out matching extraction meeting the threshold requirement on each piece of decomposed image data and the light threshold extraction matrix to obtain screening image data; and the reorganization unit is used for stitching all the screening image data to obtain the reorganization image result.
According to another aspect of the embodiment of the present invention, there is further provided a nonvolatile storage medium, where the nonvolatile storage medium includes a stored program, and when the program runs, the program controls a device in which the nonvolatile storage medium is located to execute an image synthesis method based on a ray tracing algorithm.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device including a processor and a memory; the memory stores computer readable instructions, and the processor is configured to execute the computer readable instructions, where the computer readable instructions execute a method of image synthesis based on a ray tracing algorithm.
In the embodiment of the invention, acquiring a ray tracing threshold parameter and original image information is adopted; decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement; the method for extracting and synthesizing the image data conforming to the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result solves the technical problems that in the prior art, the image screening process is only to screen static features of images, such as flaw points of the images, or the gray threshold of the images is clamped and screened, light tracking cannot be performed under different light conditions, and the light tracking results conforming to requirements are combined to obtain the image data set with higher quality.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a flow chart of an image synthesis method based on a ray tracing algorithm according to an embodiment of the invention;
FIG. 2 is a block diagram of an image synthesizing apparatus based on a ray tracing algorithm according to an embodiment of the present invention;
fig. 3 is a block diagram of a terminal device for performing the method according to the invention according to an embodiment of the invention;
fig. 4 is a memory unit for holding or carrying program code for implementing a method according to the invention, according to an embodiment of the invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In accordance with an embodiment of the present invention, there is provided a method embodiment of an image synthesis method based on a ray tracing algorithm, it being noted that the steps illustrated in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order other than that illustrated herein.
Example 1
FIG. 1 is a flowchart of an image synthesis method based on a ray tracing algorithm according to an embodiment of the invention, as shown in FIG. 1, the method comprises the steps of:
step S102, acquiring a ray tracing threshold parameter and original image information.
Specifically, in order to solve the technical problem that in the image screening process in the prior art, only static features of an image are screened, for example, flaw points of the image are screened, or gray level thresholds of the image are clamped and screened, ray tracing cannot be performed under different light conditions, and the ray tracing results meeting requirements are combined to obtain a set of image data with higher quality, firstly, original image information acquired by high-precision image pickup equipment needs to be stored and transmitted and used for subsequent ray tracing judgment and synthesis, and meanwhile, for subsequent ray tracing calculation, ray tracing threshold parameters also need to be acquired according to data such as light environment, requirements and the like.
Optionally, the acquiring the ray tracing threshold parameter includes: acquiring a light processing demand parameter and an environment real-time light parameter; and carrying out merging fitting calculation on the environment real-time light parameter and the light demand processing parameter to obtain the light ray tracing threshold parameter, wherein the light ray tracing threshold parameter comprises: ray weight parameters and ray extraction limit parameters.
And step S104, decomposing the original image information according to an image decomposition model to obtain an image set to be recombined.
Specifically, in order to separate each local image data in the original image information and use the local image data in the original image information for ray tracing calculation to obtain image data conforming to a ray tracing result, the original image information needs to be decomposed according to an image decomposition model to obtain an image set to be recombined, wherein the image decomposition model can be a decomposition model which uses a DNN neural network model to train historical decomposition data as an input vector and uses a plurality of paired decomposition results as output vectors, and can be used for normalizing the image ray tracing decomposition.
Step S106, generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing the image data in the image set to be recombined, which meets the requirement of the light ray tracing effect.
Specifically, in order to extract and screen a plurality of image data in an image data set to be recombined in the embodiment of the present invention, a light ray threshold extraction matrix for extracting and processing the image data in the image data set to be recombined, which meets the requirement of a light ray tracing effect, needs to be generated according to a light ray tracing threshold parameter, and the matrix can take the image data to be recombined as an input variable and output a screening result as an output variable.
Optionally, the generating a light threshold extraction matrix according to the light tracing threshold parameter, where the light threshold extraction matrix is used to extract and process image data in the image set to be recombined, which meets the requirement of the light tracing effect, includes: acquiring a ray weight parameter and a ray extraction limit parameter in the ray tracing threshold parameter;
according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter.
And S108, extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result.
Optionally, the extracting and synthesizing the image data meeting the matrix matching relationship in the image set to be recombined by using the light threshold extraction matrix to obtain a recombined image result includes: acquiring each decomposed image data in the image set to be recombined; matching and extracting each decomposed image data and the light threshold extraction matrix according with threshold requirements to obtain screening image data; and splicing all the screening image data to obtain the recombined image result.
Through the embodiment, the technical problems that in the prior art, the image screening process is only to screen the static features of the image, for example, the flaw points of the image are screened, or the gray threshold of the image is clamped and screened, the light ray tracing cannot be performed under different light ray conditions, and the light ray tracing results meeting the requirements are combined to obtain the image data set with higher quality are solved.
Example two
Fig. 2 is a block diagram of an image synthesizing apparatus based on a ray tracing algorithm according to an embodiment of the present invention, and as shown in fig. 2, the apparatus includes:
an acquisition module 20 is configured to acquire the ray tracing threshold parameter and the original image information.
Specifically, in order to solve the technical problem that in the image screening process in the prior art, only static features of an image are screened, for example, flaw points of the image are screened, or gray level thresholds of the image are clamped and screened, ray tracing cannot be performed under different light conditions, and the ray tracing results meeting requirements are combined to obtain a set of image data with higher quality, firstly, original image information acquired by high-precision image pickup equipment needs to be stored and transmitted and used for subsequent ray tracing judgment and synthesis, and meanwhile, for subsequent ray tracing calculation, ray tracing threshold parameters also need to be acquired according to data such as light environment, requirements and the like.
Optionally, the acquiring the ray tracing threshold parameter includes: the acquisition unit is used for acquiring the light processing demand parameters and the environment real-time light parameters; the fitting unit is configured to perform a merging fitting calculation on the environmental real-time light parameter and the light demand processing parameter to obtain the light tracking threshold parameter, where the light tracking threshold parameter includes: ray weight parameters and ray extraction limit parameters.
The decomposition module 22 is configured to decompose the original image information according to an image decomposition model, so as to obtain a to-be-recombined image set.
Specifically, in order to separate each local image data in the original image information and use the local image data in the original image information for ray tracing calculation to obtain image data conforming to a ray tracing result, the original image information needs to be decomposed according to an image decomposition model to obtain an image set to be recombined, wherein the image decomposition model can be a decomposition model which uses a DNN neural network model to train historical decomposition data as an input vector and uses a plurality of paired decomposition results as output vectors, and can be used for normalizing the image ray tracing decomposition.
The generating module 24 is configured to generate a light threshold extraction matrix according to the light tracking threshold parameter, where the light threshold extraction matrix is configured to extract and process image data in the image set to be recombined, which meets the requirement of the light tracking effect.
Specifically, in order to extract and screen a plurality of image data in an image data set to be recombined in the embodiment of the present invention, a light ray threshold extraction matrix for extracting and processing the image data in the image data set to be recombined, which meets the requirement of a light ray tracing effect, needs to be generated according to a light ray tracing threshold parameter, and the matrix can take the image data to be recombined as an input variable and output a screening result as an output variable.
Optionally, the generating module includes: the acquisition unit is used for acquiring the light weight parameter and the light extraction limit parameter in the light tracking threshold parameter;
a generation unit for according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter.
And the reorganization module 26 is configured to extract and synthesize image data, which accords with a matrix matching relationship, in the image set to be reorganized by using the light threshold extraction matrix, so as to obtain a reorganized image result.
Optionally, the reorganization module includes: the acquisition unit is used for acquiring each piece of decomposed image data in the image set to be recombined; the extraction unit is used for carrying out matching extraction meeting the threshold requirement on each piece of decomposed image data and the light threshold extraction matrix to obtain screening image data; and the reorganization unit is used for stitching all the screening image data to obtain the reorganization image result.
Through the embodiment, the technical problems that in the prior art, the image screening process is only to screen the static features of the image, for example, the flaw points of the image are screened, or the gray threshold of the image is clamped and screened, the light ray tracing cannot be performed under different light ray conditions, and the light ray tracing results meeting the requirements are combined to obtain the image data set with higher quality are solved.
According to another aspect of the embodiment of the present invention, there is further provided a nonvolatile storage medium, where the nonvolatile storage medium includes a stored program, and when the program runs, the program controls a device in which the nonvolatile storage medium is located to execute an image synthesis method based on a ray tracing algorithm.
Specifically, the method comprises the following steps: acquiring a ray tracing threshold parameter and original image information; decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement; and extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result. Optionally, the acquiring the ray tracing threshold parameter includes: acquiring a light processing demand parameter and an environment real-time light parameter; and carrying out merging fitting calculation on the environment real-time light parameter and the light demand processing parameter to obtain the light ray tracing threshold parameter, wherein the light ray tracing threshold parameter comprises: ray weight parameters and ray extraction limit parameters. Optionally, the generating a light threshold extraction matrix according to the light tracing threshold parameter, where the light threshold extraction matrix is used to extract and process image data in the image set to be recombined, which meets the requirement of the light tracing effect, includes: acquiring a ray weight parameter and a ray extraction limit parameter in the ray tracing threshold parameter;
according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter. Optionally, the extracting and synthesizing the image data meeting the matrix matching relationship in the image set to be recombined by using the light threshold extraction matrix to obtain a recombined image result includes: acquiring each decomposed image data in the image set to be recombined; matching and extracting each decomposed image data and the light threshold extraction matrix according with threshold requirements to obtain screening image data; and splicing all the screening image data to obtain the recombined image result.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device including a processor and a memory; the memory stores computer readable instructions, and the processor is configured to execute the computer readable instructions, where the computer readable instructions execute a method of image synthesis based on a ray tracing algorithm.
Specifically, the method comprises the following steps: acquiring a ray tracing threshold parameter and original image information; decomposing the original image information according to an image decomposition model to obtain an image set to be recombined; generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement; and extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result. Optionally, the acquiring the ray tracing threshold parameter includes: acquiring a light processing demand parameter and an environment real-time light parameter; and carrying out merging fitting calculation on the environment real-time light parameter and the light demand processing parameter to obtain the light ray tracing threshold parameter, wherein the light ray tracing threshold parameter comprises: ray weight parameters and ray extraction limit parameters. Optionally, the generating a light threshold extraction matrix according to the light tracing threshold parameter, where the light threshold extraction matrix is used to extract and process image data in the image set to be recombined, which meets the requirement of the light tracing effect, includes: acquiring a ray weight parameter and a ray extraction limit parameter in the ray tracing threshold parameter;
according to the formula
And generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1-T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1-Q3 are light weight parameters, and lim is a light extraction limit parameter. Optionally, the extracting and synthesizing the image data meeting the matrix matching relationship in the image set to be recombined by using the light threshold extraction matrix to obtain a recombined image result includes: acquiring each decomposed image data in the image set to be recombined; matching and extracting each decomposed image data and the light threshold extraction matrix according with threshold requirements to obtain screening image data; and splicing all the screening image data to obtain the recombined image result.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, fig. 3 is a schematic hardware structure of a terminal device according to an embodiment of the present application. As shown in fig. 3, the terminal device may include an input device 30, a processor 31, an output device 32, a memory 33, and at least one communication bus 34. The communication bus 34 is used to enable communication connections between the elements. The memory 33 may comprise a high-speed RAM memory or may further comprise a non-volatile memory NVM, such as at least one magnetic disk memory, in which various programs may be stored for performing various processing functions and implementing the method steps of the present embodiment.
Alternatively, the processor 31 may be implemented as, for example, a central processing unit (Central Processing Unit, abbreviated as CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the processor 31 is coupled to the input device 30 and the output device 32 through wired or wireless connections.
Alternatively, the input device 30 may include a variety of input devices, for example, may include at least one of a user-oriented user interface, a device-oriented device interface, a programmable interface of software, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware insertion interface (such as a USB interface, a serial port, etc.) for data transmission between devices; alternatively, the user-oriented user interface may be, for example, a user-oriented control key, a voice input device for receiving voice input, and a touch-sensitive device (e.g., a touch screen, a touch pad, etc. having touch-sensitive functionality) for receiving user touch input by a user; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, for example, an input pin interface or an input interface of a chip, etc.; optionally, the transceiver may be a radio frequency transceiver chip, a baseband processing chip, a transceiver antenna, etc. with a communication function. An audio input device such as a microphone may receive voice data. The output device 32 may include a display, audio, or the like.
In this embodiment, the processor of the terminal device may include functions for executing each module of the data processing apparatus in each device, and specific functions and technical effects may be referred to the above embodiments and are not described herein again.
Fig. 4 is a schematic hardware structure of a terminal device according to another embodiment of the present application. Fig. 4 is a specific embodiment of the implementation of fig. 3. As shown in fig. 4, the terminal device of the present embodiment includes a processor 41 and a memory 42.
The processor 41 executes the computer program code stored in the memory 42 to implement the methods of the above-described embodiments.
The memory 42 is configured to store various types of data to support operation at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, video, etc. The memory 42 may include a random access memory (random access memory, simply referred to as RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
Optionally, a processor 41 is provided in the processing assembly 40. The terminal device may further include: a communication component 43, a power supply component 44, a multimedia component 45, an audio component 46, an input/output interface 47 and/or a sensor component 48. The components and the like specifically included in the terminal device are set according to actual requirements, which are not limited in this embodiment.
The processing component 40 generally controls the overall operation of the terminal device. The processing component 40 may include one or more processors 41 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 40 may include one or more modules that facilitate interactions between the processing component 40 and other components. For example, processing component 40 may include a multimedia module to facilitate interaction between multimedia component 45 and processing component 40.
The power supply assembly 44 provides power to the various components of the terminal device. Power supply components 44 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for terminal devices.
The multimedia component 45 comprises a display screen between the terminal device and the user providing an output interface. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation.
The audio component 46 is configured to output and/or input audio signals. For example, the audio component 46 includes a Microphone (MIC) configured to receive external audio signals when the terminal device is in an operational mode, such as a speech recognition mode. The received audio signals may be further stored in the memory 42 or transmitted via the communication component 43. In some embodiments, audio assembly 46 further includes a speaker for outputting audio signals.
The input/output interface 47 provides an interface between the processing assembly 40 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: volume button, start button and lock button.
The sensor assembly 48 includes one or more sensors for providing status assessment of various aspects for the terminal device. For example, the sensor assembly 48 may detect the open/closed state of the terminal device, the relative positioning of the assembly, the presence or absence of user contact with the terminal device. The sensor assembly 48 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 48 may also include a camera or the like.
The communication component 43 is configured to facilitate communication between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot, where the SIM card slot is used to insert a SIM card, so that the terminal device may log into a GPRS network, and establish communication with a server through the internet.
From the above, it will be appreciated that the communication component 43, the audio component 46, and the input/output interface 47, the sensor component 48 referred to in the embodiment of fig. 4 may be implemented as an input device in the embodiment of fig. 3.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (4)
1. An image synthesis method based on a ray tracing algorithm is characterized by comprising the following steps:
acquiring a ray tracing threshold parameter and original image information;
decomposing the original image information according to an image decomposition model to obtain an image set to be recombined;
generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which accords with the light ray tracing effect requirement;
extracting and synthesizing image data conforming to a matrix matching relationship in the image set to be recombined by utilizing the light threshold extraction matrix to obtain a recombined image result;
the acquiring ray tracing threshold parameters includes:
acquiring a light processing demand parameter and an environment real-time light parameter;
and carrying out merging fitting calculation on the environment real-time light parameter and the light demand processing parameter to obtain the light ray tracing threshold parameter, wherein the light ray tracing threshold parameter comprises: ray weight parameters and ray extraction limit parameters;
generating a light threshold extraction matrix according to the light tracking threshold parameter, where the light threshold extraction matrix is used to extract and process image data in the image set to be recombined, which meets the requirement of the light tracking effect, and the method includes:
acquiring a ray weight parameter and a ray extraction limit parameter in the ray tracing threshold parameter;
according to the formula
Generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1, T2 and T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1, Q2 and Q3 are light weight parameters, and lim is a light extraction limit parameter;
extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be recombined by using the light threshold extraction matrix, wherein the obtaining of the recombined image result comprises the following steps:
acquiring each decomposed image data in the image set to be recombined;
matching and extracting each decomposed image data and the light threshold extraction matrix according with threshold requirements to obtain screening image data;
and splicing all the screening image data to obtain the recombined image result.
2. An image synthesizing apparatus based on a ray tracing algorithm, comprising:
the acquisition module is used for acquiring the ray tracing threshold parameters and the original image information;
the decomposition module is used for decomposing the original image information according to an image decomposition model to obtain an image set to be recombined;
the generation module is used for generating a light ray threshold extraction matrix according to the light ray tracing threshold parameters, wherein the light ray threshold extraction matrix is used for extracting and processing image data in the image set to be recombined, which meets the requirement of the light ray tracing effect;
the reorganization module is used for extracting and synthesizing the image data which accords with the matrix matching relation in the image set to be reorganized by utilizing the light threshold extraction matrix to obtain a reorganized image result;
the acquiring ray tracing threshold parameters includes:
the acquisition unit is used for acquiring the light processing demand parameters and the environment real-time light parameters;
the fitting unit is configured to perform a merging fitting calculation on the environmental real-time light parameter and the light demand processing parameter to obtain the light tracking threshold parameter, where the light tracking threshold parameter includes: ray weight parameters and ray extraction limit parameters;
the generation module comprises:
the acquisition unit is used for acquiring the light weight parameter and the light extraction limit parameter in the light tracking threshold parameter;
a generation unit for according to the formula
Generating the light threshold extraction matrix, wherein Li is the light threshold extraction matrix, T1, T2 and T3 are multiple image threshold extraction parameters, TR is a ray tracing Taylor fitting factor, Q1, Q2 and Q3 are light weight parameters, and lim is a light extraction limit parameter;
the reorganization module includes:
the acquisition unit is used for acquiring each piece of decomposed image data in the image set to be recombined;
the extraction unit is used for carrying out matching extraction meeting the threshold requirement on each piece of decomposed image data and the light threshold extraction matrix to obtain screening image data;
and the reorganization unit is used for stitching all the screening image data to obtain the reorganization image result.
3. A non-volatile storage medium comprising a stored program, wherein the program when run controls a device in which the non-volatile storage medium resides to perform the method of claim 1.
4. An electronic device comprising a processor and a memory; the memory has stored therein computer readable instructions for execution by the processor, wherein the computer readable instructions when executed perform the method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310314895.5A CN116402935B (en) | 2023-03-28 | 2023-03-28 | Image synthesis method and device based on ray tracing algorithm |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310314895.5A CN116402935B (en) | 2023-03-28 | 2023-03-28 | Image synthesis method and device based on ray tracing algorithm |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116402935A CN116402935A (en) | 2023-07-07 |
| CN116402935B true CN116402935B (en) | 2024-01-19 |
Family
ID=87008437
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310314895.5A Active CN116402935B (en) | 2023-03-28 | 2023-03-28 | Image synthesis method and device based on ray tracing algorithm |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116402935B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08171654A (en) * | 1994-12-20 | 1996-07-02 | Matsushita Electric Ind Co Ltd | Moving image generator |
| WO2014205768A1 (en) * | 2013-06-28 | 2014-12-31 | 中国科学院自动化研究所 | Feature and model mutual matching face tracking method based on increment principal component analysis |
| CN111832470A (en) * | 2020-07-15 | 2020-10-27 | 中兴飞流信息科技有限公司 | Remnant detection method integrating multiple models |
| CN113079325A (en) * | 2021-03-18 | 2021-07-06 | 北京拙河科技有限公司 | Method, apparatus, medium, and device for imaging billions of pixels under dim light conditions |
| CN114581589A (en) * | 2020-11-30 | 2022-06-03 | 华为技术有限公司 | Image processing method and related device |
| CN115484408A (en) * | 2022-09-07 | 2022-12-16 | 北京拙河科技有限公司 | Snow surface reflection coefficient generation method and device based on high-precision camera shooting |
| CN115564885A (en) * | 2021-06-30 | 2023-01-03 | 华为技术有限公司 | Ray tracing rendering method, device and equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6253280B2 (en) * | 2013-07-04 | 2017-12-27 | キヤノン株式会社 | Imaging apparatus and control method thereof |
-
2023
- 2023-03-28 CN CN202310314895.5A patent/CN116402935B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08171654A (en) * | 1994-12-20 | 1996-07-02 | Matsushita Electric Ind Co Ltd | Moving image generator |
| WO2014205768A1 (en) * | 2013-06-28 | 2014-12-31 | 中国科学院自动化研究所 | Feature and model mutual matching face tracking method based on increment principal component analysis |
| CN111832470A (en) * | 2020-07-15 | 2020-10-27 | 中兴飞流信息科技有限公司 | Remnant detection method integrating multiple models |
| CN114581589A (en) * | 2020-11-30 | 2022-06-03 | 华为技术有限公司 | Image processing method and related device |
| CN113079325A (en) * | 2021-03-18 | 2021-07-06 | 北京拙河科技有限公司 | Method, apparatus, medium, and device for imaging billions of pixels under dim light conditions |
| CN115564885A (en) * | 2021-06-30 | 2023-01-03 | 华为技术有限公司 | Ray tracing rendering method, device and equipment |
| CN115484408A (en) * | 2022-09-07 | 2022-12-16 | 北京拙河科技有限公司 | Snow surface reflection coefficient generation method and device based on high-precision camera shooting |
Non-Patent Citations (1)
| Title |
|---|
| "基于全局视觉与自主视觉的复杂场景重建与目标跟踪";陆玮;《中国优秀硕士学位论文全文数据库 信息科技辑》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116402935A (en) | 2023-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115426525B (en) | High-speed dynamic frame linkage image splitting method and device | |
| CN115631122A (en) | Image optimization method and device for edge image algorithm | |
| CN115170818A (en) | Dynamic frame image feature extraction method and device | |
| CN115984126A (en) | Optical image correction method and device based on input instruction | |
| CN116614453B (en) | Image transmission bandwidth selection method and device based on cloud interconnection | |
| CN115293985B (en) | Super-resolution noise reduction method and device for image optimization | |
| CN116402935B (en) | Image synthesis method and device based on ray tracing algorithm | |
| CN115600898A (en) | Employee behavior risk analysis method and device based on qualitative and quantitative comprehensive analysis | |
| CN115527045A (en) | Image identification method and device for snow field danger identification | |
| CN114866702A (en) | Multi-auxiliary linkage camera shooting technology-based border monitoring and collecting method and device | |
| CN116468883B (en) | High-precision image data volume fog recognition method and device | |
| CN116389915B (en) | Method and device for reducing flicker of light field camera | |
| CN116664413B (en) | Image volume fog eliminating method and device based on Abbe convergence operator | |
| CN115511735B (en) | Snow field gray scale picture optimization method and device | |
| CN116228593B (en) | Image perfecting method and device based on hierarchical antialiasing | |
| CN115187570B (en) | Singular traversal retrieval method and device based on DNN deep neural network | |
| CN115914819B (en) | Picture capturing method and device based on orthogonal decomposition algorithm | |
| CN115205313B (en) | Picture optimization method and device based on least square algorithm | |
| CN116363006B (en) | Image calibration method and device based on normal algorithm | |
| CN116088580B (en) | Flying object tracking method and device | |
| CN116579964B (en) | Dynamic frame gradual-in gradual-out dynamic fusion method and device | |
| CN116579965B (en) | Multi-image fusion method and device | |
| CN115460389B (en) | Image white balance area optimization method and device | |
| CN116309523A (en) | Dynamic frame image dynamic fuzzy recognition method and device | |
| CN117896625A (en) | Picture imaging method and device based on low-altitude high-resolution analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |