CN111787239A - Video shooting device and three-dimensional imaging method thereof - Google Patents
Video shooting device and three-dimensional imaging method thereof Download PDFInfo
- Publication number
- CN111787239A CN111787239A CN202010817855.9A CN202010817855A CN111787239A CN 111787239 A CN111787239 A CN 111787239A CN 202010817855 A CN202010817855 A CN 202010817855A CN 111787239 A CN111787239 A CN 111787239A
- Authority
- CN
- China
- Prior art keywords
- target object
- turntable
- target
- information
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Graphics (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the application provides a video shooting device and a three-dimensional imaging method thereof. The three-dimensional imaging method comprises the following steps: rotating the turntable when the target object is detected to be placed on the turntable; in the rotating process of the turntable, determining illumination configuration information based on the state information of the target object at each rotating angle; adjusting the shooting light based on the illumination configuration information to shoot the video frame sequence of the target object during the rotation of the turntable; and synthesizing the video frame sequence based on the rotation direction of the turntable to obtain the video containing the three-dimensional information of the target object. The technical scheme of this application embodiment adjusts the light of target object in different position through above-mentioned mode, rotates the target object in order to accomplish omnidirectional shooting through the mode of rotatory carousel, has improved the comprehensiveness and the accuracy nature of shooing to guarantee the shooting effect of target object.
Description
Technical Field
The application relates to the technical field of computers and communication, in particular to a video shooting device and a three-dimensional imaging method thereof.
Background
At present, the image and video technology is developed more and more technologically, images and videos can well reflect the shape, performance and the like of an object. When an object is shot many times, a good photo or video cannot be obtained due to the influence of external environment, such as illumination, the performance of a camera and the like, so that the display effect of the object is influenced, and the situation of poor shooting effect is caused.
Disclosure of Invention
The embodiment of the application provides a video shooting device and a three-dimensional imaging method thereof, and further the comprehensiveness and accuracy of shooting can be improved at least to a certain extent to guarantee the shooting effect of a target object.
Other features and advantages of the present application will be apparent from the following detailed description, or may be learned by practice of the application.
According to an aspect of an embodiment of the present application, there is provided a method of three-dimensional imaging, including: rotating the turntable when the target object is detected to be placed on the turntable; in the rotating process of the turntable, determining illumination configuration information based on the state information of the target object at each rotating angle; adjusting the shooting light based on the illumination configuration information to shoot the video frame sequence of the target object during the rotation of the turntable; and synthesizing the video frame sequence based on the rotation direction of the turntable to obtain the video containing the three-dimensional information of the target object.
In some embodiments of the present application, based on the foregoing solution, the determining, during the rotation of the turntable, illumination configuration information based on the state information of the target object at each rotation angle includes: acquiring current images of the target object at each rotation angle in the rotation process of the turntable; determining current state information of the target object based on pixel information of the target object in the current image; based on the state information, illumination configuration information for adjusting the light intensity and direction is determined.
In some embodiments of the present application, based on the foregoing solution, the determining the current state information of the target object based on the pixel information of the target object in the current image includes: generating a normal image corresponding to the current image based on the pixel information of the target object in the current image; detecting the difference of the height values between every two adjacent pixels in the normal image, and determining a region to be compensated based on the difference of the height values; and generating the current state information of the target object based on the corresponding position of the light region to be compensated in the current image.
In some embodiments of the present application, based on the foregoing solution, the generating a normal image corresponding to the current image based on the pixel information of the target object in the current image includes: generating a color image and a gray image corresponding to the target object based on the pixel information of the target object in the current image; inputting the color image and the gray level image into a generator of a normal image generation network to generate a normal image to be determined; inputting the normal image to be determined and the gray level image into a discriminator of the normal image generation network to obtain a discrimination result output by the normal image generation network; and if the judgment result is that the pixel information of the normal image to be determined is consistent with the pixel information of the target object, determining that the normal image to be determined is a normal image corresponding to the current image.
In some embodiments of the present application, based on the foregoing solution, the determining illumination configuration information for adjusting light intensity and direction based on the state information includes: determining target coordinates of the target position in a camera coordinate system based on the target position corresponding to the light region to be compensated in the state information in the current image; determining the direction of light to be supplemented based on the angle between the target coordinate and the light ray emitter; and determining the intensity of light to be supplemented based on the brightness value of the target position in the current image, so that the direction and the intensity of the light to be supplemented are used as the illumination configuration information.
In some embodiments of the present application, based on the foregoing solution, the method further comprises: and in the rotating process of the turntable, adjusting the rotating speed of the turntable and the shooting frequency of the video frame sequence based on the state information of the target object at each rotating angle.
In some embodiments of the present application, based on the foregoing solution, the method further comprises: determining a target part to be refined in the target object based on the state information; modifying the illumination direction and brightness in the illumination configuration information based on the target part to obtain updated illumination configuration information; adjusting a shooting angle and a focal length based on the target part; and shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
According to an aspect of an embodiment of the present application, there is provided a video photographing apparatus including: the detection unit is used for rotating the turntable when a target object is detected to be placed on the turntable; the determining unit is used for determining illumination configuration information based on the state information of the target object at each rotation angle in the rotating process of the turntable; the adjusting unit is used for adjusting shooting light based on the illumination configuration information so as to shoot the video frame sequence of the target object in the rotating process of the turntable; and the synthesis unit is used for synthesizing the video frame sequence based on the rotation direction of the turntable to obtain a video containing the three-dimensional information of the target object.
In some embodiments of the present application, based on the foregoing scheme, the determining unit includes: the acquisition unit is used for acquiring current images of the target object at all rotation angles in the rotating process of the turntable; a state determining unit, configured to determine current state information of the target object based on pixel information of the target object in the current image; and the adjusting unit is used for determining illumination configuration information for adjusting the light intensity and the direction based on the state information.
In some embodiments of the present application, based on the foregoing scheme, the state determination unit includes: the map generating unit is used for generating a normal image corresponding to the current image based on the pixel information of the target object in the current image; a height detection unit for detecting a difference in height value between adjacent pixels in the normal image, and determining a region to be compensated based on the difference in height value; and the state generating unit is used for generating the current state information of the target object based on the corresponding position of the light region to be compensated in the current image.
In some embodiments of the present application, based on the foregoing scheme, the map generating unit is configured to: generating a color image and a gray image corresponding to the target object based on the pixel information of the target object in the current image; inputting the color image and the gray level image into a generator of a normal image generation network to generate a normal image to be determined; inputting the normal image to be determined and the gray level image into a discriminator of the normal image generation network to obtain a discrimination result output by the normal image generation network; and if the judgment result is that the pixel information of the normal image to be determined is consistent with the pixel information of the target object, determining that the normal image to be determined is a normal image corresponding to the current image.
In some embodiments of the present application, based on the foregoing solution, the adjusting unit is configured to: determining target coordinates of the target position in a camera coordinate system based on the target position corresponding to the light region to be compensated in the state information in the current image; determining the direction of light to be supplemented based on the angle between the target coordinate and the light ray emitter; and determining the intensity of light to be supplemented based on the brightness value of the target position in the current image, so that the direction and the intensity of the light to be supplemented are used as the illumination configuration information.
In some embodiments of the present application, based on the foregoing solution, the video camera further includes: and the shooting adjusting unit is used for adjusting the rotating speed of the turntable and the shooting frequency of the video frame sequence based on the state information of the target object at each rotating angle in the rotating process of the turntable.
In some embodiments of the present application, based on the foregoing solution, the video camera further includes: the target determining unit is used for determining a target part to be refined in the target object based on the state information; the target configuration unit is used for modifying the illumination direction and the brightness in the illumination configuration information based on the target part to obtain updated illumination configuration information; the target modification unit is used for adjusting a shooting angle and a focal length based on the target part; and the target shooting unit is used for shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
According to an aspect of embodiments of the present application, there is provided a computer readable medium having stored thereon a computer program which, when executed by a processor, implements the method of three-dimensional imaging as described in the above embodiments.
According to an aspect of an embodiment of the present application, there is provided an electronic device including: one or more processors; a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the method of three-dimensional imaging as described in the embodiments above.
According to an aspect of embodiments herein, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of three-dimensional imaging provided in the various alternative implementations described above.
In the technical solutions provided in some embodiments of the present application, when a target object is detected to be placed on a turntable, the turntable is rotated, and in a process of rotating the turntable, illumination configuration information is determined according to state information of the target object at each rotation angle, so as to adjust shooting light based on the illumination configuration information, and to shoot a video frame sequence of the target video in a process of rotating the turntable based on the adjusted light, and finally, based on a rotation direction of the turntable, the video frame is synthesized to obtain a video containing three-dimensional information of the target object. The lamplight of the target object in different directions is adjusted in the above mode, the target object is rotated in a rotating turntable mode to complete all-around shooting, the shooting comprehensiveness and accuracy are improved, and the shooting effect of the target object is guaranteed.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort. In the drawings:
FIG. 1 shows a schematic diagram of an exemplary system architecture to which aspects of embodiments of the present application may be applied;
FIG. 2 schematically shows a flow diagram of a method of three-dimensional imaging according to an embodiment of the present application;
FIG. 3 schematically illustrates a flow chart for determining illumination configuration information based on state information of a target object at various angles of rotation according to one embodiment of the present application;
FIG. 4 schematically shows a schematic view of a video capture device according to an embodiment of the present application;
FIG. 5 illustrates a schematic structural diagram of a computer system suitable for use in implementing the electronic device of an embodiment of the present application.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the application. One skilled in the relevant art will recognize, however, that the subject matter of the present application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the application.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Fig. 1 shows a schematic diagram of an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied.
As shown in fig. 1, the system architecture may include a camera 101, a network 102, and a server 103. The network 103 is used to provide a medium for a communication link between the image pickup device and the server 103. Network 103 may include various connection types, such as wired communication links, wireless communication links, and so forth.
It should be understood that the number of cameras, networks, and servers in fig. 1 is merely illustrative. There may be any number of cameras, networks, and servers, as desired for implementation. For example, the server 103 may be a server cluster composed of a plurality of servers.
The user can interact with the server 103 through the network 103 using the camera device to receive or transmit messages or the like. The server 103 may be a server that provides various services. For example, when the user detects that the target object is placed on the turntable by using the camera 103, the turntable is rotated; in the rotating process of the turntable, determining illumination configuration information based on the state information of the target object at each rotating angle; adjusting the shooting light based on the illumination configuration information to shoot the video frame sequence of the target object in the rotating process of the turntable; and synthesizing the video frame sequence based on the rotation direction of the turntable to obtain the video containing the three-dimensional information of the target object. The resulting video is then transmitted to the server 103.
In the three-dimensional imaging method in this embodiment, when a target object placed on the turntable is detected, the turntable is rotated, in the rotation process of the turntable, illumination configuration information is determined according to state information of the target object at each rotation angle, so that shooting light is adjusted based on the illumination configuration information, a video frame sequence of the target video is shot in the rotation process of the turntable based on the adjusted light, and finally, a video frame is synthesized to obtain a video containing three-dimensional information of the target object based on the rotation direction of the turntable. The lamplight of the target object in different directions is adjusted in the above mode, the target object is rotated in a rotating turntable mode to complete all-around shooting, the shooting comprehensiveness and accuracy are improved, and the shooting effect of the target object is guaranteed.
It should be noted that the method for three-dimensional imaging provided in the embodiment of the present application is generally executed by the server 103, and accordingly, the video shooting device is generally disposed in the server 103. However, in other embodiments of the present application, the camera device may also have a similar function as the server, so as to execute the method of three-dimensional imaging provided by the embodiments of the present application.
The implementation details of the technical solution of the embodiment of the present application are set forth in detail below:
fig. 2 shows a flowchart of a method of three-dimensional imaging according to an embodiment of the present application, which may be performed by a server, which may be the camera device shown in fig. 1. Referring to fig. 2, the method of three-dimensional imaging at least includes steps S210 to S240, which are described in detail as follows:
in step S210, upon detecting that the target object is placed on the turntable, the turntable is rotated.
In an embodiment of the present application, the video camera of the present embodiment includes a turntable therein for mode-targeting an object. Also, the turntable in this embodiment can rotate. Meanwhile, the sensor device is arranged at the bottom of the rotary disc or the bottom of the rotary disc and used for rotating the rotary disc when the target object is placed on the rotary disc.
In addition, the method can also be used for shooting the photos of the turntable and the area on the upper part of the turntable in a video monitoring mode, detecting whether an object is placed on the turntable in the photos, and rotating the turntable if the object is placed on the turntable.
In one embodiment of the present application, the lower portion of the turntable is provided with a motor device for controlling the rotation of the turntable, and at the same time, the rotation angle and the rotation speed of the turntable, etc. can be controlled.
In step S220, during the rotation of the turntable, illumination configuration information is determined based on the state information of the target object at each rotation angle.
In an embodiment of the present application, during the rotation of the turntable, the direction of the target object changes, and therefore the received light intensity also changes, in which the illumination configuration information corresponding to each rotation angle is determined based on the state information of the target object at each rotation angle.
It should be noted that the positions of the lens and the light emitter of the shooting device in the embodiment may be fixed or may be changed, and are determined according to the setting of the video shooting device.
In an embodiment of the present application, as shown in fig. 3, in the rotating process of the turntable in step S220, the process of determining the illumination configuration information based on the state information of the target object at each rotation angle includes the following steps S310 to S330, which are described in detail as follows:
in step S310, during the rotation of the turntable, current images of the target object at various rotation angles are acquired.
In one embodiment of the present application, the direction of the object toward the lens and the light emitter is different during rotation of the turntable. Meanwhile, due to the irregular state of the target object, the light received by each portion may also be different. Therefore, in this embodiment, in the rotating process of the turntable, the current image of the target object corresponding to each rotation angle is obtained.
In step S320, current state information of the target object is determined based on the pixel information of the target object in the current image.
In one embodiment of the present application. After the current images are acquired, the current state information of the target object is determined based on the pixel information of the target object in each current image, so that the configuration information under the current rotation angle is adjusted through the current state information.
In an embodiment of the present application, the process of determining the current state information of the target object based on the pixel information of the target object in the current image in step S320 includes steps S3201 to S3203, which are described in detail as follows:
in step S3201, a normal image corresponding to the current image is generated based on the pixel information of the target object in the current image.
In one embodiment of the application, when determining the current state information of a target object, a color image and a grayscale image corresponding to the target object are generated based on the pixel information of the target object in a current image; inputting the color image and the gray level image into a generator of a normal image generation network to generate an undetermined normal image; inputting the normal image to be determined and the gray level image into a discriminator of a normal image generation network to obtain a discrimination result output by the normal image generation network; and if the judgment result is that the pixel information of the normal image to be determined is consistent with the pixel information of the target object, determining that the normal image to be determined is the normal image corresponding to the current image.
In this embodiment, the normal map is an image formed by normal lines corresponding to each point of the concave-convex surface, which is obtained by marking the direction of the normal lines based on color channels in the color image. For the visual effect, the efficiency is higher than that of the original concave-convex surface, and if a light source is applied to a specific position, concave-convex information of an object with high detail degree can be generated on the surface with low detail degree.
In step S3202, a difference in height value between adjacent pixels in the normal image is detected, and a light-to-be-compensated region is determined based on the difference in height value.
In one embodiment of the present application, after the normal image is generated, the region to be compensated is determined based on a difference in height value between respective adjacent pixels in the normal image. Specifically, the height value in this embodiment may be depth information corresponding to one pixel point in the normal line image, or the like.
Illustratively, two pixel points in the normal image are i and j, respectively, and their corresponding height values are D, respectivelyi,DjBased on the height values of the two pixel points, calculating a difference parameter as follows:
after the difference parameter is obtained through calculation, if the difference parameter is greater than a set threshold, it indicates that the difference in height values between the two points is large, that is, the difference corresponds to a region where there are irregularities in the target object, and the positions corresponding to the two pixel points are assigned to the region to be compensated.
In step S3203, current state information of the target object is generated based on a corresponding position of the region to be compensated in the current image.
In one embodiment of the application, after the light region to be compensated is determined, the current state information of the target object is determined based on the corresponding position of the light region to be compensated in the current image. The state information in this embodiment may include: a light region to be compensated in the target object and a corresponding position thereof, a difference parameter corresponding to the light region to be compensated, and the like.
In step S330, illumination configuration information for adjusting the light intensity and direction is determined based on the state information.
In one embodiment of the present application, after determining the status information, the light configuration information when the light emitting device emits the optical fiber is adjusted based on the status information.
Specifically, the illumination configuration information in this embodiment may include light intensity and direction. Specifically, when determining illumination configuration information for adjusting light intensity and direction, determining a target coordinate of a target position in a camera coordinate system based on a target position corresponding to a light region to be compensated in a current image in state information; and determining the direction of light to be supplemented based on the angle between the target coordinate and the light ray emitter.
In an embodiment of the present application, the intensity of light to be supplemented is determined based on a brightness value of the target position in the current image, so that the direction and the intensity of the light to be supplemented serve as the illumination configuration information. Optionally, in this embodiment, the intensity of light to be supplemented may also be determined according to the difference parameter.
In one embodiment of the present application, the three-dimensional imaging method further comprises: during the rotation of the turntable, the rotation speed of the turntable and the shooting frequency of the video frame sequence are adjusted based on the state information of the target object at each rotation angle.
For example, in this embodiment, because the angles of the target objects are different and the aspects that need to be displayed with emphasis are different, when the direction corresponding to the part that needs to be displayed with details corresponds, the rotation speed of the turntable can be reduced, the shooting frequency of the video frame sequence can be increased, and further, a clearer video frame can be obtained.
In step S230, the photographing light is adjusted based on the illumination configuration information to photograph a sequence of video frames of the target object during the rotation of the turntable.
In one embodiment of the application, after the illumination configuration information is determined, the shooting light is adjusted based on the lighting direction and the light intensity in the illumination configuration information. So as to shoot images of different angles of the target object image while the rotating disc rotates, and the images are used as a video frame sequence.
In one embodiment of the present application, the three-dimensional imaging method further comprises: determining a target part to be refined in the target object based on the state information; modifying the illumination direction and brightness in the illumination configuration information based on the target part to obtain updated illumination configuration information; adjusting a shooting angle and a focal length based on the target part; and shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
Specifically, in this embodiment, because the target objects have different forms, there is a target portion to be refined, and in this case, the illumination direction and the brightness in the illumination configuration information may be adjusted for the target portion, so as to obtain updated illumination configuration information. And meanwhile, adjusting the shooting angle and the focal length of the camera based on the position of the target part, and finally shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
In step S240, the sequence of video frames is synthesized based on the rotation direction of the turntable, so as to obtain a video containing the three-dimensional information of the target object.
In one embodiment of the present application, after obtaining the sequence of video frames, the sequence of video frames is synthesized based on the rotation direction of the turntable to obtain a video containing three-dimensional information of the target object. So as to present various aspects of the information of the target object through the video of the three-dimensional information of the target object.
Embodiments of the apparatus of the present application are described below, which may be used to perform the methods of three-dimensional imaging in the above-described embodiments of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method for three-dimensional imaging described above in the present application.
FIG. 4 shows a block diagram of a video capture device according to one embodiment of the present application.
Referring to fig. 4, a video camera 400 according to an embodiment of the present application includes: a detecting unit 410 for rotating the turntable when it is detected that the target object is placed on the turntable; a determining unit 420, configured to determine, during rotation of the turntable, illumination configuration information based on state information of the target object at each rotation angle; an adjusting unit 430, configured to adjust the shooting light based on the illumination configuration information to shoot a video frame sequence of the target object during rotation of the turntable; a synthesizing unit 440, configured to synthesize the sequence of video frames based on the rotation direction of the turntable, so as to obtain a video including the three-dimensional information of the target object.
In some embodiments of the present application, based on the foregoing scheme, the determining unit 420 includes: the acquisition unit is used for acquiring current images of the target object at all rotation angles in the rotating process of the turntable; a state determining unit, configured to determine current state information of the target object based on pixel information of the target object in the current image; and the adjusting unit is used for determining illumination configuration information for adjusting the light intensity and the direction based on the state information.
In some embodiments of the present application, based on the foregoing scheme, the state determination unit includes: the map generating unit is used for generating a normal image corresponding to the current image based on the pixel information of the target object in the current image; a height detection unit for detecting a difference in height value between adjacent pixels in the normal image, and determining a region to be compensated based on the difference in height value; and the state generating unit is used for generating the current state information of the target object based on the corresponding position of the light region to be compensated in the current image.
In some embodiments of the present application, based on the foregoing scheme, the map generating unit is configured to: generating a color image and a gray image corresponding to the target object based on the pixel information of the target object in the current image; inputting the color image and the gray level image into a generator of a normal image generation network to generate a normal image to be determined; inputting the normal image to be determined and the gray level image into a discriminator of the normal image generation network to obtain a discrimination result output by the normal image generation network; and if the judgment result is that the pixel information of the normal image to be determined is consistent with the pixel information of the target object, determining that the normal image to be determined is a normal image corresponding to the current image.
In some embodiments of the present application, based on the foregoing solution, the adjusting unit 430 is configured to: determining target coordinates of the target position in a camera coordinate system based on the target position corresponding to the light region to be compensated in the state information in the current image; determining the direction of light to be supplemented based on the angle between the target coordinate and the light ray emitter; and determining the intensity of light to be supplemented based on the brightness value of the target position in the current image, so that the direction and the intensity of the light to be supplemented are used as the illumination configuration information.
In some embodiments of the present application, based on the foregoing solution, the video camera 400 further includes: and the shooting adjusting unit is used for adjusting the rotating speed of the turntable and the shooting frequency of the video frame sequence based on the state information of the target object at each rotating angle in the rotating process of the turntable.
In some embodiments of the present application, based on the foregoing solution, the video camera 400 further includes: the target determining unit is used for determining a target part to be refined in the target object based on the state information; the target configuration unit is used for modifying the illumination direction and the brightness in the illumination configuration information based on the target part to obtain updated illumination configuration information; the target modification unit is used for adjusting a shooting angle and a focal length based on the target part; and the target shooting unit is used for shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
FIG. 5 illustrates a schematic structural diagram of a computer system suitable for use in implementing the electronic device of an embodiment of the present application.
It should be noted that the computer system 500 of the electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 5, the computer system 500 includes a Central Processing Unit (CPU)501, which can perform various appropriate actions and processes, such as executing the methods described in the above embodiments, according to a program stored in a Read-Only Memory (ROM) 502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for system operation are also stored. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An Input/Output (I/O) interface 505 is also connected to bus 504.
The following components are connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output section 507 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage portion 508 including a hard disk and the like; and a communication section 509 including a Network interface card such as a LAN (Local Area Network) card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. The driver 510 is also connected to the I/O interface 505 as necessary. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted into the storage section 508 as necessary.
In particular, according to embodiments of the application, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511. The computer program executes various functions defined in the system of the present application when executed by a Central Processing Unit (CPU) 501.
It should be noted that the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM), a flash Memory, an optical fiber, a portable Compact Disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with a computer program embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present application may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations described above.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by an electronic device, cause the electronic device to implement the method described in the above embodiments.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the application. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (10)
1. A method of three-dimensional imaging, comprising:
rotating the turntable when the target object is detected to be placed on the turntable;
in the rotating process of the turntable, determining illumination configuration information based on the state information of the target object at each rotating angle;
adjusting the shooting light based on the illumination configuration information to shoot the video frame sequence of the target object during the rotation of the turntable;
and synthesizing the video frame sequence based on the rotation direction of the turntable to obtain the video containing the three-dimensional information of the target object.
2. The method of claim 1, wherein determining illumination configuration information based on the state information of the target object at each rotation angle during the rotation of the turntable comprises:
acquiring current images of the target object at each rotation angle in the rotation process of the turntable;
determining current state information of the target object based on pixel information of the target object in the current image;
based on the state information, illumination configuration information for adjusting the light intensity and direction is determined.
3. The method of claim 2, wherein determining the current state information of the target object based on the pixel information of the target object in the current image comprises:
generating a normal image corresponding to the current image based on the pixel information of the target object in the current image;
detecting the difference of the height values between every two adjacent pixels in the normal image, and determining a region to be compensated based on the difference of the height values;
and generating the current state information of the target object based on the corresponding position of the light region to be compensated in the current image.
4. The method according to claim 3, wherein generating a normal image corresponding to the current image based on the pixel information of the target object in the current image comprises:
generating a color image and a gray image corresponding to the target object based on the pixel information of the target object in the current image;
inputting the color image and the gray level image into a generator of a normal image generation network to generate a normal image to be determined;
inputting the normal image to be determined and the gray level image into a discriminator of the normal image generation network to obtain a discrimination result output by the normal image generation network;
and if the judgment result is that the pixel information of the normal image to be determined is consistent with the pixel information of the target object, determining that the normal image to be determined is a normal image corresponding to the current image.
5. The method of claim 2, wherein determining illumination configuration information for adjusting light intensity and direction based on the status information comprises:
determining target coordinates of the target position in a camera coordinate system based on the target position corresponding to the light region to be compensated in the state information in the current image;
determining the direction of light to be supplemented based on the angle between the target coordinate and the light ray emitter;
and determining the intensity of light to be supplemented based on the brightness value of the target position in the current image, so that the direction and the intensity of the light to be supplemented are used as the illumination configuration information.
6. The method of claim 1, further comprising:
and in the rotating process of the turntable, adjusting the rotating speed of the turntable and the shooting frequency of the video frame sequence based on the state information of the target object at each rotating angle.
7. The method of claim 1, further comprising:
determining a target part to be refined in the target object based on the state information;
modifying the illumination direction and brightness in the illumination configuration information based on the target part to obtain updated illumination configuration information;
adjusting a shooting angle and a focal length based on the target part;
and shooting the target part based on the updated illumination configuration information and the adjusted shooting angle and focal length to obtain a target video frame sequence.
8. A video camera, comprising:
the detection unit is used for rotating the turntable when a target object is detected to be placed on the turntable;
the determining unit is used for determining illumination configuration information based on the state information of the target object at each rotation angle in the rotating process of the turntable;
the adjusting unit is used for adjusting shooting light based on the illumination configuration information so as to shoot the video frame sequence of the target object in the rotating process of the turntable;
and the synthesis unit is used for synthesizing the video frame sequence based on the rotation direction of the turntable to obtain a video containing the three-dimensional information of the target object.
9. A video capture device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the steps of the method according to any of claims 1 to 7 are implemented when the computer program is executed by the processor.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010817855.9A CN111787239A (en) | 2020-08-14 | 2020-08-14 | Video shooting device and three-dimensional imaging method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010817855.9A CN111787239A (en) | 2020-08-14 | 2020-08-14 | Video shooting device and three-dimensional imaging method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111787239A true CN111787239A (en) | 2020-10-16 |
Family
ID=72762048
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010817855.9A Pending CN111787239A (en) | 2020-08-14 | 2020-08-14 | Video shooting device and three-dimensional imaging method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111787239A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113158975A (en) * | 2021-05-13 | 2021-07-23 | 青岛海尔工业智能研究院有限公司 | Information writing method and device of intelligent equipment, equipment and storage medium |
-
2020
- 2020-08-14 CN CN202010817855.9A patent/CN111787239A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113158975A (en) * | 2021-05-13 | 2021-07-23 | 青岛海尔工业智能研究院有限公司 | Information writing method and device of intelligent equipment, equipment and storage medium |
| CN113158975B (en) * | 2021-05-13 | 2023-09-12 | 卡奥斯工业智能研究院(青岛)有限公司 | Information writing method, device, equipment and storage medium of intelligent equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10997696B2 (en) | Image processing method, apparatus and device | |
| US11663733B2 (en) | Depth determination for images captured with a moving camera and representing moving features | |
| US9979909B2 (en) | Automatic lens flare detection and correction for light-field images | |
| WO2020034924A1 (en) | Imaging control method and apparatus, electronic device, and computer readable storage medium | |
| WO2018210318A1 (en) | Blurring method and apparatus for image, storage medium, and electronic device | |
| WO2018210308A1 (en) | Blurring method and apparatus for image, storage medium, and electronic device | |
| CN110349107B (en) | Image enhancement method, device, electronic equipment and storage medium | |
| US10586394B2 (en) | Augmented reality depth sensing using dual camera receiver | |
| CN108805799B (en) | Panoramic image synthesis apparatus, panoramic image synthesis method, and computer-readable storage medium | |
| WO2020092051A1 (en) | Rolling shutter rectification in images/videos using convolutional neural networks with applications to sfm/slam with rolling shutter images/videos | |
| CN113920502A (en) | Cloud deck adjusting method, device, equipment and medium | |
| CN104184936B (en) | Image focusing processing method and system based on light field camera | |
| CN111787239A (en) | Video shooting device and three-dimensional imaging method thereof | |
| CN107093395B (en) | Transparent display device and image display method thereof | |
| CN116017129A (en) | Method, device, system, equipment and medium for adjusting angle of light supplementing lamp | |
| US11120269B2 (en) | Method and apparatus for determining target rotation direction, computer readable medium and electronic device | |
| CN114694137B (en) | Image detection method, three-dimensional imaging method and device | |
| CN112804447B (en) | Method, device, medium and electronic equipment for detecting near-field object | |
| US11205064B1 (en) | Measuring quality of depth images in real time | |
| CN112308809B (en) | Image synthesis method, device, computer equipment and storage medium | |
| KR20110074442A (en) | Image processing apparatus, image processing method and recording medium | |
| CN117690177B (en) | Face focusing method, face focusing device, electronic equipment and storage medium | |
| CN114998929B (en) | Fisheye camera bounding box identification method, system, equipment and application | |
| CN108320320B (en) | Information display method, device and equipment | |
| JP2013197892A (en) | Object recognition apparatus, object recognition method, and computer program for object recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201016 |
|
| RJ01 | Rejection of invention patent application after publication |