CN113422947A - 3D naked eye imaging method, device and medium for teaching - Google Patents

Abstract

The invention relates to the technical field of naked eye 3D display, in particular to a 3D naked eye imaging method, a device and a medium for teaching. A3D bore hole imaging method for teaching, wherein, the step includes: acquiring an image set, wherein the image set is a multi-azimuth image set of the same scene for teaching; improving the image quality of the picture content of the image set to obtain a high-quality rendering image set; calculating a mapping matrix of viewpoint sub-pixels of the pictures in the rendering picture set, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image; and carrying out frame combination on the naked eye 3D sequence frame images to obtain a naked eye 3D video. The embodiment solves the defect that the existing learning system is still an education platform system based on the traditional teaching mode. Therefore, the medical education content can be displayed in a real three-dimensional and high-quality picture, and the learning efficiency of the students is greatly improved.

Description

3D naked eye imaging method, device and medium for teaching

Technical Field

The invention relates to the technical field of naked eye 3D display, in particular to a 3D naked eye imaging method, a device and a medium for teaching.

Background

By the 21 st century, human beings are more concerned about their own health and lives, and thus, the field of medical education has been developed in a new and advanced way. Changes have been made from clinical diagnosis to surgical treatment, or from medical equipment to medical concept. At present, with the development of information communication technology and remote medical education, clinical medical skill cultivation in medical education is exploring a new revolution, that is, organically combining computer software, hardware technology, three-dimensional graphic image, automatic control and navigation, robot, biochemistry and nuclear technology and the like with traditional clinical medicine, and promoting the generation of advanced clinical medical concepts, methods, means and equipment.

With the increasing precision, intelligence and efficiency of medical equipment, medical systems are advancing to informatization, digitization and networking at a high speed, and new technologies, new methods, new theories and new knowledge in the medical field are changing day by day. The timely update of medical knowledge and the desire of medical workers to the knowledge are more and more strong, and the importance of distance education and lifelong education becomes the focus of wide attention in medical circles at home and abroad.

In the process of implementing the invention, the inventor of the invention finds that: at present, in traditional remote medical education, a remote education platform is used for reducing the learning cost of doctors and solving the problem of unbalanced development of the medical level in China, but the traditional learning system is an education platform system based on a traditional teaching mode, so that the real three-dimensional medical education content can not be presented, and the traditional remote medical education platform is not beneficial to the clinical practice learning of students.

Disclosure of Invention

In view of the foregoing defects of the prior art, a primary object of the present invention is to provide a 3D naked eye imaging method for teaching, wherein the steps include:

acquiring an image set, wherein the image set is a multi-azimuth image set of the same scene for teaching;

improving the image quality of the picture content of the image set to obtain a high-quality rendering image set;

calculating a mapping matrix of viewpoint sub-pixels of the pictures in the rendering picture set, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image;

and carrying out frame combination on the naked eye 3D sequence frame images to obtain a naked eye 3D video.

According to the embodiment, a naked eye three-dimensional camera matrix acquisition system is used for carrying out image acquisition on medical education contents, then compression processing is carried out on the acquired picture contents to obtain high-quality rendering images, then a view sub-pixel mapping matrix is calculated, corresponding shaders are compiled, the rendering images are sampled to obtain naked eye three-dimensional sequence frame images, finally frame combination is carried out on the naked eye three-dimensional sequence frame images to obtain naked eye three-dimensional videos, the video contents are transmitted to a naked eye three-dimensional display terminal after being coded, a naked eye three-dimensional display terminal decoding module carries out video content decoding, and the display module carries out naked eye three-dimensional presentation on the decoded video contents. According to the embodiment, medical education content can be displayed in a real three-dimensional and high-quality picture, and the learning efficiency of students is greatly improved.

Further, when the image set is acquired, parallax images are acquired from a plurality of directions at the same time with an application scene as a center, and the set of parallax images is the image set.

Further, the image quality improvement on the image content of the image set includes that the image set is subjected to resolution compression to obtain a compressed image set, and then the compressed image set is subjected to resolution conversion to obtain a high-quality rendering image set.

Further, the compression rule for performing resolution compression on the image set to obtain a compressed image set is as follows:

wherein, P₁(m, n) represents the 1-bit black and white value, P, of the nth column pixel of the mth row of image IMG1 in the image set₂(m, n) represents the 8-bit black and white value of the nth column pixel of the mth row of the image IMG2 of the compressed atlas;

the resolution conversion rule of the compressed atlas is as follows:

P₃(m，n)＝P₂((m×240+n)/3840，(m×108+n)％2160)，m∈[0，2160)，n∈[0，3840)

wherein, P₂(m, n) line m of the image IMG2 representing the compressed atlas8-bit black and white value, P, of the n-th column of pixels₃(m, n) represents a high quality rendered image of 8-bit black and white resolution 3840 x 2160 of the mth row, nth column pixel of the image IMG2 of the compressed atlas.

Further, the calculating of the mapping matrix of the view sub-pixels in the rendering set is to determine, according to the pictures in the high-quality rendering set, from which view point a given RGB sub-pixel on the 2D display screen corresponds to the RGB component taken, and then calculate the mapping matrix of the view sub-pixels through a calculation formula of the multi-view sub-pixel mapping matrix.

Further, the sampling processing of the mapping matrix through the Shader is to compile the mapping matrix into the Shader, perform sub-pixel level sampling processing on a plurality of rendering maps obtained by camera shooting by using the Shader, and mutually superimpose a plurality of parallax images included after the sampling processing to obtain a final naked eye 3D sequence frame image.

Further, the step of frame merging the naked eye 3D sequence frame images into the naked eye 3D video is to compress, synthesize and convert the naked eye 3D sequence frame images into the naked eye 3D video content by using mathematical software.

Further, the step of compressing the naked eye 3D sequence frame image includes:

performing deviation value comparison on the two naked eye 3D sequence frame images before and after compression through digital software;

when the deviation value is smaller than a set threshold value, judging that the contents of the two naked eye 3D sequence frame images are relatively close, and amplifying the interval time when the two naked eye 3D sequence frame images are compressed and synthesized;

when the deviation value is larger than the set threshold value, the content relative difference of the two naked eye 3D sequence frame images is judged to be large, and the time of the gap between the two naked eye 3D sequence frame images is shortened when the two naked eye 3D sequence frame images are compressed and synthesized.

The embodiment of the other hand discloses a 3D bore hole image device, wherein, includes:

the image set acquisition module is used for acquiring an image set, wherein the image set is a picture set used for teaching and provided with a same scene and multiple directions;

the image quality improving module is used for improving the image quality of the image content of the image set to obtain a high-quality rendering image set;

the image processing module is used for calculating a mapping matrix of viewpoint sub-pixels of the picture in the rendering atlas, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image;

and the image frame combination module is used for combining the frames of the naked eye 3D sequence frame images into a naked eye 3D video.

Yet another aspect of embodiments discloses a mirror apparatus comprising a processor and a memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by the processor to implement a method of 3D naked eye imaging for teaching as claimed in any one of the preceding claims.

Yet another aspect of the embodiments discloses a computer-readable storage medium having stored therein computer-executable instructions that are loaded by a processor and execute a method of 3D naked eye imaging for teaching as in any one.

Drawings

In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.

FIG. 1 is a flow chart of a 3D naked eye imaging method for teaching according to an embodiment of the invention;

FIG. 2 is a flow chart of a 3D naked eye imaging method for teaching according to another embodiment of the invention;

FIG. 3 is a block diagram of a 3D naked eye imaging device according to an embodiment of the invention;

FIG. 4 is a block diagram of a 3D naked eye imaging apparatus according to another embodiment of the present invention;

fig. 5 is a schematic diagram of a naked eye three-dimensional camera matrix acquisition system according to an embodiment of the invention.

Fig. 6 is a hardware structure diagram of an apparatus for implementing the method provided by the embodiment of the invention.

Detailed Description

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.

The embodiment discloses a 3D naked eye imaging system for teaching, which is characterized in that a naked eye three-dimensional camera matrix acquisition system is constructed according to naked eye three-dimensional display characteristics, medical education contents are acquired by the naked eye three-dimensional camera matrix acquisition system, then the acquired picture contents are compressed to obtain a high-quality rendering image, then a view sub-pixel mapping matrix is calculated, corresponding shaders are compiled, the rendering image is sampled to obtain a naked eye three-dimensional sequence frame image, finally the naked eye three-dimensional sequence frame image is subjected to frame combination to form a naked eye three-dimensional video, the video contents are encoded and transmitted to a naked eye three-dimensional display terminal, a naked eye three-dimensional display terminal decoding module is used for decoding the video contents, and the display module is used for carrying out naked eye three-dimensional presentation on the decoded video contents. According to the embodiment, medical education content can be displayed in a real three-dimensional and high-quality picture, and the learning efficiency of students is greatly improved.

It should be noted that, in the embodiments of the present invention, the terms referred to are:

subpixels, generally, each pixel in an image is composed of three primary colors, red, blue, green (RGB), and each color in each pixel is called a subpixel.

The Viewpoint, Viewpoint (Viewpoint), is a single viewing angle.

Parallax is the difference in direction of viewing the same object from two points at a distance. The angle between two points from the target is called the parallax angle of the two points, and the line between the two points is called the baseline.

Shaders, also known as shaders, are used to implement image rendering, replacing editable programs in a fixed rendering pipeline.

Hereinafter, a 3D naked eye imaging method and apparatus for teaching according to embodiments of the present invention will be described and explained in detail with reference to several specific embodiments.

Referring to fig. 1, a 3D naked eye imaging method for teaching, wherein the steps include:

step S201: an image set is obtained, wherein the image set is a picture set used for teaching in multiple directions of the same scene.

Further, the acquiring of the image set is performed by acquiring parallax images from a plurality of directions simultaneously with an application scene as a center, and the set of parallax images is the image set.

In the embodiment, a naked eye three-dimensional camera matrix acquisition system is constructed according to the naked eye three-dimensional display characteristics, and the naked eye three-dimensional camera matrix acquisition system is used for acquiring images of medical education contents. The naked eye three-dimensional camera matrix is specifically placed in a mode that a medical education content acquisition application scene is taken as a center, a plurality of CCD cameras with parallax are arranged on the circumference of the center as dots for synchronous shooting, and then a plurality of parallax images are obtained and are used for providing slightly different parallax images for left and right eyes of a viewer, so that stereoscopic vision is achieved.

In a specific embodiment, please refer to fig. 5, and for the actual medical education content, a naked eye three-dimensional camera matrix acquisition system using a plurality of circumferentially distributed CCD cameras is more suitable for real-time data acquisition. The system is characterized in that 128 CCD cameras are arranged on the circumference of a certain height, each 32 CCD cameras are a group and used for high-quality rendering image synthesis, 4 groups of CCD camera groups with certain parallax are adopted for shooting in total, each group of CCD cameras shoots the view of each visual angle direction, and then a plurality of parallax images are obtained so as to provide slightly different parallax images for the left eye and the right eye of a viewer, and therefore stereoscopic vision is achieved. The image acquired by each CCD camera is a 1-bit image IMG1 with the resolution of 1920 multiplied by 1080, and as all the CCD cameras acquire images at the same time, the photographing time of a week view is very short, which is beneficial to data acquisition of a dynamic scene.

Step S202: and improving the image quality of the picture content of the image set to obtain a high-quality rendering image set.

According to the embodiment, the image quality of the original sequence frame image is greatly reduced compared with that of the original sequence frame image, so that the embodiment improves the image quality of the original sequence frame image, and a user can watch the naked eye three-dimensional video more comfortably and experience better.

In a further embodiment, the quality of the picture content of the image set is improved by performing resolution compression on the image set to obtain a compressed image set, and then performing resolution conversion on the compressed image set to obtain a high-quality rendering image set.

Further, the compression rule for performing resolution compression on the image set to obtain a compressed image set is as follows:

wherein, P₁(m, n) represents the 1-bit black and white value, P, of the nth column pixel of the mth row of image IMG1 in the image set₂(m, n) represents the 8-bit black and white value of the nth column pixel of the mth row of the image IMG2 of the compressed atlas;

the resolution conversion rule of the compressed atlas is as follows:

P₃(m，n)＝P₂((m×240+n)/3840，(m×108+n)％2160)，m∈[0，2160)，n∈[0，3840)

wherein, P₂(m, n) represents the 8-bit black and white value, P, of the n column pixel of the m row of the compressed atlas image IMG2₃(m, n) represents a high quality rendered image of 8-bit black and white resolution 3840 x 2160 of the mth row, nth column pixel of the image IMG2 of the compressed atlas.

In a particular embodiment of the present invention,

compressing a 1-bit image IMG1 having a resolution of 1920 x 1080 into an 8-bit image IMG2 having a resolution of 240 x 1080;

in the embodiment, a 1-bit image with a resolution of 1920 × 1080 is obtained due to each CCD camera shooting. First, a 1-bit image IMG1 with a resolution of 1920 × 1080 is compressed into an 8-bit image IMG2 with a resolution of 240 × 1080, i.e. 1 pixel in IMG2 can represent a continuous 8-pixel black-and-white value in IMG1, and the conversion rule is as follows:

wherein P is₁(m, n) represents the 1-bit black and white value, P, of the nth column pixel of the mth row of image IMG1₂(m, n) represents the 8-bit black and white value of the nth column pixel of the mth row of image IMG 2.

Next, the 32 8-bit images IMG2 with resolution 240 × 1080 are converted into 8-bit images IMG3 with resolution 3840 × 2160, with the following conversion rules:

P₃(m，n)＝P₂((m×240+n)/3840，(m×108+n)％2160)，m∈[0，2160)，n∈[0，3840)

IMG3 is a high quality rendered image at a resolution of 3840 x 2160.

Step S203: and calculating a mapping matrix of view point sub-pixels of the pictures in the rendering picture set, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image.

In the embodiment, the mapping matrix is used for generating a plurality of view pictures from a high-quality rendering image through matrix mapping, and rendering at a sub-pixel level is completed, so that a naked eye 3D sequence frame image is obtained.

Further, the calculating of the mapping matrix of the view sub-pixels in the rendering set is to determine, according to the pictures in the high-quality rendering set, from which view RGB components corresponding to a given RGB sub-pixel on the 2D display screen are taken, and then calculate the mapping matrix of the view sub-pixels through a calculation formula of the multi-view sub-pixel mapping matrix.

Further, the sampling processing of the mapping matrix by the Shader is to compile the mapping matrix into the Shader, perform sub-pixel level sampling processing on a plurality of rendering maps obtained by camera shooting by using the Shader, and superimpose a plurality of parallax images included after the sampling processing to obtain a final naked eye 3D sequence frame image.

In an embodiment, the sub-pixel level sampling process is to scale the picture to conform to the resolution of the 2D display screen. And the mutual superposition of the multiple parallax images is to convert the multiple parallax images subjected to sampling processing into a final naked eye 3D sequence frame image through matrix mapping.

In a specific embodiment, first, the RGB components from which a given RGB sub-pixel on the 2D display screen should be taken are determined, and the following formula gives the calculation formula of the multi-view sub-pixel mapping matrix:

wherein X is the number of RGB sub-pixels covered by one grating period in the horizontal direction, (k, 1) is the coordinate position of the RGB sub-pixels, alpha is the inclined angle of the grating axis relative to the vertical axis of the LCD display screen, and k_offRepresenting the horizontal displacement of the upper left edge of the 2D display screen and the edge points of the raster units, N_totThe number of total viewpoints, that is, the number of parallax images participating in synthesis is represented. According to the above formula, the gray value of the corresponding coordinate position of which parallax image the gray value of each sub-pixel on the 2D display screen should be taken from can be calculated.

Step S204: and carrying out frame combination on the naked eye 3D sequence frame images to obtain a naked eye 3D video.

Further, the frame merging of the naked eye 3D sequence frame images into the naked eye 3D video is to compress, synthesize and convert the naked eye 3D sequence frame images into the naked eye 3D video content by using mathematical software.

Further, the step of compressing the naked eye 3D sequence frame image includes:

performing deviation value comparison on the two naked eye 3D sequence frame images before and after compression through digital software;

when the deviation value is smaller than a set threshold value, judging that the contents of the two naked eye 3D sequence frame images are relatively close, and amplifying the interval time when the two naked eye 3D sequence frame images are compressed and synthesized;

when the deviation value is larger than the set threshold value, the content relative difference of the two naked eye 3D sequence frame images is judged to be large, and the time of the gap between the two naked eye 3D sequence frame images is shortened when the two naked eye 3D sequence frame images are compressed and synthesized.

In the specific embodiment, in order to keep the fluency of high-quality videos and compress the memory space occupation size of video contents as much as possible, the mathematical software matlab is used for compressing, synthesizing and converting naked eye three-dimensional sequence frame images into naked eye three-dimensional video contents. The specific way of compressing and synthesizing the frame image is as follows: comparing deviation values of two naked eye three-dimensional sequence frames before and after compression through a digital software matlab, judging that the image contents of the two sequence frames are relatively close when the deviation value is smaller than a set threshold value, and amplifying the two sequence frames at intervals when the two sequence frames are compressed and synthesized; when the deviation value is larger than the set threshold value, the relative difference of the image contents of the two sequence frames is judged to be large, and the time interval between the two sequence frames is shortened when the two sequence frames are compressed and synthesized. Namely, it is assumed that the naked eye three-dimensional video content in the initial state will be compressed and synthesized into 30 sequence frame images every second, after threshold determination, if the deviation values of the similar sequence frames are all smaller than the set threshold, the compressed and synthesized images are amplified at intervals, the naked eye three-dimensional video content in every second will be compressed into less than 30 sequence frame images, otherwise, the compressed sequence frame images are more than 30. The nature of naked eye three-dimensional video is a continuous image sequence, which is composed of continuous frames, wherein one frame is an image. Due to the persistence of vision effect of the human eye, when a sequence of frames is played at a certain rate, we see a video with continuous motion. Because the similarity between the continuous frames is extremely high, in order to facilitate storage and transmission, the original video needs to be coded and compressed to remove redundancy of space and time dimensions, and meanwhile, the video content is compressed into network flow and is transmitted to a naked eye three-dimensional display terminal more simply and conveniently through a network.

In another embodiment, after frame merging of the naked-eye 3D sequence frame images into the naked-eye 3D video, the following steps are also required:

step S205: and encoding the content of the naked eye 3D video, and then transmitting the content to a naked eye 3D display terminal.

And the naked eye 3D display terminal decoding module decodes the video content, and the display module performs naked eye 3D presentation on the decoded video content.

It can be understood that, in the embodiment, the naked eye three-dimensional display terminal decoding module decodes the video content, and the display module performs naked eye three-dimensional presentation on the decoded video content. And the naked eye three-dimensional display terminal decoding module decodes the naked eye three-dimensional video content and transmits the information sequence to the display module.

In an actual embodiment, the image decoding circuit is the most important part of the data processing and transmission system, the image decoding circuit comprises an FPGA chip, a driving circuit of the FPGA chip and a memory bank, a computer performs frame combination on a naked eye three-dimensional frame image sequence to form a video, the video is further encoded and then transmitted to the image decoding circuit, the image decoding circuit decodes video content and then transmits the video content to the display module, and the display module matches parameters of a naked eye three-dimensional display terminal to perform three-dimensional presentation on the naked eye medical education video content.

In the embodiment, in order to keep the fluency of high-quality videos and compress the memory space occupation size of video contents as much as possible, mathematical software is used for judging frame image deviation values and then combining the frames into naked eye three-dimensional video contents, all contents of medical education are converted into naked eye three-dimensional display contents and then are encoded and compressed into network streams, and the network streams are transmitted to a naked eye three-dimensional display terminal through a network.

In this embodiment, a naked eye three-dimensional camera matrix acquisition system is used for image acquisition of medical education content, then compression processing is performed on the acquired picture content to obtain a high-quality rendered image, then a view sub-pixel mapping matrix is calculated, corresponding shaders are compiled, sampling processing is performed on the rendered image to obtain a naked eye three-dimensional sequence frame image, finally frame merging is performed on the naked eye three-dimensional sequence frame image to obtain a naked eye three-dimensional video, the video content is transmitted to a naked eye three-dimensional display terminal after being encoded, a naked eye three-dimensional display terminal decoding module decodes the video content, and the display module performs naked eye three-dimensional presentation on the decoded video content. According to the embodiment, medical education content can be displayed in a real three-dimensional and high-quality picture, and the learning efficiency of students is greatly improved.

Referring to fig. 3, the embodiment further discloses a 3D naked eye imaging apparatus, which includes:

the image set acquisition module 101 is configured to acquire an image set, where the image set is a multi-azimuth image set of the same scene for teaching;

the image quality improving module 102 is configured to improve the image quality of the image content of the image set to obtain a high-quality rendering image set;

the image processing module 103 is used for calculating a mapping matrix of viewpoint sub-pixels of the picture in the rendering atlas, and performing sampling processing on the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image;

and the image frame matching module 104 is used for performing frame combination on the naked eye 3D sequence frame images to form a naked eye 3D video.

In another embodiment, referring to fig. 4, the 3D naked eye imaging apparatus further includes:

and the coding transmission module 105 is used for coding the content of the naked eye 3D video and then transmitting the content to the naked eye 3D display terminal.

The device provided in the above embodiments can execute the method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. Technical details not described in detail in the above embodiments may be referred to a 3D naked eye imaging method for teaching provided in any embodiment of the present invention.

The embodiment also provides a computer-readable storage medium, in which computer-executable instructions are stored, and the computer-executable instructions are loaded by a processor and execute the 3D naked eye imaging method for teaching according to the embodiment.

Alternatively, in this embodiment, the storage medium may be located in at least one network server of a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The present embodiment also provides an apparatus, which includes a processor and a memory, where the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute a 3D naked eye imaging method for teaching according to the present embodiment.

The mirror device may be a device, a client, or a server, and the device may also participate in forming the apparatus or system provided by the embodiments of the present invention. As shown in fig. 6, the device 11 may include one or more (shown as 1102a, 1102b, … … 1102 n) processors 1102 (the processors 1102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 1104 for storing data, and a transmission device 1106 for communication functions. Besides, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 6 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 11 may also include more or fewer components than shown in FIG. 6, or have a different configuration than shown in FIG. 6.

The memory 1104 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the methods described in the embodiments of the present invention, and the processor 1102 may execute various functional applications and data processing by operating the software programs and modules stored in the memory 1104, so as to implement the 3D naked eye imaging method for teaching. The memory 1104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1104 may further include memory located remotely from the processor 1102, which may be connected to the device 11 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the device 11 (or mobile terminal).

The present specification provides method steps as described in the examples or flowcharts, but may include more or fewer steps based on routine or non-inventive labor. The steps and sequences recited in the embodiments are but one manner of performing the steps in a multitude of sequences and do not represent a unique order of performance. In the actual system or interrupted product execution, it may be performed sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.

The configurations shown in the present embodiment are only partial configurations related to the present application, and do not constitute a limitation on the devices to which the present application is applied, and a specific device may include more or less components than those shown, or combine some components, or have an arrangement of different components. It should be understood that the methods, apparatuses, and the like disclosed in the embodiments may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a division of one logic function, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or unit modules.

Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (11)

1. A 3D naked eye imaging method for teaching, wherein the steps comprise:

acquiring an image set, wherein the image set is a multi-azimuth image set of the same scene for teaching;

improving the image quality of the picture content of the image set to obtain a high-quality rendering image set;

calculating a mapping matrix of viewpoint sub-pixels of the pictures in the rendering picture set, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image;

and carrying out frame combination on the naked eye 3D sequence frame images to obtain a naked eye 3D video.

2. The 3D naked eye imaging method according to claim 1, wherein the image set is acquired by acquiring parallax images from a plurality of directions simultaneously with an application scene as a center, and the set of parallax images is an image set.

3. The 3D naked eye imaging method according to claim 1, wherein the image quality improvement on the picture content of the image set is that the image set is subjected to resolution compression to obtain a compressed image set, and then the compressed image set is subjected to resolution conversion to obtain a high-quality rendering image set.

4. The 3D naked eye imaging method according to claim 3, wherein the compression rule for performing resolution compression on the image set to obtain a compressed image set is as follows:

wherein, P₁(m, n) represents the 1-bit black and white value, P, of the nth column pixel of the mth row of image IMG1 in the image set₂(m, n) represents an image of a compressed atlasThe 8-bit black and white value of the mth row and nth column pixels of IMG 2;

the resolution conversion rule of the compressed atlas is as follows:

P₃(m，n)＝P₂((m×240+n)/3840，(m×108+n)％2160)，m∈[0，2160)，n∈[0，3840)

wherein, P₂(m, n) represents the 8-bit black and white value, P, of the n column pixel of the m row of the compressed atlas image IMG2₃(m, n) represents a high quality rendered image of 8-bit black and white resolution 3840 x 2160 of the mth row, nth column pixel of the image IMG2 of the compressed atlas.

5. The 3D naked eye imaging method according to claim 1, wherein the calculating of the mapping matrix of the view sub-pixels in the rendering set is to determine, according to the pictures in the high-quality rendering set, from which view RGB components corresponding to a given RGB sub-pixel on the 2D display screen are taken, and then calculate the mapping matrix of the view sub-pixels through a calculation formula of the multi-view sub-pixel mapping matrix.

6. The 3D naked eye imaging method according to claim 1, wherein the sampling processing of the mapping matrix by the Shader is that the mapping matrix is compiled into the Shader, a plurality of rendering maps obtained by camera shooting are subjected to sub-pixel level sampling processing by the Shader, and a plurality of parallax images included after the sampling processing are mutually superposed to obtain a final naked eye 3D sequence frame image.

7. The 3D naked eye imaging method according to claim 1, wherein the frame combination of the naked eye 3D sequence frame images into the naked eye 3D video is that the naked eye 3D sequence frame images are compressed, synthesized and converted into the naked eye 3D video content by using mathematical software.

8. The 3D naked eye imaging method according to claim 7, wherein the naked eye 3D sequence frame image compressing step comprises:

performing deviation value comparison on the two naked eye 3D sequence frame images before and after compression through digital software;

when the deviation value is smaller than a set threshold value, judging that the contents of the two naked eye 3D sequence frame images are relatively close, and amplifying the interval time when the two naked eye 3D sequence frame images are compressed and synthesized;

when the deviation value is larger than the set threshold value, the content relative difference of the two naked eye 3D sequence frame images is judged to be large, and the time of the gap between the two naked eye 3D sequence frame images is shortened when the two naked eye 3D sequence frame images are compressed and synthesized.

9. A 3D naked eye imaging apparatus, comprising:

the image set acquisition module is used for acquiring an image set, wherein the image set is a picture set used for teaching and provided with a same scene and multiple directions;

the image quality improving module is used for improving the image quality of the image content of the image set to obtain a high-quality rendering image set;

the image processing module is used for calculating a mapping matrix of viewpoint sub-pixels of the picture in the rendering atlas, and sampling the mapping matrix through a Shader to obtain a naked eye 3D sequence frame image;

and the image frame combination module is used for combining the frames of the naked eye 3D sequence frame images into a naked eye 3D video.

10. An apparatus, wherein the apparatus comprises a processor and a memory, wherein the memory has stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by the processor to implement a method of 3D open-eye imaging for teaching as claimed in any one of claims 1-8.

11. A computer-readable storage medium having stored therein computer-executable instructions to be loaded by a processor and to execute a method of 3D naked eye imaging for teaching as claimed in any one of claims 1 to 8.

Images