WO2023201864A1 - 图像显示方法、图像显示装置、设备及存储介质 - Google Patents

图像显示方法、图像显示装置、设备及存储介质 Download PDF

Info

Publication number
WO2023201864A1
WO2023201864A1 PCT/CN2022/098766 CN2022098766W WO2023201864A1 WO 2023201864 A1 WO2023201864 A1 WO 2023201864A1 CN 2022098766 W CN2022098766 W CN 2022098766W WO 2023201864 A1 WO2023201864 A1 WO 2023201864A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
target
images
display
target images
Prior art date
Application number
PCT/CN2022/098766
Other languages
English (en)
French (fr)
Inventor
孙小卫
苏尔曼菲利普•安东尼
张超键
姚振伟
Original Assignee
南方科技大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南方科技大学 filed Critical 南方科技大学
Publication of WO2023201864A1 publication Critical patent/WO2023201864A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • the present invention relates to the technical field of image processing, and in particular, to an image display method, image display device, equipment and storage medium.
  • the traditional implementation of 3D mainly uses a monitor to display images from two different viewing angles to the left eye and right eye, so as to produce a perceivable three-dimensional image in the brain through the stereoscopic difference characteristics of the image.
  • 3D images the main cause of 3D images is the "visual shift" of the eyes.
  • the currently mature polarized 3D display mainly requires the use of 3D glasses to view 3D images.
  • wearing 3D glasses for a long time not only makes users uncomfortable, And it has a huge impact on the user's vision.
  • the present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes an image display method that can directly display target images from different viewing angles without wearing 3D glasses, thereby improving the convenience of viewing 3D images.
  • the invention also provides an image display device.
  • the invention also provides an electronic device.
  • the invention also provides a computer-readable storage medium.
  • an embodiment of the present invention provides an image display method.
  • the method includes:
  • a spectroscopic device emits the target images in the target image set to different directions to display the target images from multiple different viewing angles.
  • the image display method of the embodiment of the present invention at least has the following beneficial effects: performing image analysis based on the original image through an image analysis model to obtain a target depth map, and performing image synthesis on the target depth map through a virtual viewpoint synthesis algorithm to obtain multiple targets from different perspectives.
  • the spectroscopic device directly emits multiple target images of different viewing angles to different directions, so that the target user can view the target images of different viewing angles by changing the viewing angle, and can view 3D images without wearing 3D glasses, which not only improves The convenience of viewing 3D images also reduces the discomfort of viewing 3D images.
  • the method further include:
  • Adjust the target image of the target user's main view area including:
  • the target image in the main view area is switched to the target image corresponding to the perspective information.
  • the spectroscopic device is provided with a spectroscopic area and a through hole area; the spectroscopic device emits the target images in the target image set to different directions to display The target images from multiple different perspectives, including:
  • the light splitting area of the light splitting device emits the target images in the target image set to different directions to display the target images from multiple different viewing angles.
  • the method further include:
  • Displaying the target picture in the target image through the through hole area of the spectroscopic device specifically includes:
  • Obtain display parameters which include: resolution and content type;
  • the target picture is displayed through the through hole area of the spectroscopic device.
  • the method before performing image analysis on the original image according to a preset image analysis model to obtain the target depth map, the method further includes:
  • the neural network model is trained to obtain the image analysis model, which specifically includes:
  • the neural network model is trained according to the loss function and the image training data set to obtain the image analysis model.
  • an image display device which includes:
  • Acquisition module used to obtain original images
  • An analysis module used to perform image analysis on the original image according to a preset image analysis model to obtain a target depth map
  • a synthesis module used to perform image synthesis on the target depth map according to a preset virtual viewpoint synthesis algorithm to obtain multiple target images from different perspectives;
  • a collection module used to collect the target images from multiple different perspectives to obtain a target image set
  • a spectroscopic device is configured to emit the target images in the target image set to different directions to display the target images from multiple different viewing angles.
  • the image display device of the embodiment of the present invention at least has the following beneficial effects: the image analysis model is used to perform image analysis based on the original image to obtain a target depth map, and the target depth map is image synthesized through a virtual viewpoint synthesis algorithm to obtain multiple targets from different perspectives.
  • the spectroscopic device directly emits multiple target images of different viewing angles to different directions, so that the target user can view the target images of different viewing angles by changing the viewing angle, and can view 3D images without wearing 3D glasses, which not only improves The convenience of viewing 3D images also reduces the discomfort of viewing 3D images.
  • the acquisition module, the analysis module, the synthesis module, and the collection module are integrated in an image processing terminal
  • the spectroscopic equipment includes: a grating screen and a housing, The grating screen is carried on the housing, the housing is sleeved on the image processing terminal, and the housing is adapted to the image processing terminal.
  • the image processing terminal is provided with a first image collector
  • the housing is provided with an opening corresponding to the first image collector
  • the A through-hole area is provided on the housing
  • a second image collector located on both sides of the grating screen is provided on the housing.
  • an embodiment of the present invention provides an electronic device, including:
  • At least one processor and,
  • the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method as described in the first aspect.
  • an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions for causing a computer to execute the method described in the first aspect. method.
  • Figure 1 is a schematic flow chart of a specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 2 is a schematic diagram of a video call in a specific embodiment of the image display method in the embodiment of the present invention
  • Figure 3 is a schematic flow diagram of another specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 4 is a schematic diagram of a video call in a specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 5 is a schematic diagram of a video call in a specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 6 is a flow chart of step S500 in Figure 1;
  • Figure 7 is a schematic flow chart of another specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 8 is a schematic flow chart of another specific embodiment of the image display method in the embodiment of the present invention.
  • Figure 9 is a module block diagram of a specific embodiment of the image display device in the embodiment of the present invention.
  • Figure 10 is a schematic structural diagram of a specific embodiment of the image display device in the embodiment of the present invention.
  • Figure 11 is a schematic structural diagram of a specific embodiment of the image display device in the embodiment of the present invention.
  • Figure 12 is a module block diagram of a specific embodiment of the electronic device in the embodiment of the present invention.
  • the orientation or positional relationship indicated by “up”, “down”, “front”, “back”, “left”, “right”, etc. is based on that shown in the accompanying drawings.
  • the orientation or positional relationship is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. .
  • a feature is said to be “set,” “fixed,” “connected,” or “mounted” to another feature, it may be set, fixed, or connected directly to the other feature, or it may be set, fixed, or connected indirectly. , installed on another feature.
  • the images viewed by users through electronic devices are 2D images. Since 2D images are visual information without depth, the real world has depth, so the benefit of perceiving depth can not only improve the authenticity of image viewing, but also Convey more information.
  • a display In order to realize 3D image display, a display is provided in the related art, and the display displays the image from two different viewing angles to the left eye and the right eye, so that a perceivable three-dimensional image can be generated in the brain through the stereoscopic difference characteristics of the image.
  • another 3D image display is to reproduce images in space.
  • This method includes: volume method, holographic method, light field method, overall imaging method, multi-view and super multi-view method. Therefore, as digital audio-visual technology enters the era of high-definition, stereoscopic display technology has developed into another focus in the development process of digital audio-visual technology after high-definition display.
  • 3D image display is a new multi-dimensional leap and a breakthrough technological innovation. Because 3D image display in related technologies requires the use of 3D glasses, wearing 3D glasses for a long time will have a huge impact on the user's vision and have many adverse effects on people's health.
  • this application discloses an image display method, image display device, equipment and storage medium.
  • generating multiple target images from different viewing angles and emitting multiple target images from different viewing angles to different directions through a spectroscopic device Then the user can view the 3D displayed image by emitting target images from different viewing angles through the spectroscopic device, without the need to wear 3D glasses, and without the need for human eye tracking to achieve 3D image display.
  • FIG. 1 a schematic flowchart of an image display method in an embodiment of the present invention is shown.
  • An embodiment of the present invention discloses an image display method.
  • the method includes: step S100, step S200, step S300, step S400, and step S500. It can be understood that the image display method includes but is not limited to step S100 to step S600.
  • Step S100 Obtain the original image.
  • the original image is determined according to the current application scenario, so that the corresponding original image is obtained according to the current application scenario.
  • the current application scenario is image viewing
  • the viewing instruction is received, and the corresponding image is obtained from the image database according to the viewing instruction to obtain the original image.
  • the current application scenario is a video call, obtain the image of the caller in the video call to obtain the original image.
  • the image of the person on the call is acquired through the image collector to obtain the original image.
  • Step S200 Perform image analysis on the original image according to a preset image analysis model to obtain a target depth map.
  • the preset image analysis model is used to analyze a single original image, and the image analysis model performs depth evaluation on the original image to obtain a target depth map.
  • Step S300 Perform image synthesis on the target depth map according to a preset virtual viewpoint synthesis algorithm to obtain multiple target images from different perspectives.
  • the distribution of light emitted by each pixel in different directions is usually a Lambertian distribution, so the target image viewed by the user in the two-dimensional display is a flat image.
  • the direction of light emitted by each pixel is basically not equal. For example, in a two-dimensional display, if a depicted object appears in front of the screen, its position will not change as the viewing angle changes, whereas in a three-dimensional display, if the object appears in front of the screen, its position on the screen will not change. The position must move to the left as the viewing position moves to the right and vice versa.
  • the virtual viewpoint synthesis algorithm is used to perform image synthesis based on the target depth map, that is, a three-dimensional model corresponding to the original image is constructed through the target depth map, and then the three-dimensional model is segmented to obtain multiple target images from different perspectives.
  • a 3D image display can be presented through multiple target images from different perspectives.
  • Step S400 Collect multiple target images from different viewing angles to obtain a target image set.
  • 3D image display requires multiple target images from different viewing angles to be presented at the same time, and the target images from different viewing angles are presented in different directions, so that 3D image viewing can be achieved. Therefore, by gathering multiple target images from different viewing angles to obtain a target image set, that is, synthesizing a 3D image, the 3D image can be displayed. Among them, the viewing angles of multiple target images in the target image set are different.
  • the current application scenario is a video call
  • the original image of the person on the call is obtained in real time, and multiple target images from different perspectives are obtained in real time.
  • the target images from multiple different perspectives are collected to obtain a target image set, that is, the current video is obtained. 3D call screen of the call.
  • Step S500 The spectroscopic device emits the target images in the target image set to different directions to display multiple target images from different viewing angles.
  • the target images in the target image set are emitted to different directions through the spectroscopic device.
  • the spectroscopic device determines the emission direction according to the viewing angle of the target image to emit the target image of the corresponding viewing angle in the corresponding emission direction. Then the user is viewing the target image emitted by the spectroscopic device, through Change the viewing angle direction to view target images from different angles to achieve 3D viewing of the target image. If a spectroscopic device is not used, only the target image from one viewing angle will be displayed. No matter how the user changes the viewing angle, the target image will be the same.
  • the spectroscopic device is a horizontal bar on the head of a little person. If the current application scenario is a video call, multiple target images from different viewing angles are emitted to the corresponding direction through the spectroscopic device. When the target user looks directly at the spectroscopic device, The front face of the person being called in the video call can be viewed. By moving to the left, the side face of the person being called can be viewed through the spectroscopic device. If the target user moves to the right, the other side of the person's face can be viewed. Therefore, by emitting target images from different viewing angles to corresponding directions through a spectroscopic device, users can achieve 3D video calls during video calls, which can not only improve the target user's experience, but also reduce the user's discomfort when wearing 3D glasses.
  • the original image is analyzed through the preset image analysis model to obtain the target depth map, and the target depth map is image synthesized according to the virtual viewpoint synthesis algorithm, that is, the three-dimensional model is synthesized based on the target depth map, and then the three-dimensional model is Segmentation is performed to obtain multiple target images from different perspectives.
  • a target image set is obtained by gathering multiple target images from different perspectives, that is, a synthesized 3D image.
  • the target images of different viewing angles are emitted to corresponding directions through the spectroscopic device, and the target user can view the target images of different viewing angles through the spectroscopic device. Therefore, 3D image viewing can be achieved without wearing 3D glasses, which not only improves the target user's visual sense of viewing images, but also reduces the target user's discomfort.
  • the image display method may also include, but is not limited to, the step of: adjusting the target image of the target user's main view area.
  • the target image in the target user's main view area needs to be adjusted according to the target user's selection, so that the target user always looks directly at the front of the target image.
  • a target image whose target angle is an elevation angle is obtained, and the target image of an elevation angle is displayed in the target user's main view, so that the target user always looks directly at the target image.
  • adjusting the target image of the target user's main view area may include but is not limited to step S610, step S620 and step S630.
  • Step S610 Obtain the perspective information of the target user.
  • the target user's viewing angle information is obtained according to a preset time interval period to determine the target user's current viewing angle.
  • the target user's perspective information is obtained through the head position tracker. For example, if the current application scenario is a video call, the head angle of the target user is obtained through the head position tracker to determine the target user's perspective information.
  • Step S620 Determine the main viewing area of the target user based on the viewing angle information.
  • the current viewing angle of the target user is determined through the viewing angle information, and the main viewing area of the target user is determined based on the viewing angle information.
  • P1 is the target user and P2 is the person making the call.
  • the current application scenario is a video call, determine the viewing angle areas in front of the target user as six areas: A, B, C, D, E, and F. The angle of each area is 30°, and the obtained viewing angle information of the target user is 45°, then it can be determined that the target user's main viewing area is area B. If the viewing angle information of the target user is 90°, it is determined that the main viewing area of the target user is area C.
  • Step S630 Switch the target image in the main view area to the target image corresponding to the perspective information.
  • the spectroscopic equipment can emit target images of different viewing angles to different directions to achieve 3D display.
  • the user needs to always look directly at the front viewing angle of the target image, he or she needs to switch to the corresponding viewing angle according to the main viewing area of the target user. target images to improve the experience of target users.
  • the current application scenario is a video call
  • the currently displayed target image needs to be corrected in real time.
  • the target angle of view of the target image is obtained, and according to the target user's changed main view area, the target image with the direct angle is displayed in the changed main view area, so that the target user can make eye contact with the person on the call in real time.
  • the viewing angles of the target user and the person being called face each other.
  • the caller also always looks directly at the target user.
  • the spectroscopic device is provided with a spectroscopic area and a through-hole area, and step S500 may include but is not limited to step S510.
  • Step S510 The spectroscopic area of the spectroscopic device emits the target images in the target image set to different directions to display multiple target images from different viewing angles.
  • the light splitting area emits target images from different viewing angles to different directions to achieve 3D display of the target image. Images or text that require high resolution viewing are viewed through the through hole area. , which can not only view 3D images but also view high-resolution images and text, improving the user experience of the target users.
  • the light splitting area is a grating screen, and the grating screen can realize the multi-viewing display principle, and the 3D target image can be viewed without wearing 3D glasses.
  • the image display method further includes but is not limited to the step of: displaying the target picture in the target image through the through hole area of the spectroscopic device.
  • a through-hole area needs to be set on the spectroscopic device to display the target screen in the target image, so as to achieve simultaneous viewing of 3D images and high-resolution screens. To improve the experience of target users.
  • displaying the target picture in the target image through the through hole area of the spectroscopic device may include but is not limited to step S710, step S720, and step S730.
  • Step S710 Obtain display parameters, which include: resolution and content type.
  • the obtained display parameters are customized by the target user. Through the resolution and content type customized by the target user, it can be determined that the target user wants to view the target screen that meets the display parameters.
  • Step S720 Obtain the image frame that satisfies the display parameters in the target image to obtain the target frame.
  • image content and text content in the target image are identified to obtain the image content and text content that meet the display parameters to obtain the target picture.
  • the resolution is 1000ppi and the content type is text
  • Step S730 Display the target image through the through hole area of the spectroscopic device.
  • steps S100 to S400 are executed by the image processing terminal, and the image processing terminal is equipped with a spectroscopic device.
  • the spectroscopic device is covered in front of the display screen of the image processing terminal. Since the through hole area of the spectroscopic device is not blocked, The display screen of the image processing terminal, and the target picture is set in the area corresponding to the display screen of the image processing terminal and the through-hole area, then the target picture on the display screen can be directly viewed through the through-hole area, thereby achieving high-resolution text or images Check.
  • the image display method also includes but is not limited to the step of: training a neural network model to obtain an image analysis model.
  • the neural network model is trained in advance to obtain the image analysis model.
  • training the neural network model to obtain the image analysis model may include but is not limited to step S810 and step S820.
  • Step S810 Obtain the image training data set and loss function.
  • the image training data set is collected, wherein the image training data set includes images with different viewing angle directions.
  • the training requirements of the neural network model can be determined based on the loss function.
  • Step S820 Train the neural network model according to the loss function and the image training data set to obtain the image analysis model.
  • the image training data set is input into the neural network model, and the gradient descent method is used to continuously iterate the neural network model to adjust the parameters of the neural network model according to the loss function until the neural network model converges to obtain the image analysis model.
  • An embodiment of the present invention also discloses an image display device, including: an acquisition module 110, used to acquire an original image; an analysis module 120, used to perform image processing on the original image according to a preset image analysis model. Analysis to obtain the target depth map; the synthesis module 130 is used to perform image synthesis on the target depth map according to the preset virtual viewpoint synthesis algorithm to obtain multiple target images from different perspectives; the collection module 140 is used to combine multiple different perspective images.
  • the target images are collected to obtain a target image set; the spectroscopic device 200 is used to emit the target images in the target image set to different directions to display multiple target images from different viewing angles.
  • the original image is analyzed through the preset image analysis model to obtain the target depth map, and the target depth map is image synthesized according to the virtual viewpoint synthesis algorithm, that is, the three-dimensional model is synthesized based on the target depth map, and then the three-dimensional model is segmented.
  • the target images of different viewing angles are emitted to corresponding directions through the spectroscopic device 200 , so that the target user can view the target images of different viewing angles through the spectroscopic device 200 . Therefore, 3D image viewing can be achieved without wearing 3D glasses, which not only improves the target user's visual sense of viewing, but also reduces the target user's discomfort.
  • the image display device in the embodiment of the present invention is used to perform the image display method shown in FIGS. 1 to 9 in the above embodiment.
  • the specific processing process is the same as the image display method in the above embodiment, and will not be described again here.
  • the acquisition module 110, the analysis module 120, the synthesis module 130, and the aggregation module 140 are integrated in the image processing terminal 100.
  • the spectroscopic device 200 includes: a grating screen 210 and a housing 220.
  • the grating screen 210 is carried on the housing 220.
  • the housing 220 is set on the image processing terminal 100, and the housing 220 is adapted to the image processing terminal 100.
  • the housing 220 is the housing 220 of the mobile terminal, and the housing 220 is adapted to the image processing terminal 100 .
  • the grating screen 210 of the housing 220 can be placed in front of the display screen of the image processing terminal 100. If there is no need to view a 3D image, the housing 220 can be placed on The back side of the image processing terminal 100 can not only protect the image processing terminal 100, but also prevent the casing 220 from being lost and difficult to find.
  • the image processing terminal 100 is provided with a first image collector 150.
  • the housing 220 is provided with an opening 221 corresponding to the first image collector 150.
  • the housing 220 is provided with a through hole area 222.
  • the housing 220 is provided with second image collectors 230 located on both sides of the grating screen 210 .
  • the original image needs to be captured in real time by the target user's character image, and the original image needs to be collected by the first image collector 150.
  • the first image The collector 150 collects the character image of the target user through the opening 221 to obtain the original image. This provides the first image collector 150 with a clear view. Since adding the raster screen 210 will cause the resolution loss of the display screen of the image processing terminal 100, it will be more difficult to read the text. Since the range collected by the image processing terminal 100 is larger than the human head, the through hole area 222 is set to directly connect The display screen can display high-resolution images or text through the through-hole area 222, thereby improving the reading experience of the target user. By arranging the second image collector 230 on the raster screen 210, the clarity of original image collection can be improved, and the performance of 3D display can be enhanced.
  • Figure 12 illustrates the hardware structure of an electronic device according to another embodiment.
  • the electronic device includes:
  • the processor 101 can be implemented by a general CPU (Central Processing Unit, central processing unit), a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement The technical solutions provided by the embodiments of the present invention;
  • CPU Central Processing Unit
  • ASIC Application Specific Integrated Circuit
  • the memory 102 can be implemented in the form of ROM (ReadOnlyMemory, read-only memory), static storage device, dynamic storage device, or RAM (RandomAccessMemory, random access memory).
  • the memory 102 can store operating systems and other application programs.
  • the relevant program codes are stored in the memory 102 and called by the processor 101 to execute the implementation of the present invention.
  • Example image display method
  • Input/output interface 103 used to implement information input and output
  • the communication interface 104 is used to realize communication interaction between the device and other devices. Communication can be realized through wired means (such as USB, network cable, etc.), or communication can be realized through wireless means (such as mobile network, WIFI, Bluetooth, etc.);
  • Bus 105 which transmits information between various components of the device (such as processor 101, memory 102, input/output interface 103, and communication interface 104);
  • the processor 101, the memory 102, the input/output interface 103 and the communication interface 104 realize communication connections between each other within the device through the bus 105.
  • Embodiments of the present invention also provide a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to cause the computer to execute the above image display method.
  • memory can be used to store non-transitory software programs and non-transitory computer executable programs.
  • the memory may include high-speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device.
  • the memory may optionally include memory located remotely from the processor, and the remote memory may be connected to the processor via a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.
  • the device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separate, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store the desired information and that can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种图像显示方法、图像显示装置、设备及存储介质，方法包括：获取原始图像（S100）；根据预设的图像分析模型对原始图像进行图像分析，得到目标深度图（S200）；根据预设的虚拟视点合成算法对目标深度图进行图像合成，得到多个不同视角的目标图像（S300）；将多个不同视角的目标图像进行汇集，得到目标图像集合（S400）；分光设备将目标图像集合中的目标图像发射到不同方向，以展示多个不同视角的目标图像（S500）。通过分光设备将多个不同视角的目标图像发射到不同的方向，则用户通过分光设备将不同视角的目标图像发射出来，即可查看到3D显示的图像，且无需佩戴3D眼镜，且无需根据人眼追踪以实现3D图像显示。

Description

图像显示方法、图像显示装置、设备及存储介质 技术领域
本发明涉及图像处理的技术领域，尤其是涉及一种图像显示方法、图像显示装置、设备及存储介质。
背景技术
传统实现3D主要采用显示器向左眼和右眼显示两个不同视角的图像，以通过图像的立体差异特性在大脑中产生可感知的三维图像。
相关技术中，3D影像产生的原因主要是因为眼睛的“视觉移位”，目前已经成熟的偏光式3D显示主要需要借助3D眼镜以观看3D画面，但是长时间佩戴3D眼镜不仅让用户不舒适，且让用户的视觉造成巨大的冲击。
发明内容
本发明旨在至少解决现有技术中存在的技术问题之一。为此，本发明提出一种图像显示方法，能够将不同视角的目标图像直接显示，无需佩戴3D眼镜，提高3D图像查看的便捷性。
本发明还提出一种图像显示装置。
本发明还提出一种电子设备。
本发明还提出一种计算机可读存储介质。
第一方面，本发明的一个实施例提供了图像显示方法，方法包括：
获取原始图像；
根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度图；
根据预设的虚拟视点合成算法对所述目标深度图进行图像合成，得到多个不同视角的目标图像；
将多个不同视角的所述目标图像进行汇集，得到目标图像集合；
分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
本发明实施例的图像显示方法至少具有如下有益效果：通过图像分析模型根据原始图像进行图像分析得到目标深度图，并通过虚拟视点合成算法对目标深度图进行图像合成以得到 多个不同视角的目标图像，则分光设备直接将多个不同视角的目标图像发射到不同的方向，以使目标用户通过改变视角即可查看到不同视角的目标图像，无需佩戴3D眼镜即可查看3D图像，既提高了3D图像查看的便利性，又降低3D图像查看的不适感。
根据本发明的另一些实施例的图像显示方法，在分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像之后，所述方法还包括：
调整目标用户的主视区的目标图像，具体包括：
获取目标用户的视角信息；
根据所述视角信息确定所述目标用户的主视区；
将所述主视区的所述目标图像切换为与所述视角信息对应的所述目标图像。
根据本发明的另一些实施例的图像显示方法，所述分光设备上设有分光区域和通孔区域；所述分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像，包括：
所述分光设备的所述分光区域将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
根据本发明的另一些实施例的图像显示方法，在分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像之后，所述方法还包括：
通过所述分光设备的所述通孔区域将所述目标图像中的目标画面显示，具体包括：
获取显示参数，所述显示参数包括：分辨率和内容类型；
获取所述目标图像中满足所述显示参数的图像画面，得到所述目标画面；
通过所述分光设备的所述通孔区域将所述目标画面显示。
根据本发明的另一些实施例的图像显示方法，在根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度图之前，所述方法还包括：
对神经网络模型进行训练，得到所述图像分析模型，具体包括：
获取图像训练数据集合和损失函数；
根据所述损失函数和所述图像训练数据集合对所述神经网络模型进行训练，得到所述图像分析模型。
第二方面，本发明的一个实施例提供了图像显示装置，装置包括：
获取模块，用于获取原始图像；
分析模块，用于根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度 图；
合成模块，用于根据预设的虚拟视点合成算法对所述目标深度图进行图像合成，得到多个不同视角的目标图像；
汇集模块，用于将多个不同视角的所述目标图像进行汇集，得到目标图像集合；
分光设备，用于将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
本发明实施例的图像显示装置至少具有如下有益效果：通过图像分析模型根据原始图像进行图像分析得到目标深度图，并通过虚拟视点合成算法对目标深度图进行图像合成以得到多个不同视角的目标图像，则分光设备直接将多个不同视角的目标图像发射到不同的方向，以使目标用户通过改变视角即可查看到不同视角的目标图像，无需佩戴3D眼镜即可查看3D图像，既提高了3D图像查看的便利性，又降低3D图像查看的不适感。
根据本发明的另一些实施例的图像显示装置，所述获取模块、所述分析模块、所述合成模块、所述汇集模块集成于图像处理终端，所述分光设备包括：光栅屏幕和壳体，所述光栅屏幕承载于所述壳体上，所述壳体套设于所述图像处理终端上，且所述壳体和所述图像处理终端相适配。
根据本发明的另一些实施例的图像显示装置，所述图像处理终端上设有第一图像采集器，所述壳体上开设有与所述第一图像采集器相对应的开孔，所述壳体上设有通孔区域，所述壳体上设有位于所述光栅屏幕两侧的第二图像采集器。
第三方面，本发明的一个实施例提供了电子设备，包括：
至少一个处理器，以及，
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如第一方面所述的方法。
第四方面，本发明的一个实施例提供了计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如第一方面所述的方法。
本申请的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本申请而了解。本申请的目的和其他优点可通过在说明书以及附图中所特别指出的结构来实现和获得。
附图说明
图1是本发明实施例中图像显示方法的一具体实施例流程示意图；
图2是本发明实施例中图像显示方法的一具体实施例中视频通话的示意图；
图3是本发明实施例中图像显示方法的另一具体实施例流程示意图；
图4是本发明实施例中图像显示方法的一具体实施例中视频通话的示意图；
图5是本发明实施例中图像显示方法的一具体实施例中视频通话的示意图；
图6是图1中步骤S500的流程图；
图7是本发明实施例中图像显示方法的另一具体实施例流程示意图；
图8是本发明实施例中图像显示方法的另一具体实施例流程示意图；
图9是本发明实施例中图像显示装置的一具体实施例模块框图；
图10是本发明实施例中图像显示装置的一具体实施例的结构示意图；
图11是本发明实施例中图像显示装置的一具体实施例的结构示意图；
图12是本发明实施例中电子设备的一具体实施例模块框图。
附图标记说明：100、图像处理终端；110、获取模块；120、分析模块；130、合成模块；140、汇集模块；150、第一图像采集器；200、分光设备；210、光栅屏幕；220、壳体；221、开孔；222、通孔区域；230、第二图像采集器。
具体实施方式
以下将结合实施例对本发明的构思及产生的技术效果进行清楚、完整地描述，以充分地理解本发明的目的、特征和效果。显然，所描述的实施例只是本发明的一部分实施例，而不是全部实施例，基于本发明的实施例，本领域的技术人员在不付出创造性劳动的前提下所获得的其他实施例，均属于本发明保护的范围。
在本发明的描述中，如果涉及到方位描述，例如“上”、“下”、“前”、“后”、“左”、“右”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。如果某一特征被称为“设置”、“固定”、“连接”、“安装”在另一个特征，它可以直接设置、固定、连接在另一个特征上，也可以间接地设置、固定、连接、安装在另一个特征上。
在本发明实施例的描述中，如果涉及到“若干”，其含义是一个以上，如果涉及到“多个”，其含义是两个以上，如果涉及到“大于”、“小于”、“超过”，均应理解为不包括本数，如果涉 及到“以上”、“以下”、“以内”，均应理解为包括本数。如果涉及到“第一”、“第二”，应当理解为用于区分技术特征，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量或者隐含指明所指示的技术特征的先后关系。
目前生活中，用户通过电子设备查看的图像是2D图片，由于2D图像是没有深度的视觉信息，但是现实世界却是有深度的，所以感知深度的好处既能够提高图像查看的真实性，又能够传递更多的信息。
为了实现3D图像显示，相关技术中设置显示器，且显示器向左眼和右眼显示图像的两个不同视角就可以通过图像的立体差异特征在大脑中产生可感知的三维图像。除此之外，另一个3D图像显示则是在空间中再现图像，这种方法包括：体积法、全息法、光场法、整体成像法、多视角和超级多视角法。因此，随着数字视听技术进入高清化的时代，立体显示技术已经发展成为继高清显示之后数字视听技术发展历程中的又一焦点。不同于标清到高清的升级，3D图像显示是一种全新的多维度跨越，是一种突破性的技术革新。由于相关技术中的3D图像显示需要借助3D眼镜以实现，但是用户长时间佩戴3D眼镜会对视觉造成巨大的冲击，且对人的健康产生众多不良的影响。
基于此，本申请公开了一种图像显示方法、图像显示装置、设备及存储介质，通过生成多个不同视角的目标图像，并通过分光设备将多个不同视角的目标图像发射到不同的方向，则用户通过分光设备将不同视角的目标图像发射出来，即可查看到3D显示的图像，且无需佩戴3D眼镜，且无需根据人眼追踪以实现3D图像显示。
参照图1，示出了本发明实施例中图像显示方法的流程示意图。在本发明实施例公开了一种图像显示方法，方法包括：步骤S100、步骤S200、步骤S300、步骤S400、步骤S500。可以理解，图像显示方法包括但不限于步骤S100至步骤S600。
步骤S100：获取原始图像。
需要说明的是，原始图像根据当前应用场景所确定，以根据当前应用场景获取对应的原始图像。例如，若当前应用场景为图像查看，则接收查看指令，根据查看指令从图像数据库获取对应的图像以得到原始图像。若当前应用场景为视频通话，获取视频通话的通话人物的图像以得到原始图像。
具体地，若当前应用场景为视频通话，通过图像采集器获取通话人物的图像以得到原始图像。
步骤S200：根据预设的图像分析模型对原始图像进行图像分析，得到目标深度图。
需要说明的是，预设的图像分析模型用于对单张的原始图像进行分析，且图像分析模型对原始图像进行深度评估得到目标深度图。
步骤S300：根据预设的虚拟视点合成算法对目标深度图进行图像合成，得到多个不同视角的目标图像。
需要说明的是，在二维显示器中，每个像素点发出的光在不同方向上的分布通常情况是呈朗伯分布，所以用户查看二维显示器中的目标图像为平面图像。然而，在三维显示器中，每个像素点发出的光所在方向上基本不是相等。例如，在二维显示器中，如果一个被描绘的物体出现在屏幕的正面，那么它的位置不会随着视角的改变而改变，而三维显示器中，物体出现在屏幕面前，它在屏幕上的位置必须随着观察位置向右移动而向左移动，反之亦然。因此，通过虚拟视点合成算法根据目标深度图进行图像合成，也即通过目标深度图构建出原始图像对应的三维模型，再将三维模型进行切分以得到多个不同视角的目标图像。通过多个不同视角的目标图像即可呈现出3D图像显示。
步骤S400：将多个不同视角的目标图像进行汇集，得到目标图像集合。
需要说明的是，由于3D图像显示需要将多个不同视角的目标图像同时呈现，且不同视角的目标图像以不同的方向进行呈现，以便于可以实现3D图像查看。因此，通过将多个不同视角的目标图像汇集得到目标图像集合，也即合成3D图像，即可进行3D图像显示。其中，目标图像集合中的多个目标图像之间的视角不同。
例如，若当前应用场景为视频通话，则实时获取通话人物的原始图像，并实时得出多个不同视角的目标图像，将多个不同视角的目标图像汇集得到目标图像集合，也即得到当前视频通话的3D的通话画面。
步骤S500：分光设备将目标图像集合中的目标图像发射到不同方向，以展示多个不同视角的目标图像。
需要说明的是，为了实现3D图像显示，需要将多个不同视角的目标图像发射到不同方向，所以通过查看目标图像时，改变观看的视角即可看到3D格式的目标图像。因此，通过设置分光设备，通过分光设备将目标图像集合中的目标图像发射到不同的方向。其中，由于多个目标图像之间的视角不同，则分光设备根据目标图像的视角确定发射方向，以在对应的发射方向发射对应视角的目标图像，则用户在查看分光设备发射的目标图像，通过改变视角方向以查看到不同角度的目标图像，以实现目标图像的3D查看。若不采用分光设备，则只显示一个视角角度的目标图像，无论用户如何改变视角，目标图像都是一样的。
例如，请参照图2，分光设备为小人头上的横杠，若当前应用场景为视频通话，通过分光设备将多个不同视角的目标图像发射到对应的方向，目标用户通过分光设备正视时可以查看到视频通话中通话人物的正脸，通过移动到左侧后能够通过分光设备查看到通话人物的侧脸，若目标用户移动到右侧，则可以查看到通话人物的另一边侧脸。因此，通过分光设备将不同视角的目标图像发射到对应的方向，则用户在进行视频通话时实现3D视频通话，既能够提高目标用户的体验感，又能够减轻用户佩戴3D眼镜的不适感。
综上，通过预设的图像分析模型将原始图像进行图像分析以得到目标深度图，并根据虚拟视点合成算法对目标深度图进行图像合成，也即根据目标深度图合成三维模型，再将三维模型进行切分以得到多个不同视角的目标图像。通过将多个不同视角的目标图像汇集得到目标图像集合，也即合成3D图像。最后，通过分光设备将不同视角的目标图像发射到对应的方向，则目标用户可以通过分光设备查看到不同视角的目标图像。因此，无需佩戴3D眼镜即可实现3D图像查看，既提高目标用户查看图像的视觉感，又减轻目标用户的不适感。
在本申请的一些实施例中，在执行步骤S500之后，图像显示方法还可以包括但不限于步骤：调整目标用户的主视区的目标图像。
需要说明的是，为了提高目标用户查看图像或者视频通话过程的体验感，需要根据目标用户选择调整目标用户的主视区的目标图像，以使目标用户始终正视目标图像的正面。其中，通过获取多个目标图像的目标视角，以获取目标视角为正视角度的目标图像，以在目标用户的主视图中显示正视角度的目标图像，以使目标用户始终正视目标图像。
请参照图3，调整目标用户的主视区的目标图像，可以包括但不限于步骤S610、步骤S620和步骤S630。
步骤S610：获取目标用户的视角信息。
需要说明的是，由于目标用户在查看图像或者视频通话过程会不断改变视角，因此根据预设时间间隔周期获取目标用户的视角信息，以确定目标用户的当前视角。其中，通过头部位置跟踪器获取目标用户的视角信息。例如，若当前应用场景为视频通话，则通过头部位置跟踪器获取目标用户的头部角度以确定目标用户的视角信息。
步骤S620：根据视角信息确定目标用户的主视区。
需要说明的是，通过视角信息确定目标用户的当前视角，并根据视角信息确定目标用户的主视区。
请参照图4，例如，P1为目标用户，P2为通话人物，若当前应用场景为视频通话，确定 目标用户前面的视角区域为A、B、C、D、E、F六个区域，且每个区域的角度为30°，获取目标用户的视角信息为45°，则可以确定目标用户的主视区为B区域。若目标用户的视角信息为90°，则确定目标用户的主视区为C区域。
步骤S630：将主视区的目标图像切换为与视角信息对应的目标图像。
需要说明的是，由于分光设备可以将不同视角的目标图像发射到不同的方向以实现3D显示，但是用户需要始终正视目标图像的正视视角时，则需要根据目标用户的主视区切换为对应视角的目标图像，以提高目标用户的体验感。
例如，请参照图5，若当前应用场景为视频通话，为了保证目标用户始终正视通话人物，以在视频通话应用中双方可以进行眼神交流，则需要实时矫正当前显示的目标图像。则获取目标图像的目标视角，根据目标用户变化的主视区，将正视角度的目标图像显示在变化的主视区，则目标用户可与通话人物实时进行眼神交流。参照图5可知，通过将目标用户的主视区显示的目标图像调整为与视角信息对应的目标图像，则目标用户和通话人物的视角正视，除此之外，不管目标用户的视角如何变化，通话人物也时刻正视目标用户。
请参照图6，在本申请的一些实施例中，分光设备上设有分光区域和通孔区域，步骤S500可以包括但不限于步骤S510。
步骤S510：分光设备的分光区域将目标图像集合中的目标图像发射到不同方向，以展示多个不同视角的目标图像。
需要说明的是，由于分光设备呈现3D的目标图像的分辨率较低，且分光设备会将目标图像的分辨率损失掉，使得小文本难以看清楚。因此通过在分光设备上设置分光区域和通孔区域，则分光区域将不同视角的目标图像发射到不同方向实现目标图像的3D显示，对于需要高分辨率查看的图像或者文字则通过通孔区域查看，既能够实现3D图像查看又能够查看高分辨率的图像和文字，提高目标用户的使用体验感。
其中，分光区域为光栅屏幕，且光栅屏幕可以实现多视角显示原理，无需佩戴3D眼镜也可以查看3D的目标图像。
在本申请的一些实施例中，执行步骤S500之后，图像显示方法还包括但不限于步骤：通过分光设备的通孔区域将目标图像中的目标画面显示。
需要说明的是，为了便于目标用户查看高分辨率的图像或文字，则需要在分光设备上设置通孔区域将目标图像中的目标画面显示，以实现3D图像和高分辨率画面的同时查看，以提高目标用户的体验感。
请参照图7，通过分光设备的通孔区域将目标图像中的目标画面显示，可以包括但不限于步骤S710、步骤S720和步骤S730。
步骤S710：获取显示参数，显示参数包括：分辨率和内容类型。
需要说明的是，所获取的显示参数由目标用户自定义，通过目标用户自定义的分辨率和内容类型，即可确定目标用户想要查看符合显示参数的目标画面。
步骤S720：获取目标图像中满足显示参数的图像画面，得到目标画面。
需要说明的是，对目标图像中的图像内容和文字内容进行识别，以获取满足显示参数的图像内容和文字内容以得到目标画面。
例如，若分辨率为1000ppi，内容类型文字，则获取目标图像中分辨率满足1000ppi的文字内容，以得到目标画面。
步骤S730：通过分光设备的通孔区域将目标画面显示。
需要说明的是，其中，步骤S100至步骤S400由图像处理终端执行，且图像处理终端上设有分光设备，分光设备盖设于图像处理终端的显示屏前，由于分光设备的通孔区域没有遮挡图像处理终端的显示屏，且目标画面设置于图像处理终端的显示屏与通孔区域对应的区域，则通过通孔区域可以直接查看显示屏上的目标画面，从而实现高分辨率的文字或者图像查看。
本申请的一些实施例中，图像显示方法还包括但不限于步骤：对神经网络模型进行训练，得到图像分析模型。
需要说明的是，为了保证图像分析模型根据原始图像即可分析出可以构建多个不同视角的目标深度图，以提高目标深度图的准确性，则提前对神经网络模型进行训练以得到图像分析模型。
请参照图8，对神经网络模型进行训练，得到图像分析模型，可以包括但不限于步骤S810和步骤S820。
步骤S810：获取图像训练数据集合和损失函数。
需要说明的是，通过收集图像训练数据集合，其中，图像训练数据集合包括视角方向不同的图像。根据目标用户预先设定好的损失函数，即可根据损失函数确定神经网络模型的训练要求。
步骤S820：根据损失函数和图像训练数据集合对神经网络模型进行训练，得到图像分析模型。
需要说明的是，将图像训练数据集合输入至神经网络模型，且利用梯度下降法不断迭代 神经网络模型，以根据损失函数调整神经网络模型的参数，直到神经网络模型收敛，以得到图像分析模型。
另外，请参照图9，本发明实施例还公开了一种图像显示装置，包括：获取模块110，用于获取原始图像；分析模块120，用于根据预设的图像分析模型对原始图像进行图像分析，得到目标深度图；合成模块130，用于根据预设的虚拟视点合成算法对目标深度图进行图像合成，得到多个不同视角的目标图像；汇集模块140，用于将多个不同视角的目标图像进行汇集，得到目标图像集合；分光设备200，用于将目标图像集合中的目标图像发射到不同方向，以展示多个不同视角的目标图像。
通过预设的图像分析模型将原始图像进行图像分析以得到目标深度图，并根据虚拟视点合成算法对目标深度图进行图像合成，也即根据目标深度图合成三维模型，再将三维模型进行切分以得到多个不同视角的目标图像。通过将多个不同视角的目标图像汇集得到目标图像集合，也即合成3D图像。最后，通过分光设备200将不同视角的目标图像发射到对应的方向，则目标用户可以通过分光设备200查看到不同视角的目标图像。因此，无需佩戴3D眼镜即可实现3D图像查看，既提高目标用户查看的视觉感，又减轻目标用户的不适感。
本发明实施例的图像显示装置用于执行上述实施例中图1至图9的图像显示方法，其具体处理过程与上述实施例中的图像显示方法相同，此处不再一一赘述。
请参照图10，获取模块110、分析模块120、合成模块130、汇集模块140集成于图像处理终端100，分光设备200包括：光栅屏幕210和壳体220，光栅屏幕210承载于壳体220上，壳体220套设于图像处理终端100上，且壳体220和图像处理终端100相适配。
例如，若图像处理终端100为移动终端，则壳体220为移动终端的壳体220，且壳体220与图像处理终端100相适配。当需要查看3D的目标图像，或者进行3D的视频通话时，可以将壳体220的光栅屏幕210位于图像处理终端100的显示屏前，若无需进行3D图像查看，则将壳体220套设于图像处理终端100的背面，既能够保护图像处理终端100，又可以防止壳体220丢失难以寻找。
请参照图11，图像处理终端100上设有第一图像采集器150，壳体220上开设有与第一图像采集器150相对应的开孔221，壳体220上设有通孔区域222，壳体220上设有位于光栅屏幕210两侧的第二图像采集器230。
若当前应用场景为视频通话，则原始图像需要实时获取目标用户的人物图像，则需要通过第一图像采集器150所采集原始图像，通过在壳体220上开设有开孔221，则第一图像采 集器150通过开孔221采集到目标用户的人物图像，以得到原始图像。从而提供第一图像采集器150清晰的视野。由于增加光栅屏幕210会造成图像处理终端100的显示屏的分辨率损失，对于文本来说更加难以阅读，由于图像处理终端100所采集的范围大于人的头部，所以设置通孔区域222直接连通显示屏，则可以通过通孔区域222显示高分辨率的图像或文字，从而提高目标用户的阅读体验感。通过在光栅屏幕210设置第二图像采集器230，可以提高原始图像采集的清晰度，且可以增强3D显示的性能。
请参阅图12，图12示意了另一实施例的电子设备的硬件结构，电子设备包括：
处理器101，可以采用通用的CPU(CentralProcessingUnit，中央处理器)、微处理器、应用专用集成电路(ApplicationSpecificIntegratedCircuit，ASIC)、或者一个或多个集成电路等方式实现，用于执行相关程序，以实现本发明实施例所提供的技术方案；
存储器102，可以采用ROM(ReadOnlyMemory，只读存储器)、静态存储设备、动态存储设备或者RAM(RandomAccessMemory，随机存取存储器)等形式实现。存储器102可以存储操作系统和其他应用程序，在通过软件或者固件来实现本说明书实施例所提供的技术方案时，相关的程序代码保存在存储器102中，并由处理器101来调用执行本发明实施例的图像显示方法；
输入/输出接口103，用于实现信息输入及输出；
通信接口104，用于实现本设备与其他设备的通信交互，可以通过有线方式(例如USB、网线等)实现通信，也可以通过无线方式(例如移动网络、WIFI、蓝牙等)实现通信；
总线105，在设备的各个组件(例如处理器101、存储器102、输入/输出接口103和通信接口104)之间传输信息；
其中处理器101、存储器102、输入/输出接口103和通信接口104通过总线105实现彼此之间在设备内部的通信连接。
本发明实施例还提供了一种计算机可读存储介质，该计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如上述的图像显示方法。
存储器作为一种非暂态计算机可读存储介质，可用于存储非暂态软件程序以及非暂态性计算机可执行程序。此外，存储器可以包括高速随机存取存储器，还可以包括非暂态存储器，例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施方式中，存储器可选包括相对于处理器远程设置的存储器，这些远程存储器可以通过网络连接至该处理器。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
以上所描述的装置实施例仅仅是示意性的，其中作为分离部件说明的单元可以是或者也可以不是物理上分开的，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统可以被实施为软件、固件、硬件及其适当的组合。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
上面结合附图对本发明实施例作了详细说明，但是本发明不限于上述实施例，在所属技术领域普通技术人员所具备的知识范围内，还可以在不脱离本发明宗旨的前提下作出各种变化。此外，在不冲突的情况下，本发明的实施例及实施例中的特征可以相互组合。

Claims (10)

  1. 一种图像显示方法，其特征在于，方法包括：
    获取原始图像；
    根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度图；
    根据预设的虚拟视点合成算法对所述目标深度图进行图像合成，得到多个不同视角的目标图像；
    将多个不同视角的所述目标图像进行汇集，得到目标图像集合；
    分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
  2. 根据权利要求1所述的图像显示方法，其特征在于，在分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像之后，所述方法还包括：
    调整目标用户的主视区的目标图像，包括：
    获取目标用户的视角信息；
    根据所述视角信息确定所述目标用户的主视区；
    将所述主视区的所述目标图像切换为与所述视角信息对应的所述目标图像。
  3. 根据权利要求1所述的图像显示方法，其特征在于，所述分光设备上设有分光区域和通孔区域；所述分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像，包括：
    所述分光设备的所述分光区域将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
  4. 根据权利要求3所述的图像显示方法，其特征在于，在分光设备将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像之后，所述方法还包括：
    通过所述分光设备的所述通孔区域将所述目标图像中的目标画面显示，包括：
    获取显示参数，所述显示参数包括：分辨率和内容类型；
    获取所述目标图像中满足所述显示参数的图像画面，得到所述目标画面；
    通过所述分光设备的所述通孔区域将所述目标画面显示。
  5. 根据权利要求1至4任一项所述的图像显示方法，其特征在于，在根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度图之前，所述方法还包括：
    对神经网络模型进行训练，得到所述图像分析模型，包括：
    获取图像训练数据集合和损失函数；
    根据所述损失函数和所述图像训练数据集合对所述神经网络模型进行训练，得到所述图像分析模型。
  6. 一种图像显示装置，其特征在于，装置包括：
    获取模块，用于获取原始图像；
    分析模块，用于根据预设的图像分析模型对所述原始图像进行图像分析，得到目标深度图；
    合成模块，用于根据预设的虚拟视点合成算法对所述目标深度图进行图像合成，得到多个不同视角的目标图像；
    汇集模块，用于将多个不同视角的所述目标图像进行汇集，得到目标图像集合；
    分光设备，用于将所述目标图像集合中的所述目标图像发射到不同方向，以展示多个不同视角的所述目标图像。
  7. 根据权利要求6所述的图像显示装置，其特征在于，所述获取模块、所述分析模块、所述合成模块、所述汇集模块集成于图像处理终端，所述分光设备包括：光栅屏幕和壳体，所述光栅屏幕承载于所述壳体上，所述壳体套设于所述图像处理终端上，且所述壳体和所述图像处理终端相适配。
  8. 根据权利要求7所述的图像显示装置，其特征在于，所述图像处理终端上设有第一图像采集器，所述壳体上开设有与所述第一图像采集器相对应的开孔，所述壳体上设有通孔区域，所述壳体上设有位于所述光栅屏幕两侧的第二图像采集器。
  9. 一种电子设备，其特征在于，包括：
    至少一个处理器，以及，
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如权利要求1至5任一项所述的方法。
  10. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如权利要求1至5任一项所述的方法。
PCT/CN2022/098766 2022-04-22 2022-06-14 图像显示方法、图像显示装置、设备及存储介质 WO2023201864A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210426720.9 2022-04-22
CN202210426720.9A CN114840165A (zh) 2022-04-22 2022-04-22 图像显示方法、图像显示装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2023201864A1 true WO2023201864A1 (zh) 2023-10-26

Family

ID=82566000

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/098766 WO2023201864A1 (zh) 2022-04-22 2022-06-14 图像显示方法、图像显示装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN114840165A (zh)
WO (1) WO2023201864A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014135006A (ja) * 2013-01-11 2014-07-24 Canon Inc 画像処理装置、画像処理方法、およびプログラム
CN108495117A (zh) * 2018-03-29 2018-09-04 香港光云科技有限公司 全息图像多视角处理转换、显示方法及设备
CN111667438A (zh) * 2019-03-07 2020-09-15 阿里巴巴集团控股有限公司 视频重建方法、系统、设备及计算机可读存储介质
CN111669570A (zh) * 2019-03-07 2020-09-15 阿里巴巴集团控股有限公司 多角度自由视角视频数据处理方法及装置、介质、设备
CN112255820A (zh) * 2020-12-21 2021-01-22 苏州苏大维格科技集团股份有限公司 裸眼三维显示装置
CN112799237A (zh) * 2021-01-11 2021-05-14 苏州苏大维格科技集团股份有限公司 裸眼三维显示装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014135006A (ja) * 2013-01-11 2014-07-24 Canon Inc 画像処理装置、画像処理方法、およびプログラム
CN108495117A (zh) * 2018-03-29 2018-09-04 香港光云科技有限公司 全息图像多视角处理转换、显示方法及设备
CN111667438A (zh) * 2019-03-07 2020-09-15 阿里巴巴集团控股有限公司 视频重建方法、系统、设备及计算机可读存储介质
CN111669570A (zh) * 2019-03-07 2020-09-15 阿里巴巴集团控股有限公司 多角度自由视角视频数据处理方法及装置、介质、设备
CN112255820A (zh) * 2020-12-21 2021-01-22 苏州苏大维格科技集团股份有限公司 裸眼三维显示装置
CN112799237A (zh) * 2021-01-11 2021-05-14 苏州苏大维格科技集团股份有限公司 裸眼三维显示装置

Also Published As

Publication number Publication date
CN114840165A (zh) 2022-08-02

Similar Documents

Publication Publication Date Title
US10560687B2 (en) LED-based integral imaging display system as well as its control method and device
US20210209859A1 (en) Cross reality system
US9749619B2 (en) Systems and methods for generating stereoscopic images
US8488869B2 (en) Image processing method and apparatus
JP5515301B2 (ja) 画像処理装置、プログラム、画像処理方法、記録方法および記録媒体
JP4328311B2 (ja) 三次元画像表示用多視点画像の作成方法およびプログラム
US10715791B2 (en) Virtual eyeglass set for viewing actual scene that corrects for different location of lenses than eyes
US11037321B2 (en) Determining size of virtual object
US20220303524A1 (en) System and method for processing three dimensional images
JP2004221700A (ja) 立体画像処理方法および装置
EP3683656A1 (en) Virtual reality (vr) interface generation method and apparatus
JP2004007395A (ja) 立体画像処理方法および装置
JP2004007396A (ja) 立体画像処理方法および装置
WO2022267573A1 (zh) 裸眼3d显示模式的切换控制方法、介质和系统
CN103281507A (zh) 基于真三维显示的可视电话系统及方法
CN112752085A (zh) 基于人眼跟踪的裸眼3d视频播放系统及方法
JP2015154091A (ja) 画像処理方法、画像処理装置、及び電子機器
CN113253845A (zh) 一种基于人眼追踪视图显示方法、装置、介质及电子设备
WO2012136002A1 (zh) 调节立体图像的方法、装置、系统、电视机及立体眼镜
US11126001B2 (en) Image generating apparatus, head-mounted display, content processing system and image displaying method
JP5396877B2 (ja) 画像処理装置、プログラム、画像処理方法、および記録方法
US9225968B2 (en) Image producing apparatus, system and method for producing planar and stereoscopic images
JP2004221699A (ja) 立体画像処理方法および装置
JP6166985B2 (ja) 画像生成装置および画像生成プログラム
KR20070010306A (ko) 촬영장치 및 깊이정보를 포함하는 영상의 생성방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22938093

Country of ref document: EP

Kind code of ref document: A1