WO2022267573A1

WO2022267573A1 - Switching control method for glasses-free 3d display mode, and medium and system

Info

Publication number: WO2022267573A1
Application number: PCT/CN2022/081637
Authority: WO
Inventors: 张建伟; 丁仁国; 廖鑫
Original assignee: 纵深视觉科技(南京)有限责任公司
Priority date: 2021-06-22
Filing date: 2022-03-18
Publication date: 2022-12-29
Also published as: CN113438464A; CN115735358A

Abstract

Disclosed in the embodiments of the present application are a switching control method for a glasses-free 3D display mode, and a medium and a system. The method comprises: acquiring the number of viewers within a viewing range of a glasses-free 3D display device (110); and according to the number of viewers, controlling the display mode of the glasses-free 3D display device to switch between a single-person viewing mode and a multi-person viewing mode (120).

Description

Naked-eye 3D display mode switching control method, medium and system

This application claims priority to a Chinese patent application with application number 202110690462.0 filed with the China Patent Office on June 22, 2021, the entire contents of which are incorporated herein by reference.

technical field

The embodiments of the present application relate to technologies in the field of image display, for example, to a switching control method, medium and system for a naked-eye 3D display mode.

Background technique

A naked-eye 3D display device refers to a display device that can be directly viewed with naked eyes without wearing 3D glasses to achieve a 3D effect. Glasses-free 3D display devices generally use technologies such as cylindrical prisms and slit gratings, and use the parallax characteristics of the left and right eyes to achieve 3D effects. Without any auxiliary equipment, stereoscopic images with space and depth can be obtained. Provide a strong visual impact.

At present, there are naked-eye 3D display devices for single-person viewing in the market, which are mainly aimed at achieving 3D effects for single-person viewing, and are called two-viewpoint naked-eye 3D display devices; The device can realize 3D effects on multiple people at different positions at the same time, which is called a multi-viewpoint naked-eye 3D display device. The different characteristics of these two glasses-free 3D display devices can be applied to different application scenarios, and also have their own advantages and disadvantages. Although the two-viewpoint glasses-free 3D display device can present a better 3D effect, it can only provide a better 3D viewing effect for one viewer at the same time, and cannot allow multiple people to watch the 3D effect at the same time; the multi-viewpoint glasses-free 3D display device can It provides multiple people to watch the 3D effect simultaneously in a relatively wide field, but the 3D effect presented is not ideal.

Contents of the invention

Embodiments of the present application provide a switching control method, medium, and system for naked-eye 3D display modes, so as to realize naked-eye 3D display effects in various scenarios.

In the first aspect, the embodiment of the present application provides a switching control method for naked-eye 3D display mode, the method including:

Obtain the number of viewers within the viewing range of the naked-eye 3D display device;

According to the number of viewers, the display mode of the naked-eye 3D display device is controlled to be switched between a single-person viewing mode and a multi-person viewing mode.

In the second aspect, the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the switching of the naked-eye 3D display mode as described in any embodiment of the present application is realized. Control Method.

In the third aspect, the embodiment of the present application also provides a naked-eye 3D display system, including a naked-eye 3D display device and a display control device, and the display control device is configured to execute the naked-eye 3D display mode described in any embodiment of the present application. Switch control method.

Description of drawings

FIG. 1 is a flow chart of a switching control method of a naked-eye 3D display mode in an embodiment of the present application;

Fig. 2 is a flow chart of a switching control method of a naked-eye 3D display mode in another embodiment of the present application;

FIG. 3A is a schematic structural diagram of a naked-eye 3D display system in an embodiment of the present application;

Fig. 3B is a schematic structural diagram of the EESVR software control system in an embodiment of the present application;

Fig. 3C is a schematic structural diagram of the EESVR software control system in another embodiment of the present application;

FIG. 4 is a schematic structural diagram of a switching control device for a naked-eye 3D display mode in an embodiment of the present application;

Fig. 5 is a schematic structural diagram of a computer device in an embodiment of the present application.

detailed description

The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only some structures related to the present application are shown in the drawings but not all structures.

Fig. 1 is a flowchart of a switching control method of a naked-eye 3D display mode in an embodiment of the present application. This embodiment is applicable to a naked-eye 3D display device that can be used as a single-viewpoint naked-eye 3D device or as a multi-viewpoint naked-eye display device. In the case of using a 3D display device, the method can be executed by the naked-eye 3D display mode switching control device in the embodiment of the present application. The device can be implemented in the form of software and/or hardware, and can be configured in an electronic device with computing capabilities. accomplish. As shown in Figure 1, the method includes the following steps:

Step 110, acquiring the number of viewers within the viewing range of the naked-eye 3D display device.

Among them, the naked-eye 3D display device is a display device that can be directly viewed with naked eyes without wearing 3D glasses to achieve a 3D effect; based on the imaging principle of naked-eye 3D, generally at a set position in front of the screen, the left and right eyes of the viewer can be adjusted. Obtain the left-eye image and right-eye image with horizontal parallax respectively and present the 3D display effect. The collection of these positions is the viewing range. The scope can be within 50-100 centimeters from the viewer to the naked-eye 3D display device; the camera can be one or more, and the installation method of the camera can be embedded in the display device, or externally placed above or below the naked-eye 3D display device , can also be independent of the vicinity of the naked-eye 3D display device, so as to facilitate the shooting of the current number of viewers; the number of viewers can be obtained through automatic acquisition or manual input, for example, it can be detected by the camera through the face recognition function within the viewing range The number of viewers; the face recognition function is realized by the face recognition service program in the host system, and its method can be the method of support vector machine, hidden Markov model method, subspace method and neural network method, etc., for example, can A neural network face recognition method is adopted as the face recognition method of this embodiment.

For example, the acquisition of the number of viewers can be obtained from the calibration image collected by the camera, and the shooting pose of the camera is calibrated and corrected according to the calibration image, so as to obtain a real-time image collected by the camera within the viewing range of the naked-eye 3D display device; Face recognition is performed on the real-time image, and the number of viewers is determined according to the face recognition result.

Step 120, according to the number of viewers, control the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode.

Wherein, the display mode of the naked-eye 3D display device is the visual effect that the 3D screen can achieve, for example, it can be a 2D display mode or a 3D display mode; the single-person viewing mode is that the number of viewers is a single person, or viewing When the number of viewers is multiple but includes viewers with priority, the display mode of the naked-eye 3D display device is the naked-eye 3D display mode in the case of a single person, generally presenting a 3D effect at the position of a single person; When the viewing mode is multiple viewers, the display mode of the naked-eye 3D display device is the naked-eye 3D display mode under the condition of multiple people, that is, the 3D effect is presented within an area where multiple people are located.

For example, the software system in the host system controls the switching of the display mode of the naked-eye 3D display device between single-person viewing mode and multi-person viewing mode. The software system can judge that the number of viewers is single-person Or multiple people, and control the 3D display screen through the naked-eye 3D display device control software in the system, so as to realize the automatic switching of the display mode of the display device.

For example, according to the number of viewers, after controlling the display mode of the naked-eye 3D display device to switch between the single-person viewing mode and the multi-person viewing mode, it also includes: if switching to the single-person viewing mode, tracking and obtaining the naked-eye 3D display The position and interpupillary distance of the viewer within the viewing range of the device; according to the position and interpupillary distance of the viewer, the image rendering parameters of the naked-eye 3D display device are controlled to present a 3D display effect at the position of the viewer.

For example, after obtaining the number of viewers within the viewing range of the naked-eye 3D display device, it further includes: if the number of viewers is zero, controlling the display mode of the naked-eye 3D display device to switch to a 2D display mode.

For example, according to the number of viewers, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode includes: according to the number of viewers, determining that the display mode is a single-person viewing mode or a multi-person viewing mode Human viewing mode: transmit the control command representing the display mode to the picture control system, so as to control the rendering parameters of the naked-eye 3D display device.

For example, the rendering parameters of the naked-eye 3D display device are mainly controlled by the K3 picture control system in the host system. The sub-pixels are rearranged and combined to realize the conversion between 2D and 3D modes.

For example, after obtaining the number of viewers within the viewing range of the naked-eye 3D display device, it also includes identifying the viewers if the number of viewers is multiple; correspondingly, controlling the naked-eye 3D display according to the number of viewers Switching the display mode of the device between the single-person viewing mode and the multi-person viewing mode includes: controlling the display mode of the naked-eye 3D display device to switch between the single-person viewing mode and the multi-person viewing mode according to the number of viewers and the identification results. to switch between.

For example, the identity recognition can be completed by the face recognition service program in the host system. In the multi-person mode, the person identity recognition is first performed on the present viewers, and it is judged whether there are viewers with priority among the viewers. The above-mentioned viewers with priority can manually input the viewer information, or input the viewer's picture in the face recognition service program in advance, and the face recognition service program will recognize the facial features on the picture, Identify viewers with priorities.

For example, according to the number of viewers and the identification result, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode includes: if the number of viewers is multi-person, then according to The identity recognition result determines the identity priority of the viewer; the viewer whose identity priority meets the set conditions is regarded as a single viewer or multiple viewers, and the display mode of the naked-eye 3D display device is controlled to switch to a single viewing mode or a multi-person viewing mode. human viewing mode.

For example, when there are many viewers, the identity of the viewers should be identified first, and the priority can be set according to the identity of the viewers in the face recognition service program, and the person with the highest level can be set as the first priority. The second highest person is set as the second priority, and so on. People who have not input viewer information in the face recognition service program in advance are ordinary viewers. , provide viewers with a single-person viewing mode with stronger 3D effects in turn according to the priority; if there is no priority viewer, provide viewers with a multi-person viewing mode.

For example, obtaining the number of viewers within the viewing range of the naked-eye 3D display device further includes obtaining a calibration image collected by the camera, and performing calibration and correction on the shooting pose of the camera according to the calibration image.

For example, the calibration image collected by the camera can be used for dual-target timing, so that the two cameras can take pictures of the same calibration board multiple times, respectively calibrate their own internal parameters and external parameters relative to the calibration board, and then calculate the two cameras. relationship between locations. After binocular positioning, the two cameras can use epipolar constraints to perform binocular correction after shooting the same object, so that the same feature point is located on the same straight line in the horizontal direction of the two images of the left and right cameras, reducing image distortion.

In the technical solution of this embodiment, the number of viewers within the viewing range of the naked-eye 3D display device can be obtained, and according to the number of viewers, the display mode of the naked-eye 3D display device can be controlled between a single-person viewing mode and a multi-person viewing mode. switch, and when the number of viewers is multi-person, it can determine whether the display mode of the display device is multi-person viewing mode or single-person viewing mode according to whether the viewers include viewers with priority, which improves the current market The naked-eye 3D display device can only display single-person mode or multi-person mode, so that the device can be used not only as a single-viewpoint naked-eye 3D device, but also as a multi-viewpoint naked-eye 3D display device.

FIG. 2 is a flow chart of a switching control method for a naked-eye 3D display mode provided by another embodiment of the present application. This embodiment refines the switching control method for a naked-eye 3D display mode on the basis of the above-mentioned embodiments.

In the embodiment of this application, the naked-eye 3D display system mainly includes a naked-eye 3D display device and a display control device. The optical design of the display device takes into account both the dual-viewpoint solution and the multi-viewpoint solution. Optical parameter design, the optical parameters include the thickness, width, and refractive index of the prism, etc., through the optical design of the 3D display screen, with the cooperation of optical refraction-based hardware and supporting interweaving software, the display can be The device presents a naked-eye 3D effect.

As shown in Figure 2, the method of this embodiment includes the following steps:

Step 210, acquiring real-time images collected by cameras within the viewing range of the naked-eye 3D display device.

Wherein, the camera is installed on the 3D display device, the position of the camera can be above or below the 3D display screen, and the number can be one or more, and the installation method of the camera can be embedded in the display device, or placed outside The top or bottom of the naked-eye 3D display device can also be independent of the vicinity of the naked-eye 3D display device; the real-time image can be a calibration image collected by a camera, and the shooting pose of the camera is calibrated and corrected according to the calibration image .

For example, the host system of the camera and the naked-eye 3D display device can be connected through a Universal Serial Bus (USB) line, and the captured real-time image is transmitted to the face recognition service program in the host system through the USB line, When the camera is working, the camera will continue to capture the faces of the viewers within the viewing range, so as to detect changes in the number of viewers, and send the data to the computer host system for processing by the face recognition service program.

Step 220, perform face recognition on the real-time image and determine the number of viewers according to the face recognition result.

Wherein, the face recognition is to recognize the face by processing the feature points of the viewer's face, and the method can be a support vector machine method, a hidden Markov model method, a subspace method and a neural network method, etc. For example, a neural network face recognition method can be used as the face recognition method of this embodiment, which is implemented by the face recognition service program in the host system in this embodiment, and is used to analyze the viewer information in the collected real-time images, wherein the viewer The viewer information is specifically the number of viewers and eye tracking information in the single viewing mode, and the pupil movement track of the viewer is obtained by detecting the interpupillary distance of the pupils and the spatial coordinates of the pupils.

For example, the face recognition service program in the host system will compare the face feature points in the real-time image with the face feature points in the face recognition service program. The face feature points can be eyes, nose, mouth, etc. and eyebrows, among which the face recognition is mainly to recognize the key point features of the face, which is generally represented by 128 points, and can also be represented by 64 points or other points to represent the contours of these facial organs. These features can be used to identify well Specific people can be identified, so as to identify whether the number of viewers is single or multiple. When the number of viewers is single, or the number of viewers is multiple, but includes viewers with priority, the face recognition service program tracks the eyeballs by calculating the pupillary distance of the viewer and recording the spatial coordinates of the pupils There are many ways to track the movement track and the pupil movement track, for example, the sclera-iris edge method, the pupil tracking method and the pupil-cornea reflection method, etc. For example, the pupil tracking method can be used as the method for pupil movement track tracking in the embodiment of the present application The pupil tracking method mainly performs image processing on the human eye features detected in the face recognition service program, the continuous images of the human eyes captured by the camera, combined with the change in the shape of the viewer's eyes, detects the pixel changes of the human eye feature points , and determine the position of the pupils of both eyes according to the amount of change in the pixels in the image, and use the point the pupils are looking at as the pupil center point, record the spatial coordinates of the pupil center point and calculate the pupillary distance, and analyze the movement of the pupils of the eyes.

Step 230, according to the number of viewers, determine whether the display mode is a single-person viewing mode or a multi-person viewing mode.

Wherein, the number of viewers is the result of detection by the face recognition service program, specifically the number of viewers in the viewer information, the face recognition service program can automatically send the viewer information to the host system for processing, and determine that the display mode is single Watch mode or multiplayer watch mode.

For example, if the number of viewers detected by the face recognition service program is a single person, the display mode of the naked-eye 3D display device is controlled by the host system to be a single-person viewing mode; Or, according to the priority of the viewer, the pupil information of the viewer with priority is tracked, and the naked-eye 3D display device is controlled by the host system to provide the single-person viewing mode for the viewer according to the priority; if the number of viewers is If there are multiple people, and does not include viewers with priority, then the host system controls the display mode of the naked-eye 3D display device to be multi-person viewing mode.

Step 240, transmit the control command representing the display mode to the image control system, so as to control the rendering parameters of the glasses-free 3D display device.

Wherein, the display mode is the display mode of the naked-eye 3D display device, such as 2D display mode or 3D display mode; the control instruction is sent by the EESVR software control system in the host system; the rendering parameters of the naked-eye 3D display device Controlled by K3 screen control system. Among them, the eye tracking service (Eye Tracking Service, EESVR) software control system mainly includes the eye tracking module, the server monitoring and data processing module, the tray menu module, the communication protocol analysis and data transmission module, etc. Identify the viewer information detected by the service program, and send an instruction to switch the viewing mode of the naked-eye 3D display device to the K3 picture control system according to the number of viewers.

For example, if the EESVR software control system acquires that the number of viewers is zero, the EESVR software control system sends an instruction to close the 3D display mode and switch to a 2D display mode to the K3 image control system through a USB cable; If the number of viewers is single, the EESVR software control system sends an instruction to switch to single-person viewing mode to the K3 screen control system through the USB cable; Send an instruction to switch to multiplayer mode to the K3 screen control system.

According to the number of viewers, after controlling the display mode of the naked-eye 3D display device to switch between the single-person viewing mode and the multi-person viewing mode, it also includes:

In single-person viewing mode, the human eye tracking module in the EESVR software control module can continuously track the position of the human pupil. First, image processing is performed on the human eye image obtained by the face recognition service program, and the continuous image of the human eye captured by the camera is combined with the change in the shape of the viewer’s eye to detect the pixel change of the feature point of the human eye and obtain the center point of the pupil, namely Determines the center position of the pupil of the human eye. Finally, the real-time location information is converted into rendering parameters, and the rendering parameters are transmitted to the K3 image control system through the USB cable.

Step 250, according to the number of viewers, control the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode.

Among them, the display mode of the naked-eye 3D display device is mainly controlled by the K3 picture control system. The core of the K3 picture control system is the K3 picture control chip. 3D display effect is presented; the naked-eye 3D display screen adopts columnar prism technology, which can divide the space of the display screen into different viewing areas; the viewing mode can be 2D viewing mode, 3D single-person viewing mode and 3D multi-person viewing mode.

For example, the 2D viewing mode is a picture display without a 3D effect, and the K3 picture control system can cut the left and right double pictures of the display screen into a single picture output; when the 3D viewing mode is a single viewing mode, wherein, The single-person viewing mode can be enabled under the condition that the number of viewers is single, or there are viewers with priority among multiple viewers. The display screen space is divided into left view area and right view area. When watching The K3 picture control system can make the picture in the left viewing zone enter the left eye of the viewer, and the picture in the right viewing zone enter the right eye of the viewer. The K3 picture control system rearranges and combines the sub-pixels through the rendering parameters sent by the EESVR software control system. Since the rendering parameters are related to the position information of the pupil under this module, the rendering parameters will be generated every time the pupil position moves. Changes, and the arrangement of sub-pixels changes accordingly. Since the center point of the viewing zone always falls on the center of the pupil, the K3 picture control system can always know the spatial position of the pupil through human eye tracking no matter how the viewer moves, and then Convert it into rendering parameters, and notify the K3 screen system to rearrange and combine sub-pixels according to the latest parameters, so that the left-view zone picture can enter the viewer’s left eye, and the right-view zone picture can enter the viewer’s right eye, allowing the viewer to Enjoy naked-eye 3D stereoscopic effects; when the 3D viewing mode is a multi-person viewing mode, the display screen is divided into multiple different viewing areas, for example, it can be 28 viewing areas, or 54 viewing areas, and two adjacent viewing areas The distance between the pupils of the viewer is controlled at N times the distance between the pupils of the viewer. By arranging and combining the sub-pixels in the image with a fixed algorithm, there is a fixed parallax between adjacent viewing areas, so that no matter which viewing area the viewer is in, you can See naked eye 3D stereo effect. Since there is a crosstalk zone between two adjacent viewing zones, when the viewer is in the crosstalk zone, they will feel uncomfortable. At this time, it is only necessary to move the position to avoid the crosstalk zone. In the multi-person viewing mode, the K3 image control system uses a fixed method to rearrange and combine the input 3D content with sub-pixels in a fixed way, so that multiple people can see the naked-eye 3D stereoscopic effect in different spatial positions.

In the technical solution of this embodiment, the optical design of the naked-eye 3D display device is carried out through the embodiment of the application, taking into account the dual-viewpoint solution and the multi-viewpoint solution, using the camera to capture real-time images within the viewing range, and transmitting them to the host system through the USB cable. The face recognition service program measures the facial features of the face recognition service program to analyze and judge the viewer information, and when the number of viewers is a single person, or when the number of viewers is multiple but includes viewers with priority, According to the level of priority, a single-person viewing mode can be provided for the viewer. By obtaining the pupil information of the viewer, the viewer information is sent to the EESVR software control system, and the system sends an instruction to switch the viewing mode to the K3 screen control system , the K3 picture control system controls the rearrangement and combination of the pixels of the naked-eye 3D display device screen. In different modes, the screen is divided into left and right viewing areas in single-person viewing mode and multiple different viewing areas in multi-person viewing mode. For example, it can be 28 viewing areas or 54 viewing areas, which improves the switching between single-person viewing mode and multi-person viewing mode of the naked-eye 3D display device, and achieves that the device can be used as a single-view naked-eye 3D device or as a The effect used as a multi-view glasses-free 3D display device.

Fig. 3A is a schematic structural diagram of a naked-eye 3D display system provided by an embodiment of the present application; Fig. 3B and Fig. 3C are schematic structural diagrams of an EESVR software control system. This embodiment is based on the above-mentioned multiple embodiments. As shown in FIG. 3A , the naked-eye 3D display system includes a naked-eye 3D display device 310 and a display control device 320, wherein the optical design of the naked-eye 3D display device takes into account both the dual-viewpoint solution and the Multi-viewpoint solution, the optical design refers to the parameter design of the columnar prism for the selected 3D display screen, based on the optical refraction of the columnar prism and the supporting interweaving software to achieve naked-eye 3D visual effects, for example, the optical parameters include prism In addition, the naked-eye 3D display device 310 includes a camera and a K3 picture control system, as shown in Figure 3B and Figure 3C, the display control device is a host system, mainly including a face recognition service program And EESVR software control system, in which EESVR software control system mainly includes: eye tracking module, server monitoring and data processing module, tray menu module, communication protocol analysis and data transmission module, etc. The eye tracking module includes functions such as eye tracking status query, eye tracking switch, and eye tracking parameter debugging, while the data processing module includes functions such as authentication, K3 control, and 3D diaphragm switch.

Among them, when the EESVR software control system program is started, the human eye tracking mode is started, and the EESVR is set accordingly, and the modules can be connected through image data lines, command data lines and multiple application interfaces. Among them, the server monitoring module is a module that monitors the connection communication between the 3D application program (3D renderer and player, etc.) and the EESVR software control system. Once a new connection is detected, a new process is created to realize the server Information exchange and processing with 3D applications. The human eye tracking module is connected with the server monitoring module, the client receiving data process, and the data sending process through the human eye tracking interface program, and is set to transmit human eye tracking information; after the client receiving data process receives the relevant data, the The data processing module performs data analysis, for example, the data can be in JSON string format; the data processing module sends the data that needs to be sent to the client to the data sending process and the K3 control process, and the K3 control process performs 3D image rendering through the K3 control chip, etc. , so that the naked-eye 3D display device can switch the viewing mode. In addition, the watchdog process is used to monitor whether the human eye tracking process, the EESVR extended service process, and the tray program are running normally. If the program runs abnormally, the process can be restarted.

In an example, the lenticular prism technology adopted by the 3D display device is in a single-viewer mode, wherein the single-viewer mode can be single when the number of viewers is single, or with priority viewers among multiple viewers. Open under certain conditions, the use of the columnar prism technology can divide the space of the screen into the left viewing area and the right viewing area, and transmit the image of the left viewing area to the left eye, and the image of the right viewing area to the right eye; In mode, the screen is divided into multiple different viewing areas, for example, it can be 28 viewing areas, or 54 viewing areas, and the images are transmitted to viewers from different angles, presenting 3D images to viewers.

Among them, the human eye tracking module is set to calculate the interpupillary distance of the human eye, record the spatial coordinates of the pupil center point, and realize eyeball movement trajectory tracking; the server monitoring module is set to detect whether there is a new application client connected to the EESVR software control system, Once it is detected that a new application program is connected to the EESVR software control system, a new thread is created to handle the communication between the application program and the EESVR software control system. The player module is connected to the server through the application interface, and is set to play 3D images. When playing 3D content in full screen, it sends control instructions to the EESVR software control system through the connection protocol, turns on the human eye tracking function and controls the naked eye 3D display device at the same time. switch to the 3D stereoscopic display mode; the K3 picture control module can control the 3D rendering parameters of the image through the K3 picture control chip, so that the naked-eye 3D display device can realize the switching between the 2D display mode and the 3D display single-person mode and multi-person mode; data transmission The modules are configured to transmit different data to corresponding modules.

When the naked-eye 3D display device is working, it is connected to the computer host through a wired high-definition multimedia interface (High Definition Multimedia Interface, HDMI), as a naked-eye 3D display device for the computer, and the relevant 3D content data can be transmitted through the wired HDMI. The camera is connected to the host computer through a connecting line such as a USB cable or a network cable, and the calibration image collected by the camera is calibrated and corrected according to the shooting position of the calibration image camera, and sent to the computer host system through the connecting line such as a USB cable or a network cable. , the face recognition service program performs image recognition and other related processing on the real-time image. The image recognition is mainly aimed at facial features, including eyes, nose, mouth or eyebrows, etc., which can generally be represented by 128 points, or can be represented by 64 points or other points. The contours of these organs can be effectively identified through these features Specific people, so as to determine whether the number of viewers is single or multiple, and when the number of viewers is single, the face recognition service program calculates the interpupillary distance of the viewer's pupils and records the spatial coordinates of the pupils.

When the number of viewers is zero, the EESVR software control system sends a message to the K3 image control system to close the naked-eye 3D display mode and switch to the 2D display mode.

When the number of viewers is single or the number of viewers is multiple but includes viewers with priority, the display mode is single viewing mode, and the EESVR software control system receives the viewer information sent by the face recognition service program After receiving the information, the system can automatically send an instruction to switch the naked-eye 3D single-person viewing mode to the K3 picture control module, and then use the EESVR software to control the human eye tracking module in the system, and use the interpupillary distance and pupil space coordinates of the viewer in the single-person mode as The real-time position information is transmitted to the K3 picture control system through the USB cable, and converted into rendering parameters. The K3 picture control system rearranges and combines the sub-pixels of the 3D image, and divides the screen of the naked-eye 3D display device into left viewing area and The right viewing area, so that when the images in the left and right viewing areas are refracted into the human eye through the prism, the image in the left viewing area is guaranteed to be transmitted to the left eye, and the image in the right viewing area is transmitted to the right eye, so that the gaze point on the screen always falls on the pupil The central position enables the viewer to always enjoy the naked-eye 3D effect within the viewing range.

When the number of viewers is multiple and does not include viewers with priority, the display mode is multi-person viewing mode, and the EESVR software control system sends an instruction to switch the naked-eye 3D multi-person viewing mode to the K3 screen control module, and the K3 screen The control system rearranges and combines the sub-pixels of the 3D image, and divides the screen of the naked-eye 3D display device into multiple different viewing areas, for example, it can be 28 viewing areas or 54 viewing areas, and two adjacent viewing areas The spacing between the pupils of the viewer is controlled at N times the distance between the pupils of the viewer. By arranging and combining the sub-pixels in the image in a fixed way, there is a fixed parallax between adjacent viewing areas, so that no matter which viewing area the viewer is in, the You can see the naked eye 3D stereoscopic effect. Since there is a crosstalk zone between two adjacent viewing zones, when the viewer is in the crosstalk zone, they will feel uncomfortable. At this time, it is only necessary to move the position to avoid the crosstalk zone.

In the technical solution of this embodiment, the optical design of the naked-eye 3D display device is carried out through the embodiment of the application, taking into account the dual-viewpoint solution and the multi-viewpoint solution, using the camera to capture real-time images within the viewing range, and transmitting them to the host system through the USB cable. Face recognition service program, the face recognition service program can judge the number of viewers by detecting facial features, and when the number of viewers is a single person, or there are multiple viewers including priority viewers, The viewer with high priority provides a single-person viewing mode. By obtaining the pupil information of the viewer, for example, including the pupil distance and spatial coordinates, the viewer information is sent to the EESVR software control system, and the system realizes the control of the K3 screen The system sends an instruction to switch the viewing mode. Finally, the K3 picture control system can switch the viewing mode of the naked-eye 3D display screen to single-person viewing mode or multi-person viewing mode according to the instruction, which improves the single-person viewing mode and multi-person viewing mode of the naked-eye 3D display device. The switching of viewing modes achieves the effect that the device can be used as a single-viewpoint naked-eye 3D device, and can also be used as a multi-viewpoint naked-eye 3D display device.

FIG. 4 is a diagram of a switching control device for a naked-eye 3D display mode provided by an embodiment of the present application. The device can be implemented in the form of software and/or hardware, and the device can be implemented in an electronic device with computing power. As shown in FIG. 4 , the device includes: a viewer number acquisition module 410 and a viewing mode switching control module 420 .

Wherein, the number of viewers acquisition module 410 is configured to obtain the number of viewers within the viewing range of the naked-eye 3D display device;

Among them, the module for obtaining the number of viewers includes:

The real-time image acquisition unit is configured to acquire real-time images collected by the camera within the viewing range of the naked-eye 3D display device;

The face recognition unit is configured to perform face recognition on the real-time image, and determine the number of viewers according to the face recognition result.

The viewing mode switching control module 420 is configured to control the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode according to the number of viewers.

Wherein, the viewing mode switching control module includes:

Switch the 2D viewing mode unit, set to if the number of viewers is zero, then control the display mode of the naked-eye 3D display device to switch to the 2D display mode;

Switch the 3D viewing mode unit, which is set to track and obtain the position and interpupillary distance of the viewer within the viewing range of the naked-eye 3D display device if it is switched to the single-person viewing mode; according to the position and interpupillary distance of the viewer, control the Image rendering parameters of the 3D display device, so as to present a 3D display effect at the position of the viewer.

For example, according to the number of viewers, it is determined that the display mode is a single-person viewing mode or a multi-person viewing mode.

For example, the control instruction representing the display mode is transmitted to the picture control system, and is set to control the rendering parameters of the glasses-free 3D display device.

For example, after acquiring the number of viewers within the viewing range of the naked-eye 3D display device, it also includes: if the number of viewers is multiple, identify the viewers; correspondingly, control the naked-eye 3D Switching the display mode of the display device between the single-person viewing mode and the multi-person viewing mode includes: controlling the display mode of the naked-eye 3D display device between the single-person viewing mode and the multi-person viewing mode according to the number of viewers and the identification results. to switch between.

For example, according to the number of viewers and the identification result, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode includes: if the number of viewers is multiple, then according to the The above identification results determine the identity priority of the viewer; the viewer whose identity priority meets the set conditions is regarded as a single viewer or multiple viewers, and the display mode of the naked-eye 3D display device is controlled to switch to a single-person viewing mode or a multi-person viewing mode watch mode.

For example, a calibration image collected by the camera is acquired, and it is set to calibrate and correct the shooting pose of the camera according to the calibration image.

For example, the naked-eye 3D display system has at least one camera, which is set to collect real-time images within the viewing range of the naked-eye 3D display device; interval setting.

For example, an image data line is set between the naked-eye 3D display device and the display control device: an image data line configured to transmit image data to be displayed and an instruction data line configured to transmit data on the number of viewers, switching instructions of display modes, and rendering parameters .

A naked-eye 3D display mode switching control device provided in an embodiment of the present application can execute the method provided in any embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method.

In the technical solution of this embodiment, by acquiring the number of viewers within the viewing range of the naked-eye 3D display device, according to the number of viewers, the display mode of the naked-eye 3D display device is controlled to switch between single-person viewing mode and multi-person viewing mode , and when there are many viewers including priority viewers, a single-person viewing mode can be provided for viewers with high priority according to the priority of the viewers, which improves the naked-eye 3D display device in the related art. It can display single-person viewing mode or multi-person viewing mode, realizing that the naked-eye 3D display device can automatically switch between single-person viewing mode and multi-person viewing mode according to the number of viewers, taking into account the effect of dual-viewpoint scheme and multi-viewpoint scheme.

FIG. 5 is a schematic structural diagram of a computer device in an embodiment of the present application. Figure 5 shows a block diagram of an exemplary computer device 12 suitable for implementing embodiments of the present application. The computer device 12 shown in FIG. 5 is only an example, and should not limit the functions and scope of use of the embodiment of the present application.

As shown in FIG. 5, computer device 12 takes the form of a general-purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16 , system memory 28 , bus 18 connecting various system components including system memory 28 and processing unit 16 .

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus structures. These architectures include, by way of example, but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect ( PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12 and include both volatile and nonvolatile media, removable and non-removable media.

System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32 . Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be configured to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 5, commonly referred to as a "hard drive"). Although not shown in FIG. 5, a disk drive for reading and writing to removable nonvolatile disks (e.g., "floppy disks") may be provided, as well as for removable nonvolatile optical disks (e.g., CD-ROM, DVD-ROM). or other optical media) CD-ROM drive. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present application.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including - but not limited to - an operating system, one or more application programs, other program Modules and program data, each or some combination of these examples may include the implementation of the network environment. The program modules 42 generally perform the functions and/or methods of the embodiments described herein.

The computer device 12 may also communicate with one or more external devices 14 (e.g., a keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and/or with Any device (eg, network card, modem, etc.) that enables the computing device 12 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 22 . In addition, in the computer device 12 in this embodiment, the display 24 does not exist as an independent entity, but is embedded in the mirror surface. When the display surface of the display 24 is not displayed, the display surface of the display 24 and the mirror surface are visually integrated. Also, the computer device 12 can also communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN) and/or a public network, such as the Internet) through the network adapter 20 . As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.

The processing unit 16 executes a variety of functional applications and data processing by running the program stored in the system memory 28, for example, realizing the switching control method of the naked-eye 3D display mode provided in the embodiment of the present application: acquiring the naked-eye 3D display device within the viewing range The number of viewers; according to the number of viewers, control the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode.

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the switching control method of the naked-eye 3D display mode as provided in all the application embodiments of the present application is realized: obtaining naked-eye 3D The number of viewers within the viewing range of the display device; according to the number of viewers, the display mode of the naked-eye 3D display device is controlled to switch between a single-person viewing mode and a multi-person viewing mode. Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer readable storage media include: electrical connections with one or more leads, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. The computer readable storage medium may be a non-transitory computer readable storage medium.

A computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including - but not limited to - electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including - but not limited to - wireless, wires, optical cables, radio frequency RF, etc., or any suitable combination of the foregoing.

Computer program code for performing the operations of the present application may be written in one or more programming languages or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).

Claims

A switching control method for naked-eye 3D display mode, comprising:

Obtain the number of viewers within the viewing range of the naked-eye 3D display device;

According to the number of viewers, the display mode of the naked-eye 3D display device is controlled to be switched between a single-person viewing mode and a multi-person viewing mode.
The method according to claim 1, wherein said obtaining the number of viewers within the viewing range of the naked-eye 3D display device comprises:

Obtain real-time images collected by the camera within the viewing range of the naked-eye 3D display device;

Face recognition is performed on the real-time image, and the number of viewers is determined according to the face recognition result.
The method according to claim 1, after controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode according to the number of viewers, further comprising:

In response to determining to switch to the single-person viewing mode, track and acquire the position and interpupillary distance of the viewer within the viewing range of the naked-eye 3D display device;

According to the position of the viewer and the interpupillary distance, image rendering parameters of the naked-eye 3D display device are controlled to present a 3D display effect at the position of the viewer.
The method according to claim 1, after acquiring the number of viewers within the viewing range of the naked-eye 3D display device, further comprising:

In response to determining that the number of viewers is zero, controlling the display mode of the glasses-free 3D display device to switch to a 2D display mode.
The method according to claim 1, wherein, according to the number of viewers, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode comprises:

According to the number of viewers, determine that the display mode is a single-person viewing mode or a multi-person viewing mode;

The control instruction representing the display mode is transmitted to the picture control system to control the rendering parameters of the naked-eye 3D display device.
The method according to claim 1, after acquiring the number of viewers within the viewing range of the naked-eye 3D display device, further comprising:

identifying a viewer in response to determining that the number of viewers is a plurality;

According to the number of viewers, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode includes:

According to the number of viewers and the identification result, the display mode of the naked-eye 3D display device is controlled to be switched between a single-person viewing mode and a multi-person viewing mode.
The method according to claim 6, wherein, according to the number of viewers and the identification result, controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode comprises:

In response to determining that the number of viewers is multiple, determine the identity priority of the viewer according to the identification result;

The viewer whose identity priority satisfies the set condition is regarded as a single viewer, and the display mode of the naked-eye 3D display device is controlled to be switched to a single viewing mode; or the viewer whose identity priority meets the set condition is regarded as a single viewer. Multiple viewers control the display mode of the naked-eye 3D display device to switch to a multi-person viewing mode.
The method of claim 2, further comprising:

The calibration image collected by the camera is acquired, and the shooting pose of the camera is calibrated and corrected according to the calibration image.
A computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the switching control method for naked-eye 3D display mode according to any one of claims 1-8 is implemented.
A naked-eye 3D display system, comprising a naked-eye 3D display device and a display control device, the display control device being configured to execute the switching control method of the naked-eye 3D display mode according to any one of claims 1-8.
The system of claim 10, further comprising:

At least one camera is configured to collect real-time images within the viewing range of the naked-eye 3D display device; the camera is arranged above or below the screen of the naked-eye 3D display device, and multiple cameras are arranged at intervals.
The system according to claim 10, wherein, between the naked-eye 3D display device and the display control device:

An image data line, configured to transmit image data to be displayed;

The command data line is set to transmit the data of the number of viewers, the switching command of the display mode and the rendering parameters.