CN217693558U - Naked eye 3D instant messaging equipment - Google Patents

Abstract

The utility model provides a bore hole 3D instant messaging equipment, bore hole 3D instant messaging equipment includes: the system comprises a naked eye 3D display, and a video module, an audio module and a communication model which are connected with the naked eye 3D display; the naked eye 3D display is provided with a controller for controlling the naked eye 3D instant communication equipment to work, and the video module, the audio module and the communication module are all connected with the controller; the naked eye 3D instant messaging equipment establishes communication connection with at least one instant messaging object through the communication module, so that the video data acquired by the video module and the audio data acquired by the audio module are transmitted to the at least one instant messaging object in real time through the communication connection, and the naked eye 3D instant messaging with the at least one instant messaging object is realized. The utility model discloses a bore hole 3D instant messaging equipment can make the picture that uses the object to see and show effectively have the third dimension, and can realize double and many people's real-time bore hole 3D demonstration and interdynamic.

Description

Naked eye 3D instant messaging equipment

Technical Field

The utility model relates to the field of communication, especially a bore hole 3D instant messaging equipment.

Background

Instant messaging refers to services that are capable of sending and receiving internet messages and the like instantaneously. With the development of communication technology, the functions of instant messaging are increasingly abundant, and various functions such as e-mail, blogs, music, television, games, searching and the like are gradually integrated. At present, instant messaging is not a simple chat tool any more, and has been developed into a comprehensive information platform integrating communication, information, entertainment, search, e-commerce, office collaboration, enterprise customer service and the like.

However, most of the traditional instant messaging devices used for instant messaging are single in instant messaging effect according to the existing devices such as mobile phones and tablet computers, and only two-dimensional planar pictures can be displayed, so that a more three-dimensional participation sense cannot be provided for users.

SUMMERY OF THE UTILITY MODEL

In view of the above, the present invention has been made in order to provide an naked eye 3D instant messaging device that overcomes or at least partially solves the above mentioned problems.

According to the utility model discloses an aspect provides a bore hole 3D instant messaging equipment, include: the system comprises a naked eye 3D display, and a video module, an audio module and a communication model which are connected with the naked eye 3D display;

the naked eye 3D display has a naked eye 3D display function, the naked eye 3D display is provided with a controller for controlling the naked eye 3D instant communication equipment to work, and the video module, the audio module and the communication module are all connected with the controller; the video module is used for collecting video data of an environment where the video module is deployed; the audio module is used for acquiring audio data of the environment where the audio module belongs and/or playing the audio data under the control of the controller;

the naked eye 3D instant messaging equipment establishes communication connection with at least one instant messaging object through the communication module, so that video data acquired by the video module and audio data acquired by the audio module are transmitted to the at least one instant messaging object in real time through the communication connection, and naked eye 3D instant messaging with the at least one instant messaging object is realized;

the video module comprises at least two cameras, and the at least two cameras are fixed around the naked eye 3D display and used for collecting transverse video data and/or vertical video data; each camera is correspondingly provided with a rotating base so as to realize 360-degree rotation through the rotating base.

Optionally, the at least two cameras are arranged in parallel, and optical axes of the at least two cameras are located on the same horizontal plane; or the like, or, alternatively,

the at least two cameras are arranged in a staggered mode in the horizontal direction, and optical axes of the at least two cameras form an optical axis distance in the horizontal direction; the distance between the optical axes is 0.1-6.5 cm.

Optionally, the naked eye 3D display further includes a plurality of display units and a naked eye 3D part forming a certain included angle with the display units in the horizontal direction, and the plurality of display units and the naked eye 3D part cooperatively display the video data collected by the video module for processing to generate a naked eye 3D interlaced image.

Optionally, the naked eye 3D component includes a lenticular array, a slit grating array, or a microlens grating array.

Optionally, the naked eye 3D instant messaging device further includes an eyeball tracking module, which is in communication connection with the controller;

the eyeball tracking module is used for tracking the positions of the two eyes of the object used by the naked eye 3D instant communication equipment in real time, feeding the positions of the two eyes back to the controller, and adjusting the naked eye 3D interlaced image in real time by the controller so that the naked eye 3D interlaced image is matched with the positions of the two eyes of the object used;

the eyeball tracking module comprises infrared equipment or image acquisition equipment.

Optionally, the video module, the audio module and the communication module are connected with the naked-eye 3D display through a USB interface, a Type-c interface and/or an HDMI interface;

the naked eye 3D display comprises a mobile phone, a flat panel, a notebook, a display, a television and/or a splicing wall with the naked eye 3D display function.

Optionally, the naked eye 3D instant messaging device is connected to the server via the communication module; the server side starts a main connection monitoring process and a cooperative connection monitoring process, and the communication module in the naked eye 3D instant communication equipment is connected with the main connection monitoring process of the server side;

when the naked eye 3D instant communication equipment needs to establish instant communication with any instant communication object, the cooperative connection interception process is connected through the communication module, and after the server side sends a notification message to the instant communication object through the cooperative connection interception process, instant communication connection is established with the instant communication object.

Optionally, the notification message sent by the server to the instant messaging object through the cooperative connection interception process carries a first IP address and a first port number of the naked eye 3D instant messaging device, so that the instant messaging object sends a connection request to the naked eye 3D instant messaging device by using the first IP address and the first port number;

and when the naked eye 3D instant communication equipment receives the connection request of the instant communication object, recording the source IP address and the source port number of the instant communication object.

Optionally, the naked eye 3D instant messaging device is further configured to receive a second IP address and a second port number of the instant messaging object sent by the server, so as to establish an instant messaging connection with the instant messaging object by using the second IP address and the second port number;

and the second IP address and the second port number are sent after the server receives a synchronous sending preparation notice that the instant messaging object sends a connection request to the naked eye 3D instant messaging equipment and sends the synchronous sending preparation notice to a main connection interception process of the server.

Optionally, the glasses frame further comprises a frame kit, and the naked eye 3D display, the video module, the audio module and the communication module are arranged on the frame kit.

According to another aspect of the present invention, there is provided an naked eye 3D instant messaging system, comprising at least two of the above embodiments of the naked eye 3D instant messaging devices and a server; and each naked eye 3D instant communication device is in communication connection with the server so as to realize real-time naked eye 3D instant communication and interaction of multiple persons through the server.

The utility model provides a bore hole 3D instant messaging equipment, through utilizing bore hole 3D instant messaging equipment through setting up bore hole 3D display, not only can make the picture that uses the object to see and demonstrate effectively have the third dimension, establish instant messaging through server and other instant messaging objects and connect, realize double and many people's real-time bore hole 3D demonstration and interdynamic, in order at many people interactive in-process, more specifically and vividly demonstrate the image information who participates in the instant messaging object, shorten the distance and feel and promote the telepresence.

The above description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented according to the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more obvious and understandable, the following detailed description of the present invention is given.

The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 shows a schematic structural diagram of an open-eye 3D instant messaging device according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a camera module according to an embodiment of the present invention;

fig. 3A to 3B are schematic front and side views of a camera module structure according to another embodiment of the present invention;

fig. 4A, 4B, and 4C are schematic diagrams illustrating interlaced images according to an embodiment of the present invention;

fig. 5A-5B show schematic diagrams of a left eye image and a right eye image according to an embodiment of the invention;

fig. 6 shows a schematic diagram of a display layout according to an embodiment of the present invention;

fig. 7 is a schematic diagram illustrating an image conversion according to an embodiment of the present invention;

fig. 8 is a schematic diagram illustrating an image conversion according to another embodiment of the present invention;

fig. 9 shows a schematic structural diagram of an naked eye 3D instant messaging system according to another embodiment of the present invention;

the system comprises 100 naked eye 3D instant messaging equipment, 10 naked eye 3D displays, 11 display units, 12 naked eye 3D parts, 20 video modules, 21 cameras, 22 rotating bases, 23 camera fixing supports, 30 audio modules, 40 communication models, 50 support kits, 60 eyeball tracking modules and 200 service terminals.

Detailed Description

In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and to simplify the description, but do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore should not be construed as limiting the present invention.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically limited otherwise.

In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "fixed" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood according to specific situations by those of ordinary skill in the art.

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

The embodiment of the utility model provides a bore hole 3D instant messaging equipment 100, refer to fig. 1 and know, the utility model discloses a including bore hole 3D instant messaging equipment 100 can include bore hole 3D display 10 at least and with video module 20, audio module 30 and the communication model that bore hole 3D display 10 is connected. The video module 20, the audio module 30 and the communication module 40 can be connected to the naked- eye 3D display 10 through a USB interface, a Type-c interface, an HDMI interface, and the like.

The naked eye 3D display 10 has a naked eye 3D display function, the naked eye 3D display 10 is provided with a controller for controlling the naked eye 3D instant messaging equipment 100 to work, and the video module 20, the audio module 30 and the communication module 40 are all connected with the controller. The naked eye 3D display 10 can be a mobile phone, a tablet, a notebook, a display, a television, a splicing wall and the like with a naked eye 3D display function, and the display screen of the naked eye 3D display 10 can be a display device such as an LCD screen, an OLED screen, an LED screen, a micro LED screen and a mini LED screen.

The video module 20 is configured to collect video data of an environment where the video module 20 is deployed; the audio module 30 is used for collecting audio data of an environment where the audio module 30 belongs and/or controlling the controller to play audio data. The audio module 30 may integrate both wired or wireless microphone and audio devices.

The naked eye 3D instant messaging device 100 establishes a communication connection with at least one instant messaging object through the messaging module 40, so as to transmit the video data collected by the video module 20 and the audio data collected by the audio module 30 to the at least one instant messaging object in real time through the communication connection, thereby implementing naked eye 3D instant messaging with the at least one instant messaging object. Optionally, the communication mode of the communication module 40 may be 5G, wiFi or a wireless or wired communication mode such as bluetooth. The instant messaging object of this embodiment may be other naked-eye 3D instant messaging devices 100 or ordinary 2D instant messaging devices.

As can be seen from fig. 1, the naked-eye 3D instant messaging device 100 of the present embodiment may further include a holder kit 50, and the naked- eye 3D display 10, the video module 20, the audio module 30, and the communication module 40 are disposed on the holder kit 50 to form a complete set of devices. The holder kit 50 of the present embodiment fixes each of the above modules to face the user, for the user of the naked eye 3D instant messaging device 100 to take a self-timer; the video module 20 can be rotated by 0-180 degrees to support the user to take a photograph, and the holder kit 50 can be made of aluminum alloy, plastic, etc.

In the embodiment of the present invention, the video module 20 includes at least two cameras 21, and at least two cameras 21 are fixed around the naked eye 3D display 10 for collecting horizontal video data and/or vertical video data. As shown in fig. 2, each camera 21 is correspondingly provided with a rotating base 22, so that 360 ° rotation is realized through the rotating base 22; the video module 20 further includes a camera fixing support 23, the at least two cameras 21 are fixedly disposed on the camera fixing support 23 through the corresponding rotating bases 22, and the camera fixing support 23 provided with the at least two cameras 21 is disposed around the naked- eye 3D display 10. That is, the camera 21 is mounted on the rotating base 22, and then mounted on the camera fixing bracket 23 through the rotating base 22.

The embodiment of the utility model provides an in video module 20 include that at least two cameras 21 can have two kinds of setting modes: first, the at least two cameras 21 are arranged in parallel, and optical axes of the at least two cameras 21 are located on the same horizontal plane. Fig. 2 shows a real-time mode in which the video module 20 includes two cameras 21, and as can be seen from fig. 2, the two cameras 21 are placed in a horizontal direction, the optical axes of the cameras 21 are in a straight line in the horizontal direction, and the distance x between the optical axes of the two cameras 21 in the vertical direction is 0.1-6.5cm, preferably 0.5-3cm.

Secondly, the at least two cameras 21 are arranged in a staggered manner in the horizontal direction, and optical axes of the at least two cameras 21 form an optical axis distance in the horizontal direction; the optical axis distance y is 0.1-6.5 cm. As shown in fig. 3A to 3B, the two cameras 21 are vertically displaced, and the optical axes of the two cameras 21 have a pitch of 0.1 to 6.5cm, preferably 0.5 to 3cm. The rotating base 22 supports the adjusting camera 21 to rotate coaxially by 360 degrees, preferably 0 degree and 90 degrees, and supports horizontal video shooting and vertical video shooting. In practical applications, two paths of images shot by the two cameras 21 can be compressed by 50% in an equal proportion in the transverse direction and kept unchanged in the longitudinal direction, or compressed by 50% in an equal proportion in the longitudinal direction and kept unchanged in the mode direction, and combined into a path of video content in a left-right format or a top-bottom format.

In this embodiment, the controller is integrated with a naked eye 3D interleaving algorithm kit, so that the naked eye 3D interleaving algorithm kit is used to process the video data collected by the video module 20 to generate a naked eye 3D interleaved image. In this embodiment, the naked eye 3D interleaving algorithm kit may be a naked eye 3D interleaving algorithm SDK kit, which may be integrated with a controller disposed in the naked eye 3D display 10, and the naked eye 3D interleaving algorithm SDK kit may interleave a path of video content in a left-right format or a top-bottom format in real time into a matched naked eye 3D image based on a 3D design scheme of the naked eye 3D display 10.

In this embodiment, the naked- eye 3D display 10 further includes a plurality of display units 11 and a naked-eye 3D component 12 forming a certain included angle α with the display units 11 in the horizontal direction, and the plurality of display units 11 and the naked-eye 3D component 12 cooperatively display the naked-eye 3D interlaced image. The naked eye 3D part 12 includes a lenticular array, a slit grating array, or a microlens grating array.

Fig. 4A to 4C show the schematic diagram of the interlaced image according to the embodiment of the present invention, and this embodiment uses the lenticular lens as the naked eye 3D component 12 as an example, and it can be known from fig. 4A to 4C that the horizontal width of the lenticular lens structure is P, and the horizontal included angle between the adjacent connecting lines of the lenticular lens and the display unit 11 is α. The two cameras 21 are respectively a left camera and a right camera, the image collected by the left camera is image 1, the image collected by the right camera is image 2, the horizontal width of the lenticular structure is z, the z comprises n sub-pixels of the display unit 11, the n sub-pixels are divided into a left sub-pixel and a right sub-pixel in equal, the image 1 and the image 2 are respectively filled into the left sub-pixel and the right sub-pixel to finish naked eye 3D image interweaving, if the sub-pixels are respectively positioned between the left sub-pixel and the right sub-pixel or between adjacent lenticular structures, a scheme with a proportion larger than 50% is adopted to fill the corresponding images, and 50% is filled according to the left image preferentially.

As shown in fig. 1, the naked eye 3D instant messaging device 100 may further include an eyeball tracking module 60, where the eyeball tracking module 60 is configured to track positions of two eyes of an object used by the naked eye 3D instant messaging device 100 in real time and feed back the positions of the two eyes to the controller; the controller is further used for adjusting the naked eye 3D interlaced image in real time according to the positions of the two eyes of the user object by utilizing the naked eye 3D interlaced algorithm toolkit, so that the naked eye 3D interlaced image is matched with the positions of the two eyes of the user object. When the eyes of the person look in different directions, the eyes have slight changes, and these changes will generate features that can be extracted, and the eyeball tracking module 60 in this embodiment can extract these features by image capturing or scanning, so as to track the changes of the eyes in real time. The eyeball-tracking module 60 in this embodiment may be an infrared device or an image-capturing device.

The eyeball tracking module 60 can feed back the acquired positions of the eyes of the user to the controller, and the controller can adjust the interleaving algorithm in real time by using a naked eye 3D interleaving algorithm toolkit to enable the optimal 3D viewing position to be matched with the positions of the eyes of the user.

As shown in fig. 5A to 5B, the naked eye 3D interleaving algorithm respectively displays the left eye image L and the right eye image R based on the pixel points in the display module, when the eyeball tracking module 60 confirms that the eyeball position information of the viewer is shown in fig. 5A, the interleaving algorithm processes the pixel points to display the left eye image L and the left eye image R of fig. 5A to 5B, at this time, the left and right eye images projected by the naked eye 3D display 10 coincide with the positions of human eyes, the viewer can experience a correct 3D image, when the eyeball tracking module 60 confirms that the eyeball position information of the viewer is shown in fig. 5B, the left and right eye positions of the viewer change, the interleaving algorithm processes the pixel points to display the image to synchronously change into the content shown in fig. 5B, and then the image is projected to the left and right eyes of the viewer through the naked 3D display 10, and the viewer experiences the correct 3D image again.

The controller can play the processed naked eye 3D interlaced image in real time on the own party of the used object of the naked eye 3D instant messaging device 100 through the naked eye 3D display 10, or play the image in a single view window on the other party of the used object instant messaging, or play the image in picture on the two parties, or play the 2D image of the own party or the other party. Optionally, a switching button to be hidden is set on the playing window interface, which corresponds to the own side, the opposite side and the picture-in-picture display function respectively, the played 2D picture is a preferred left camera image, and 50% of horizontal direction pulling is performed to restore the original image, that is, the normal 2D picture. The 2D picture is to independently display a picture a or B picture, and set a function of shielding naked eye 3D interleaving algorithm SDK, preferably, full-screen picture is used for naked eye 3D display, and picture-in-picture is used for 2D display, as shown in fig. 6. Namely, when the own picture is displayed in a full screen mode, naked eye 3D display is performed, and when the opposite picture is displayed in a full screen mode, naked eye 3D display is performed.

When the naked eye 3D display 10 displays images, the two cameras 21 respectively capture 2D display images, the 2D display images may be horizontal display images or vertical display images, and the two images are transmitted to the video module 20 to be synthesized into a left-right format or a top-bottom format, and the horizontal and vertical images and the left-right format and the top-bottom format may be matched with each other, as shown in fig. 7 and 8. The 2D display pictures are subjected to transverse equal-proportion compression by 50% and longitudinal unchanged, and then transmitted to a naked eye 3D interlacing algorithm SDK, the two pictures are subjected to equal-proportion pull-up by 50%, naked eye 3D picture interlacing is completed based on 10 naked eye 3D display 3D design parameters, and then the pictures are displayed through a display device, as shown in figure 8.

In this embodiment, the naked eye 3D instant messaging device 100 is connected to a server via the messaging module 40; the server starts a main connection monitoring process and a cooperative connection monitoring process, and the communication module 40 in the naked eye 3D instant communication device 100 is connected with the main connection monitoring process of the server; when the naked eye 3D instant messaging device 100 needs to establish instant messaging with any instant messaging object, the communication module 40 is used to connect the cooperative connection interception process, and after the server sends a notification message to the instant messaging object through the cooperative connection interception process, the server establishes instant messaging connection with the instant messaging object. The server in this embodiment is a backend server associated with at least one naked eye 3D instant messaging device 100, and the server may cooperate with the naked eye 3D instant messaging device 100 to implement instant messaging or information transmission.

Optionally, the notification message sent by the server to the instant messaging object through the cooperative connection interception process carries a first IP address and a first port number of the naked eye 3D instant messaging device 100, so that the instant messaging object sends a connection request to the naked eye 3D instant messaging device 100 by using the first IP address and the first port number; when the naked eye 3D instant messaging device 100 receives the connection request of the instant messaging object, the source IP address and the source port number of the instant messaging object are recorded. Namely, the instant messaging object is assisted by the server to realize hole punching to the naked eye 3D instant messaging device 100.

The naked eye 3D instant messaging device 100 is further configured to receive a second IP address and a second port number of the instant messaging object sent by the server, so as to establish an instant messaging connection with the instant messaging object by using the second IP address and the second port number; the second IP address and the second port number are sent after the server receives a ready-to-send notification that the instant messaging object is synchronized to a main connection listening process of the server when sending a connection request to the naked eye 3D instant messaging device 100.

The naked eye 3D instant messaging device 100 provided by the embodiment not only can effectively make the picture seen and shown by the user object have a stereoscopic effect by arranging the naked eye 3D display 10, but also integrates and arranges a naked eye 3D interleaving algorithm toolkit in the controller of the naked eye 3D display 10, carries out real-time interleaving into a matched naked eye 3D image based on the 3D design scheme of the naked eye 3D display 10, and carries out adaptation adjustment according to the positions of the two eyes of the user object, so as to provide the user object with an image having a stereoscopic effect and a sense of reality.

The embodiment of the utility model provides a bore hole 3D instant messaging system is still provided, as shown in fig. 9, bore hole 3D instant messaging system can include bore hole 3D instant messaging equipment 100 and server 200 of two at least above-mentioned embodiments; each naked eye 3D instant messaging device 100 is in communication connection with the server 200, so that multi-user real-time naked eye 3D instant messaging and interaction are achieved through the server 200. The connection mode of each naked eye 3D instant messaging device 100 is described in detail below.

In this embodiment, the public network server is defined as a server S, the intranet naked eye 3D instant messaging device a is defined as a client a, the client a router is defined as NAT-a, the intranet naked eye 3D instant messaging device B is defined as a client B, and the client B router is defined as NAT-B. The intranet client A and the intranet client B both adopt the naked eye 3D instant messaging equipment of the embodiment.

S1, a server S starts two network interception processes, one is a main connection interception process, the other is a cooperative connection interception process, and the interception is assisted in hole punching.

And S2, the client A and the client B are respectively in contact with the main connection interception process of the S.

And S3, when the client A needs to establish direct TCP connection with the client B, firstly connecting a port corresponding to the cooperative connection interception process of the server S, and sending an assisted connection application. While snooping is initiated on that port number. Note that since the binding is to different sockets on the same network terminal, the SO _ REUSEADDR attribute must be set for these sockets (i.e. reuse is allowed) otherwise the listening will fail.

And S4, after receiving the application of the client A, the cooperative connection interception process of the server S informs the client B through the main connection interception process, and informs the client B of information such as a first public network IP address, a first port number and the like of the client A after NAT-A conversion.

And S5, after receiving the connection notification of the server S, the client B is firstly connected with the cooperative connection interception process port of the server S, and is immediately disconnected after randomly sending some data, so that the server S can acquire the second public network IP and the second port number of the client B after NAT-B conversion.

S6, the client B tries to connect with the first public network IP address and the first port of the client A after NAT-A conversion. Depending on the result of the router, some routers (e.g. TPLink R402) can establish a connection in this operation (most routers directly discard the SYN request packet without self-arrival to cause a connection failure, but NAT-a records the source address and source port number of this connection, and prepares for the next real connection, which is called hole punching, i.e. client B punches a hole in client a, and next client a can directly connect to the port number that client B just used.

And S7, starting interception on the same port while the client B punches a hole. After all the client B is ready, replying a message that I is ready through a main connection interception process with the server S, and after receiving the message, the server S tells the client A the public network IP and the port number of the client B after NAT-B conversion.

S8, after receiving the information such as the public network IP and the port number of the client B replied by the server S, the client A starts to be connected to the public network IP and the port number of the client B, and because the client B tries to connect the public network IP address and the port of the client A in S6, the NAT-A records the information of the connection, when the client A actively connects the client B, the NAT-B considers the legal SYN data and allows the data to pass through, so that the direct TCP connection is established.

After the client A and the client B establish the TCP connection, naked eye 3D instant communication can be realized by combining naked eye 3D displays and other components of respective equipment ends.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments can be modified or some or all of the technical features can be equivalently replaced within the spirit and principles of the present invention; such modifications and substitutions do not depart from the scope of the present invention.

Claims (10)

1. A naked eye 3D instant messaging device, comprising: the system comprises a naked eye 3D display, and a video module, an audio module and a communication module which are connected with the naked eye 3D display;

the naked eye 3D display has a naked eye 3D display function, the naked eye 3D display is provided with a controller for controlling the naked eye 3D instant communication equipment to work, and the video module, the audio module and the communication module are all connected with the controller; the video module is used for collecting video data of an environment where the video module is deployed; the audio module is used for collecting audio data of the environment where the audio module belongs and/or is controlled by the controller to play the audio data;

the naked eye 3D instant messaging equipment establishes communication connection with at least one instant messaging object through the communication module, so that video data acquired by the video module and audio data acquired by the audio module are transmitted to the at least one instant messaging object in real time through the communication connection, and naked eye 3D instant messaging with the at least one instant messaging object is realized;

the video module comprises at least two cameras, and the at least two cameras are fixed around the naked eye 3D display and used for acquiring transverse video data and/or vertical video data; each camera is correspondingly provided with a rotating base so as to realize 360-degree rotation through the rotating base.

2. Naked-eye 3D instant messaging device according to claim 1,

the at least two cameras are arranged in parallel, and optical axes of the at least two cameras are positioned on the same horizontal plane; or the like, or, alternatively,

the at least two cameras are arranged in a staggered mode in the horizontal direction, and optical axes of the at least two cameras form an optical axis distance in the horizontal direction.

3. The naked eye 3D instant messaging device according to claim 2, wherein the optical axis distance is 0.1 to 6.5cm.

4. Naked-eye 3D instant messaging device according to claim 1,

the naked eye 3D displayer further comprises a plurality of display units and a naked eye 3D component which forms a certain included angle with the display units in the horizontal direction, and the display units and the naked eye 3D component cooperatively display the video data collected by the video module to be processed to generate a naked eye 3D interlaced image.

5. The naked eye 3D instant messaging device according to claim 4, wherein the naked eye 3D component comprises a lenticular array, a slit grating array, or a microlens grating array.

6. The naked eye 3D instant messaging device according to claim 4, further comprising an eye tracking module communicatively connected to the controller;

the eyeball tracking module is used for tracking the positions of the two eyes of the naked eye 3D instant communication equipment using object in real time, feeding the positions of the two eyes back to the controller, and the controller adjusts the naked eye 3D interlaced image in real time so that the naked eye 3D interlaced image is matched with the positions of the two eyes of the using object.

7. The naked eye 3D instant messaging device according to claim 6, wherein the eyeball tracking module comprises an infrared device or an image acquisition device.

8. Naked eye 3D instant messaging device according to any of the claims 1-7,

the video module, the audio frequency module with the communication module passes through the USB interface, type-c interface and/or HDMI interface with bore hole 3D display is connected.

9. Naked eye 3D instant messaging device according to any of the claims 1-7,

the naked eye 3D display comprises a mobile phone, a flat panel, a notebook, a display, a television and/or a splicing wall with the naked eye 3D display function.

10. The naked eye 3D instant messaging device according to any one of claims 1 to 7, further comprising a cradle kit on which the naked eye 3D display, the video module, the audio module and the communication module are disposed.

Images