TWM650161U - Autostereoscopic 3d reality system - Google Patents

Abstract

(無)

Description

Naked vision 3D reality system

The present invention relates to a reality system, and in particular to a naked-view three-dimensional reality system.

Virtual Reality (VR) and Augmented Reality (AR) provide users with various scene experiences in the form of three-dimensional simulations. Generally, users wear head-mounted devices to experience real-life situations. In addition to the trouble of wearing them, the user's line of sight will also be completely covered by the display screen of the head-mounted device, making it difficult to detect emergencies in the surrounding environment.

In view of this, there is currently a lack of a three-dimensional reality system on the market that can replace wearable devices and provide users with a real-world experience, so relevant industries are looking for solutions.

The purpose of the present invention is to provide a naked-view three-dimensional reality system that can replace general reality wearable devices and provide users with a real-world experience.

According to one embodiment of the structural aspect of the present invention, a naked-eye three-dimensional reality system is provided for obtaining a three-dimensional virtual object of a plurality of objects. The naked-eye three-dimensional reality system includes at least one image capturing device, a processing device and at least one display device. At least one image capturing device is used to capture a detection image of each object. The processing device is signal-connected to at least one image capture device and includes at least one artificial intelligence module, one spatial logic operation module and at least one three-dimensional rendering module. At least one artificial intelligence module is used to identify and segment the detection image according to a recognition rule to generate image object information. The spatial logic operation module is connected to at least one artificial intelligence module and includes an image space positioning operation unit and a full-space logic operation unit. The image space positioning computing unit obtains image object information and performs three-dimensional space positioning to generate positioning data of each object in a virtual space. The full-space logical operation unit is connected to the image space positioning operation unit. The full-space logical operation unit obtains the image object information and positioning data, and performs a spatial logical operation on the image object information and positioning data according to the complex algorithm to generate a space between each object. A position relationship and a movement relationship in the virtual space. At least one three-dimensional rendering module is connected to the spatial logic operation module to obtain positional relationships and movement relationships to draw three-dimensional virtual objects corresponding to each object. At least one display device signal is connected to the processing device to obtain and display the three-dimensional virtual object.

Other examples of the aforementioned implementation are as follows: the recognition rule includes a plurality of defined objects, and at least one artificial intelligence module integrates the detected image and each defined object to generate image object information.

Other examples of the aforementioned implementation are as follows: the image object information includes a three-dimensional coordinate corresponding to each object at a viewing angle.

Other examples of the aforementioned implementation are as follows: the spatial logic operation module further includes an image database. The image database is connected to the image space positioning computing unit, and the image database is used to store multiple historical image objects. Among them, the image space positioning calculation unit integrates the image object information and each historical image object to generate positioning data, and stores the image object information and positioning data to the image database to update the image database.

Other examples of the aforementioned implementation are as follows: the spatial logic operation module further includes a scene database. The scene database is connected to the full-space logical operation unit, and the scene database is used to store multiple defined scenes. Among them, the full-space logical operation unit applies one of the defined scenes to the virtual space and performs spatial logical operations to generate the positional relationship of each object in the virtual space.

Other examples of the aforementioned implementation are as follows: the naked-eye three-dimensional reality system further includes at least one algorithm module connected to the spatial logic operation module to store each algorithm. Among them, the full-space logical operation unit obtains each algorithm, and operates on the position relationship based on each algorithm to obtain the movement relationship.

Other examples of the foregoing implementation are as follows: the movement relationship includes a continuous state of interaction between objects.

Other examples of the aforementioned implementation are as follows: the spatial logic operation module further includes a load balancing unit. The load balancing unit is connected to the spatial logic operation module and at least one three-dimensional rendering module, and is used to correspondingly allocate the position relationship and movement relationship of each object according to the workload of the at least one three-dimensional rendering module.

In this way, the present invention captures object images through an image capture device, and cooperates with a processing device to perform spatial logic operations to obtain corresponding three-dimensional virtual objects. It can interact with other three-dimensional virtual objects in the virtual space and perform real-world operations.

Several embodiments of the present invention will be described below with reference to the drawings. For the sake of clarity, many practical details will be explained together in the following narrative. However, it should be understood that these practical details should not be used to limit the invention. That is to say, in some embodiments of the present invention, these practical details are not necessary. In addition, for the sake of simplifying the drawings, some commonly used structures and components are shown in the drawings in a simple schematic manner; and repeated components may be represented by the same numbers.

In addition, when a certain component (or unit or module, etc.) is "connected" to another component in this article, it may mean that the component is directly connected to the other component, or it may mean that one component is indirectly connected to the other component. , meaning that there are other elements between the said element and another element. When it is stated that an element is "directly connected" to another element, it means that no other elements are interposed between the element and the other element. The terms first, second, third, etc. are only used to describe different components without limiting the components themselves. Therefore, the first component can also be renamed the second component. Moreover, the combination of components/units/circuit in this article is not a combination that is generally known, conventional or customary in this field. Whether the component/unit/circuit itself is common knowledge cannot be used to determine whether its combination relationship is easily recognized by those in the technical field. Easily accomplished by the average person with knowledge.

Referring to Figures 1 to 4, Figure 1 is a schematic diagram of the naked-eye three-dimensional reality system 100 according to the first embodiment of the present invention; Figure 2 is a schematic diagram of the processing device 120 in Figure 1. ; Figure 3 is a block diagram illustrating the steps of a method 200 for providing naked-eye three-dimensional reality according to the second embodiment of the present invention; Figure 4 is a usage scenario according to the naked-eye three-dimensional reality system 100 in Figure 1 Schematic diagram. The naked-eye three-dimensional reality system 100 is configured to implement the method 200 for providing naked-eye three-dimensional reality, and is used to obtain a three-dimensional virtual object 2 of a plurality of objects 1, and perform reality operations in a virtual space S through the three-dimensional virtual object 2 . It must be noted that the method 200 of the present invention for providing a naked-eye three-dimensional reality is not limited to being implemented through the naked-eye three-dimensional reality system 100 of the present invention. The naked-eye three-dimensional reality system 100 includes at least one image capture device 110, a processing device 120 and at least one display device 130. The processing device 120 is connected to the image capture device 110 and the display device 130 via signals. In the first embodiment, the processing device 120, the image capture device 110 and the display device 130 can be connected through a wired physical connection or a wireless network device, but the present invention is not limited to this. In other embodiments, the image capturing device 110, the processing device 120 and the display device 130 can be integrated into one machine for user operation.

The image capturing device 110 is used to capture a detection image of the object 1 , the processing device 120 is used to generate a three-dimensional virtual object 2 corresponding to the object 1 , and the display device 130 is used to display the three-dimensional virtual object 2 . Among them, object 1 can be the user's whole body, face or limbs. In the first embodiment, the image capturing device 110 is a camera or video camera with multiple heights and directions; the processing device 120 can be a processor (Processor), a microprocessor (Microprocessor), or a Central Processing Unit (CPU) ), computer, mobile device processor, cloud processor or other electronic computing processor; the display device 130 can be a display screen of a terminal device such as a computer, mobile phone, tablet computer, etc., or it can be equipped with a single-sided or light-transmissive double-sided projection. A projector with a curtain, but the present invention is not limited to this.

The processing device 120 includes at least one artificial intelligence module 121, at least one algorithm module 122, a spatial logic operation module 123, and at least one three-dimensional rendering module 124. The spatial logic operation module 123 connects the artificial intelligence module 121, the algorithm module 122 and the three-dimensional rendering module 124. The artificial intelligence module 121 is used to identify and segment the detection image according to a recognition rule to generate image object information. Among them, the recognition rules include a plurality of defined objects, and the artificial intelligence module 121 integrates the detected images and the defined objects to generate image object information. Specifically, the defined objects are the characteristics of Object 1 (such as a human face), or the behaviors and actions performed by Object 1 (such as facial movements, body movements, or gestures). As shown in Figure 4, the image object information includes a three-dimensional coordinate corresponding to each object 1 at a viewing angle. Accordingly, when users at different locations view the same three-dimensional virtual object 2 in the virtual space S, they will view the same three-dimensional virtual object 2 according to their respective The three-dimensional coordinates where it is located have corresponding viewing angles. The algorithm module 122 is used to store complex number algorithms, and provides the spatial logic operation module 123 to read the algorithms and perform spatial operations. The spatial logic operation module 123 is used to perform three-dimensional spatial positioning and spatial logic operations on the image object information to generate a positional relationship and a movement relationship between the objects 1 in the virtual space S. The three-dimensional rendering module 124 is used to draw the three-dimensional virtual objects 2 corresponding to each object according to the position relationship and the movement relationship, and display the three-dimensional virtual objects 2 through the display device 130 after superimposing the three-dimensional virtual objects 2 .

The spatial logic operation module 123 includes an image space positioning operation unit 1231, an image database 1232, a full space logic operation unit 1233, a scene database 1234 and a load balancing unit 1235. The image space positioning operation unit 1231 is connected to the image database 1232 and the full-space logical operation unit 1233. The image database 1232 is connected to the load balancing unit 1235. The full-space logical operation unit 1233 is connected to the scene database 1234 and the load balancing unit 1235. The image space positioning calculation unit 1231 obtains image object information and performs three-dimensional space positioning to generate positioning data of each object 1 in the virtual space S. The image database 1232 is used to store a plurality of historical image objects. The image space positioning calculation unit 1231 integrates the image object information and each historical image object to generate positioning data, and stores the image object information and positioning data to the image database 1232 to update the image. Database 1232. The full-space logical operation unit 1233 obtains the image object information and positioning data, and obtains a complex algorithm from the algorithm module 122 to perform a spatial logical operation on the image object information and positioning data according to the algorithm to generate a relationship between each object 1 location relationship and movement relationship. Among them, the movement relationship is obtained by the full-space logical operation unit 1233 operating on the position relationship according to each algorithm. The movement relationship includes a continuous state of interaction between objects 1 . The scene database 1234 is used to store a plurality of defined scenes. The full-space logical operation unit 1233 applies one of the defined scenes to the virtual space S and performs spatial logical operations to generate the positional relationship of each object 1 in the virtual space S. The load balancing unit 1235 is used to correspondingly allocate the position relationship and movement relationship of each object 1 to the three-dimensional rendering module 124 for rendering according to the workload of the three-dimensional rendering module 124, so as to achieve optimal resource usage. Among them, when the image space positioning calculation unit 1231 determines that the image object information contains existing image objects, it can provide the corresponding historical image objects in the image database 1232 to the three-dimensional rendering module 124 through the load balancing unit 1235 to accelerate three-dimensional rendering. Homework.

Referring to FIGS. 1 to 5 , FIG. 5 is a step flow chart illustrating the method 200 for providing naked-eye three-dimensional reality in FIG. 3 . The method 200 for providing naked-eye three-dimensional reality includes sequentially executing an image capturing step S10, an image processing step S20, and a displaying step S30. The image capturing step S10 includes driving the image capturing device 110 to capture the detection image of the object 1 . The image processing step S20 includes a recognition step S21 and a calculation step S22. The recognition step S21 includes driving the artificial intelligence module 121 to recognize and cut the detection image according to the recognition rules to generate image object information. The operation step S22 includes driving the processing device 120 to generate a three-dimensional virtual object 2 corresponding to the object 1 based on the image object information. The display step S30 includes driving the display device 130 to obtain and display the three-dimensional virtual object 2 .

Specifically, the operation step S22 includes a positioning operation step S221, a logic operation step S222, a load balancing step S223 and a three-dimensional rendering step S224. The positioning operation step S221 includes driving the image space positioning operation unit 1231 to obtain image object information and perform three-dimensional space positioning to generate positioning data of each object 1 in the virtual space S. The positioning operation step S221 further includes driving the image space positioning operation unit 1231 to integrate the image object information and each historical image object to generate positioning data, and store the image object information and positioning data into the image database 1232 to update the image database 1232. The logical operation step S222 includes driving the full-space logical operation unit 1233 to obtain the image object information and positioning data, applying one of the defined scenes in the scene database 1234 to the virtual space S and performing spatial logical operations to obtain the positional relationship, and based on the algorithm model Each algorithm of the group 122 operates on the positional relationship and obtains the movement relationship. The load balancing step S223 includes driving the load balancing unit 1235 to allocate the position relationship and movement relationship corresponding to each object 1 according to the workload of the three-dimensional rendering module 124 . The three-dimensional rendering step S224 includes driving the three-dimensional rendering module 124 to obtain the position relationship and the movement relationship to draw the three-dimensional virtual object 2 corresponding to each object 1.

As can be seen from the above embodiments, the novel naked-view 3D reality system and the method for providing naked-eye 3D reality have the following advantages: First, the object image is captured through an image capture device, and the processing device is used to perform spatial logic operations to obtain the image. The corresponding three-dimensional virtual objects can interact with other three-dimensional virtual objects in the virtual space and perform real-world operations; secondly, the load balancing unit allocates the corresponding position relationship of each object according to the workload of the three-dimensional rendering module and Moving the relationship to draw the 3D rendering module can optimize the use of resources and speed up the drawing work of the 3D rendering module.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The scope of protection of the present invention shall be determined by the appended patent application scope.

1:Object 2: Three-dimensional virtual objects 100: Naked vision 3D reality system 110:Image capture device 120: Processing device 121:Artificial intelligence module 122: Algorithm module 123: Spatial logic operation module 1231: Image space positioning operation unit 1232:Image database 1233: Full space logic operation unit 1234: Scene database 1235:Load balancing unit 124: 3D rendering module 130:Display device 200: A method to provide naked vision three-dimensional reality S: virtual space S10: Image capture steps S20: Image processing steps S21: Identification steps S22: Operation steps S221: Positioning operation steps S222: Logical operation steps S223: Load balancing steps S224: Three-dimensional drawing steps S30: Display steps

Figure 1 is a schematic diagram of a naked-eye three-dimensional reality system according to the first embodiment of the present invention; Figure 2 is a schematic diagram of a processing device according to Figure 1; Figure 3 is a block diagram illustrating the steps of a method for providing naked-eye three-dimensional reality according to the second embodiment of the present invention; Figure 4 is a schematic diagram illustrating the usage scenario of the naked-eye three-dimensional reality system in Figure 1; and FIG. 5 is a step flow chart illustrating the method of providing naked-eye three-dimensional reality according to FIG. 3 .

100: Naked vision 3D reality system

110:Image capture device

120: Processing device

121:Artificial intelligence module

122: Algorithm module

123: Spatial logic operation module

124: 3D rendering module

130:Display device

Claims (8)

A naked-view three-dimensional reality system used to obtain a three-dimensional virtual object of a plurality of objects. The naked-eye three-dimensional reality system includes: At least one image capture device for capturing one detection image of each object; A processing device, the signal is connected to the at least one image capture device, and includes: At least one artificial intelligence module is used to identify and segment the detection image according to a recognition rule to generate image object information; A spatial logic operation module is connected to the at least one artificial intelligence module and includes: An image space positioning computing unit obtains the image object information and performs three-dimensional space positioning to generate positioning data of each object in a virtual space; and A full-space logical operation unit is connected to the image space positioning operation unit. The full-space logical operation unit obtains the image object information and the positioning data, and performs a spatial logical operation on the image object information and the positioning data according to a complex algorithm. , to generate a positional relationship and a movement relationship between the objects in the virtual space; and At least one three-dimensional rendering module is connected to the spatial logic operation module to obtain the position relationship and the movement relationship to draw the three-dimensional virtual object corresponding to each object; and At least one display device is connected to the processing device with signals to obtain and display the three-dimensional virtual object. The naked-eye three-dimensional reality system described in claim 1, wherein the recognition rule includes a plurality of defined objects, and the at least one artificial intelligence module integrates the detection image and the defined objects to generate the image object information. The naked-eye three-dimensional reality system as described in claim 2, wherein the image object information includes a three-dimensional coordinate corresponding to each object at a viewing angle. The naked-eye three-dimensional reality system as described in claim 1, wherein the spatial logic operation module further includes: An image database is connected to the image space positioning computing unit, and the image database is used to store a plurality of historical image objects; Among them, the image space positioning calculation unit integrates the image object information and each historical image object to generate the positioning data, and stores the image object information and the positioning data into the image database to update the image database. The naked-eye three-dimensional reality system as described in claim 1, wherein the spatial logic operation module further includes: A scene database connected to the full-space logical operation unit. The scene database is used to store a plurality of defined scenes; Among them, the full-space logical operation unit applies one of the defined scenes to the virtual space and performs the spatial logical operation to generate the positional relationship of each object in the virtual space. The naked-eye three-dimensional reality system as described in request item 1 further includes: At least one algorithm module is connected to the spatial logic operation module to store each algorithm; Among them, the full-space logical operation unit obtains each of the algorithms, and performs operations on the position relationship according to each of the algorithms to obtain the movement relationship. The naked-eye three-dimensional reality system as described in claim 6, wherein the movement relationship includes a continuous state of interaction between the objects. The naked-eye three-dimensional reality system as described in claim 1, wherein the spatial logic operation module further includes: A load balancing unit connects the spatial logic operation module and the at least one three-dimensional rendering module, and is used to correspondingly allocate the position relationship and the movement corresponding to each object according to the workload of the at least one three-dimensional rendering module. relation.

Images