TW202247105A - System, apparatus and method for presenting stereoscopic image - Google Patents

Abstract

A system, an apparatus and a method for presenting a stereoscopic image are provided. An image presentation apparatus receives a captured picture from an image capture device and sends the captured picture to a server. The server recognizes a special pattern in the captured picture, searches for logo data that matches the special pattern, and extracts three-dimensional image data corresponding to the logo data. Afterwards, the server provides the three-dimensional image data to a display of the image presentation apparatus.

Description

Stereoscopic image presentation system, device and method

The present invention relates to an image display architecture, and in particular to a stereoscopic image presentation system, device and method.

In the previous technology, the simulation technology of the sales side on the electronic platform for the product catalog generally uses two-dimensional images for plane presentation, and cannot provide a 360-degree dynamic appearance that is close to the actual appearance. Accordingly, consumers It is only possible to speculate on the overall appearance of the product based on the results presented in a single direction, which makes it difficult to create the value of the product.

The present invention provides a three-dimensional image presentation system, image presentation device and method, which uses three-dimensional image files to simulate the display appearance of physical goods, and then achieves the effect of sales and rapid ordering by target customers.

The stereoscopic image presentation system of the present invention includes: a server and an image presentation device. The server includes a first storage device, a first connection device and a first processor, wherein the first storage device stores an object database and a logo database, and the first processor is coupled to the first storage device and the first connection device. The image presentation device includes: a display, an image capture device, a second connection device and a second processor, wherein the second processor is coupled to the display, the image capture device and the second connection device. The second processor is configured to: receive the photographed picture from the image capture device, send the photographed picture to the server through the second connection device, so as to provide the three-dimensional image file data received from the server to the display. The first processor is configured to: receive the photographed picture from the image presentation device via the first connection device, identify the special pattern in the photographed picture, search the logo data matching the special pattern from the logo database, and automatically The 3D graphic file data corresponding to the logo data is retrieved from the object database.

In an embodiment of the present invention, the first processor is configured to: create a three-dimensional image file of the object based on a plurality of images corresponding to the object, wherein the images are taken from different angles.

In an embodiment of the present invention, the first processor is configured to: receive identity verification data from the image presentation device via the first connection device; obtain the consumption type according to the identity verification data; and obtain the identification data Afterwards, according to the consumption pattern, the three-dimensional image data corresponding to one or more objects corresponding to the symbol data and conforming to the consumption pattern are retrieved from the object database.

In an embodiment of the present invention, the second processor is configured to: display a user interface on a display; provide the interface data received from the server to the display to display the interface data on the user interface, and receiving an operation instruction through the user interface; and based on the operation instruction, sending a corresponding notification instruction to the server, so as to receive another 3D dynamic graphic file from the server.

The image presentation device of the present invention includes: a display, an image capture device, a connection device and a processor. The processor is coupled to the display, the image capture device and the connection device. The processor is configured to: receive the photographed picture from the image capture device, send the photographed picture to the server through the connection device, so as to provide the three-dimensional image file data received from the server to the display.

In one embodiment of the present invention, the processor is configured to: display a user interface on a display; provide the interface data received from the server to the display to display the interface data on the user interface, and through The user interface receives an operation instruction; and based on the operation instruction, sends a corresponding notification instruction to the server, so as to receive another 3D dynamic image file from the server.

The stereoscopic image presentation method of the present invention includes: receiving the photographed picture from the image capture device through the image presentation device, and sending the photographed picture to the server; identifying the special pattern in the photographed picture through the server; The pattern matches the logo data, and according to the logo data, the three-dimensional image file data corresponding to the logo data is obtained; and the three-dimensional image file data is provided to the display through the server, wherein the image presentation device includes the display.

Based on the above, by photographing the special pattern and sending the photographed picture to the server in the cloud, the three-dimensional image file data corresponding to the special pattern is obtained and displayed. Accordingly, the appearance of the actual display of the object is simulated by using the three-dimensional image file data, thereby achieving the effect of sales and rapid ordering by target customers.

FIG. 1 is a block diagram of a stereoscopic image presentation system according to an embodiment of the invention. Referring to FIG. 1 , the stereoscopic image presentation system 100 includes a server 110 and an image presentation device 120 . The server 110 communicates with the image presentation device 120 through the Internet 130 .

The server 110 includes a first storage device 111 , a first connection device 113 and a first processor 115 . The first processor 115 is coupled to the first storage device 111 and the first connection device 113 . The image presentation device 120 includes a second storage device 121 , a second connection device 123 , a second processor 125 , a display 127 and an image capture device 129 . The second processor 125 is coupled to the second storage device 121 , the second connection device 123 , the display 127 and the image capture device 129 . Application programs for the image presentation system 100 are stored in the second storage device 121 .

The first processor 115 and the second processor 125 may be hardware (such as chipsets, processors, etc.), software components (such as operating systems, application programs, etc.) with computing and processing capabilities, or a combination of hardware and software components. . The image processor 110 is, for example, a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), or other programmable microprocessor (Microprocessor), digital signal processor (Digital Signal Processor) , DSP), Programmable Controller, Application Specific Integrated Circuits (Application Specific Integrated Circuits, ASIC), Programmable Logic Device (Programmable Logic Device, PLD) or other similar devices.

The first storage device 111 and the second storage device 121 are, for example, any type of fixed or removable random access memory, read-only memory, flash memory, secure digital card, hard disk or other similar devices or these combination of devices. A plurality of program code segments are stored in the first storage device 111 , and the above program code segments are executed by the first processor 115 after being installed. A plurality of program code segments are stored in the second storage device 121 , and the above program code segments are executed by the second processor 125 after being installed.

The first connection device 113 and the second connection device 123 are, for example, network cards, WiFi chips, mobile communication chips and the like. The display 127 is an output device for displaying images and colors. The image capturing device 129 is, for example, a video camera or a camera using a charge coupled device (CCD) lens, a complementary metal oxide semiconductor transistors (CMOS) lens, or the like.

In the server 110, the first storage device 111 stores an object database and a logo database. The object database stores at least one object's three-dimensional image file data corresponding to different mark data. The logo database includes logo data corresponding to multiple product suppliers. The logo data is, for example, graphic data corresponding to the product supplier's trademark.

In addition, in the server 110, the 3D graphic file data can also be created in advance through the first processor 115. For example, the product supplier provides multiple images of various objects shot at different angles (for example: 60-degree angle, 120-degree angle, 180-degree angle, 240-degree angle, 300-degree angle, 360-degree angle) to the server 110 . The first processor 115 of the server 110 constructs three-dimensional image data corresponding to various objects based on these images, and the three-dimensional image data can be used to simulate the dynamic stereoscopic effect of objects at an angle of 0-360 degrees.

Fig. 2 is a schematic diagram of 3D reconstruction according to an embodiment of the present invention. In this embodiment, a Neural Radiance Field (NeRF) algorithm is used to reconstruct the 3D image file 200 based on a plurality of 2D images 201 - 1 - 201 -N.

In addition, the first processor 115 can also receive identity verification data from the image presentation device 120 via the first connection device 113 , so as to establish a consumption pattern related to the identity verification data. For example, the server 110 will record the operations corresponding to the identity verification data, so as to analyze the consumption habits of different users, and then obtain the consumption pattern corresponding to each user (identity verification data). The first processor 115 can use the Persona model to describe consumption preferences and habitual consumption characteristic data, and through industry classification and association links with multiple business data, it can summarize multiple life styles, consumption behaviors, and business opportunities. and other data, so as to obtain the consumption patterns of different users.

FIG. 3 is a flowchart of a stereoscopic image presentation method according to an embodiment of the invention. 4A-4F are schematic diagrams of an messenger interface for stereoscopic image presentation according to an embodiment of the present invention. In this embodiment, the image presentation device 120 is, for example, a smart phone. The user can install the application program corresponding to the stereoscopic image presentation system 100 in the image presentation device 120. When the application program is activated, the second processor 125 of the image presentation device 120 will drive the image capture device 129 together, The real-time display screen 410 of the image capture device 129 is displayed on the display 127 , and a user interface 420 is provided to the display 127 by the application program. Here, the user interface 420 is superimposed on the real-time display screen 410 .

The second processor 125 implements steps S305-S320 by executing the application program. In step S305 , the captured picture is received from the image capturing device 129 through the image presentation device 120 , and the captured picture is sent to the server 110 . As shown in FIG. 4A , when the user activates the application program of the image presentation device 120 , the real-time display screen 410 is displayed on the display 127 , and the user interface 420 is superimposed on the real-time display screen 410 . At this moment, the user interface 420 in FIG. 4A has no interface data yet. The user activates the image capture device 129 to take pictures of the mark M (special pattern) to obtain a picture. In this way, there is a special pattern in the captured picture. Afterwards, the image presentation device 120 transmits the captured picture to the server 110 via the Internet 130 for identification.

Next, in step S310 , through the server 110 , identify the special pattern in the photographed picture. Moreover, in step S315, the server 110 is used to search for logo data matching the special pattern, and according to the logo data, the 3D graphic file data corresponding to the logo data is retrieved. Afterwards, in step S320 , the server 110 provides the 3D graphic file data to the display 127 .

After receiving the photographed picture, the server 110 uses feature recognition to find out the special pattern (mark M shown in FIG. 4A ) in the photographed picture, and compares it with the logo data stored in the logo database. When the mark data "QUEEN SHOP" that matches the mark M (special pattern) shown in Figure 4A exists in the mark database, take out the corresponding mark data "QUEEN SHOP" from the object database of the first storage device 111 The three-dimensional image data 430 of the image is provided to the display 127, as shown in FIG. 4B. The 3D image file data 430 is, for example, a default display, or it may be set for consumption patterns.

For example, the server 110 receives identity verification information from the image presentation device 120 via the first connection device 113 . The first processor 115 obtains the consumption type according to the identity verification information. Moreover, after obtaining the logo data, the first processor 115 fetches the 3D image file data 430 corresponding to the logo data and corresponding to the object of consumption type from the object database. In this embodiment, only the 3D image data 430 corresponding to one object is retrieved. However, in other embodiments, a plurality of three-dimensional graphic file data corresponding to a plurality of objects conforming to consumption patterns can also be retrieved.

Moreover, the server 110 further transmits the interface data 421 of the logo data “QUEEN SHOP” to the image presentation device 120 for displaying in the user interface 420 . In this embodiment, the interface data 421 includes a plurality of thumbnails corresponding to a plurality of objects. As shown in FIG. 4B , the user of the image presentation device 120 can receive an operation instruction through the user interface 420 and send a corresponding notification instruction to the server 110 .

For example, the user can select one of the multiple thumbnails in the interface data 421 , and then send a merged notification command to the server 110 based on the selected thumbnail. After receiving the notification command, the server 110 finds out another 3D dynamic image file corresponding to the notification command from the data set contained in the tag data "QUEEN SHOP" in the object database, and stores the other 3D dynamic graphic file The graphic file is transmitted to the image presentation device 120 and superimposed and displayed on the real-time display screen 410 .

In addition, as shown in FIG. 4C , the object information 440 of the 3D dynamic image file can be further displayed. For example, the user interface 420 also provides an option. After the user selects the option, the object information 440 of the 3D dynamic graphic file will be further superimposed on the real-time display screen 410 .

In addition, the user can also directly rotate the three-dimensional dynamic image file 430 on the real-time display screen 410 of the display 127 to present different angles, such as the three-dimensional dynamic image file 430' shown in FIG. 4D and the three-dimensional dynamic image file shown in FIG. 4E 430''. Moreover, if the displayed object is clothing, the clothing can also be applied to the human body model, such as the three-dimensional dynamic image file 450 shown in FIG. 4F .

To sum up, in the above-mentioned embodiments, the photographed pictures with special patterns are captured by the image capture device, so as to obtain and display the 3D image data corresponding to the special patterns. The 3D graphic file data can be further fused with the background, combined with the virtual portrait and displayed in the image display device. In addition, the 3D image can be moved or rotated to present an augmented reality effect. Accordingly, the actual appearance of the object is simulated through the three-dimensional image file data, so as to achieve the effect of sales and rapid ordering by target customers. Using image recognition in the server to do intelligent classification and grouping to target customers for retail sales and product interaction, combined with the application of marketing strategy tools, and the 3D image file data can be transmitted with the minimum amount of transmission, so that the image display device can quickly reflect A virtual dynamic stereoscopic image of the simulated object is presented. The 3D graphic file shows the whole picture of the object in 360 degrees. Compared with the traditional two-dimensional static catalog, it can increase the integrity of the product object display. The present disclosure constructs 3D image file data by using multiple images, which can further reduce the installation cost of hardware devices such as sensors. In addition, online simulation and order purchase methods are provided to improve product applicability.

100:Stereoscopic image presentation system 110: server 111: the first storage device 113: The first connection device 115: The first processor 120: Image presentation device 121: Second storage device 123: Second connection device 125: second processor 127: Display 129: Image capture device 130: Internet 200: 3D graphic files 201-1～201-N: Video 410: Immediate display screen 420: user interface 421: interface data 430, 430’, 430’’, 450: 3D graphic files 440: Object information S305～S320: steps of the stereoscopic image presentation method

FIG. 1 is a block diagram of a stereoscopic image presentation system according to an embodiment of the invention. Fig. 2 is a schematic diagram of 3D reconstruction according to an embodiment of the present invention. FIG. 3 is a flowchart of a stereoscopic image presentation method according to an embodiment of the invention. 4A-4F are schematic diagrams of an messenger interface for stereoscopic image presentation according to an embodiment of the present invention.

100:Stereoscopic image presentation system

110: server

111: the first storage device

113: The first connection device

115: the first processor 115

120: Image presentation device

121: Second storage device

123: Second connection device

125: second processor

127: Display

129: Image capture device

130: Internet

Claims (10)

A stereoscopic image presentation system, comprising: A server and an image presentation device, wherein The server includes: a first storage device, a first connection device and a first processor, wherein the first storage device stores an object database and a logo database, and the first processor is coupled to the the first storage device and the first connection device, The image presentation device includes: a display, an image capture device, a second connection device and a second processor, wherein the second processor is coupled to the display, the image capture device and the second connection device, Wherein, the second processor is configured to: receive a photographed picture from the image capture device, transmit the photographed picture to the server through the second connection device, and transfer the 3D image file data received from the server to provided to the display, The first processor is configured to: receive the photographed picture from the image presentation device via the first connection device, identify a special pattern in the photographed picture, and search for a pattern matching the special pattern from the logo database mark data, and fetch the 3D graphic file data corresponding to the mark data from the object database according to the mark data. The stereoscopic image presentation system as claimed in claim 1, wherein the first processor is configured to: Based on multiple images corresponding to an object, the three-dimensional image file data of the object is established, wherein the images are taken from different angles. The stereoscopic image presentation system as claimed in claim 1, wherein the first processor is configured to: receiving an identity verification data from the image presentation device via the first connection device; obtaining a consumption pattern according to the identity verification information; and After the logo data is obtained, the three-dimensional image file data corresponding to one or more objects corresponding to the logo data and conforming to the consumption pattern are fetched from the object database. The stereoscopic image presentation system as claimed in claim 1, wherein the second processor is configured to: displaying a user interface on the display; providing an interface data received from the server to the display for displaying the interface data in the user interface and receiving an operation instruction through the user interface; and Based on the operation instruction, a corresponding notification instruction is sent to the server to receive another 3D dynamic image file from the server. An image presentation device, comprising: a display; an image capture device; a wired device; and A processor, coupled to the display, the image capture device and the connection device, the processor is configured to: Receive a shot picture from the image capture device, send the shot picture to a server through the connection device, so as to provide the three-dimensional image file data received from the server to the display. The image presentation device as claimed in claim 5, wherein the processor is configured to: displaying a user interface on the display; providing an interface data received from the server to the display for displaying the interface data in the user interface and receiving an operation instruction through the user interface; and Based on the operation instruction, a corresponding notification instruction is sent to the server to receive another 3D dynamic image file from the server. A stereoscopic image presentation method, comprising: receiving a photographed picture from an image capture device through an image presentation device, and sending the photographed picture to a server; identifying a special pattern in the captured picture through the server; Search through the server for the logo data matching the special pattern, and retrieve the 3D image file data corresponding to the logo data according to the logo data; and The three-dimensional image file data is provided to a display through the server, wherein the image display device includes the display. The stereoscopic image presentation method as described in claim item 7, further comprising: Through the server, based on multiple images corresponding to an object, the three-dimensional image file data of the object is established, wherein the images are taken from different angles. The stereoscopic image presentation method as described in Claim 7, further comprising: before the step of receiving the photographed picture from the image capture device: sending an identity verification data to the server through the image presentation device; obtaining a consumption pattern by the server according to the identity verification data; and After obtaining the logo data, according to the consumption pattern, the server retrieves the corresponding three-dimensional image file data of one or more objects corresponding to the logo data and conforming to the consumption pattern. The stereoscopic image presentation method as described in claim 7, wherein the step of providing the three-dimensional image file data to the display through the server includes: providing an interface data and the 3D graphic file data to the display through the server for displaying the interface data in a user interface of the display; Wherein, the stereoscopic image presentation method further includes: receiving an operation instruction through the user interface; and Based on the operation instruction, a corresponding notification instruction is sent to the server to receive another 3D dynamic image file from the server.

Images