TWI799012B - Electronic apparatus and method for presenting three-dimensional space model - Google Patents

Abstract

An electronic apparatus and method for presenting three-dimensional space model are provided. The electronic apparatus includes a storage device and a processor. The storage device includes a database and a three-dimensional space model. The three-dimensional space model includes a plurality of positioning points, and the database includes a plurality of panoramas respectively corresponding to the positioning points. The processor is configured to: execute the three-dimensional space model; when detecting that a cursor click instruction acting on the three-dimensional space model; obtain a designated positioning point with the smallest distance from a click position corresponding to the cursor click instruction from the plurality of positioning points; obtain a designated panorama corresponding to the designated positioning point from the plurality of panoramas included in the database; and place the obtained panorama as a material into the three-dimensional space model to display on a display screen.

Description

Electronic device and method for presenting three-dimensional space model

The present invention relates to a technology for establishing a virtual space, and in particular to an electronic device and method for presenting a three-dimensional space model.

With the advancement of technology and the rise of the Internet, more and more websites are available for the public to obtain the information they need through Internet connections. In the era of innovation and change, the traditional method of photo browsing combined with text reading has been increasingly unable to meet the needs of the public. Therefore, the development of 3D navigation technology allows users to experience the experience of being in the scene by creating a realistic environment. feel. At present, there are roughly two mainstream technologies for webpage virtual reality, one of which is to use 360-degree environmental photography technology to create a virtual reality, and the other is to use 3D computer graphics software to create a 3D virtual scene.

However, the virtual reality webpage made with 360-degree environmental photography technology can only watch static images, and cannot move freely in the virtual space. However, the 3D virtual scene made with computer graphics software requires a relatively large amount of calculation because it has a large number of 3D models. Therefore, low-end terminals may not be able to open webpages smoothly.

The present invention provides an electronic device and method for presenting a three-dimensional space model, which can not only provide detailed and realistic images, but also ensure smooth operation on low-end terminals.

The electronic device for presenting a three-dimensional space model of the present invention includes: a storage device and a processor. The storage device includes a database and a three-dimensional space model. The three-dimensional space model includes a plurality of anchor points, and the database includes a plurality of surrounding view images respectively corresponding to the anchor points. The processor is coupled to the storage device and is configured to: execute the stereoscopic space model; when detecting a cursor operation instruction acting on the stereoscopic space model, obtain an operation position corresponding to the cursor operation instruction from the positioning points A designated anchor point with the smallest distance; fetching a designated surround view image corresponding to the designated anchor point from a plurality of surround view images included in the database; in the display screen.

In an embodiment of the present invention, an interaction position is reserved in the three-dimensional space model, and the storage device further includes an interactive component database. The interactive component database includes interactive components. The processor is configured to: set the interactive element at the interactive position of the three-dimensional space model; and when obtaining the designated positioning point corresponding to the operating position, calculate the relative position information between the designated positioning point and the interactive position, so as to base on the relative position information to adjust the rendering parameters of interactive components.

In an embodiment of the present invention, the processor is configured to: after the stereoscopic space model is executed and before the cursor operation command acting on the stereoscopic space model is detected, the preset surrounding scene corresponding to the preset position The image is placed in the three-dimensional space as a material model and display it on the display screen. Here, the preset position is one of the anchor points, and the preset surround view image is one of the surround view images.

In an embodiment of the present invention, the positioning point is set on a movable range. The processor is configured to: if the cursor operation command acts on a position outside the movable range in the three-dimensional space model, perform an adjustment action on the specified surrounding view image currently displayed in the display screen, and the adjustment action includes moving, rotating and scale at least one of them.

In an embodiment of the present invention, the electronic device further includes: a communication element coupled to the processor. The processor is configured to: receive a cursor operation instruction from the user terminal device through a communication element, and after placing the specified surrounding view image as a material into the three-dimensional space model, move the virtual camera corresponding to the three-dimensional space model to a specified anchor point , and display the three-dimensional space model that has been placed in the designated panorama on the display screen of the client device through the communication component.

The method for presenting a three-dimensional space model of the present invention includes: executing the three-dimensional space model, wherein the three-dimensional space model includes a plurality of positioning points, and these positioning points are respectively corresponding to a plurality of surrounding view images in the database; When the cursor operation command of the three-dimensional space model is obtained, the specified positioning point with the smallest distance from the operation position corresponding to the cursor operation command is obtained from the positioning points, and the corresponding specified positioning point is obtained from multiple surrounding views included in the database. The designated surrounding view image of the point; and placing the extracted designated surrounding view image as a material into the three-dimensional space model and displaying it on the display screen.

Based on the above, the present invention adopts a three-dimensional space model to be used with a plurality of surrounding views, and selects a corresponding surrounding view based on the operating position. It can also ensure smooth operation on low-end terminals.

100: client device

200: electronic device

210: Processor

220: communication components

230: storage device

231: Database

233: Three-dimensional space model

E1~E19: Interaction position

P1~P29: positioning point

S505~S520: Steps of the method for presenting a three-dimensional space model

FIG. 1 is a block diagram of a system for presenting a three-dimensional space model according to an embodiment of the invention.

FIG. 2 is a block diagram of an electronic device for presenting a three-dimensional space model according to an embodiment of the invention.

FIG. 3 is a schematic diagram of a three-dimensional space model according to an embodiment of the invention.

FIG. 4 is a schematic diagram of a three-dimensional space model including multiple anchor points according to an embodiment of the present invention.

FIG. 5 is a flowchart of a method for presenting a three-dimensional space model according to an embodiment of the invention.

FIG. 1 is a block diagram of a system for presenting a three-dimensional space model according to an embodiment of the invention. Referring to FIG. 1 , the system for presenting a three-dimensional space model includes a client device 100 and an electronic device 200 . The client device 100 is, for example, a smart phone, a tablet computer, a notebook computer, or a personal computer used by a user, and is an electronic device with computing capability and networking function. The electronic device 200 is, for example, a web server. The electronic device 200 and the client device 100 can be connected by wired or wireless communication technology.

FIG. 2 is a block diagram of an electronic device for presenting a three-dimensional space model according to an embodiment of the invention. The electronic device 200 includes a processor 210 , a communication component 220 and a storage device 230 . The processor 210 is coupled to the communication element 220 and the storage device 230 .

The processor 210 is, for example, a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), or other programmable microprocessor (Microprocessor), digital signal processor (Digital Signal Processor, DSP), programmable controller, application specific integrated circuit (Application Specific Integrated Circuits, ASIC), programmable logic device (Programmable Logic Device, PLD) or other similar devices.

The communication element 220 may be a chip or a circuit using local area network (LAN) technology, wireless area network (Wireless LAN, WLAN) technology or mobile communication technology. An example of the LAN is Ethernet. The wireless local area network is, for example, Wi-Fi. Mobile communication technologies are, for example, Global System for Mobile Communications (GSM), third-generation mobile communication technology (third-Generation, 3G), fourth-generation mobile communication technology (fourth-Generation, 4G), fifth-generation Mobile communication technology (fifth-Generation, 5G), etc.

The storage device 230 is, for example, any type of fixed or removable random access memory, read-only memory, flash memory, hard disk or other similar devices or a combination of these devices. The storage device 230 is used for storing a database 231 and a three-dimensional space model 233 .

The database 231 stores a plurality of surrounding view images. The creation of the panorama can be, for example, Made by 3D animation software, it can also be obtained by shooting with a camera. The virtual camera of the 3D animation software can simulate the camera in the real world, divide the 3D scene into photos from multiple angles, and then make this group of photos into a panoramic view.

An example is given below to illustrate the three-dimensional space model 233 . FIG. 3 is a schematic diagram of a three-dimensional space model according to an embodiment of the invention. FIG. 4 is a schematic diagram of a three-dimensional space model including multiple anchor points according to an embodiment of the present invention.

The three-dimensional space model 233 is, for example, a three-dimensional space model 233 corresponding to a space generated by software such as a three-dimensional modeling tool used by a three-dimensional model designer according to customer requirements, as shown in FIG. 3 . After completing the three-dimensional space model 233, the three-dimensional model designer then sets a plurality of positioning points P1-P29 as shown in Figure 4 in the three-dimensional space model 233 according to customer needs, and sets them according to each point of the positioning points P1-P29 It corresponds to a panorama picture and is stored in the database 231 . In addition, at least one interactive position can be further reserved in the three-dimensional space model 233 according to requirements, so that the user can dynamically insert other interactive elements. In the embodiment shown in FIG. 4 , the three-dimensional space model 233 is preset with 19 interaction positions E1 - E19 . However, this is only for illustration, and does not limit the number of anchor points and the number of reserved interaction positions.

In addition, the storage device 230 also stores a plurality of program code segments, and the above program code segments are executed by the processor 210 after being installed, so as to implement the following method for presenting the three-dimensional space model 233 .

FIG. 5 is a flowchart of a method for presenting a three-dimensional space model according to an embodiment of the invention. Referring to FIG. 5 , in step S505 , the three-dimensional space model 233 is executed. For example, the user terminal device 100 intends to connect to the electronic device 200 to open a three-dimensional webpage for illustration, and the electronic device 200 will execute the three-dimensional space model 233 after receiving the connection notification.

After the three-dimensional space model 233 is executed, and before the cursor operation command acting on the three-dimensional space model 233 is detected, the processor 210 may first use the preset surrounding view image corresponding to the preset position as a material to insert into the three-dimensional space model 233, And the three-dimensional space model 233 that has been placed in the preset surrounding view image is displayed on the display screen. Here, the preset position is one of the anchor points, and the preset surround view image is one of the surround view images. For example, the anchor point P3 is set as the preset anchor point.

Next, in step S510 , when a cursor operation instruction acting on the three-dimensional space model 233 is detected, a designated anchor point with the smallest distance between the operation positions corresponding to the cursor operation instruction is obtained from the plurality of anchor points.

In one embodiment, the user of the client device 100 can use an operating device such as a mouse or a touch panel to control the cursor on the display screen, and the three-dimensional image displayed on the display screen through the operating device such as a mouse or a touch panel If one of the spatial models 233 is clicked, dragged or slid, the client device 100 will transmit the corresponding cursor operation instruction to the electronic device 200 . The processor 210 of the electronic device 200 receives the cursor operation instruction from the client device 100 through the communication element 220, and when detecting the cursor operation instruction acting on the three-dimensional space model 233, it will further calculate the operation position and the three-dimensional space corresponding to the cursor operation instruction. The space model 233 sets the distance between each positioning point, and takes the positioning point corresponding to the minimum distance as the specified positioning point corresponding to the operating position. For example, if the cursor operation command corresponds to a click action, Then the click position is the operation position. If the cursor operation command corresponds to a dragging action, the position when the dragging action is released is taken as the operating position.

Afterwards, in step S515 , a designated panoramic view corresponding to the designated anchor point is retrieved from the plurality of panoramic views included in the database 231 .

Next, in step S520 , the extracted designated panoramic image is placed as a material into the three-dimensional space model 233 and displayed on the display screen. In one embodiment, after the processor 210 puts the specified surrounding view image as a material into the stereoscopic space model 233 , it will further move the virtual camera corresponding to the stereoscopic space model 233 to the specified anchor point. Afterwards, the three-dimensional space model 233 placed in the designated panoramic view is displayed on the display screen of the client device 100 through the communication component 220 .

Here, the processor 210 uses a rendering method to put the specified surrounding view image as a material into the three-dimensional space model 233 . Generally speaking, 3D models are covered with textures, and the process of arranging textures onto 3D models is called texture mapping. After texture mapping processing, the 3D model can be more detailed and look more realistic. In this embodiment, the surround view image is used as a texture-mapped material and put into the three-dimensional space model 233 . In addition to texture mapping, surface normals can also be adjusted for lighting effects, some surfaces can use bump mapping methods, and other tricks for stereo rendering.

In addition, during the rendering process, the processor 210 uses the virtual camera to locate the relationship with each object in the three-dimensional space model 233 , thereby obtaining multiple rendering parameters. In the real world, the eye sees an object because light rays are reflected from the object to the eye. The position of the virtual camera is the position of the "eye". Through ray tracing (ray The tracing) method can calculate rendering parameters such as reflection index corresponding between the virtual camera and each pixel in the stereoscopic space model 233 . Therefore, after obtaining the designated anchor point, the processor 210 will further move the virtual camera to the designated anchor point, thereby obtaining rendering parameters corresponding to the designated anchor point.

In addition, a movable range is set in the three-dimensional space model 233 , and a plurality of anchor points are included in the movable range. The movable range is used to define which regions in the three-dimensional space model 233 need to switch the surround view image, and which regions do not switch the surround view image. For example, in the electronic device 200, if the processor 210 detects that the cursor operation command acts on a position outside the movable range of the three-dimensional space model 233, it does not need to switch the panoramic view, but instead controls the current position in the display screen. The displayed panorama view is adjusted. The adjustment action includes moving, rotating or scaling. Here, the cursor operation command is a single click command, a double click command, a drag command, or a pinch command. Different adjustment actions can be further performed for different cursor operation instructions.

That is to say, if the operation position corresponding to the cursor operation instruction is not within the movable range, there is no need to switch the surround view image, and directly perform adjustment actions such as moving, rotating or zooming the currently displayed surround view image.

In addition, the storage device 230 can further set an interactive element database. The interactive component database includes the interactive component and the interactive position of the interactive component in the three-dimensional space model 233 . The interactive elements are, for example, multimedia files, interactive interfaces or buttons. The processor 210 sets the interactive elements in the three-dimensional space model 233 according to the interactive positions corresponding to the interactive elements. And, when the operating position coincides with one of the anchor points, the count Calculate the relative position information between the anchor point and the interactive position, so as to adjust the rendering parameters of the interactive component based on the relative position information.

Assuming that the interactive element is set at the interactive position E1, if the currently displayed panorama image corresponding to the anchor point P3, the processor 210 will calculate the relative positional relationship between the interactive position E1 and the anchor point P3, and then adjust the interactive element at its position The rendering parameters such as the rendering angle and light and shadow rendering in the corresponding panorama image are used to adjust its visual related effects. If switching to the surround view image of the anchor point P5, the processor 210 will recalculate the relative positional relationship between the interaction position E1 and the anchor point P5, and then adjust the rendering parameters of the interactive element in its corresponding surround view image. Accordingly, the presentation of the interactive elements can be dynamically adjusted along with the movement of the cursor, thereby obtaining a visual effect closer to the real space.

The user can operate the interactive elements in the three-dimensional space model 233 through the client device 100 . For example, suppose the interactive component is a playback interface, which has multiple operation buttons, and the user can click the operation buttons in the playback interface to control functions such as playing, pausing, fast-forwarding or returning the video. For another example, assuming that the interactive element is a button, the user can click the interactive element with the cursor to trigger the function corresponding to the button, such as connecting to another web page, or displaying another layer of window interface on the three-dimensional space model 233 .

To sum up, in the present invention, a three-dimensional space model is used together with multiple surrounding views, and the corresponding surrounding views are selected based on the operating position corresponding to the cursor operation command. Moreover, a plurality of interactive positions are reserved in the three-dimensional space model to set the interactive components, and the presentation mode of the interactive components is adjusted according to the operating positions. Accordingly, not only rendering The detailed and realistic graphics can also ensure smooth operation on low-end terminals.

200: electronic device

210: Processor

220: communication components

230: storage device

231: Database

233: Three-dimensional space model

Claims (10)

An electronic device for presenting a three-dimensional space model, comprising: a storage device including a database and a three-dimensional space model, wherein the three-dimensional space model includes a plurality of positioning points, and the database includes multiple positioning points corresponding to the positioning points respectively. a surrounding view image; and a processor, coupled to the storage device, and configured to: execute the stereoscopic space model; when detecting a cursor operation instruction acting on the stereoscopic space model, from the anchor points Obtain a designated anchor point with the smallest distance from an operation position corresponding to the cursor operation instruction; move a virtual camera corresponding to the stereoscopic space model to the designated anchor point to obtain a rendering corresponding to the designated anchor point Parameters; fetching a specified panorama corresponding to the specified anchor point from the panoptics included in the database; and placing the fetched specified panoply as a material into the stereo based on the rendering parameters The spatial model is displayed on a display screen. The electronic device as described in claim 1, wherein an interaction position is reserved in the three-dimensional space model, and the storage device further includes: an interactive component database storing an interactive component; the processor is configured to: in the three-dimensional space Set the interactive component at the interactive position of the model; and calculate the specified positioning when obtaining the specified anchor point corresponding to the operation position Relative position information between the point and the interactive position, so as to adjust the rendering parameter of the interactive component based on the relative position information. The electronic device according to claim 1, wherein the processor is configured to correspond to a preset position after executing the three-dimensional space model and before detecting the cursor operation instruction acting on the three-dimensional space model A preset surrounding view image is placed into the three-dimensional space model as a material and displayed on the display screen, wherein the preset position is one of the anchor points, and the preset surrounding view image is the one of the The electronic device as claimed in claim 1, wherein the positioning points are set on a movable range, and the processor is configured to: if the cursor operation instruction acts on a position in the three-dimensional space model outside the movable range , performing an adjustment action on the specified surrounding view image currently displayed on the display screen, where the adjustment action includes at least one of moving, rotating, and zooming. The electronic device as described in claim 1, further comprising: a communication element coupled to the processor, and the processor is configured to: receive the cursor operation command from a client device through the communication element, and through the communication The component displays the three-dimensional space model that has been placed in the specified surrounding view on the display screen of a client device. A method for presenting a stereoscopic space model, performed by a processor, the method comprising: executing a stereoscopic space model, wherein the stereoscopic space model includes a plurality of positioning Points, these anchor points respectively correspond to a plurality of surround view images in a database; when a cursor operation instruction acting on the three-dimensional space model is detected, the cursor operation instruction corresponding to the cursor operation instruction is obtained from the anchor points A designated anchor point with the smallest distance between corresponding operating positions; moving a virtual camera corresponding to the stereoscopic space model to the designated anchor point to obtain a rendering parameter corresponding to the designated anchor point; from the database Extracting a designated surrounding view corresponding to the designated anchor point from the included surrounding views; and based on the rendering parameter, placing the extracted designated surrounding view as a material into the three-dimensional space model and displaying it on a displayed on the screen. The method for presenting a three-dimensional space model as described in claim 6, wherein at least one interaction position is reserved in the three-dimensional space model, and the method further includes: setting an interaction element at the interaction position of the three-dimensional space model; and obtaining When the designated anchor point corresponding to the operating position is operated, a relative position information between the designated anchor point and the interaction position is calculated, so as to adjust the rendering parameter of the interactive component based on the relative position information. The method for presenting a three-dimensional space model as described in Claim 6, wherein after executing the three-dimensional space model, it further includes: before detecting the cursor operation command acting on the three-dimensional space model, corresponding to a preset position A preset surrounding view image is placed into the three-dimensional space model as a material and displayed on the display screen, wherein the preset position is one of the anchor points, and the default surrounding view image is the surrounding view images one of them. The method for presenting a three-dimensional space model as described in Claim 6, wherein the anchor points are set on a movable range, and after executing the three-dimensional space model, further comprising: if the cursor operation instruction acts on the three-dimensional space model For a position outside the movable range in the display screen, an adjustment action is performed on the designated panoramic image currently displayed on the display screen, and the adjustment action includes at least one of moving, rotating and zooming. The method for presenting a three-dimensional space model as described in claim 6, wherein after executing the three-dimensional space model, it further includes: receiving the cursor operation command from a client device through a communication element; wherein, after the fetched specified The step of embedding the three-dimensional space model as a material and displaying it on the display screen includes: displaying the three-dimensional space model that has been placed in the specified environment picture to the display screen of a client device through the communication element middle.

Images