TW202312081A - Object presentation device with label mainly including an object database, a plan view database, an interactive module, and an operation module - Google Patents

Abstract

An object presentation device with label of the present invention mainly includes an object database, a plan view database, an interactive module, and an operation module. The interactive module marks a plurality of scene buttons that can be selected on the plan view displayed on the operation interface according to the plan view provided by the plan view database; and when the scene button is activated, the panorama image corresponding to the position of the activated scene button is played through the operation interface. When the label symbol is activated, the corresponding viewing angle command is calculated according to the predetermined coordinates relative to the label symbol, and a predetermined viewing angle scene with the label symbol is presented and the label description with text and pictures is displayed, wherein the label description is a removable window.

Description

Object Rendering Devices with Labels

The invention relates to an interactive picture file playing device, especially an object presenting device with labels.

In order to allow consumers to quickly find houses that they are willing to buy, some operators have broadcast pictures through the Internet, allowing consumers to view houses online 24 hours a day. For real estate agents, they can save a lot of time and spend more time on items that have been filtered by consumers themselves.

Through the various screening mechanisms provided by the website, such as region, price range, house type, house age, etc., in order to find multiple pieces of eligible housing object information, and then through photos or image files one by one, a preliminary understanding of each object The concept allows consumers to find the items they are interested in without interference, rather than the items that real estate brokers want to sell.

In illustrations of house objects, it is common to see interior scenes for different rooms or viewpoints of the object. For example, the picture file will display the living room, dining room, kitchen, balcony, bedroom, bathroom, etc. in a specific shooting range.

In the conventional technology, if only the original indoor scene is presented when the surround view image of house objects is played, the user can only rely on his own imagination based on the image he sees.

Based on the above purpose, the object presentation device with label of the present invention mainly includes Component database, plan database, interactive module, operation module. The interactive module marks a plurality of scene buttons that can be selected on the floor plan displayed on the operation interface according to the floor plan provided by the floor plan database, and plays through the operation interface when the scene button is activated The panorama image relative to the location where the activated scene button is located. When the label symbol is activated, according to the predetermined coordinates relative to the label symbol, calculate the corresponding viewing angle command, present a predetermined viewing angle screen with the label symbol and display the label description with text and pictures, Wherein the label is described as a removable window.

The main purpose of the tagged object presentation device of the present invention is to use the scene button marked on the plan to allow the user to play the paragraph image file of the room or place marked on the plan when the user clicks the scene button.

The secondary purpose of the tagged object display device of the present invention is to use the scene button marked on the plan to allow the user to play the paragraph image file of the room or place marked on the plan when the user clicks the scene button.

Another important purpose of the tagged object presentation device of the present invention is to allow the system to automatically judge the scene attributes of each segment by using the paragraph mark added when shooting, and automatically complete the image file index form (such as establishing the living room and dining room respectively) etc.), it does not need to be done by the same person when shooting and merging image files.

The advantages and spirit of the present invention can be further understood through the following detailed description of the invention and the accompanying drawings.

1: Operation interface

10: Object database

12: Floor plan database

13: Operation module

14:Interactive module

16: Identification database

18: Paragraph cutting module

20: Panorama image

201~206: Paragraph

22: floor plan

221~226: scene button

227: Dress up button

2211: angle of view symbol

301~303: Door and window position

300: simulate light button

310: label symbol

312: label description

314: list form

The first figure is a schematic diagram of an object presentation device with labels of the present invention

The second figure is a schematic diagram of the correlation between the plan view and the surround view image of the present invention

Figures 3 A to 3 B are schematic diagrams of the surround view images of the present invention

The 4th A ~ 4 B figure is the schematic diagram of the surround view image of the present invention

The 5th A ~ 5 B figure is the schematic diagram of the surround view image of the present invention

Figure 6 is another schematic diagram of the object presentation device with labels of the present invention

Please refer to the first figure. The first figure is a schematic diagram of an object presentation device with labels of the present invention. As shown in the first figure, the tagged object presentation device of the present invention mainly includes an object database 10 , a floor plan database 12 , an interaction module 14 , and an operation module 13 . The object database 10 mainly stores a plurality of tag data belonging to a plurality of building objects, a sunshine data map and a surrounding view image 20 (as shown in the fourth A to the third B diagrams).

Each tag data has a tag symbol and belongs to the space in the room, and each tag data can store a tag description 312 with text and pictures relative to the predetermined coordinate position in the space (as shown in the third figure A shown). Each space has at least one surround view image, and the surround view image 20 includes a plurality of segments. The sunshine data map at least includes an orientation of the location of the house object, the height of the first floor, and the positions and sizes of a plurality of doors and windows, and each space has at least one surrounding view image, and the location of each door and window is related to the plan view. The floor plan database 12 stores a floor plan 22 (as shown in FIG. 2 ) and dimension data. The floor plan 22 is mainly used to present a brief view of at least one room in the house object. The room is a space surrounded by a plurality of walls. The size data is related to these walls. For example, the height of the room is three meters, so the height of each wall is three meters, and the width of the wall is In addition to measuring with an instrument, it is also possible to obtain the required size information by taking a plan view of the paper and using image processing technology. For details, please refer to CN108961395A.

Please refer to the second figure, the second figure is a schematic diagram of the correlation between the plan view and the surround view image of the present invention. As shown in FIG. 2 , the plan view 22 is mainly used to present a brief view of at least one room in the house object, wherein the room is a space surrounded by a plurality of walls. For example, the space enclosed in the plan view 22 can be divided into a living room, a dining room, a kitchen, a balcony, a bedroom, and a bathroom.

In order to allow the user to operate and present the surround view image to which a specific house object belongs, the interactive module 14 can present the plan view 22 through the operation interface 1 according to the plan view 22 provided by the plan view database 12 , and display the plan view 22 on the plan view 22 A plurality of scene buttons 221-226 that can be selected are marked, and when the scene buttons 222-226 are activated, the surround view image relative to the position where the activated scene button is played is played through the operation interface. In addition to being represented by scene buttons 221-226, the scene buttons can also be representative images of opposite segments in the surround view image.

Specifically, in the plan view 22, the part belonging to the living room has a paragraph providing two viewing angles, and scene buttons 221 and 222 are respectively provided for the user to operate and play. Each paragraph in the surround view image 20 has a start angle of view and an end angle of view, and an index table is composed of the start angle of view and the end angle of view of a plurality of paragraphs. That is to say, the starting angle of view and the ending angle of view of each paragraph 20 in the surround view image can be respectively corresponding to the living room, the dining room, the kitchen, the balcony, the bedroom, and the bathroom.

When the scene button 221 is clicked, it will be played with the angle of view of the living room space, and at the same time, an angle of view symbol 2211 will appear near the scene button 221 on the plan view 22 to indicate the shooting angle of the paragraph 201. The angle of view symbol 2211 may be a static picture or a dynamic picture.

For example, if you were shooting a living room while using a gyroscope record, and use the same time axis to record the change of angle of view during the shooting process of paragraph 201. The symbol of angle of view 2211 can start to rotate with the playing time of the image file, showing the change of angle of view in a dynamic way. The information of the angle change during the shooting process of the paragraph 201 is recorded in the index table in the object database 10 . The index table includes an angle change relative to each segment in the surround view image, the angle change relative to a start angle and an end angle of each segment.

In order to allow users to grasp more information more clearly, the present invention will directly display multiple tag data in the surround view image, so as to assist the information that the simple surround view image cannot provide.

Please refer to Figures 3A to 3B. Figures 3A to 3B are schematic diagrams of the surround view images of the present invention. As shown in Figures 3A to 3B, the operation module 13 first marks or displays in the operation interface 1 in the form of a list 314 one less label symbol 310 that belongs to the current space and can be selected. After displaying at least one label symbol 310 in the form of a list 314, if the user wants to further understand the description of the label symbol 310, the user can click the label symbol 310 or the corresponding name, and the operation module 13 will base on the corresponding label symbol 310 The predetermined coordinates of the symbol 310, calculate the corresponding viewing angle command, present the predetermined viewing angle screen with the label symbol and display the label description 312 with text and pictures, wherein the label description is a removable window , when the viewport is removed, the tab symbol is temporarily obscured.

In order to allow users to see the indoor lighting results of different rooms in different time periods, the present invention can simulate the indoor lighting results by means of ray tracing technology. That is to say, by means of the currently displayed space and the location of the house object, the height of the building, the positions of multiple doors and windows, and the selected simulation time period, the indoor lighting results are simulated, allowing consumers to purchase a house. It can fully grasp the indoor lighting conditions before. Ray Tracing (Ray Tracing) is a 3D computer graphics A special rendering algorithm that traces the rays emanating from the eye rather than from the light source, a technique that produces a mathematical model of the choreographed scene that emerges. The results obtained in this way are similar to the results of ray casting and scan line rendering methods, but this method has better optical effects, such as more accurate analog effects for reflection and refraction, and is very efficient, so when pursuing high quality This method is often used when the effect of

Please refer to Figures 4 A to 4 B, which are schematic diagrams of the surround view image of the present invention. When the user clicks the scene button 221, the corresponding surround view image 20 is first presented on the operation interface 1, and the simulated lighting button 300 that can be selected is marked on the operation interface 1, as shown in FIG. 3B. In order to allow users to see the indoor lighting results of different rooms and rooms at different times, when the simulated lighting button is activated, the currently displayed space and the orientation of the location of the house object, the height of the building, and the multiple doors and windows Based on the position and size, and the selected simulation period, calculate the relative lighting information of the space currently displayed based on ray tracing technology, so as to cover the original image in the surrounding image displayed on the operation interface, as shown in the third figure A Show.

More specifically, the simulation period can be divided into three times: morning, afternoon, and evening to simplify the complexity of calculations. In the same simulation period, it is only necessary to simply base on the orientation, the building height, and the complex number of the location of the house object. Calculate the position and size of each door and window, and the larger the size of the door and window, the more light should be injected into the interior space. However, what needs to be noted here is that the so-called ray tracing technology is used to calculate the relative lighting information of the currently displayed space. In addition to using the GPU to perform calculations, it is also considered that the GPU computing capabilities of smartphones and computer devices are not powerful enough, which leads to the use of Or the waiting time is too long, so after simulating the lighting button 300, it does not necessarily have to rely on the client's GPU for real-time computing, and it is also possible to pass the computing requirements to the cloud server, and return the calculated results to the client, or is in the cloud After the server calculates the results, the calculation results are stored, and the results can be displayed without re-computation when there is a need for calculation next time.

In addition, in order to allow users to see the results of interior decoration as a reference for the willingness to purchase a house, the object display device with tags of the present invention can use the size data of the space that has been established in advance to perform real-time calculations to provide a simulated interior. Decoration, especially the perspective view of the wall, for example, the wall of the bedroom adjacent to the living room becomes perspective, and the interior space of the adjacent bedroom can be seen, increasing the feeling of spaciousness.

Please refer to Figures 5 A to 5 B. Figures 5 A to 5 B are schematic diagrams of the surround view image of the present invention. When the user clicks the scene button 221, the corresponding surround view image 20 is first presented on the operation interface 1, and the selectable dress-up button 227 is marked on the operation interface 1, as shown in the fourth figure A. When the dress-up button 227 is activated, the operation module 13 uses the currently displayed space (that is, the aisle where the scene button 221 is located) and the size data of the adjacent space (that is, the kitchen where the scene button 223 is located), The wall perspective is calculated, and the wall perspective is presented by covering the wall image in the surround view image originally displayed on the operation interface, as shown in FIG. 4B.

The wall perspective view is mainly calculated by using the currently displayed space and the surrounding field image and size data of the adjacent space. More specifically, in the operation interface 1 , since the adjacent spaces that are far away from each other are no longer covered by walls, part of their surround view images will also be displayed in the operation interface 1 . The distance between the adjacent space and the currently displayed space is known, that is, the locations where the scene button 221 and the scene button 223 are shooting are known, so two relative panoramic images can be obtained using the same viewing angle, and In the operation interface 1 , the surround view images of persons with a relatively long distance need to be scaled down appropriately according to the distance between them, so as to present a vision with a relatively long distance.

In order to avoid an inappropriate wall perspective view, or when the system builder has special restrictions, the dress-up button 227 can be hidden and the user is not allowed to click and operate. For example, when the currently displayed space is the living room, the adjacent space may only be the bedroom, so as to calculate the wall perspective view between the living room and the bedroom, and for example, the currently displayed space is the In the case of a dining room, the adjacent space may only be the kitchen, so as to calculate the perspective view of the wall between the dining room and the kitchen.

Please refer to FIG. 6 . FIG. 6 is another schematic view of the tagged object presentation device of the present invention. As shown in the sixth figure, the present invention can use the paragraph mark (not depicted) added or photographed during shooting to allow the paragraph cutting module 18 to automatically judge the scene attributes of each segment, and automatically complete the image file index table (For example, the starting time of setting up the living room, dining room, etc. separately), it is not necessary to take pictures and merge pictures and files must be carried out by the same person.

For example, when the photographer is shooting towards the living room, first point the camera lens to the paragraph mark with "living room", and then start shooting towards the living room. In addition to the paragraph mark of the image, the paragraph mark can also be a voice. For example, when shooting, the photographer uses a camera with a radio function to call out "living room", and let the camera record a paragraph mark belonging to the sound.

In this way, as long as multiple paragraph marks of images or voices are first established in the recognition database 16, the paragraph cutting module 18 can use the multiple paragraph marks of the recognition database 16 for comparison and analysis, and automatically read Take a plurality of surrounding images stored in a specific folder, and use image or voice recognition technology to determine the starting and ending angles of view of each paragraph when the paragraph mark appears, and record it in in the index table. Simultaneously, when the interactive module multicast 14 plays the relative paragraph in the surround view image, the part marked by the paragraph will be skipped.

Through the detailed description of the above preferred specific embodiments, it is hoped that the present invention can be described more clearly. The characteristics and spirit of the invention are not limited to the scope of the invention by the preferred embodiments disclosed above. On the contrary, the intention is to cover various changes and equivalent arrangements within the scope of the patent application for the present invention.

1: Operation interface

10: Object database

12: Floor plan database

13: Operation module

14:Interactive module

Claims (10)

An object presentation device with tags, which is used to present a surrounding scene image to which a plurality of house objects belong, including: A floor plan database, storing a floor plan and a size data, the floor plan is mainly used to present a brief view of at least one room in the house object, wherein the room is a space surrounded by a plurality of walls, the size the data is related to those walls; An object database, storing a plurality of pieces of tag data and the surrounding view image belonging to a plurality of house objects, each tag data has a tag symbol and belongs to the space in the room, and each tag data can be stored relative to the A label description with text and pictures at a predetermined coordinate position in space; An interactive module, coupled to an operation interface, according to the plan provided by the plan database, a plurality of scene buttons that can be selected are marked on the plan displayed on the operation interface, and the scene buttons are selected When activated, the surround view image relative to the position where the activated scene button is played is played through the operation interface, and at the same time, a predetermined view angle picture relative to the surround view image can be presented according to a view angle command, and the view view command can be divided into a first an axis and a second axis, the first axis and the second axis being perpendicular to each other; and An operation module, coupled to the floor plan database, the object database, and the interaction module, marking or displaying in the operation interface at least one label symbol belonging to the current space that can be selected, and in the When the label symbol is activated, the corresponding angle of view command is calculated according to the predetermined coordinates relative to the label symbol, and the predetermined angle of view screen with the label symbol is presented and the label description with text and pictures is displayed, wherein the Label descriptions are removable windows that temporarily obscure the label symbol from view when the window is removed. The tagged object presentation device as described in item 1 of the scope of the patent application, wherein the object database stores the sunshine data map to which a plurality of house objects belong, and the sunshine data map includes at least one direction of the location of the house object, The height of the first floor, the positions and sizes of multiple doors and windows, each space has at least one surround view image, the position of each door and window is related to the plan, and the operation module marks a selected one in the operation interface. Simulate the lighting button, and when the simulated lighting is activated, by means of the currently displayed space and the orientation of the location of the house object, the height of the building, the positions and sizes of a plurality of doors and windows, and a selected simulation period, A relative illumination information of the currently displayed space is calculated based on the ray tracing technology, so as to cover the original image in the surround view image displayed on the operation interface. The object presentation device with tags as described in item 2 of the scope of the patent application, which In the operation interface, a dress-up button that can be selected is marked, and when the dress-up button is activated, a wall perspective is calculated by using the currently displayed space and the size data of the adjacent space image to overlay the wall image in the panorama image displayed on the operation interface. As the tagged object presentation device described in item 2 of the scope of the patent application, the space enclosed in the plan view can be divided into a living room, a dining room, a kitchen, a balcony, a bedroom, and a bathroom. As for the tagged object presentation device described in item 3 of the scope of the patent application, when the currently displayed space is the living room, the adjacent space can only be the bedroom, so as to calculate the distance between the living room and the bedroom. The wall perspective view; when the currently displayed space is the dining room, the adjacent space may only be the kitchen, so as to calculate the wall perspective view between the dining room and the kitchen. The tagged object presentation device as described in item 3 of the scope of the patent application, wherein each paragraph in the surround view image has a starting angle of view and an ending angle of view, and is composed of a plurality of starting angles of view and ending angles of view of a plurality of paragraphs. index table. The tagged object presentation device as described in claim 5, wherein the index table contains a change in viewing angle relative to each paragraph in the ambient image, and the change in viewing angle is relative to the start of each paragraph Angle and End Angle. The tagged object presentation device as described in item 5 of the scope of the patent application, wherein the object presentation device further includes: The paragraph cutting module determines the starting angle of view and the ending angle of view of each paragraph according to the time when a paragraph mark appears in the surround view image, and records them in the index table. According to the tagged object presentation device described in item 7 of the scope of the patent application, when the interactive module plays the surround view image relative to the position where the scene button is activated, the part marked with the paragraph will be skipped. The tagged object display device as described in item 8 of the scope of the patent application, wherein the object display device further includes: A recognition database includes a plurality of paragraph marks, and the paragraph marks can be divided into image and voice.

Images