TWM630897U - Article presentation device with label - Google Patents

Abstract

The object presentation device with labels in this creation mainly includes an object database, a floor plan database, an interactive module, and an operation module. According to the floor plan provided by the floor plan database, the interactive module marks a plurality of scene buttons that can be selected on the floor plan displayed in the operation interface, and when the scene button is activated, it is played through the operation interface The surround image relative to the location where the scene button is activated. When the label symbol is activated, according to the predetermined coordinates relative to the label symbol, the corresponding viewing angle command is calculated, the predetermined viewing angle picture with the label symbol is presented, and the label description with text and pictures is displayed, The label is described as a removable window.

Description

Object presentation device with label

The present invention relates to an interactive graphic file playing device, especially an object presenting device with a label.

In order to allow consumers to find housing items that they are willing to buy more quickly, existing operators have broadcasted pictures through the Internet, allowing consumers to view houses online at any time 24 hours a day, which not only saves consumers the time to look around the house, For real estate brokers, it can save a lot of time for viewing, and focus more on the items that have been filtered by consumers themselves.

Through various screening mechanisms provided by the website, such as region, price range, room type, house age, etc., in order to find multiple pieces of housing object information that meet the requirements, and then through photos or drawings one by one, each object has a preliminary The concept allows consumers to find the items they are interested in without being disturbed, rather than the items that the real estate agent wants to sell.

In a drawing of a house object, the interior scene is usually viewed from a different room or perspective for the object. For example, the picture file will display the living room, dining room, kitchen, balcony, bedroom, bathroom, etc. in a specific shooting range.

In the prior art, when playing a surrounding image of a house object, if only the original indoor scene is presented, the user can only imagine by himself based on the image he sees.

Based on the above purpose, the object presentation device with labels in this creation mainly includes objects software database, floor plan database, interactive module, operation module. According to the floor plan provided by the floor plan database, the interactive module marks a plurality of scene buttons that can be selected on the floor plan displayed in the operation interface, and when the scene button is activated, it is played through the operation interface The surround image relative to the location where the scene button is activated. When the label symbol is activated, according to the predetermined coordinates relative to the label symbol, the corresponding viewing angle command is calculated, the predetermined viewing angle picture with the label symbol is presented, and the label description with text and pictures is displayed, The label is described as a removable window.

The main purpose of creating a labelled object presentation device is to use the scene button marked on the floor plan to let the user click the scene button to play the paragraph file of the room or place marked on the floor plan.

The secondary purpose of creating a labelled object presentation device is to use the scene button marked on the floor plan to let the user click the scene button to play the paragraph file of the room or place marked on the floor plan.

The purpose of this creation of the object presentation device with tags is to use the paragraph marks added during shooting to allow the system to automatically interpret the scene attributes of each clip, and automatically complete the image file index table (for example, create a living room, dining room, respectively) etc.), it does not have to be the same person who shoots and merges the image files.

The advantages and spirit of the present invention can be further understood from the following detailed description of the new model and the accompanying drawings.

1: Operation interface

10: Object Database

12: Floor Plan Database

13: Operation module

14: Interactive Mods

16: Identification database

18: Paragraph cutting module

20: Surround View Image

201~206: Paragraph

22: Floor Plan

221~226: Scene button

227: Dress Up Button

2211: Perspective notation

301~303: Position of doors and windows

300: Simulate Lighting Button

310: Label Symbols

312: Label Description

314: list form

The first picture is a schematic diagram of the creation of the object presentation device with labels

The second picture is a schematic diagram of the relationship between the creative floor plan and the surrounding image

Figures 3A~3B are the schematic diagrams of creating a surrounding image.

Figures 4A~4B are the schematic diagrams of the creation of the surrounding image.

Figures 5A~5B are the schematic diagrams of the creation of the surrounding image.

The sixth figure is another schematic diagram of the creation of the object presentation device with labels

Please refer to the first figure, the first figure is a schematic diagram of a device for creating objects with labels. As shown in the first figure, the object presentation device with labels in this creation mainly includes an object database 10 , a floor plan database 12 , an interactive module 14 , and an operation module 13 . The object database 10 mainly stores a plurality of tag data, a sunshine data map and a surrounding image 20 (as shown in the fourth A to the third B) to which the plurality of house objects belong.

Each label data has a label symbol and belongs to the space in the room, and each label data can store a label description 312 with text and pictures relative to a predetermined coordinate position in the space (as shown in Figure 3A). shown). There is at least a single surrounding scene image in each space, and the surrounding scene image 20 includes a plurality of paragraphs. The sunshine data map at least includes an orientation of the location of the house object, the height of the first floor, the positions and dimensions of a plurality of doors and windows, each space has at least a single surrounding image, and the position of each door and window is related to the floor plan. The floor plan database 12 stores floor plans 22 (as shown in the second figure) and dimension data. The floor plans 22 are mainly used to present a schematic view of at least one room in the house object. The room is a space surrounded by a plurality of walls, and the dimension data is related to these walls. For example, the height of the room is three meters, so the height of each wall is three meters, and the width of the wall is In addition to using instruments to measure, you can also use the plan of the paper to obtain the required size data through image processing technology. For details, please refer to CN108961395A.

Please refer to the second figure, which is a schematic diagram of the relationship between the creative floor plan and the surrounding image. As shown in the second figure, the plan view 22 is mainly used to present a schematic diagram of at least one room in the house object, wherein the room is a space surrounded by a plurality of walls. For example, the space enclosed in the floor plan 22 can be divided into a living room, a dining room, a kitchen, a balcony, a bedroom, and a bathroom.

In order to allow the user to operate and present the surrounding image to which the specific house object belongs, the interactive module 14 can present the floor plan 22 through the operation interface 1 according to the floor plan 22 provided by the floor plan database 12 , and display the floor plan 22 on the floor plan 22 . A plurality of scene buttons 221 to 226 can be selected, and when the scene buttons 222 to 226 are activated, the surrounding scene image relative to the position of the activated scene button is played through the operation interface. In addition to being represented by the scene buttons 221 to 226, the scene buttons can also be representative images of the opposite paragraphs in the surround view image.

Specifically, in the plan view 22, in the part belonging to the space of the living room, there are paragraphs that provide two perspectives, and scene buttons 221 and 222 are respectively provided for the user to operate and play. Each segment in the surround view image 20 has a start angle and an end angle, and an index table is formed by the start angle and end angle of a plurality of segments. That is to say, the starting and ending angles of each segment 20 in the surround view image may correspond to the living room, the dining room, the kitchen, the balcony, the bedroom, and the bathroom, respectively.

When the scene button 221 is clicked, the playback will be played at the original viewing angle of the living room space. At the same time, the viewing angle symbol 2211 will appear near the scene button 221 on the plan view 22 to indicate the shooting angle of the paragraph 201 . The viewing angle symbol 2211 can be a static picture or a dynamic picture.

For example, if a gyroscope was used at the same time when photographing the living room space, Recording, and use the same time axis to record the change of the angle of view during the shooting process of paragraph 201, the symbol of the angle of view 2211 can start to rotate with the playback time of the image file, showing the change of the angle of view in a dynamic way. The information of the angle change in the shooting process of the segment 201 is recorded in the index table in the object database 10 . The index table includes a viewing angle change relative to each paragraph in the surround view image, and the viewing angle change is relative to a starting viewing angle and an ending viewing angle of each paragraph.

In order to allow users to grasp more information more clearly, this creation will directly display multiple tag data in the surrounding image to assist the information that cannot be provided by the simple surrounding image.

Please refer to Figures 3A~3B. Figures 3A~3B are schematic diagrams of the creation of the surrounding image. As shown in FIGS. 3A to 3B , the operation module 13 firstly marks or displays in the operation interface 1 one less label symbol 310 belonging to the current space that can be selected in a list form 314 . After displaying at least one label symbol 310 in the form of a list 314, if the user wants to know more about the description of the label symbol 310, the user can click the label symbol 310 or the corresponding name, and the operation module 13 will The predetermined coordinate of the symbol 310, the corresponding viewing angle command is calculated, the predetermined viewing angle picture with the label symbol is presented, and the label description 312 with text and pictures is displayed, wherein the label description is a removable window. , when the window is removed, the label symbol is visible temporarily obscured.

In order to allow users to see the indoor lighting results of different time periods and different rooms, this creation can simulate the indoor lighting results through ray tracing technology. That is to say, by using the currently displayed space and the location of the house object, the height of the building, the positions of a plurality of doors and windows, and the selected simulation period, the indoor lighting results are simulated, so that consumers can buy a house when they buy a house. The indoor lighting conditions can be more fully grasped before. Ray Tracing is a 3D computer graphics 's special color rendering algorithm, which tracks the light from the eye rather than the light source, is revealed by such a technique to generate a mathematical model of the choreographed scene. The results obtained in this way are similar to the results of the ray casting and scanline rendering methods, but this method has better optical effects, such as more accurate analog effects for reflection and refraction, and is very efficient, so when the pursuit of high quality This method is often used when the effect of

Please refer to Figures 4 A to 4 B. Figures 4 A to 4 B are schematic diagrams of creating a surrounding image. When the user clicks the scene button 221, the relative surround view image 20 is first displayed on the operation interface 1, and the selectable simulated lighting button 300 is marked in the operation interface 1, as shown in Figure 3B. In order to allow the user to see the indoor lighting results of different time periods and different rooms, when the simulated lighting button is activated, the current displayed space and the position of the house object, the height of the building, the number of doors and windows are displayed. The position and size, as well as the selected simulation period, calculate the relative illumination information of the space currently displayed based on ray tracing technology to cover the original image in the surround image displayed on the operation interface, as shown in Figure 3A Show.

More specifically, the simulation period can be divided into three times: morning, afternoon, and evening to simplify the complexity of the calculation. In the same simulation period, it is only necessary to simply rely on the orientation, the height of the building, and the complex number of the location of the house object. The position and size of each door and window are calculated. The larger the size of the door and window, the more light should be injected into the indoor space. However, it should be noted here that the so-called calculation of the relative illumination information of the currently displayed space based on ray tracing technology, in addition to the use of GPU for even computing, also considers that the GPU computing power of smartphones and computer devices themselves is not powerful enough, which leads to the use of The waiting time is too long. Therefore, after simulating the lighting button 300, it is not necessary to rely on the GPU of the client to perform real-time calculations. It is also possible to pass the calculation requirements to the cloud server, and return the calculated results to the client, or is in the cloud After the server calculates the result, the operation result is stored, and the result can be displayed without re-operation next time when there is a need for operation.

In addition, in order to allow users to see the results of interior decoration as a reference for their willingness to buy a house, the object presentation device with a label can use the pre-established dimension data of the space to perform real-time calculations to provide a simulated interior The decoration, especially the wall perspective, for example, the wall of the bedroom adjacent to the living room becomes a perspective, and the interior space of the adjacent bedroom can be seen, increasing the feeling of spaciousness.

Please refer to Figures 5A~5B. Figures 5A~5B are schematic diagrams of creating a surrounding image. When the user clicks the scene button 221, the relative surround view image 20 is first displayed on the operation interface 1, and the selectable dress-up button 227 is marked in the operation interface 1, as shown in FIG. 4A. When the dressing button 227 is activated, the operation module 13 uses the currently displayed space (that is, the aisle where the scene button 221 is located) and the size data of the adjacent space (that is, the kitchen where the scene button 223 is located). The perspective view of the wall is calculated, and the perspective view of the wall is presented by covering the wall image in the surround view image originally displayed on the operation interface, as shown in FIG. 4B .

The perspective view of the wall is mainly calculated by using the currently displayed space and the surrounding image and size data of the adjacent space. More specifically, in the operation interface 1 , the surrounding images are partially displayed in the operation interface 1 because of the relationship between the adjacent spaces that are farther away, because the wall is no longer covered by the wall. The distance between the adjacent space and the currently displayed space is known, that is, the location of the scene button 221 and the scene button 223 when shooting is known, so two opposite surrounding images can be obtained using the same viewing angle, and In the operation interface 1 , the surrounding images of those who are farther away need to be appropriately scaled down with the distance between them, so as to present the vision of the farther distance.

In order to avoid the appearance of inappropriate wall perspectives, or when the system builder has special restrictions, the change button 227 can be hidden so that the user cannot click to operate. For example, when the currently displayed space is the living room, the adjacent space may only be the bedroom, so as to calculate the perspective view of the wall between the living room and the bedroom, and for example, the currently displayed space is the In the case of a dining room, the adjacent space may only be the kitchen, so as to calculate the perspective view of the wall between the dining room and the kitchen.

Please refer to Figure 6. Figure 6 is another schematic diagram of the device for creating objects with labels. As shown in the sixth figure, this creation can use the segment marks (not depicted) added or captured during shooting, so that the segment cutting module 18 can automatically interpret the scene attributes of each segment, and automatically complete the image file index table (For example, the starting time of the living room, dining room, etc. is established separately), and it is not necessary that the shooting and the image file merging must be carried out by the same person.

For example, when a photographer is shooting in the living room, he first points the camera at the paragraph sign that says "living room", and then starts to shoot in the living room. In addition to the paragraph mark of the image, the paragraph mark can also be a voice. For example, when the photographer is shooting, he uses a camera with a radio function to shout "living room", and let the camera record the paragraph mark belonging to the voice.

In this way, as long as the plural paragraph marks of images or voices are first established in the recognition database 16, the paragraph cutting module 18 can use the plural paragraph marks of the identification database 16 to perform comparative analysis, and automatically read the paragraph marks. Take multiple surround view images stored in a specific folder, and use image or voice recognition technology to determine the starting and ending perspectives of each paragraph at the time when the paragraph marks appear, and record them in the in the index table. At the same time, when the interactive module broadcast 14 is playing the opposite paragraph in the surround view image, the part marked with the paragraph will be skipped.

Through the detailed description of the preferred embodiments above, it is hoped that the present invention can be described more clearly. The characteristics and spirit of the novel are not intended to limit the scope of the present invention by the preferred embodiments disclosed above. On the contrary, the intention is to cover various modifications and equivalent arrangements within the scope of the claimed patent scope of the present invention.

1: Operation interface

10: Object Database

12: Floor Plan Database

13: Operation module

14: Interactive Mods

Claims (10)

An object presentation device with a label is used for presenting a scene image to which a plurality of house objects belong, including: a floor plan database, storing a floor plan and a dimension data, the floor plan is mainly used to present a schematic diagram of at least one room in the house object, wherein the room is a space surrounded by a plurality of walls, the dimension the information relates to those walls; an object database, which stores a plurality of label data and the surrounding image to which a plurality of house objects belong, each label data has a label symbol and belongs to the space in the room, and each label data can store relative to the A label description with text and pictures on a predetermined coordinate position in space; An interactive module coupled to an operation interface, and according to the floor plan provided by the floor plan database, a plurality of scene buttons that can be selected are marked on the floor plan displayed in the operation interface, and the scene buttons are displayed on the floor plan. When activated, the surround view image relative to the position where the scene button is activated is played through the operation interface, and at the same time, a predetermined angle of view picture relative to the surround view image can be presented according to a view angle command, and the view angle command can be divided into a first view angle image. an axis and a second axis, the first axis and the second axis are perpendicular to each other; and an operation module coupled to the floor plan database, the object database, and the interactive module, in the operation The interface is marked or displayed in the form of a list at least one label symbol belonging to the current space that can be selected, and when the label symbol is activated, according to the predetermined coordinate relative to the label symbol, calculate the corresponding viewing angle command , presenting a predetermined viewing angle picture with the label symbol and displaying the label description with text and pictures, wherein the label description is a removable window, when the window is removed, the temporarily obscured window can be seen The label symbol. The object presentation device with a label as described in item 1 of the scope of the patent application, wherein the object database stores a sunlight data map to which a plurality of house objects belong, and the sunlight data map at least includes an orientation of the location of the house object, The height of the first floor, the positions and sizes of a plurality of doors and windows, each space has at least a single surrounding image, the position of each door and window is related to the floor plan, and the operation module indicates a selectable one in the operation interface. Simulate the lighting button, and when the simulated lighting button is activated, by the currently displayed space and the orientation of the location of the house object, the height of the building, the positions and dimensions of a plurality of doors and windows, and a selected simulation period , based on the ray tracing technique, a relative illumination information of the space currently displayed is calculated to cover the original image in the surrounding image displayed on the operation interface. The object presentation device with a label as described in item 2 of the scope of the patent application, wherein a change button that can be selected is marked in the operation interface, and is displayed in the operation interface. When the change button is activated, a perspective view of the wall is calculated based on the currently displayed space and the size data of the adjacent space, so as to cover the wall image in the surrounding image displayed on the operation interface . The object presentation device with a label as described in item 2 of the patent application scope, wherein the space surrounded by the plan can be divided into a living room, a dining room, a kitchen, a balcony, a bedroom, and a bathroom. According to the object presentation device with a label described in item 4 of the scope of application, when the currently displayed space is the living room, the adjacent space may only be the bedroom, so as to calculate the distance between the living room and the bedroom. The perspective view of the wall; when the currently displayed space is the dining room, the adjacent space may only be the kitchen, so as to calculate the perspective view of the wall between the dining room and the kitchen. The object presentation device with a label as described in item 3 of the scope of the patent application, wherein each segment in the surround view image has a starting angle of view and an ending angle of view, and the starting angle and ending angle of view of a plurality of segments form a index table. The object presentation device with a label as described in claim 6, wherein the index table includes a viewing angle change relative to each paragraph in the surround view image, and the viewing angle change is relative to the start of each paragraph point of view and end point of view. The object presentation device with a label as described in item 6 of the scope of the patent application, The object presentation device further includes: A paragraph cutting module determines the starting angle and ending angle of each paragraph according to the time when a paragraph mark appears in the surround view image, and records it in the index table. The object presentation device with a label as described in claim 7, wherein when the interactive module plays the surround view image relative to the position where the scene button is activated, the part of the paragraph mark is skipped. The object presentation device with a label as described in claim 8, wherein the object presentation device further comprises: A recognition database, including plural paragraph marks, the paragraph marks can be divided into images and voices.

Images