TWI786511B - Object display device for marking on three-dimensional buildings - Google Patents

Abstract

The object display device for marking on the three-dimensional building mainly includes a regional three-dimensional map database, a video database, and an interactive module. According to the stereogram of the region provided by the stereogram database of the region, the interactive module marks a plurality of scene buttons to which a plurality of house objects belong on the stereogram of the region, and when the scene button is activated, plays the button of the scene. The scene buttons correspond to the relative paragraphs in the scene movie.

Description

Object display device for marking on three-dimensional buildings

The invention relates to an interactive video playing device, especially an object display device for marking on three-dimensional buildings.

In order to allow consumers to find buildings that they are willing to buy more quickly, some operators have broadcasted videos on the Internet, allowing consumers to view houses online 24 hours a day. For middlemen, they can save a lot of time to watch and spend more time on objects that have been filtered by consumers themselves.

Through the various screening mechanisms provided by the website, such as region, price range, house type, house age, etc., in order to find multiple pieces of eligible building information, and then through photos or videos one by one, have a preliminary understanding of each house object The concept allows consumers to find the items they are interested in without interference, rather than the items that real estate brokers want to sell.

In order to let users know the location of each house object more clearly, some operators often use electronic maps to mark the location of each house object. The outline of the building is used to mark the location of these objects, and at the same time, 3D interactive viewing is provided, and the internal space of the objects is presented through images or 360 panoramic photos. However, users have to enter a specific object to see it. If they find that they are not satisfied with the view, they have to go back to Google Maps and click on other objects to see the content space images of other objects, which is very troublesome.

In the conventional technology, the user has to click on a specific object from the electronic map and enter the corresponding web page content to perform 3D interactive house inspection operation, which is very troublesome.

Based on the above purpose, the object display device for marking on the three-dimensional building mainly includes a regional three-dimensional map database, a video database, and an interactive module. According to the stereogram of the region provided by the stereogram database of the region, the interactive module marks a plurality of scene buttons to which a plurality of house objects belong on the stereogram of the region, and when the scene button is activated, plays the button of the scene. The scene buttons correspond to the relative paragraphs in the scene movie.

The advantages and spirit of the present invention can be further understood through the following detailed description of the invention and the accompanying drawings.

1: Image scanning components

2: browser

10: Video database

11: Regional stereogram database

12:Pattern map module

13: Identification module

14:Interactive module

15: Teleportation module

16: Identification database

18: Paragraph cutting module

20: Scene Video

201~206: Paragraph

22: Pattern diagram

221~226, 301~302: scene buttons

2211: angle of view symbol

30: Stereoscopic map of the area

The first figure is a schematic diagram of an object display device for marking on a three-dimensional building according to the present invention

The second figure is a schematic diagram of a perspective view of the area of the present invention.

The third figure is another schematic diagram of the object display device for marking on a three-dimensional building according to the present invention

The fourth figure is a schematic diagram of the relationship between the regional stereogram and the scene film of the present invention

The fifth figure is another schematic diagram of the object display device for marking on a three-dimensional building according to the present invention

Please refer to the first figure, which is another schematic diagram of the object display device for marking on a three-dimensional building according to the present invention. Object display device for marking on three-dimensional buildings according to the present invention It further includes a video database 10 , a regional stereogram database 11 , a layout diagram module 12 , and an interactive module 14 . The video database 10 mainly stores scene videos 20 (as shown in the fourth figure) to which a plurality of house objects belong, and the scene video 20 includes a plurality of paragraphs, and each paragraph is corresponding to a plurality of shooting scenes of the house objects, and each Each house object has a house number, so that the corresponding scene movie 20 can be obtained with the house number. The layout diagram module 12 provides the layout diagram 22 (as shown in the fourth figure), and the area stereogram 30 is provided by the area stereogram database 11 (as shown in the second diagram). The regional three-dimensional map database 11 stores a plurality of regional three-dimensional maps and the total number of floors of the buildings. Each regional three-dimensional map is mainly used to present at least a three-dimensional map of the outline of the building in the building, wherein the outline of the building is composed of a plurality of The space surrounded by walls and floors.

Please refer to the second figure, which is a schematic diagram of a perspective view of the area of the present invention. As shown in the second figure, in the area perspective view 30 of the present invention, each area perspective view 30 is mainly used to present at least a perspective view of the outline of the building in the building, wherein the outline of the building is composed of a plurality of walls, floors and floors. the space surrounded by it.

When the consumer needs to view the area stereogram 30, the transmission module 15 will relatively transmit to the area stereogram 30 with the outline of the building and the relative words and numbers according to the received area code to the user end, so that the display device at the user end can present the perspective view 30 of the area.

In order to allow consumers to directly view photos or images of each house object on the three-dimensional map of the area 30, each house object on the three-dimensional map of the area 30 has scene buttons 301~302 relatively, and when the scene buttons 301~302 are clicked Photos or videos of each house object can be displayed at any time, instead of having to enter to see the photos or videos.

In order to realize this purpose, because this area perspective map 30 itself is three-dimensional, therefore When marking the scene button 301 ~ 302 on it, at first you must know where the mark is. The interactive module 14 first divides the floor where the house number is located by the total number of floors to obtain the proportional position, and then marks the scene buttons 301-302 on the three-dimensional map 30 of the area one by one according to the proportional position. Or, because the same house number may have different floors that are being sold at the same time, and when a plurality of house objects overlap in position on the three-dimensional map 30 of the area, the interactive module 14 will display the plurality of house objects in the form of a list The plurality of scene buttons to which it belongs. For example, when displaying the actual transaction price, when the scene buttons 301-302 are clicked, first select the floor. The method of making the three-dimensional map 30 in this area can be directly applied to the google electronic map, but the accuracy of the outline of the buildings on the google electronic map is low, so the paper map drawn by the field survey or the measurement result map can be converted into an electronic map picture.

To put it simply, in the object display device for marking on a three-dimensional building of the present invention, after the recognition module 13 converts the predetermined format of the paper document into a line segment, the original paper document is often scanned. If some mottled patterns are directly converted into bar graphs without processing, misjudgments are likely to occur. Therefore, these line segments must first be extended to make contact with other line segments to form a closed rectangular frame outside the building. contour, and calculate the height of the building based on the total number of floors of the building, but if there are already contacts between the line segments, they will no longer be extended. Finally, the result will be stored in the three-dimensional map database 11 of the area, and the image file will be stored at the same time The location of the information in the document is identified as the relative text and the number, where the text is usually a road name, and the number is usually a house number.

Please refer to the third figure, which is a schematic diagram of the object display device for marking on a three-dimensional building according to the present invention. As shown in the third figure, the object display device for marking on a three-dimensional building of the present invention mainly includes an area stereogram database 11, an image scanning device 1, an identification module 13, Teleport module 15. A plurality of regional stereograms and the total number of floors of the buildings are stored in the regional stereogram database 11, and each regional stereogram is mainly used to present the outline of the building in the building. The image scanning device 1 is used to scan the paper document into an image file, so that the identification module 13 converts the paper document into a substantially closed rectangular box outline of the building, and stores it in the area stereogram database 11 , and at the same time identify the position of the data in the image file as the relative character and number. The transmission module sends 15 the stereoscopic view of the area with the outline of the building and the corresponding characters and numbers to the user terminal, so that the display device at the user end can present the stereoscopic view of the area. Wherein, the paper file is often a measurement result map with the most accurate map data or a hand-painted three-dimensional map of the area, and the paper file has a predetermined format, and the predetermined format includes at least a plurality of line segments and a plurality of data positions, Each data location contains at least text or numbers.

Please refer to the fourth figure, which is a schematic diagram of the relationship between the area stereogram and the scene video of the present invention. As shown in Figure 4, the layout diagram 22 is mainly used to present the configuration diagram of each space (such as living room, dining room, etc.) in the building, and is a space surrounded by a plurality of walls and floors. .

In order to allow the user to operate and present the scene video to which the specific house object belongs, the interactive module 14 can present the layout diagram 22 through the browser 2 according to the layout diagram 22 provided by the layout diagram module 12, and display the layout diagram 22 in the layout diagram module 12. A plurality of scene buttons 221-226 are marked on FIG. 22 , and when the scene buttons 222-226 are activated, the corresponding paragraphs 201-206 in the scene movie 20 are played. In addition to being represented by scene buttons 221-226, the scene buttons can also be representative images of corresponding sections in the scene video.

Specifically, in the layout diagram 22, the part belonging to the living room space has provided The paragraphs 201 and 202 of the two perspectives respectively provide scene buttons 221 and 222 for the user to operate and play. Each segment in the scene movie 20 has a start time code and an end time code, and an index table is composed of a plurality of start time codes and end time codes of the segments. That is to say, the start time code and end time code of each paragraph in the scene movie 20 can correspond to different spaces respectively.

For example, the start timecode and end timecode of segment 201 are 0:00 and 3:10 respectively, and the start timecode and end timecode of segment 202 are 3:10 and 4:14 respectively. The paragraph 203 of the Japanese room is then relative to the scene button 226 , the paragraph 204 of the kitchen is then relative to the scene button 223 , the paragraph 205 of the bedroom is then relative to the scene button 224 , and the paragraph 206 of the bathroom is relative to the scene button 225 .

When the scene button 221 is clicked, it will be played with the original viewing angle of the living room space. At the same time, on the pattern diagram 22, an angle of view symbol 2211 will appear near the scene button 221 to indicate the shooting angle of the paragraph 201. The angle of view symbol 2211 may be a static picture or a dynamic picture.

For example, if the gyroscope was used to record when shooting the living room, and the angle of view change during the shooting process of paragraph 201 was recorded on the same time axis, the symbol of the angle of view 2211 can start to rotate with the playing time of the movie, so as to A dynamic way to show changes in perspective. The information of the angle change during the shooting process of the paragraph 201 is recorded in the index table in the video database 10 . The index table contains an angle change relative to each segment in the scene movie, the angle change relative to each segment's start timecode and end timecode.

Specifically, if the angle of view of the camera used to shoot the segment 201 is 60 degrees, the angle of view of the segment 201 during the shooting process can be 120 degrees to 180 degrees at 2 minutes and 10 seconds, and 120 degrees to 180 degrees at 2 minutes and 12 seconds. for 125 degrees to 185 degrees...and so on. In this way, when the scene button 221 is clicked, the angle of view symbol 2211 of the scene button 221 will change from 120 degrees to 2 minutes and 10 seconds. 180 degrees to present, 2 minutes and 12 seconds to present at 125 to 185 degrees.

However, since the living room, dining room, kitchen, etc. are all independent spaces, when actually shooting, they will be shot separately to obtain several independent video files, and several video segments need to be merged into one single video. However, during the merging process, there must be a photographer to execute or guide, first judge whether each video belongs to the living room, dining room, kitchen, balcony, and then execute the video merging work and create a video index table and write the video data Library 10.

Please refer to the fifth figure, which is another schematic diagram of the object display device for marking on a three-dimensional building according to the present invention. As shown in the fifth figure, the present invention can make use of the paragraph mark (not depicted) added or photographed during shooting to allow the paragraph cutting module 18 to automatically interpret the scene attributes of each paragraph, and automatically complete the film index table ( For example, the starting time of setting up the living room, dining room, etc. separately), it is not necessary to shoot and merge the video must be done by the same person.

For example, when the photographer is shooting towards the living room, first point the camera lens to the paragraph mark with "living room", and then start shooting towards the living room. In addition to the paragraph mark of the image, the paragraph mark can also be a voice. For example, when shooting, the photographer uses a camera with a radio function to call out "living room", and let the camera record a paragraph mark belonging to the sound.

In this way, as long as multiple paragraph marks of images or voices are first established in the recognition database 16, the paragraph cutting module 18 can use the multiple paragraph marks of the recognition database 16 for comparison and analysis, and automatically read Take a plurality of scene videos stored under a specific directory, and use image or voice recognition technology to determine the start time code and end time code of each paragraph when the time of the paragraph mark appears, and record it in that index table. Simultaneously, when the interactive module broadcasting 14 puts the relative paragraph in this scene film, the part of this paragraph mark can be skipped. Through the above detailed description of the preferred embodiments, it is hoped that the characteristics and spirit of the present invention can be described more clearly, and the scope of the present invention is not limited by the preferred embodiments disclosed above. On the contrary, the intention is to cover various changes and equivalent arrangements within the scope of the patent application for the present invention.

2: browser

10:Movie module

11: Regional stereogram database

12:Pattern map module

14:Interactive module

Claims (9)

An object display device for marking on a three-dimensional building, comprising: a regional three-dimensional map database, which stores a plurality of regional three-dimensional maps and the total number of floors of the building, and each regional three-dimensional map is mainly used to present at least one building in a building A three-dimensional view of the outline of a building, wherein the outline of the building is a space surrounded by a plurality of walls and floors; a video database is used to store a scene video to which a plurality of house objects belong, the scene The video contains a plurality of paragraphs, each paragraph corresponds to a plurality of shooting scenes of the house object, each house object has a house number; and an interactive module, based on the area stereogram provided by the area stereogram database, and then according Divide the floor where the house number is located by the total number of floors to obtain a proportional position, so as to mark the multiple scene buttons to which the multiple house objects belong one by one on the three-dimensional map of the area according to the proportional position, and when the scene button is activated, Playing the scene button corresponds to the relative paragraph in the scene video; wherein, the scene button is a representative image of the relative paragraph in the scene video. The object display device for marking on a three-dimensional building as described in item 1 of the scope of the patent application, wherein the display device further includes: an image scanning element for scanning a paper document into an image file, and the paper document has A predetermined format, the predetermined format includes at least a plurality of line segments, and a plurality of data positions, each data position contains at least one character or a number; a recognition module, coupled to the area stereogram database and the image scanning component, It is used to convert the predetermined format of the paper file into line segments, and then extend these line segments until they come into contact with other line segments, so as to form the outline of the building that is generally a closed rectangular box, and based on its Store the height calculated from the total number of floors of the building in the 3D map database of the area, and at the same time identify the position of the data in the image file as the relative text and the number, and if there is contact between the line segments, then no longer extend. The object display device for marking on a three-dimensional building as described in item 1 of the scope of application, wherein each paragraph in the scene film has a start time code and an end time code, and the start time of multiple paragraphs The code and the end time code form an index table. The object display device for marking on a three-dimensional building as described in item 3 of the scope of the patent application, wherein the space surrounded by the three-dimensional view of the area can be divided into different house numbers, and the starting time of each paragraph in the scene video Code and The end time codes can correspond to different house numbers respectively. The object display device for marking on a three-dimensional building as described in item 4 of the scope of patent application, wherein the index table contains a perspective change relative to each paragraph in the scene film, and the perspective change is relative to each paragraph The start timecode and end timecode of the . The object display device for marking on a three-dimensional building as described in item 4 of the scope of patent application, which further includes: a paragraph cutting module, which determines the starting point of each paragraph according to the time when a paragraph mark appears in the scene film start timecode and end timecode, and record in this index table. The object display device for marking on a three-dimensional building as described in item 6 of the scope of the patent application, wherein when the interactive module plays the corresponding paragraph in the scene video, the part marked by the paragraph will be skipped. The object display device for marking on a three-dimensional building as described in item 6 of the scope of the patent application, wherein the object display device for marking on a three-dimensional building further includes: an identification database, including a plurality of paragraph marks, the Paragraph marks can be divided into image and voice. The object marked on the three-dimensional building as described in item 8 of the scope of the patent application A display device, wherein before shooting the scene, the paragraph mark of the image will be shot into the scene film.

Images