TW202011151A - Interactive video playback device and method capable of fixing viewing angle having an interactive module to show plural scene buttons on a compartment map and transmits a related segment when the scene buttons are activated - Google Patents

Abstract

An interactive video playback device and method capable of fixing a viewing angle according to the present invention mainly include a video database, a compartment map module, and an interactive module. The video database mainly stores a site image belonging to plural house objects. The site image includes plural segments, and each segment is related to a plurality of shooting scenes of the house object. The compartment map module provides a compartment map, and the compartment map mainly presents an outline diagram of at least a room in the house object, wherein the room is the space surrounded by plural walls. The interactive module shows plural scene buttons on the compartment map according to the compartment map provided by the compartment map module and transmits the related segment when the scene buttons are activated, wherein the viewing angles starting from plural scene buttons can be designated the same.

Description

Interactive video playback device and method with fixed viewing angle

The invention relates to an interactive video playback device, in particular to an interactive video playback device and method with a fixed viewing angle.

In order to allow consumers to find housing objects with a willingness to purchase more quickly, existing players use the Internet to play videos, allowing consumers to watch houses online 24 hours a day, which not only saves consumers the time to look around the house. For those who work in the industry, they can save a lot of time and focus on the objects that have been filtered by consumers themselves.

Through the various screening mechanisms provided by the website, such as area, price range, room type, age of the house, etc., in order to find out multiple pieces of eligible housing object information, and then through photos or videos one by one, there is a preliminary for each object The concept is to allow consumers to find the items they are interested in without interference, rather than the items that the real estate agent wants to sell.

In a movie of a house object, the indoor scene is usually viewed for different rooms or perspectives of the object. For example, the film will show the living room, dining room, kitchen, balcony, bedroom, bathroom, etc. in a specific shooting range.

However, in order to facilitate the management and presentation of videos of house objects, the above several video paragraphs are usually combined into a single video, so that when consumers want to go back to watch clips of specific scenes, they have to try to play back multiple times before they find it. The start time of the specific scene.

In order to solve this problem, for different scenes, such as living room, dining room, kitchen, balcony, bedroom, bathroom, respectively, create a video index table (such as the start time of creating a living room, dining room, etc.), and provide information on house objects The selection buttons or hyperlinks of the above-mentioned clips are provided by names (eg living room, dining room), and different clip videos are played according to the user's viewing needs.

However, if the shooting angles are different in the same place, they must be provided separately in living room-1 and living room-2. At the same time, due to the lack of information provided by the viewing angle, it is difficult for users to understand the connection between these videos, which is not easy Let consumers have a more specific spatial concept for the indoor scene of house objects.

In addition, when shooting separately for different scenes (such as living room, dining room, kitchen, balcony), you will get several movie fragments, and when several movie paragraphs are merged into a single movie, you need to manually play the content of each fragment. And to determine whether each video belongs to the living room, dining room, kitchen, balcony, there is a way to create a video index table, so the shooting and video merge must be performed by the same person, otherwise it will be difficult to complete the establishment of the video index table, making the conventional operation mode There is no way to divide the work and cooperation, professional division of labor, quickly complete the production of online house watching videos.

In the conventional technology, when playing a video of a house object, only the paragraph video that can be played is marked by the name (for example, living room, dining room), and the relative paragraph video is played when clicked, but if it is the same place with different shooting angles, then It is difficult for users to understand the connection between these videos, and it is difficult for users to understand the indoor scenes of house objects.

Based on the above purpose, the present invention can provide a fixed-angle interactive video playback device and method mainly including a video database, a compartment map module, and an interactive module. The video database mainly stores the site image to which a plurality of house objects belong, and the site image contains a plurality of fragments, and each paragraph is relative to a plurality of shooting scenes of the house object. The compartment map module provides a compartment map, and the compartment map is mainly used to present a brief view of at least the room in the house object, wherein the room is a space surrounded by a plurality of walls. The interactive module can be based on the compartment map provided by the compartment map module, and a plurality of scene buttons are marked on the compartment map, and when the scene button is activated, to transmit the relative paragraph. Among them, the angle of view at the beginning of a plurality of scene buttons can be designated as the same.

The main purpose of the interactive video playback device and method with fixed viewing angle of the present invention is to use the scene button marked on the compartment map, and when the user clicks the scene button, the room marked on the compartment map is transmitted Or the passage of the place.

The secondary purpose of the interactive video playback device and method with fixed viewing angle of the present invention is to use the paragraph mark added during shooting to allow the system to automatically interpret the scene attributes of each segment, and automatically complete the video index table (for example, create separate The starting time of the living room, dining room, etc.), it is not necessary to shoot and merge the film must be carried out by the same person.

The advantages and spirit of the present invention can be further understood through the following detailed description of the invention and the accompanying drawings.

1‧‧‧browser

10‧‧‧ video database

12‧‧‧compartment map module

14‧‧‧Interactive Module

16‧‧‧Identification database

18‧‧‧Paragraph cutting module

20‧‧‧ venue image

201~206‧‧‧ Paragraph

22‧‧‧compartment map

221~226‧‧‧Scene button

2211, 2221‧‧‧ Perspective

101‧‧‧car body

102‧‧‧Drive module

103‧‧‧Photo Module

104‧‧‧Communication module

105‧‧‧Displacement control module

30‧‧‧Handheld device

301‧‧‧Display screen

302‧‧‧ scene image

The first figure is a schematic diagram of an interactive video playback device and method with fixed viewing angle of the present invention

The second A~B diagrams are schematic diagrams of the compartment diagrams of the present invention

The third figure is a schematic diagram of the connection between the compartment map of the present invention and the site image

FIG. 4 is another schematic diagram of an interactive video playback device and method with fixed viewing angle according to the present invention

The fifth figure is a schematic diagram of a remote control mobile device with photographing function of the present invention

Figure 6 is a schematic diagram of the operation of the handheld device of the present invention

Please refer to the first figure, which is a schematic diagram of an interactive video playback device and method with fixed viewing angle according to the present invention. As shown in the first figure, the fixed-angle interactive video playback device and method of the present invention mainly include a video database 10, a compartment map module 12, and an interactive module 14. The video database 10 mainly stores site images 20 (as shown in the third figure) to which a plurality of house objects belong, and the site images 20 include a plurality of segments, and each paragraph is relative to a plurality of shooting scenes of the house object. The compartment diagram module 12 provides a compartment diagram 22 (as shown in the third diagram).

Please refer to the second A~B diagrams. The second A~B diagrams are schematic diagrams of the compartments of the present invention. As shown in the second figures A to B, the compartment picture 22 is mainly used to present a brief view of at least one room in the house object, where the room is a space surrounded by a plurality of walls. For example, the space surrounded by the compartment in FIG. 22 can be divided into a living room, dining room, kitchen, balcony, bedroom, and toilet.

In order to allow the user to operate and present the image of the venue to which a specific house object belongs, the interactive module 14 can present the compartment map 22 through the browser 1 according to the compartment map 22 provided by the compartment map module 12, In addition, a plurality of scene buttons 221~226 are marked on the compartment map 22, and when the scene buttons 221~226 are activated, the corresponding paragraphs 201~206 of the venue image 20 are sent to the display or smartphone to facilitate Play paragraphs 201~206. In addition to being represented by scene buttons 221~226, scene buttons can also be representative images of relative paragraphs in the venue image.

The angles of view starting from a plurality of scene buttons 221~226 can be designated as the same. More specifically, when one of the scene buttons 221 to 226 is activated and the image 20 relative to the venue is being transmitted, the interactive module 14 will record the current perspective 2211, 2221, and the other scene button 221 When ~226 is activated, the video relative to the venue starts to be transmitted with the recorded current perspective. For example, when switching from the original scene button 221 to the scene button 222, as if the user walked from the door to the living room, the viewing angle 2211 and the viewing angle 2221 are still the same, so that the user does not feel that the change is too big. And there is a visual experience of walking from the door to the living room, as shown in the second A~B diagram.

Please refer to the third figure. The third figure is a schematic diagram of the connection between the compartment map of the present invention and the site image. Specifically, in the compartment of FIG. 22, the part of the space that belongs to the living room has paragraphs 201 and 202 that provide two perspectives, and scene buttons 221 and 222 are provided to allow the user to perform operation transmission. Each paragraph in the venue image 20 has a start time code and an end time code, and an index table is composed of the start time codes and end time codes of a plurality of segments. That is to say, the start time code and end time code of each paragraph in the site video 20 can correspond to the living room, the dining room, the kitchen, the balcony, the bedroom, and the bathroom, respectively.

For example, the start time code and end time code of paragraph 201 are 0:00 and 3:10, respectively, and the start time code and end time code of paragraph 202 are 3:10 and 4:14, respectively. The section 203 of the He room is relative to the scene button 226, the section 204 of the kitchen is relative to the scene button 223, the section 205 of the bedroom is relative to the scene button 224, and the section 206 of the bathroom is relative to the scene button 225.

When the scene button 221 is clicked, it will be transmitted from the perspective of the original shooting living room space. At the same time, the perspective 2211 will appear near the scene button 221 on the compartment map 22 to indicate the shooting perspective of the paragraph 201. The angle of view 2211 can be a static picture or a dynamic picture.

For example, if you used the gyroscope to record the living room space at the same time, and record the change of the viewing angle of the shooting process of paragraph 201 on the same time axis, the symbol of the viewing angle 2211 can start to rotate with the time of the film transmission, A dynamic way to show changes in perspective. The information about the angle of view during the shooting process of paragraph 201 is recorded in the index table in the video database 10. The index table contains a view angle change relative to each paragraph in the site image, and the angle change of the view angle is relative to the start time code and end time code of each paragraph.

Specifically, if the angle of view of the camera used to shoot the clip 201 is 60 degrees, the change of the angle of view of the shot 201 during the shooting process may be 120 degrees to 180 degrees at 2 minutes and 10 seconds and 2 minutes and 12 seconds in the paragraph 201 125 degrees to 185 degrees... and so on. In this way, when the scene button 221 is clicked, the perspective 2211 of the scene button 221 will be presented at 120 degrees to 180 degrees at 2 minutes and 10 seconds, and at 125 to 185 degrees at 2 minutes and 12 seconds. .

However, since the living room, dining room, kitchen, etc. are separate spaces, in actual shooting, they will be shot separately and obtained several independent video files, and several video paragraphs need to be merged into a single first film. However, during the merge process, there must be a photographer to perform or guide, first determine whether each video belongs to the living room, dining room, kitchen, balcony, and then perform the video merge work and create a video index table, and write the video data Library 10.

Please refer to the fourth figure, which is another schematic diagram of an interactive video playback device and method with fixed viewing angle according to the present invention. As shown in the fourth figure, the present invention can use the paragraph mark (not depicted) added or photographed at the time of shooting to allow the paragraph cutting module 18 to automatically interpret the scene attributes of each segment and automatically complete the movie index table ( (For example, the starting time of establishing a living room, dining room, etc.), it is not necessary to merge the shooting and the film by the same person.

For example, when the photographer takes a picture in the living room, the camera lens is first pointed at the paragraph mark with "Living Room" written before the picture is taken in the living room. In addition to the paragraph mark of the image, the paragraph mark can also be an associative voice. For example, when the photographer is taking a picture, he uses the camera with radio function to call out the "living room" and let the camera record the paragraph mark belonging to the harmony.

In this way, as long as the plural paragraph marks of the image or voice are created in the recognition database 16, the paragraph cutting module 18 can use the plural paragraph marks of the recognition database 16 for comparison and analysis, and automatically read Take a plurality of site images stored under a specific folder, and use image or voice recognition technology to detect the time of the paragraph mark, and determine the start time code and end time code of each paragraph, and record In the index table. At the same time, when the interactive mode multicast 14 displays the opposite paragraph in the video of the venue, the part of the paragraph mark will be skipped.

In addition to capturing the venue image 20 in advance and storing it in the video database 10, it is also possible to capture the location image in real time to replace the venue image 20 obtained from the video database 10.

Please refer to the fifth figure. The fifth figure is a schematic diagram of a remote control mobile device with a photographing function according to the present invention. As shown in the fifth figure, the remote control mobile device with a photographing function of the present invention mainly includes a car body 101, a driving module 102, a photographing module 103, a communication module 104, a displacement control module 105, and an interaction module 14. Among them, the driving module 102 is provided on the vehicle body 101 to drive the movement of the vehicle body 101, and the photographing module 103 is fixed on the vehicle body 101 to capture the image in the forward direction and generate the corresponding image Signal. The displacement control module 105 is coupled to the communication module 104 and the drive module 102, and receives the drive command sent from the handheld device 30 through the communication module 104, and the drive module 102 enables the The vehicle body 101 performs corresponding displacement.

When the user selects one of the plurality of scene buttons 221~226 in the compartment map, it is equivalent to causing the driving command to move to the relative position of the scene button in the compartment map, and at the same time, based on the interactive module 14 is coupled to the communication module 102 and the photographing module 103, and transmits the image signal generated by the photographing module 103 through the communication module 102, and transmits through the communication module 102 with the original perspective video The video signal replaces the relative paragraph obtained from the video of the venue of the video database 10. In the process of the photographing module 103 being moved to the relative position of the designated scene button, the photographing module 103 will continuously transmit the image signal, so that the user has a feeling of moving in the indoor space.

In addition to selecting one of the plurality of scene buttons 221 to 226 to allow the camera module 103 to be moved, the driving command can also be generated by other means, especially after the relative position of the scene button is reached.

The handheld device 30 may be a smart phone, but it must have a motion detector (not depicted) and a display screen 301 (as shown in the sixth figure), so that the handheld device 30 can sense the motion detector by the motion detector The amount of movement of the handheld device 30 relative to a fixed direction generates the drive command. Wherein, the movement amount detector is composed of a gyroscope, and can sense the movement amount of the pitch of the vehicle body 101 relative to the direction of the gravity field.

In short, when the displacement control module 105 of the remote control mobile device 10 with photographing function of the present invention receives the driving command from the handheld device 30 through the communication module 104, except that the driving module 102 makes The vehicle body 101 performs a corresponding displacement, and the interactive module 14 mounted on the vehicle body 101 transmits the image signal generated by the camera module 103 through the communication module 104 synchronously, so that the handheld device 30 The display screen 301 displays an image signal, and also adjusts the image signal displayed on the display screen according to the amount of movement in a fixed direction.

Please refer to the sixth figure, which is a schematic diagram of the operation of the handheld device of the present invention. As shown in the sixth figure, the handheld device 30 of the present invention has a gyroscope, and can sense the amount of lateral movement of the handheld device 30 relative to the direction of the gravity field, so that the image signal band transmitted by the interactive module There is relative left and right roll. The image signal with relative left-right tilt is used to cover off part of the image signal generated by the camera module. The hand-held device 30 has the driving command of forward, backward and backward when the gyro senses the amount of forward and backward tilting movement relative to the direction of the gravity field.

As shown in the sixth figure, for example, when the user tilts the handheld device 30 of the present invention to the left, the handheld device 30 has a gyro sensing the amount of movement to the left, but in order to maintain the interactive module 14 The transmitted image signal is in a horizontal state, so the image signal generated by the camera module 103 in the upper left and lower right corners is shielded. Conversely, when the handheld device 30 of the present invention is tilted to the right, the image signal generated by the camera module 103 in the upper right corner and the lower left corner is shielded. Among them, according to the amount of left-right roll motion, the shadow range of the image signals in the upper right and lower left corners is determined.

With the above detailed description of the preferred embodiments, it is hoped that the features and spirit of the present invention can be described more clearly, rather than limiting the scope of the present invention with the preferred embodiments disclosed above. On the contrary, the purpose is to cover various changes and equivalent arrangements within the scope of the patent application of the present invention.

1‧‧‧browser

10‧‧‧ video database

12‧‧‧compartment map module

14‧‧‧Interactive Module

Claims (10)

An interactive video playback device with a fixed viewing angle is used to present the site image to which a plurality of house objects belong, including: a video database to store the site image to which a plurality of house objects belong, the site image includes A plurality of fragments, each paragraph is relative to a plurality of shooting scenes of the house object; a compartment map module provides a compartment map, which is mainly used to present at least one room in the house object Brief diagram, in which the room is surrounded by a plurality of walls; and an interactive module, coupled to the compartment map module and the video database, according to the compartment map module provides the Compartment map, and a plurality of scene buttons are marked on the provided compartment map, and when the scene button is activated, a relative paragraph is obtained from the database image of the venue, and a starting perspective The video transmits the relative passage in the venue image through a communication module; wherein, the angle of view at the beginning of a plurality of scene buttons can be specified. An interactive video playback device with a fixed viewing angle as described in item 1 of the patent scope, wherein when the scene button is activated and the image relative to the venue is playing, the interactive module will record the current viewing angle and When the other scene button is activated, the video relative to the venue starts to be transmitted with the recorded current perspective. The interactive video playback device with fixed viewing angle as described in item 1 of the patent scope, wherein the playback device further includes: a car body; a drive module, which is provided on the car body and used to drive the car body Mobile; a camera module, fixed on the car body, used to capture the image in the direction of travel and generate a corresponding image signal; a displacement control module, coupled to the communication module and the drive module, through The communication module receives the driving command from a handheld device, and the corresponding displacement is caused by the driving module, wherein the driving command refers to moving to a plurality of scenes in the compartment picture The relative position of the button; wherein, the interactive module is coupled to the communication module and the camera module, transmits the image signal generated by the camera module through the communication module, and passes through A communication module transmits the image signal to replace the relative paragraph obtained from the database image of the venue. An interactive video playback device with a fixed viewing angle as described in item 7 of the patent scope, wherein the handheld device has a motion detector and a display screen, the motion detector can sense the handheld device relative to A fixed direction of motion and generating the drive command, and passing through the relative segment in the venue image received by the communication module, causes the display screen of the handheld device to display the image signal, while adjusting according to the fixed direction of motion The image signal displayed on the display screen. An interactive video playback device and method with a fixed viewing angle as described in item 9 of the scope of the patent application, wherein the image signal with a relative left and right tilt is used to mask out part of the image signal generated by the camera module. An interactive video playing method with fixed viewing angle is used to present the site image to which a plurality of house objects belong, including: providing a compartment map, which is mainly used to present at least one room in the house object A schematic diagram of the room in which the room is surrounded by a plurality of walls; and the compartment map provided by the compartment map module, and a plurality of scenes are marked on the provided compartment map Button; and when the scene button is activated, the relative paragraph is obtained, and the relative paragraph in the venue image is transmitted with the starting one-angle video, wherein the angle of view at the beginning of a plurality of scene buttons can be specified. An interactive video playback method with a fixed viewing angle as described in item 6 of the patent scope, wherein when the scene button is activated, when the video relative to the venue is being played, the current perspective is recorded, and the other scene buttons are recorded When it is activated, the video relative to the venue starts to be transmitted with the recorded current perspective. As described in item 6 of the patent application scope, an interactive video playback method with a fixed viewing angle, a driving module is provided on a vehicle body to drive the movement of the vehicle body, and a camera module is fixed on the vehicle On the body, it is used to capture the image in the forward direction and generate a corresponding image signal. The playback method further includes: receiving the driving command from a handheld device, and using the driving module to make the vehicle body Perform a corresponding displacement, where the driving command refers to moving to the relative position of a plurality of scene buttons in the compartment map; the video signal is transmitted from the starting perspective video to replace the relative paragraph obtained in the venue video. The interactive video playback method with fixed viewing angle as described in item 8 of the patent application scope, wherein the handheld device has a motion detector and a display screen, the motion detector can sense the handheld device relative to A fixed direction of motion and generating the drive command, and passing through the relative section of the venue image received by the communication module, causes the display screen of the handheld device to display the image signal, and adjusts according to the fixed direction of motion The image signal displayed on the display screen. An interactive video playback method and method with a fixed viewing angle as described in item 9 of the scope of the patent application, wherein the image signal with a relative left and right tilt is used to mask out part of the image signal generated by the camera module.

Images