TWI811292B - Interactive photography device and method - Google Patents

Abstract

The interactive photography device and method of the present invention mainly include a vehicle body, a communication module, a driving module, a photography module, and a displacement control module, and allow interaction with multiple user devices. In the interactive photography device of the present invention, the displacement control module can receive the coordinate position sent from each of the user devices of the main device, convert the coordinate position into the driving command, and use the The driving module causes the vehicle body to move correspondingly, and at the same time transmits the image signal generated by the camera module to all user devices. The main user device has a compartment map module and an operation module. The interactive module receives the interactive operation issued by one of the plurality of user devices and broadcasts it to the plurality of other user devices, so that the display content corresponding to the interactive operation is displayed on the display of each of the user devices. .

Description

Interactive photography devices and methods

The invention relates to an interactive video playback device, in particular to an interactive photography device.

In order to allow consumers to quickly find houses they are willing to buy, some operators have used video playback on the Internet to allow consumers to view houses online 24 hours a day. For industry players, it can save a lot of time for viewing and focus more time on items that have been filtered by consumers themselves.

Through the various filtering mechanisms provided by the website, such as area, price range, room type, house age, etc., you can find multiple housing property information that meets the conditions, and then use photos or videos one by one to get a preliminary understanding of each property. The concept allows consumers to find the items they are interested in without interference, rather than the items the real estate agent wants to sell.

In videos of house objects, interior scenes are often viewed from different rooms or perspectives of the object. For example, the video will show the living room, dining room, kitchen, balcony, bedroom, bathroom, etc. in specific shooting areas.

However, in order to facilitate the management and presentation of videos of house objects, the above-mentioned several video segments are usually merged into a single video, so that when consumers want to go back and watch the clips of a specific scene, they have to try to play it back many times before they can find it. The starting time of this particular scene.

In order to solve this problem, first create video index tables for different scenes, such as living room, dining room, kitchen, balcony, bedroom, bathroom and toilet (for example, create separate video index tables for living room, dining room, etc. start time), and provide selection buttons or hyperlinks for the above-mentioned clips by name (such as living room, dining room) in the provided house object information, and play different clip videos according to the user's viewing needs.

However, in order to meet the more diversified needs of consumers, businesses can no longer just provide pre-filmed videos for consumers to watch, but should also allow consumers to watch videos at different times and under different weather conditions. View indoor and outdoor images of your house more easily.

At the same time, in order to give agents the opportunity to directly interact with consumers online to view houses, this kind of online house viewing should add interactive functions.

In the conventional technology, users are only allowed to operate and view the operation results by themselves, but cannot interact with other people.

Based on the above objectives, the interactive photography device and method of the present invention mainly include a vehicle body, a communication module, a driving module, a photography module, and a displacement control module, and allow interaction with multiple user devices. In the interactive photography device of the present invention, the displacement control module can receive the coordinate position sent from each of the user devices of the main device, convert the coordinate position into the driving command, and through the The driving module causes the vehicle body to move correspondingly, and at the same time transmits the image signal generated by the camera module to all user devices. The main user device has a compartment map module and an operation module. The interactive module receives the interactive operation issued by one of the plurality of user devices and broadcasts it to the plurality of other user devices, so that the display content corresponding to the interactive operation is displayed on the display of each of the user devices. .

The advantages and spirit of the present invention can be obtained from the following detailed description of the invention and the accompanying drawings. to learn more.

1: Browser

10:Video database

12:Partition map module

14: Operation module

15:Interactive module

16:Identification database

18: Paragraph cutting module

20: Site image

201~206: Paragraph

22: Compartment diagram

221~226: Venue fixed point

2211, 2221: perspective

101:Car body

The first picture is a schematic diagram of the interactive photography device of the present invention.

The second figure is a schematic diagram of the operation of the user device of the present invention.

Figures 3A to 3B are schematic diagrams of compartment diagrams of the present invention.

The fourth figure is a schematic diagram showing the relationship between the partition map and the site image of the present invention.

The fifth figure is another schematic diagram of the interactive photography device of the present invention.

Please refer to the first figure. The first figure is a schematic diagram of the interactive photography device of the present invention. As shown in the first figure, the interactive photography device of the present invention mainly includes a vehicle body 101, a driving module 102, a photography module 103, a communication module 104, and a displacement control module 105. Among them, the driving module 102 is provided on the vehicle body 101 to drive the movement of the vehicle body 101, and the camera module 103 is fixed on the vehicle body 101 to capture images in the direction of travel and generate corresponding images. signal. The displacement control module 105 is coupled to the communication module 104 and the driving module 102, and receives the driving command from each of the user devices 30 through the communication module 104, and through the driving module The group 102 causes the vehicle body 101 to perform corresponding displacement.

In order to allow interaction with a plurality of user devices 30 , the interaction module 15 is coupled to the communication module 104 and can receive an interactive operation from one of the plurality of user devices 30 and broadcast it to other users. A plurality of user devices 30 causes display content corresponding to the interactive operation to be displayed on the display 301 of the user device 30 . For example, the so-called interactive operation here can of course refer to text or voice communication content, and it can also allow brokers to directly mark the displayed screen so that other buyers or sellers who receive the message can understand more intuitively. What the agent wants To express the meaning, for example, draw a straight line in the picture of the living room and explain that the distance between the straight line and the straight line is about two meters.

Theoretically, multiple user devices 30 that join a specific group can all issue the driving command to the corresponding photographing device in the group, so that the driving module 102 of the photographing device causes the vehicle body 101 to perform corresponding displacement, but in this way It may make the driver command too confusing, so when the interactive operation received by the interactive module 15 is a designated primary device, the interactive module 15 only receives each 30 of the user devices from the designated primary device. The user action issued belongs to the user that can be performed by the main device.

The household operations that can be performed by the main device mainly include the following two types. One of them can be generated by each of the user devices 30 when the fixed point of the site is selected through the operation module 14, which is related to the compartment. The coordinate position of the image is transferred to the displacement control module 105 . In addition, the household operation that can be performed by the main device can be to transmit the generated driving command to the displacement control module 105, and at the same time broadcast the image signal generated from the camera module 103 to all user devices, so that the The display 301 of each of the user devices 30 displays the image signal, and at the same time, the image signal displayed by the display is adjusted according to the amount of movement in the fixed direction.

More specifically, in addition to the interaction module 15 , the user device 30 also has a compartment map module 12 and an operation module 14 . The operation module 14 marks a plurality of site fixed points 221 ~ 226 on the provided compartment map based on the compartment map provided by the compartment map module (as shown in the third A to third B pictures) , and when the fixed point of the site is selected, the coordinate position related to the compartment map is generated.

Please refer to the second figure. The second figure is a schematic diagram of the operation of the user device. As shown in the second figure, the user device 30 can be a smartphone, but it must have a motion detector (not depicted) and a display 301 so that the user device 30 can sense these uses through the motion detector. device Each 30 degrees of motion relative to a fixed direction generates the drive command. The motion detector is composed of a gyroscope and can sense the pitch motion of the user device 30 relative to the direction of the gravity field.

Please refer to Figures 3A to 3B. Figures 3A to 3B are schematic diagrams of compartment diagrams of the present invention. As shown in Figures 3A to 3B, the partition map 22 is mainly used to present a schematic diagram of at least one room in the house object, where the room is a space surrounded by a plurality of walls. For example, the space enclosed in the partition diagram 22 can be divided into a living room, a dining room, a kitchen, a balcony, a bedroom, and a bathroom. In order to allow the user to operate and display the site image to which a specific house object belongs, the operation module 14 can display the compartment map 22 through the browser 1 based on the compartment map 22 provided by the compartment map module 12. And mark a plurality of site fixed points 221 ~ 226 on the compartment map 22, and when the site fixed point is selected, the coordinate position related to the compartment map is generated, so that the interactive photography device 10 can automatically move to This coordinate position does not require the user to find a way to remotely control the interactive photography device to move around the house.

To put it simply, when the displacement control module 105 in the interactive photography device 10 of the present invention receives the coordinate position sent from each of the user devices 30 through the communication module 104, the coordinate position is converted into the drive In addition to the corresponding displacement of the vehicle body 101 through the drive module 102, the operation module 14 simultaneously transmits the image signal generated by the camera module 103 through the communication module 104, so that the users The display 301 of each device 30 displays an image signal so that the user can see the image signal captured while moving to create a sense of reality. The image signal displayed on the display is also adjusted according to the amount of movement in a fixed direction.

After the interactive photography device 10 reaches the coordinate position, the user can use The user device 30 is used to remotely control the interactive photography device. As shown in the second figure, the user device 30 of the present invention has a gyroscope, and can sense the left and right tilting motion of each user device 30 relative to the direction of the gravity field, so that the operation module transmits The image signal has relative left and right roll. The image signal with relative left and right tilt is generated by blocking part of the camera module. When the user device 30 has a gyroscope that senses the amount of forward and backward pitching and tilting motion relative to the direction of the gravity field, the user device 30 will issue the driving command of forward, backward, and backward.

As shown in the second figure, for example, when the user tilts the user device 30 of the present invention to the left, the user device 30 has a gyroscope that senses the amount of movement tilted to the left, but in order to maintain the operation module 14 The transmitted image signal is in a horizontal state, thus blocking the image signal generated by the camera module 103 in the upper left corner and lower right corner. On the contrary, when the user device 30 of the present invention is tilted to the right, the image signal generated by the camera module 103 in the upper right corner and lower left corner is blocked. Among them, the shielding range of the upper right corner and lower left corner of the image signal will also be determined based on the amount of left and right tilting movement.

However, when a failure occurs, the image signal captured in advance can be temporarily sent to the user device 30 . That is to say, when the site fixed points 221 to 226 are selected, the corresponding sections 201 to 206 in the site image 20 are sent to the display or the smart phone so that the sections 201 to 206 can be played. In addition to being represented by field fixed points 221 to 226, the field fixed points can also be representative images of corresponding sections in the field image.

The angles of view starting from multiple site fixed points 221~226 can be specified to be the same. More specifically, when one of the site fixed points 221 to 226 is selected and the site image 20 is being transmitted, the operation module 14 will record the current viewing angles 2211, 2221, and adjust the other site fixed points 221 When ~226 is selected, the image of the site will be transmitted starting from the current recorded perspective. For example, when switching from the original venue fixed point 221 to the venue fixed point 222, just as the user walks from the door to the living room, the angle of view 2211 and the angle of view 2221 are still the same, so that the user will not feel that the change is too big visually. And there is a visual experience of walking from the door to the living room, as shown in Figures 3A~3B.

Please refer to the fourth figure. The fourth figure is a schematic diagram of the relationship between the partition map and the site image of the present invention. Specifically, in the partition diagram 22, the space belonging to the living room has paragraphs 201 and 202 that provide two viewing angles, and site fixed points 221 and 222 are respectively provided for the user to perform operations and transmissions. Each segment in the venue image 20 has a start time code and an end time code, and an index table is composed of the start time codes and end time codes of multiple segments. That is to say, the start time code and the end time code of each paragraph 20 in the venue image can respectively correspond to the living room, the dining room, the kitchen, the balcony, the bedroom, and the bathroom.

For example, the start time code and end time code of paragraph 201 are 0:00 and 3:10 respectively, and the start time code and end time code of paragraph 202 are 3:10 and 4:14 respectively. The Japanese room section 203 is relative to the site fixed point 226, the kitchen section 204 is relative to the site fixed point 223, the bedroom section 205 is relative to the site fixed point 224, and the bathroom section 206 is relative to the site fixed point 225.

When the site fixed point 221 is clicked, it will be transmitted from the perspective of the original shooting of the living room space. At the same time, the perspective 2211 will appear near the site fixed point 221 on the compartment diagram 22 to indicate the shooting perspective of paragraph 201. The perspective 2211 can be a static picture or a dynamic picture.

For example, if a gyroscope was used to record the living room space when filming, and the changes in angle of view during the shooting process in paragraph 201 were recorded on the same timeline, the symbol of angle of view 2211 could start to rotate along with the time of the video transmission, so as to Show perspective changes in a dynamic way. The information about the angle change during the shooting process of paragraph 201 is recorded in the index table in the film database 10 . The index table contains the angle of view relative to one of the viewing angle changes in each segment of the site image. The degree change is relative to the start timecode and end timecode of each paragraph.

Specifically, if the angle of view of the camera used to shoot segment 201 is 60 degrees, the change of angle of view during the shooting process of segment 201 can be from 120 degrees to 180 degrees at 2 minutes and 10 seconds, and from 120 degrees to 180 degrees at 2 minutes and 12 seconds in paragraph 201. It's 125 degrees to 185 degrees...and so on. In this way, when the venue fixed point 221 is clicked, the viewing angle 2211 of the venue fixed point 221 will be presented from 120 degrees to 180 degrees at 2 minutes and 10 seconds, and from 125 degrees to 185 degrees at 2 minutes and 12 seconds. .

However, since the living room, dining room, kitchen, etc. are all separate spaces, when actually shooting, they will be shot separately and obtain several independent video files, and several video segments need to be merged into a single one. Film. However, during the merging process, there must be a photographer to perform or guide, first determine whether each video belongs to the living room, dining room, kitchen, balcony, and then perform the video merging work, create a video index table, and write the video data Library 10.

Please refer to the fifth figure. The fifth figure is another schematic diagram of the interactive photography device of the present invention. As shown in Figure 5, the present invention can use the segment marks (not depicted) added or captured during shooting to allow the segment cutting module 18 to automatically interpret the scene attributes of each segment and automatically complete the video index table ( For example, create the starting time of the living room, dining room, etc. separately). It is not necessary that the shooting and video merging must be done by the same person.

For example, when the photographer takes a picture of the living room, he first points the camera lens at the paragraph mark that says "living room" and then starts to take pictures of the living room. In addition to the paragraph mark of the image, the paragraph mark can also be with the voice. For example, when the photographer is taking pictures, he uses a camera with a radio function to shout "living room", and the camera records the paragraph mark with the sound.

In this way, as long as the plurality of paragraph marks of the image or voice are first established in the recognition database 16, the paragraph cutting module 18 can use the plurality of paragraph marks of the recognition database 16 for comparison. Analyze and automatically read multiple venue images stored in a specific directory, and use image or voice recognition technology to determine the start time code of each paragraph when it detects the time when the paragraph mark appears. and end timecode, and recorded in the index table. At the same time, when the operation module multicast 14 plays the corresponding paragraph in the venue image, the part marked by the paragraph will be skipped.

Through the above detailed description of the preferred embodiments, it is hoped that the characteristics and spirit of the present invention can be more clearly described, but the scope of the present invention is not limited by the above disclosed preferred embodiments. On the contrary, the intention is to cover various modifications and equivalent arrangements within the scope of the patent for which the present invention is intended.

1: Browser

10:Video database

12:Partition map module

14: Operation module

15:Interactive module

101:Car body

102:Driver module

103:Photography module

104: Communication module

105: Displacement control module

30: User device

Claims (8)

An interactive photography device allows interaction with a plurality of user devices. Each of the user devices has a compartment diagram module and an operation module. The compartment diagram module provides A partition diagram. The partition diagram is mainly used to present a schematic diagram of at least one room in the house object. The room is a space surrounded by multiple walls. The operation module is based on the partition diagram. The compartment map provided by the module has a plurality of site fixed points marked on the provided compartment map, and when the site fixed point is selected, a coordinate position related to the compartment map is generated. The photography device includes: a vehicle body; a communication module located on the vehicle body; a driving module located on the vehicle body and used to drive the movement of the vehicle body according to a driving command; a photography module, Fixed on the vehicle body, used to capture images in the direction of travel and generate a corresponding image signal; a displacement control module, coupled to the communication module and the driving module, receives data from the communication module through the communication module The coordinate position sent by each of the user devices is converted into the drive command, and the drive module causes the vehicle body to perform corresponding displacement, and The image signal generated by the camera module is transmitted to each of the user devices through the communication module; wherein each of the user devices includes an interactive module coupled to the communication module , receiving an interactive operation issued by one of the plurality of user devices, and broadcasting it to the plurality of other user devices, so that the display content corresponding to the interactive operation is displayed on a display of each of the other plurality of user devices. ; Among them, when the interactive operation received by the interactive module is a designated primary device, the interactive module only receives the executable operation of the primary device from each of the user devices of the designated primary device. Interactive operation; wherein, the interactive operation that can be performed by the main device can generate the coordinate position related to the compartment map when each of the user devices is selected through the operation module at a fixed point on the site, and Pass the coordinate position to the displacement control module. The interactive photography device as described in item 1 of the patent application, wherein each of the user devices has a motion detector and a display, and the motion detector can sense the movement of the user devices. Each amount of movement relative to a fixed direction generates the drive command, and the interactive operation that the main device can perform can be the generated drive command. The command is passed to the displacement control module, and the image signal generated by the camera module is broadcast to all user devices at the same time, so that the display of each of the user devices displays the image signal, and at the same time according to the fixed direction The amount of movement adjusts the image signal displayed on the monitor. The interactive photography device as described in item 2 of the patent application, wherein the motion detector is composed of a gyroscope and can sense the pitch of each of the user devices relative to the direction of the gravity field. The amount of movement of each of the user devices relative to the direction of the gravity field can be sensed, so that the image signal transmitted by the operation module has a relative left and right tilt. As described in item 3 of the patent application, in the interactive photography device, the image signal with relative left and right tilt is generated by partially blocking the image signal generated by the camera module. The interactive photography device as described in item 1 of the patent application, wherein the photography device further includes: a video database for storing images of the site to which a plurality of house objects belong, and the site image includes a plurality of fragments , each segment is relative to multiple shooting scenes of the house object; among them, when the fixed point of the site is selected, the operation module obtains the corresponding segment from the database of the site image, and uses the initial perspective The video transmits the venue image through the communication module Give each of those user devices the corresponding paragraph. As for the interactive photography device described in item 5 of the patent application, when a fixed point of the venue is selected and the image relative to the venue is being played, the operation module will record the current perspective and display it at other locations. When a fixed point is selected, the image relative to the site starts to be transmitted from the current recorded perspective. An interactive photography device as described in Item 6 of the patent application, wherein each segment in the venue image has a start time code and an end time code, and is composed of a plurality of start time codes and end time codes of the segments. Form an index table. An interactive photography method allows interaction between a plurality of user devices and an interactive photography device; each of the user devices includes: a cubicle diagram module, the cubicle diagram mainly It is a brief diagram used to present at least one room in the house object, where the room is a space surrounded by a plurality of walls; an operation module, the partition diagram module provides a partition diagram, the operation Based on the compartment map provided by the compartment map module, the module marks a plurality of site fixed points on the provided compartment map, and when the site fixed point is selected, it generates a map related to the compartment. A coordinate position in the figure; the interactive photography device includes: a vehicle body; a communication module located on the vehicle body; a driving module located on the vehicle body for driving according to a driving command The movement of the car body; a camera module, a fixed Fixed on the vehicle body, used to capture images in the direction of travel and generate a corresponding image signal; the photography method includes: receiving the coordinate position sent from each of the user devices through the communication module; Convert the coordinate position into the drive command, and use the drive module to cause the vehicle body to perform corresponding displacement; transmit the image signal generated by the camera module to the user devices through the communication module Each; receives an interactive operation issued by one of the plurality of user devices, and broadcasts it to the plurality of other user devices, so that the display content corresponding to the interactive operation is displayed on each of the other plurality of user devices. On the display, when the interactive operation is a designated primary device, only the interactive operation that is executable by the primary device and is sent from each of the user devices of the designated primary device is received; where the primary device is executable. The interactive operation can generate the coordinate position related to the compartment map for each of the user devices when the fixed point on the site is selected through the operation module.

Images