EP3682631A1 - Einrichtung und verfahren zur audio/visuellen aufzeichnung und wiedergabe von bildern/filmen - Google Patents
Einrichtung und verfahren zur audio/visuellen aufzeichnung und wiedergabe von bildern/filmenInfo
- Publication number
- EP3682631A1 EP3682631A1 EP18765892.7A EP18765892A EP3682631A1 EP 3682631 A1 EP3682631 A1 EP 3682631A1 EP 18765892 A EP18765892 A EP 18765892A EP 3682631 A1 EP3682631 A1 EP 3682631A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- images
- camera
- recording
- display surface
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 title claims description 13
- 239000011521 glass Substances 0.000 claims description 18
- 241001465754 Metazoa Species 0.000 claims description 9
- 230000001154 acute effect Effects 0.000 claims description 7
- 230000008447 perception Effects 0.000 claims description 5
- 229920003023 plastic Polymers 0.000 claims description 5
- 239000004033 plastic Substances 0.000 claims description 3
- 238000005192 partition Methods 0.000 claims description 2
- 238000001454 recorded image Methods 0.000 claims description 2
- 239000000284 extract Substances 0.000 claims 1
- 230000033001 locomotion Effects 0.000 description 17
- 230000000694 effects Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 239000002775 capsule Substances 0.000 description 8
- 210000003128 head Anatomy 0.000 description 4
- 230000036651 mood Effects 0.000 description 3
- 230000001427 coherent effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000015654 memory Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000380131 Ammophila arenaria Species 0.000 description 1
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000001914 calming effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000003797 telogen phase Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- E—FIXED CONSTRUCTIONS
- E06—DOORS, WINDOWS, SHUTTERS, OR ROLLER BLINDS IN GENERAL; LADDERS
- E06B—FIXED OR MOVABLE CLOSURES FOR OPENINGS IN BUILDINGS, VEHICLES, FENCES OR LIKE ENCLOSURES IN GENERAL, e.g. DOORS, WINDOWS, BLINDS, GATES
- E06B9/00—Screening or protective devices for wall or similar openings, with or without operating or securing mechanisms; Closures of similar construction
- E06B9/24—Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blinds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
- G09G3/3208—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D11/00—Passenger or crew accommodation; Flight-deck installations not otherwise provided for
- B64D2011/0061—Windows displaying outside view, artificially generated
-
- E—FIXED CONSTRUCTIONS
- E06—DOORS, WINDOWS, SHUTTERS, OR ROLLER BLINDS IN GENERAL; LADDERS
- E06B—FIXED OR MOVABLE CLOSURES FOR OPENINGS IN BUILDINGS, VEHICLES, FENCES OR LIKE ENCLOSURES IN GENERAL, e.g. DOORS, WINDOWS, BLINDS, GATES
- E06B9/00—Screening or protective devices for wall or similar openings, with or without operating or securing mechanisms; Closures of similar construction
- E06B9/24—Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blinds
- E06B2009/2464—Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blinds featuring transparency control by applying voltage, e.g. LCD, electrochromic panels
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/10—Automotive applications
Definitions
- the present invention relates to a device for audio / visual recording and playback of images / films comprising for recording one or more cameras, which each viewed images / movies directed from a viewer in different directions and recorded for playback at least two spatially separated display surfaces which are set up for the respective reproduction of the images / films recorded by one of these cameras and respectively assigned to a recording, wherein the display surfaces are each windows of a room and wherein the windows are in boundary surfaces at an angle to each other this room are located.
- EP 2 800 350 A2 discloses an arrangement and a method for recording and reproducing images of a scene or objects which are transmitted to a suitable display surface so that the viewer spatially perceives the images.
- images are recorded, for example, with a stereo camera comprising two similar cameras for each of a left and a right image.
- a stereo camera comprising two similar cameras for each of a left and a right image.
- multiview cameras which are suitable for correct image reproduction for multi-channel systems.
- WO 00/25177 A1 describes a method for the interactive audio / visual reproduction of a multi-scene film, the width and / or height of which is greater than the portion of the film which is visible during film reproduction. This process captures a panoramic movie backdrop in which the entire scene is composed of several different scenes that are not related to each other in an event-related manner. All movie scenes are shot with a single camera, which virtually creates a 360 ° image.
- the respective sounds belonging to a scene are also recorded, whereby each optical scene is also assigned the associated sound during the recording.
- the system is set up in such a way that the respective viewing direction of the observer is recognized and this then also the sounds belonging to the respective scene section are recorded.
- the goal is to selectively reproduce sections of a multi-scenic film by interacting with the viewer.
- the system requires a spherical screen that surrounds the viewer so that it is no longer in the natural environment of a room. The viewer thus perceives only visually and acoustically what the multi-scene film reproduces.
- An adaptation to a generally rectangular geometry of a typical room in an apartment is not provided.
- this known device it is precisely the fact that when changing the viewing angle of the viewer in each case a different scene section is shown, which differs in its experience characteristic of the other scenes sections.
- window areas of a room as a screen.
- a window element is already described, for example, in EP 1 366 265 B1.
- the glass surface of a window element serves as a display surface, wherein a projector-independently generated image is displayed on the window surface.
- display light emitting diodes such as OLEDs or LEDs can be used.
- OLED screens can be used which are largely or even completely transparent when turned off, when the display is turned off, a conventional window remains open which is permeable to daylight and persons who are in the room can be like a regular window to view the surroundings unhindered through the window.
- DE 10 2009 010 425 A1 describes an artificial window with flat screen with spatial perception, which is used for this purpose To transmit the image of an environment by camera from the control station of a cruise ship in the interior cabins of the cruise ship, so that the people staying there can see the outside environment visible in the helm.
- the display surface used here is an artificial window in which a flat screen is located in the window opening. This means that the viewer can not look out through the window when the display is off. This is technically not possible because it is an inner cabin of a ship that has no outer wall.
- this known device only one single artificial window is used, within which a three-dimensional impression is created by arranging a plurality of parallel screens arranged one behind the other in the same window opening. This is not comparable with a situation in which the viewer finds in a room several screens in different angular wall surfaces, on each of which images or films are displayed, since then the viewer from different perspectives taken pictures, for example, next to him, in front of him or behind you.
- Japanese Laid-Open Patent Publication JP H09-187 573 A describes a type of flight simulator in which a person is in a capsule that can perform various movements with respect to the environment, namely rotational movements as well as translatory movements in the height direction and laterally, ie in X. , Y and Z direction. These movements are triggered via a control lever by the person in the capsule.
- images are displayed in different spatial directions and modified in such a way that the images simulate the respective movement of the capsule in space.
- the "windows” used here are virtual windows that serve as display surfaces for displaying the images, which are installed on the wall of the interior of the capsule, ie, in front of the wall, so they are not real windows
- the space the capsule in which the person resides, moves in relation to its environment and between these movements and those on the display surfaces of the images reproduced on artificial windows.
- the image changes analogously to the respective movement of the capsule in order to simulate the viewer, as it were, the authenticity of the movement during a flight with a spacecraft. This is therefore similar to the functional principle of a flight simulator.
- the object of the present invention is to provide a less elaborate device for audio / visual reproduction of images / films with the features mentioned above, in which several standing in a scenic context image sequences / movies on spatially separated display areas in a everyday living or working environment without isolating the viewer from its environment through a specific screen or the like.
- the solution to the above object provides a device for audio / visual playback of images / films of the type mentioned with the features of claim 1.
- the space is a space which does not move with respect to the surroundings outside the room, in particular in a building, and the images / films shown on the display areas have been recorded with a camera or cameras installed on a moving object such a recording of a camera is simulated.
- the "camera” or “cameras” de is, then this term includes a real camera or a virtual camera, that is, a device that electronically generates an image of a camera.
- the present invention thus takes a different route than the previously described prior art.
- the space in which the viewer is located does not move in relation to the surroundings. Rather, it is a normal room, for example in a house or in an office.
- In the walls of the room are at least two, possibly several windows, which are located in mutually angled boundary surfaces of this room.
- These windows have the function of display surfaces on which images or films (moving images) are reproduced, which were recorded on a moving object by means of several cameras from different angles or possibly a single all-around camera, so that the viewer has the impression that he is located in a moving object, wherein on the different angular display surfaces display different angles are reflected, as you see them for example on a vehicle, for example, looking forward or to the side or back.
- images are thus reproduced on the display surfaces which simulate a movement, but these images are decoupled from the space in which the person is located, that is to say from the space in which the person is located. the space and the person who is in it do not move.
- the solution according to the invention is thus technically much less expensive and can be installed in a very ordinary space in a building. It only requires a corresponding number of displays that are suitable for the reproduction of the images.
- the display surfaces are in each case windows that are largely transparent when the display is switched off and enable a view to the outside of the room into the surroundings.
- the window surfaces largely comprise transparent glass or plastic glass surfaces (acrylic glass) which, when the display is switched off, fulfill the function of a normal window, so that the person in the room can look out through one of the windows.
- these window areas serve as display areas.
- This dual function can be realized, for example, when using transparent OLED displays, or when using windows which comprise such transparent OLED displays as a layer of layers that are transparent overall when the display is switched off.
- This preferred variant of the invention has the advantage that when the display is switched off, the display function is practically not perceived by the viewer, so that it is a very ordinary room situation the viewer can look outside and daylight falls into the room. The person in the room is thus not isolated from the external environment.
- windows with display function can be used, as described in the above-mentioned EP 1 366 265 B1.
- the person When the display function is switched on, the person does not have to bring about movements of the room via an operating function as in the space capsule according to the above-described prior art, but the images / movies on the display surfaces run automatically, so that the person can pursue any normal activity in the room.
- the effect that is caused across the display surfaces is such that the person feels that they are in a moving object.
- the device according to the invention for audio / visual recording and reproduction of images / films may for example comprise at least two cameras which, with regard to their technical specification as well as the devices for reproducing the images / films, are equipped in such a way that they correspond as closely as possible to human perception , This can be achieved, for example, by observing a number of measurable parameters such as the resolution, the frame rate, the contrast, the brightness range, the focal length during recording, and / or the sound quality, in particular with regard to the spatial impression, the dynamics, the sharpness the reproduction of highs and lows and the like.
- the resolution can be at least 4K
- the frame rate can be at least 60 frames per second
- contrast / brightness can be achieved by lossless dynamic compression or the highest possible dynamic range, for example by using HDR technology
- the focal length can be approx. 45x 35 mm, which corresponds to a 35 mm format and about the focal length of the human eye.
- the core idea of the present invention is to image images, preferably moving images, on such windows, which are transparent when the display is switched off, which images an environment recorded with different cameras and, viewed in different viewing directions, viewed from a reference point, so that the images correspond to the perception of a person, as well as their surroundings experienced at the time of shooting when she looks in different directions.
- the present invention takes a different route than when producing a typical 3D image with conventional technology. In the latter case, several cameras record the same scene to later achieve spatial three-dimensional perception when playing the scene on a flat screen. Or a screen surrounds the person around when playing around, so that the viewer perceives different parts of the scene when he changes his perspective by turning.
- a picture of an environment is taken directed in a specific first direction with a first camera and then a picture of the same environment, for example, simultaneously addressed in a second or third direction, which with the first viewing direction does not match, the respective image section usually does not overlap.
- the recording thus takes place according to the invention from a point of view in different directions, which thus corresponds to the image impression that a person has when he turns his head in different directions, for example, where the location changes continuously, which corresponds to a picture impression, a person, an animal, or an object that moves in an environment (that is, it is not a photograph of a moving object from different angles).
- a possible preferred variant of the present invention provides that the recording takes place with at least two cameras and the reproduction of the images takes place on at least two display surfaces designed as windows which are located in boundary surfaces of the room which are approximately at right angles to one another.
- rooms in buildings are designed in such a way that at least two of their walls assume a right angle to each other.
- a window which is designed according to the invention as a display and is suitable for the reproduction of images / films. For example, when a person is in such a room, she may look at pictures of a first scene on a display formed by a window in a wall on which that person is sitting in a standard position, for example, sitting at a table.
- a second display configured as a window could then, for example, are in a second wall which extends laterally with respect to this person, so that the display can be viewed, if the person 0 to about 90 rotates towards the side.
- the two displays then each run a scene that was previously seen by two cameras in different directions.
- the device for audio / visual recording and playback of images / films comprises only one camera which takes a 360 ° recording around and at least two spatially separated display areas for the reproduction of
- the display surfaces are in each case windows of a room, wherein the windows are in mutually angled boundary surfaces of this room and wherein the relative spatial position of these windows corresponding image sections of the images / films of the camera , which were recorded in each case directed in different directions, in each case reproduced on the display surfaces.
- the recording it is also preferable for the recording to take place with at least three cameras in different directions from the same point of view, or with a camera which takes 360 ° recording around and the images are reproduced on at least three display surfaces each formed as a window of which there are at least two boundary surfaces, which are approximately at right angles to one another Are located in space and at least two in mutually approximately parallel and oppositely disposed boundary surfaces of the room.
- This can then be, for example, a display surface in a wall in front of a seated person and two display surfaces, which are located respectively to the right and left side of this person.
- the "same viewpoint” referred to here is a locally variable viewpoint when simulating, for example, the view of a moving person or a moving animal or object, and taking two, three or more cameras in different directions from the respective viewpoint The recorded scenes are then those as they arise from a running person or a moving object, if one looks from this in different directions.
- the recording takes place with at least four cameras from the same point of view in respectively different directions, or with a camera which takes a 360 ° recording around and the reproduction of the images takes place on at least four display surfaces each formed as a window of which there are in each case two mutually approximately at right angles boundary surfaces of the room and two in each case approximately parallel to each other and oppositely disposed boundary surfaces of the room.
- the person can then look forward as seen a first display surface, if the gaze each to the right or left, each one arranged laterally to her display surface and when the person turns around, then they can another, from the fourth camera or the View 360 ° camera scene, which in turn shows a different line of sight, as the images on the other display surfaces, but preferably each perspective, which were taken with different cameras in the same environmental situation.
- the application of the invention is not limited to windows or other glass surfaces as display surfaces, which are located in a wall of a room, but it may be, for example, a display surface on the ceiling. In this case, the recording can for example be done with five cameras, one of which is directed upward.
- windows as display surfaces
- glass doors such as patio doors, balcony doors or glass façade parts, glass partitions, glass ceilings, glass roofs or glass surfaces of furniture, mirror surfaces, transparent plastic surfaces or the like.
- the recording takes place with several cameras recorded in different directions or with a camera which takes a 360 ° recording around, in each case at the same time or approximately at the same time.
- a sound recording from the corresponding perspective takes place and during playback of the respective display surface associated with sound recording is played.
- the person viewing the display surfaces then hears a background noise that is similar overall, since it comes from the same recorded environmental situation, but the recorded sound is slightly different for each camera because the direction from which the sound comes is different.
- this spatial sound effect perceived in the recording situation can be reproduced in a corresponding manner, so that the reproduction very realistically reproduces the sound situation during the recording.
- the arrangement of the display surfaces is preferably such that a first display surface is arranged approximately frontally in front of a person looking at it and at least one further display surface is arranged approximately laterally of the person looking at it, the first display surface and the further display surface preferably forming an acute angle take a right angle to each other. Furthermore, it is preferably such that a first display surface is arranged approximately frontally in front of a person looking at it, at least one second display surface is arranged approximately laterally of the person looking at it, wherein the first display surface and the further display surface preferably an acute angle or a right angle occupy each other and at least a third display surface about the second display surface opposite or opposite to this offset from each other.
- a first display surface is arranged approximately frontally in front of a person looking at it and at least one second display surface is arranged behind the person looking at it, the first display surface and the second display surface preferably being offset from each other or offset from each other - Are arranged over lying.
- a first display surface is arranged approximately frontally in front of a person looking at it is particularly preferred, at least one second display surface being arranged laterally to the person looking at it, wherein the first display surface and the further display surface preferably have an acute angle or a occupy a right angle to each other, at least a third display surface about the second display surface opposite or offset to this lying opposite and at least a fourth display surface about the first display surface lying opposite or offset to this lying opposite.
- the recording situation is preferably selected such that images / films are recorded by means of a first camera which records with a perspective oriented in a first direction that images with a second camera are preferably recorded simultaneously with the images of the first camera Camera with a aligned in a second direction perspective, which is aligned at a sharp or a right angle to the first direction and further that images are taken with a third camera preferably simultaneously with the images of the first and second camera, wherein the third camera with a perspective oriented in a third direction, which is oriented approximately opposite to the first direction.
- all images can be taken by a 360 ° camera, which simultaneously takes an all-around image, in which case the corresponding image sections, which respectively correspond to the perspective of the display surfaces, are reproduced on the display surfaces.
- At least four cameras are used for recording, i. that in this case further images are taken with a fourth camera, preferably at the same time as the images of the first, second and third camera, wherein the fourth camera receives with a oriented in a fourth direction perspective, which is approximately opposite to the second direction.
- all four images can also be taken by a 360 ° camera, in which case the corresponding four image sections are reproduced on the four display surfaces.
- the images / films are recorded by means of cameras or a camera which are located on a moving object.
- This mobile object may be, for example, a motor vehicle, a rail vehicle, a bicycle, a boat, an airplane, a spaceship, a running person or a running animal.
- Such recordings later produce for the observer the effect of moving with the speed of the moving object relative to the recorded environment in accordance with the camera during the recording.
- This can be a fast relative movement in a motor vehicle, such as an automobile or a motorcycle or a correspondingly slower movement in a bicycle.
- Recordings of a running animal such as a horse or a dog produce further interesting effects for the viewer, on the one hand by the fact that a horse or a dog can also move away from roads or larger paths and because the camera also by the specific Art the locomotion generated movement (for example, up and down) also retraces.
- recordings are possible from the bird's eye view, which can be recorded from an aircraft or from a drone. It is also possible, for example, recordings from a spaceship, in which case the recording does not necessarily have to be real with multiple cameras, but the camera recordings can be simulated here by computer, as in the other examples mentioned above, the recording with several Cameras directed in different directions is simulated and the corresponding images are transmitted to the various displays in the room in which the person viewing this is, the playback is done on these displays that the corresponding display, on each of which Playback takes place, in terms of the direction of the direction in which the respective camera was aligned when shooting.
- people or animals can move while the cameras maintain their position. It can, for example, a natural scene be recorded and capture the cameras with their image and sound recordings the appropriate mood of this scene (for example, a forest scene in the evening or a sunset at the sea) in several different directions and give this mood during playback on the multiple displays in the room for the viewer again.
- the images / films concerning the virtual environment to be viewed on the displays either provide only an atmosphere through which, for example, certain memories of this person can be conveyed, for example memories of a holiday spent, by reproducing or providing pictures of holidays the person the option, if necessary, to view the images played on the displays.
- This alternative mode can be set, for example, when the person desires a calming mood, for example in the evening or in a rest phase serving for relaxation.
- the subject of the present invention is also a method for audio / visual recording of pictures / films by means of at least three cameras, or by means of a camera which takes a 360 ° recording around, these pictures / films being provided for a reproduction on spatial Separate display surfaces of a device having the features described above, wherein when recording by means of at least three cameras images / films are recorded by means of a first camera, which receives aligned from a mobile point of view in a first direction, wherein further images with a second camera preferably simultaneously with the images of the first camera, the second camera being aligned from the same movable position in a second direction aligned at a sharp or a right angle to the first direction, and further comprising images with a third camera preferred time can be easily taken to the images of the first and second camera, wherein the third camera receives aligned from the same movable position in a third direction, which is approximately opposite to the first Direction is aligned or that when using only a camera that takes a 360 ° recording around, are
- images with a fourth camera are preferably taken simultaneously with the images of the first, second and third camera, wherein the fourth camera receives aligned in a fourth direction, which is aligned approximately opposite to the second direction or, using only one camera taking a 360 ° shot around, a fourth frame is made showing images aligned in a fourth direction from the same point of view as described above.
- the images / films are recorded by means of two, three or four cameras or only one 360 ° camera, which are located on a moving object.
- the moving object is a motor vehicle, a rail vehicle, a bicycle, a boat, an airplane, a spaceship, a running person or a running animal.
- FIG. 1 shows a schematic view of an exemplary room with a device for audio / visual reproduction of previously recorded images / films according to a possible embodiment of the present invention
- FIG. 2 shows a schematic view of a scene in which the recording of images / films takes place by means of a plurality of cameras according to the present invention.
- FIG. 1 shows a highly schematically simplified example of a substantially cuboidal space 10, in which a person 1 1 resides, which uses this space 10, for example as a living space or, alternatively, also as a working space. It may therefore also be an office, for example or a public space of an exhibition, a museum or the like.
- the room 10 may also be a private living room, bedroom or any other room.
- the space 10 is provided with four walls oriented approximately perpendicular to one another.
- this variant of the room is only intended to serve as an example because, of course, this room 10 may in principle also have any ground plan shape deviating from a purely rectangular floor plan.
- the walls may be at an acute angle to each other or partially rounded and there may be additional Versprünge, niches or the like, as well as the room may have, for example, only three walls.
- the space geometry is therefore not subject to any specific restriction. In the example, only a standard space was illustrated by means of which the invention will be explained.
- the space 10 shown in FIG. 1, which is somewhat rectangular in plan view, comprises, for example, four walls, namely a left side wall 12, a right side wall 13, which lies opposite the left side wall 12 and runs approximately parallel to this, a rear wall 14 which, relative to the two side walls 12 and 13 is a transverse wall and thus extends approximately at a right angle to these two side walls 12, 13 and connects them at one end to each other.
- a front wall 15 is still present, which runs approximately parallel and at a distance from the rear wall and thus the rear wall 14 is opposite and represents a second transverse wall of the room. This front wall 15 thus connects the two side walls 12 and 13 at their other, the rear wall 14 opposite end to each other.
- These four walls 12, 13, 14, 15 thus form a somewhat rectangular in plan view space 10, within which the person 1 1, which looks at the pictures, for example, approximately in a central area.
- the person 1 1 when looking forward, the front wall 15 to look at when turning the head to the left, they can look at the left side wall 12, when it turns the head to the right, it can the right side wall 13th When she turns around, she looks behind her at the back wall 14 of the room.
- left side wall, right side wall, rear wall, front wall are chosen in principle arbitrary, since these terms are based on the respective orientation of the viewer. These terms are therefore only a better illustration here.
- the four walls of this room could equally well be called the first wall, the second wall, the third wall and the fourth wall. If you look at the four walls then, for example, clockwise, starting at the left side wall 12, then this forms a first wall, the front wall 15 forms a second wall, the right side wall 13 forms a third wall and the rear wall 14 forms a fourth wall.
- Each of the four walls 12, 13, 14, 15 of the space 10 described above now has a respective display surface which, according to the invention, is designed as a window which is suitable for producing images or films on the display surface.
- a first window 16 which forms a first display surface.
- a second window 17 which forms a second display surface.
- a third window 18 which forms a third display surface
- in the rear wall 14 is a fourth window 19, which forms a fourth display surface.
- Each of these four windows can be OLED display areas in which one can produce arbitrary images, in principle like an OLED television.
- these OLED display surfaces are transparent or largely transparent when switched off, so that the person can see through each of the windows 16, 17, 18, 19 and view the environment outside the room as soon as the corresponding display is switched off.
- the solution according to the invention has the advantage that the surfaces of the four windows 16, 17, 18, 19 let the daylight through each time the display is switched off, so that the room is not darkened during the day.
- the display surfaces formed by the four windows 16, 17, 18, 19 do not form a coherent display surface, but are separated from each other, each at a distance from each other and are located in or on different walls of the room , If, for example, the person 1 1 in the middle area of the room 10 is viewing the display surface 17 (or the window 17) on the front wall 15, for example when the display function is switched on, then with its angle of vision it does not usually also recognize the display surface 16 at the same time On the left side wall 12 or the display surface 18 on the right side wall 13.
- the fourth display surface 19 on the rear wall 14 can recognize it in any case only when it rotates in the space about 180 0 around its own axis. But by turning the head or the body, the person comparatively quickly change from viewing one display area to the other, if the display functions are always switched on.
- a further special feature of the present invention consists in that preferably different partial scenes are played on the display surfaces, which, however, are in a scenic context insofar as these partial scenes were recorded in the same situation with different cameras from different angles, preferably at the same time ,
- the display surfaces then play several partial scenes that belong to an overall scene and, in principle, represent a situation that is related to each other but can be viewed from different perspectives by the viewer, depending on which of the display surfaces he is viewing, according to the respective angle of view of the camera when recording the corresponding partial scene.
- This aspect of the present invention will be explained in more detail below with reference to FIG. This illustration shows by way of example a vehicle 20 which travels along a road 21 through a landscape.
- a plurality of cameras are mounted on the roof or on the roof of the hood and / or in the rear area, which accommodate the surroundings of the moving vehicle 20.
- the example involved four cameras, all of which are aligned in a different direction.
- the cameras can thus simultaneously record the image and sound of the same scene at the same time, namely the surroundings of the moving vehicle, but from different perspectives.
- a first camera 23 is oriented so that it receives from the vehicle 20 approximately at right angles to the left.
- a second camera 22 is oriented forwardly of the vehicle and thus receives a partial scene as it presents itself to a viewer who is looking forward from the moving vehicle.
- a third camera 24 is oriented to the right side of the vehicle 20 to the side and thus takes a partial scene, as it presents itself to the viewer when he looks out of the moving vehicle out of the side window to the left.
- a fourth camera 25 is provided, which is mounted on the vehicle 20 so that it is oriented backwards so that it receives a partial scene, as it presents itself to a viewer who looks out of the moving vehicle 20 to the rear ,
- the first camera 23 is thus directed to the left and the third camera 24 takes at an angle of about 180 0 to the first camera (seen in plan view), so that you can take the passing landscape from different perspectives.
- the second camera 22 is directed towards the front and thus absorbs at an angle of approximately 90 ° to the first camera 23 and to the third camera 24.
- the second camera 22 thus captures a partial scene as perceived by the driver of the vehicle, for example, who recognizes the road and the landscape on both sides beyond the road, each with a restricted viewing angle, for example similar to that which the human eye can recognize. As the vehicle 20 travels fast, the second camera 22 captures a scene that is rapidly approaching the viewer.
- the fourth rearwardly directed camera 25 picks up at an angle of about 180 ° compared to the second camera 22.
- a scene is taken as presented to someone driving through the rear window of the vehicle 20 that is, the viewer sees a rapidly moving scene with the road and its surrounding landscape in accordance with the limited viewing angle that a person has while looking out the back window of the vehicle.
- the viewer sees on the respective displays on the four walls surrounding him in his room those images which, with regard to their recording perspective, correspond exactly to the spatial direction in which the viewer also sees the images reproduced on the displays.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Structural Engineering (AREA)
- Business, Economics & Management (AREA)
- Aviation & Aerospace Engineering (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- Civil Engineering (AREA)
- Closed-Circuit Television Systems (AREA)
- Studio Devices (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017120956.5A DE102017120956A1 (de) | 2017-09-11 | 2017-09-11 | Einrichtung zur audio/visuellen Aufzeichnung und Wiedergabe von Bildern/Filmen |
PCT/EP2018/074208 WO2019048643A1 (de) | 2017-09-11 | 2018-09-07 | Einrichtung und verfahren zur audio/visuellen aufzeichnung und wiedergabe von bildern/filmen |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3682631A1 true EP3682631A1 (de) | 2020-07-22 |
Family
ID=63524301
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18765892.7A Withdrawn EP3682631A1 (de) | 2017-09-11 | 2018-09-07 | Einrichtung und verfahren zur audio/visuellen aufzeichnung und wiedergabe von bildern/filmen |
Country Status (4)
Country | Link |
---|---|
US (1) | US20200275060A1 (de) |
EP (1) | EP3682631A1 (de) |
DE (1) | DE102017120956A1 (de) |
WO (1) | WO2019048643A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11996012B2 (en) | 2021-02-03 | 2024-05-28 | Better Way Productions LLC | 360 degree interactive studio |
US11431920B2 (en) * | 2021-02-03 | 2022-08-30 | Better Way Productions LLC | 360 degree interactive studio |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09187573A (ja) * | 1995-11-07 | 1997-07-22 | Sozoan:Kk | 仮想空間体験装置、画面用窓枠および映像システム |
CN1212012C (zh) * | 1995-11-07 | 2005-07-20 | 有限会社创造庵 | 屏幕用窗框 |
DE19849269A1 (de) | 1998-10-26 | 2000-05-18 | Jeffrey Shaw | Interaktive Filmwiedergabe |
DE10205405A1 (de) | 2002-02-09 | 2003-08-21 | Thomas Emde | Fensterelement |
DE102006055641B4 (de) | 2006-11-22 | 2013-01-31 | Visumotion Gmbh | Anordnung und Verfahren zur Aufnahme und Wiedergabe von Bildern einer Szene und/oder eines Objektes |
DE102009010425A1 (de) * | 2009-02-26 | 2011-02-17 | Heike Reinemann | Künstliches Fenster mit Flachbildschirm mit räumlicher Wahrnehmung ohne störende Reflexionen |
US20100271394A1 (en) * | 2009-04-22 | 2010-10-28 | Terrence Dashon Howard | System and method for merging virtual reality and reality to provide an enhanced sensory experience |
WO2013106243A1 (en) * | 2012-01-12 | 2013-07-18 | West Kanye Omari | Multiple screens for immersive audio/video experience |
US9350954B2 (en) * | 2012-03-20 | 2016-05-24 | Crane-Cohasset Holdings, Llc | Image monitoring and display from unmanned vehicle |
-
2017
- 2017-09-11 DE DE102017120956.5A patent/DE102017120956A1/de not_active Withdrawn
-
2018
- 2018-09-07 EP EP18765892.7A patent/EP3682631A1/de not_active Withdrawn
- 2018-09-07 US US16/645,866 patent/US20200275060A1/en not_active Abandoned
- 2018-09-07 WO PCT/EP2018/074208 patent/WO2019048643A1/de unknown
Also Published As
Publication number | Publication date |
---|---|
WO2019048643A1 (de) | 2019-03-14 |
DE102017120956A1 (de) | 2019-03-14 |
US20200275060A1 (en) | 2020-08-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69937468T2 (de) | System zur Filmaufnahme und -Schnitt | |
DE3884907T2 (de) | Blickpunkt-Bewegungssimulatorsystem. | |
DE19640936C2 (de) | Positionsadaptiver Autostereoskoper Monitor (PAM) | |
EP0267971A1 (de) | Videoanlage zur informationswiedergabe | |
DE69421141T2 (de) | Bildvorführgerät | |
DE69423338T2 (de) | Verarbeitungs-und anzeigevorrichtung für zeitlich variable bilder | |
EP2795401B1 (de) | Filmvorführvorrichtung und verfahren zum vorführen eines films | |
WO2009062492A2 (de) | Verfahren zum darstellen von bildobjekten in einem virtuellen dreidimensionalen bildraum | |
DE112019002353T5 (de) | Techniken zum umschalten zwischen immersionsebenen | |
WO2019048643A1 (de) | Einrichtung und verfahren zur audio/visuellen aufzeichnung und wiedergabe von bildern/filmen | |
EP3012712A1 (de) | Virtuelles zeichnen in realer umgebung | |
DE102019116713B4 (de) | Verfahren, Vorrichtung und Fortbewegungsmittel für eine kinetosevermeidende Darstellung einer virtuellen Flüssigkeit in einer Datenbrille im Fortbewegungsmittel | |
DE102013016921A1 (de) | Bildanzeigesystem und -verfahren zur bewegungssynchronen Bildanzeige in einem Transportmittel | |
DE102006030923A1 (de) | Vorrichtung und Verfahren zur interaktiven Präsentation virtueller Realität | |
DE112021002752T5 (de) | Erfassung und Wiedergabe von räumlichem Video | |
DE102012007441B4 (de) | Virtuelle Transportmaschine: Task-Ins-Cubicle | |
DE102016006855B4 (de) | Verfahren zum Betreiben eines Anzeigesystems und Anzeigesystem | |
DE102021126316A1 (de) | Aufnahmeverfahren und Aufnahmesystem | |
DE102016005579B4 (de) | Verfahren zum Betreiben eines Anzeigesystems und Anzeigesystem | |
DE10134430A1 (de) | Verfahren und Anordnung zur stereoskopischen Projektion von Bildern | |
EP1125165B1 (de) | Interaktive filmwiedergabe | |
EP3183044A1 (de) | Wasserrutschen-system sowie betriebsverfahren | |
DE10308810B4 (de) | Verfahren zur komprimierten Übertragung von Bilddaten für eine 3-dimensionale Darstellung von Szenen und Objekten | |
DE112021002641T5 (de) | 3d-fotos | |
EP4163783A1 (de) | Hintergrund-wiedergabeeinrichtung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200408 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20211104 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20230401 |