WO2022123772A1 - 映像表示方法、映像表示装置およびプログラム - Google Patents
映像表示方法、映像表示装置およびプログラム Download PDFInfo
- Publication number
- WO2022123772A1 WO2022123772A1 PCT/JP2020/046302 JP2020046302W WO2022123772A1 WO 2022123772 A1 WO2022123772 A1 WO 2022123772A1 JP 2020046302 W JP2020046302 W JP 2020046302W WO 2022123772 A1 WO2022123772 A1 WO 2022123772A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display device
- display
- subject
- image
- video
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000005259 measurement Methods 0.000 claims description 14
- 238000010586 diagram Methods 0.000 description 8
- 238000000605 extraction Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 238000011156 evaluation Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001093 holography Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
- G09G5/30—Control of display attribute
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/363—Graphics controllers
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
- G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
- H04N13/395—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
Definitions
- This disclosure relates to a video display method, a video display device, and a program.
- a plurality of subjects in an image are presented to the viewer by a plurality of pseudo virtual image devices (display devices) arranged in the depth direction when viewed from the viewer.
- a plurality of pseudo-virtual image devices are arranged according to the positions of a plurality of subjects in the actual depth direction, and the image corresponding to each subject is transferred to the pseudo-virtual image devices arranged at the positions corresponding to the subjects. indicate.
- the image of the subject actually located on the front side is displayed on the pseudo virtual image device on the front side
- the image of the subject actually located on the back side is displayed on the pseudo virtual image device on the back side.
- the viewer can get a more realistic sense of depth.
- the transmissive display device the portion where the subject is not displayed can be seen through, so that the user can visually recognize the image to be displayed on the pseudo virtual image device on the back side in the transparent portion (for example,). See Non-Patent Document 1).
- FIG. 13 is a diagram showing an example of arrangement of a plurality of subjects. As shown in FIG. 13, it is assumed that the subject s1 exists at the position of the distance T1 from the photographing device 2 and the subject s2 exists at the position of the distance T2 (T1> T2) from the photographing device 2. Since T1> T2, the subject s1 is located behind the subject s2 when viewed from the photographing device 2.
- the display device 3b is arranged at the position of the distance P1 from the viewer, and the display device 3f is arranged at the position of the distance P2 (P1> P2) from the viewer. Since P2> P1, the display device 3f is arranged in front of the display device 3b when viewed from the viewer.
- the display device 3b displays the subject s1 located on the back side, and the display device 3f displays the subject s2 located on the front side.
- the display device 3f and the display device 3b are arranged side by side in the depth direction when viewed from the viewer. Further, the display device 3f is configured to transmit the display image of the display device 3b so as to be visually recognized by the viewer. Therefore, as shown in FIG.
- the display image of the display device 3b and the display image of the display device 3f are superimposed and visually recognized by the viewer.
- the distances P1 and P2 to the actual distances T1 and T2, respectively, the distance from the viewer to the subject s1 and s2 matches the distance to the actual subject, so that the depth is more realistic. A feeling can be given to the viewer.
- the distance T1'from the photographing device 2 to the subject s1 and the distance from the photographing device 2 to the subject s2. Will be close. Even though the distance between the subject s1 and the subject s2 in the depth direction has changed, the distance from the photographing device 2 to the display device 3b and the display device 3f (distances P1 and P2) does not change, so that the distance to the actual subject is not changed. As a result, the distances to the display devices 3b and 3f do not match, and the viewer cannot obtain a realistic sense of depth.
- An object of the present disclosure made in view of the above-mentioned problems is to provide a video display method, a video display device, and a program capable of presenting a more realistic video.
- a display target is displayed by a first display device and a second display device arranged in front of the first display device when viewed from the user. It is an image display method in an image display device in which the display image of the first display device and the display image of the second display device are superimposed and visually recognized by the user, and the display as seen from the user side. It includes a step of measuring a distance in the depth direction of an object and a step of displaying the display object on either the first display device or the second display device based on the measured distance.
- the video display device is to be displayed by the first display device and the second display device arranged in front of the first display device when viewed from the user.
- a measurement unit that measures the distance in the depth direction
- a display control unit that displays the display target on either the first display device or the second display device based on the distance measured by the measurement unit
- a display control unit Equipped with.
- the program according to the present disclosure causes the computer to function as the above-mentioned video display device.
- FIG. 2 It is a block diagram which shows the schematic structure of the computer which functions as the image display device which concerns on 1st Embodiment of this disclosure. It is a figure which shows the structural example of the image display system including the image display device which concerns on 1st Embodiment of this disclosure. It is a flowchart which shows an example of the operation of the image display device shown in FIG. It is a figure which shows an example of the movement of a subject. It is a figure which shows another example of the movement of a subject. It is a figure for demonstrating the operation of the image display apparatus shown in FIG. 2 with the movement of the subject shown in FIG. 4A. It is a figure for demonstrating the operation of the image display apparatus shown in FIG. 2 with the movement of the subject shown in FIG. 4B.
- FIG. 1 It is a figure for demonstrating the difference in the position shift of a subject according to the position of a viewer. It is a figure which shows the example of the thinning pattern by the subject image thinning part shown in FIG. It is a figure which shows an example of the arrangement of a photographing apparatus and a subject. It is a figure for demonstrating the display of a subject by a conventional method. It is a figure which shows an example of the display image by a conventional method. It is a figure which shows another example of the arrangement of a photographing apparatus and a subject.
- FIG. 1 is a block diagram showing a hardware configuration when the video display device 10 according to the first embodiment of the present disclosure is a computer capable of executing a program instruction.
- the computer may be a general-purpose computer, a dedicated computer, a workstation, a PC (Personal Computer), an electronic notepad, or the like.
- the program instruction may be a program code, a code segment, or the like for executing a necessary task.
- the video display device 10 includes a processor 110, a ROM (ReadOnlyMemory) 120, a RAM (RandomAccessMemory) 130, a storage 140, an input unit 150, a display unit 160, and a communication interface (I / F). Has 170.
- the processor 110 is a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a SoC (System on a Chip), or the like, and is of the same type or different types. It may be composed of a plurality of processors.
- the processor 110 controls each configuration and executes various arithmetic processes. That is, the processor 110 reads the program from the ROM 120 or the storage 140, and executes the program using the RAM 130 as a work area. The processor 110 controls each of the above configurations and performs various arithmetic processes according to the program stored in the ROM 120 or the storage 140. In the present embodiment, the program according to the present disclosure is stored in the ROM 120 or the storage 140.
- the program is stored in a non-transitory storage medium such as a CD-ROM (CompactDiskReadOnlyMemory), a DVD-ROM (DigitalVersatileDiskReadOnlyMemory), or a USB (UniversalSerialBus) memory. May be provided at. Further, the program may be downloaded from an external device via a network.
- a non-transitory storage medium such as a CD-ROM (CompactDiskReadOnlyMemory), a DVD-ROM (DigitalVersatileDiskReadOnlyMemory), or a USB (UniversalSerialBus) memory. May be provided at. Further, the program may be downloaded from an external device via a network.
- the ROM 120 stores various programs and various data.
- the RAM 130 temporarily stores a program or data as a work area.
- the storage 140 is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs including an operating system and various data.
- the input unit 150 includes a pointing device such as a mouse and a keyboard, and is used for performing various inputs.
- the display unit 160 is, for example, a liquid crystal display and displays various information.
- the display unit 160 may adopt a touch panel method and function as an input unit 150.
- the communication interface 170 is an interface for communicating with other devices such as an external device (not shown), and for example, standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark) are used.
- Ethernet registered trademark
- FDDI FDDI
- Wi-Fi registered trademark
- FIG. 2 is a diagram showing an example of the functional configuration of the video display system 1 including the video display device 10 according to the present embodiment.
- the video display device 10 according to the present embodiment has a plurality of display devices 3f, in which the subjects in the video shot by the shooting device 2 are arranged in the depth direction when viewed from the viewer (user) as shown in FIG. It is displayed by 3b.
- the video display system 1 includes a photographing device 2, display devices 3b and 3f, and a video display device 10.
- the shooting device 2 is a camera that shoots a subject within a predetermined shooting range, and outputs the shot image to the video display device 10.
- the display devices 3b and 3f display images according to the control of the image display device 10. As shown in FIG. 14, the display devices 3f and 3b are arranged side by side in the depth direction when viewed from the viewer (user). Specifically, the display device 3b is arranged on the back side when viewed from the viewer, and the display device 3f is arranged on the front side when viewed from the viewer. That is, the display device 3b is arranged behind the display device 3f when viewed from the viewer.
- the display devices 3b and 3f display the image in such a manner that the display image of the display device 3b and the display image of the display device 3f are superimposed and visually recognized by the viewer.
- the display devices 3b and 3f display (project) an image by, for example, holography.
- the method of displaying the image by the display devices 3b and 3f is not limited to this, and if the display image of the display device 3b and the display image of the display device 3f can be superimposed and visually recognized by the viewer. Any method can be used.
- the display device 3b and the display device 3f are not distinguished, they are referred to as a display device 3.
- the video display device 10 displays the shot video shot by the shooting device 2 by the display devices 3b and 3f. Specifically, the image display device 10 displays the subject in the captured image of the photographing device 2 on the display devices 3b and 3f, and the display image of the display device 3b and the display image of the display device 3f are superimposed and the viewer. Make it visible to. In the following, the image display device 10 displays the subject s1 located on the back side of the photographing device 2 and the subject s2 located on the front side of the photographing device 2 as display targets as shown in FIG. An example of displaying on the devices 3b and 3f will be described.
- the image display device 10 may display not only the image captured by the image pickup device 2 but also the subject included in the image reproduced by the reproduction device on the display devices 3b and 3f. Therefore, it is not limited to the photographing device 2 that the video including the display target is input to the video display device 10.
- the video display device 10 includes a subject extraction unit 11, a subject depth measurement unit 12 as a measurement unit, and a display destination determination unit 13 as a display control unit.
- the subject extraction unit 11, the subject depth measurement unit 12, and the display destination determination unit 13 may be configured by dedicated hardware such as an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array), or as described above. It may be configured by one or more processors, or may be configured by including both.
- ASIC Application Specific Integrated Circuit
- FPGA Field-Programmable Gate Array
- the subject extraction unit 11 extracts the subject (subject s1, s2) to be displayed from the image captured by the photographing device 2, and outputs the subject (subject s1, s2) to the subject depth measuring unit 12.
- the subject can be extracted by the subject extraction unit 11 by using an arbitrary image processing technique or by using a model learned by an arbitrary deep learning technique.
- the subject depth measuring unit 12 measures the distance in the depth direction of each subject extracted by the subject extracting unit 11 from a predetermined position (for example, the position of the photographing device 2).
- the subject depth measuring unit 12 can measure the distance in the depth direction of the subject by using an arbitrary image processing technique or by using a model learned by an arbitrary deep learning technique.
- the subject depth measuring unit 12 may measure the distance in the depth direction of the subject by using the depth sensor.
- the subject depth measuring unit 12 outputs the measurement result of the distance in the depth direction of each subject to the display destination determination unit 13.
- the display destination determination unit 13 sets the display destination of the subject as the display device 3b or the display device 3f based on the measurement result in the depth direction of the subject to be displayed, which is measured by the subject depth measurement unit 12. Is determined. That is, the display destination determination unit 13 as the display control unit has the display device 3b as the first display device and the display device 3f as the second display device based on the measured distance of the subject in the depth direction. Display in one of.
- the display device 3 on which the display target is displayed is switched as the display target moves in the depth direction, so that a more realistic image can be presented without impairing the realistic sense of depth. Can be done.
- FIG. 3 is a flowchart showing an example of the operation of the video display device 10 according to the present embodiment, and is a diagram for explaining a video display method in the video display device 10.
- the subject extraction unit 11 extracts the subject to be displayed from the captured image of the photographing device 2 (step S11).
- the subject depth measuring unit 12 measures the distance in the depth direction of the extracted subject as seen from the viewer side (step S12).
- the display destination determination unit 13 determines whether or not the measured distance of the subject in the depth direction is larger than the predetermined threshold value M (step S13).
- the threshold value M is the distance to a predetermined point between the display device 3b and the display device 3f as seen from the viewer side.
- step S13: Yes the display destination determination unit 13 determines that the display destination of the subject is the display device 3b and displays the subject on the display device 3b (step S13: Yes). Step S14).
- the display destination determination unit 13 determines that the display destination of the subject is the display device 3f and displays the subject on the display device 3f (step S13: No). Step S15).
- the operation of the video display device 10 according to the present embodiment will be described more specifically with reference to FIGS. 4A to 5B.
- the subject s1 existing at the position of the distance T1 from the imaged device 2 is displayed on the display device 3b
- the subject s2 existing at the position of the distance T2 from the photographing device 2 is displayed on the display device.
- the display destination determination unit 13 displays the subject s1 on the display device 3b as shown in FIG. 5A.
- the display destination determination unit 13 moves the subject s1 together with the subject s2 as shown in FIG. 5B. , Displayed on the display device 3f.
- FIGS. 4A to 5B an example of switching the display destination of the subject s1 with the movement of the subject s1 has been described, but the present disclosure is not limited to this.
- the display destination of the subject s2 may be switched from the display device 3f to the display device 3b as the subject s2 moves.
- the video display device 10 includes a subject depth measuring unit 12 as a measuring unit and a display destination determination unit 13 as a display control unit.
- the subject depth measuring unit 12 measures the distance in the depth direction of the display target (subjects s1 and s2) as seen from the viewer (user) side.
- the display destination determination unit 13 displays the display target on either the display device 3b as the first display device or the display device 3f as the second display device based on the measured distance.
- the video display method in the video display device 10 includes a measurement step (step S12) and a display step (steps S13 to S15).
- the measurement step the distance in the depth direction of the display target (subject s1, s2) seen from the viewer (user) side is measured.
- the display step the display target is displayed on either the display device 3b as the first display device or the display device 3f as the second display device based on the measured distance.
- the display target By displaying the display target on either the display device 3b or the display device 3f based on the distance in the depth direction of the display target as seen from the viewer side, the display target is displayed as the display target moves. Since the display device 3 can be switched, it is possible to present a more realistic image without impairing the realistic sense of depth.
- the display destination of the subject s1 is switched from the display device 3b to the display device 3f at a certain point.
- reference viewing position the position of the display devices 3b and 3f so that the position of the subject s1 does not change before and after the switching at the position of a certain viewer (hereinafter referred to as “reference viewing position") at the time when the display destination is switched.
- reference viewing position it is possible to prevent the subject s1 from being displaced.
- non-reference viewing position a position deviating from the reference viewing position
- the position of the display target visually recognized by the viewer shifts due to the switching of the display destination of the display target.
- FIG. 6 is a diagram showing a state in which an object in physical space is projected onto the display device 3f and the display device 3b.
- the numbered solid line circles indicate the positions when the object in the physical space is projected onto the display device 3b
- the numbered broken line circles indicate the objects in the physical space. The position when projected on 3f is shown.
- the black line circle and the broken line circle with the same number indicate the position where the same object in the physical space is projected on the display device 3b and the position projected on the display device 3f, respectively. ing.
- FIG. 8 is a diagram showing an example of the functional configuration of the video display device 20 according to the second embodiment of the present disclosure.
- the same components as those in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
- the image display device 20 includes a subject extraction unit 11, a subject depth measurement unit 12, a display destination determination unit 13, a subject image storage unit 21, and a subject image thinning unit 22. And prepare.
- the image display device 20 according to the present embodiment is different from the image display device 10 according to the first embodiment in that a subject image storage unit 21 and a subject image thinning unit 22 are added.
- the subject image storage unit 21 accumulates the image (image frame) of the subject to be displayed, delays it by a predetermined time, and outputs it to the subject image thinning unit 22.
- the subject image thinning unit 22 thins out the image frame of the subject output from the subject image storage unit 21 in a predetermined period before and after the switching.
- the output is output to the display device 3 determined to be the display destination by the display destination determination unit 13. That is, when the display device 3 for displaying the display target is switched, the subject image thinning unit 22 thins out the video frames of the subject in a predetermined period before and after the switching.
- the subject image thinning unit 22 will be described in more detail.
- an example will be described in which the subject to be displayed moves from the back side to the front side, and the display destination of the image of the subject is switched from the display device 3b to the display device 3f as the subject moves.
- FIG. 9A is a flowchart showing an example of the operation of the subject image thinning unit 22 relating to the display of the subject image on the display device 3b when the display destination is switched from the display device 3b to the display device 3f.
- the subject image thinning unit 22 determines whether or not the display device 3b to which the subject is displayed is switched to the display device 3f after X seconds (step S21).
- step S21 When it is determined that the display destination of the subject is not switched after X seconds (step S21: No), the subject image thinning unit 22 repeats the process of step S21.
- step S21: Yes the subject image thinning unit 22 performs the thinning process of the image frame of the subject to be displayed (step S22).
- FIG. 10 is a diagram showing an example of display of a subject before and after switching the display destination.
- the subject image thinning unit 22 thins out the image frames of the subject for a predetermined time (6 frames in the example of FIG. 10) before the display destination is switched. Therefore, the subject is hidden in the thinned out video frame.
- the subject image thinning unit 22 determines that the display destination of the subject is switched after X seconds, and when X seconds have elapsed, the display destination of the subject is changed from the display device 3b to the display device 3f. Since the switching is possible, the output of the video frame to the display device 3b is stopped (step S23).
- FIG. 9B is a flowchart showing an example of the operation of the subject image thinning unit 22 relating to the display of the subject image on the display device 3f when the display destination is switched from the display device 3b to the display device 3f.
- the subject image thinning unit 22 determines whether or not the display device 3b to which the subject is displayed is switched to the display device 3f after X seconds (step S31).
- step S31 When it is determined that the display destination of the subject is not switched after X seconds (step S31: No), the subject image thinning unit 22 repeats the process of step S31.
- step S31 When it is determined that the display destination of the subject is switched after X seconds (step S31: Yes), the subject image thinning unit 22 waits for X seconds (step S32).
- the display destination of the subject After determining that the display destination of the subject is switched after X seconds, the display destination is switched after waiting for X seconds, and the subject image thinning unit 22 outputs the image frame of the subject to the display device 3f. Is started (step S33).
- the subject video thinning unit 22 When the video frame of the subject is output to the display device 3f by switching the display destination, the subject video thinning unit 22 performs the thinning process of the video frame of the subject to be displayed (step S34). Specifically, as shown in FIG. 10, the subject image thinning unit 22 thins out the image frames of the subject until a predetermined time (6 frames in the example of FIG. 10) elapses after switching the display destination. I do. After a lapse of a predetermined time, the subject image thinning unit 22 finishes thinning out the image frames of the subject.
- a predetermined time 6 frames in the example of FIG. 10
- the subject image thinning unit 22 is displayed in a predetermined period before and after the switching. Thin out the video frames.
- the subject image thinning unit 22 thins out the image frames more frequently as the timing of switching the display destination of the subject approaches. By doing so, it is possible to reduce the amount of change in the position of the subject in the moving direction when the subject to be displayed is visually recognized as moving discontinuously at the non-reference viewing position.
- the subject image thinning unit 22 prepares in advance a plurality of thinning patterns (patterns 1 to N) for thinning out the image frames of the subject as shown in FIG.
- Patterns 1 to N are patterns in which at least one of the number of thinning out of the video frames to be displayed and the timing of thinning out the video frames are different from each other.
- the small amount of change in the moving direction of the subject at the time of switching is defined as follows, for example.
- the large amount of thinning is, for example, the number of thinning out video frames in each pattern.
- the subject image thinning unit 22 searches for N in which the following equation (1) is minimized.
- the viewing position is, for example, the position group of the audience seats of the venue where the video display system 1 according to the present disclosure is used. Since the position of the subject displayed on the display device 3b and the subject displayed on the display device 3f are different due to the difference in the viewing position, the addition value of the evaluation function values at all the viewing positions is minimized. This makes it as realistic as possible for all viewers.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
図1は、本開示の第1の実施形態に係る映像表示装置10がプログラム命令を実行可能なコンピュータである場合のハードウェア構成を示すブロック図である。ここで、コンピュータは、汎用コンピュータ、専用コンピュータ、ワークステーション、PC(Personal Computer)、電子ノートパッドなどであってもよい。プログラム命令は、必要なタスクを実行するためのプログラムコード、コードセグメントなどであってもよい。
第1の実施形態に係る映像表示装置10においては、奥側の被写体s1が手前側に連続的に移動した場合、ある時点で被写体s1の表示先が表示装置3bから表示装置3fに切り替わる。表示先の切り替わる時点で、ある視聴者の位置(以下、「基準視聴位置」と称する)において、切り替わりの前後で被写体s1の位置が変わらないように表示装置3b,3fの位置を調整することで、基準視聴位置では、被写体s1の位置ずれが生じるのを防ぐことができる。しかしながら、基準視聴位置から外れた位置(以下、「非基準視聴位置」と称する。)では、表示対象の表示先の切り替わりにより、視聴者が視認する表示対象の位置ずれが生じてしまう。
評価関数(間引きパタンN)
=切り替え時の被写体の移動方向の変化量の少なさ+間引き量の多さ
|sin(切り替え前の被写体の移動角度-切り替え時の被写体の移動角度)|
この値が小さいほど、切り替えの前後で被写体の移動方向の変化が少ないため、視聴者にとってより現実味を損なわないようになる。また、間引きの量の多さは、例えば、各パタンにおいて映像フレームを間引く数である。
2 撮影装置
3b 表示装置(第1の表示装置)
3f 表示装置(第2の表示装置)
10,20 映像表示装置
11 被写体抽出部
12 被写体奥行計測部(計測部)
13 表示先判定部(表示制御部)
21 被写体映像蓄積部
22 被写体映像間引き部(間引き部)
110 プロセッサ
120 ROM
130 RAM
140 ストレージ
150 入力部
160 表示部
170 通信I/F
190 バス
Claims (6)
- 第1の表示装置および前記第1の表示装置よりもユーザから見て手前に配置された第2の表示装置により、表示対象を表示し、前記第1の表示装置の表示映像と前記第2の表示装置の表示映像とを重畳して前記ユーザに視認させる映像表示装置における映像表示方法であって、
前記ユーザ側から見た前記表示対象の奥行き方向の距離を計測するステップと、
前記計測された距離に基づき、前記表示対象を前記第1の表示装置および前記第2の表示装置のいずれかに表示するステップと、を含む映像表示方法。 - 請求項1に記載の映像表示方法において、
前記表示対象を表示する表示装置を切り替える場合、切り替えの前後の所定の期間において、前記表示対象の映像フレームを間引くステップを、さらに含む映像表示方法。 - 請求項2に記載の映像表示方法において、
前記表示対象を表示する表示装置の切り替えに近づくほど、前記映像フレームの間引き数を多くする、映像表示方法。 - 請求項2に記載の映像表示方法において、
前記表示対象の映像フレームの間引き数および前記映像フレームを間引くタイミングの少なくとも一方が互いに異なる複数の間引きパタンの中から、前記切り替えに伴う前記表示対象の移動方向の変化量および各間引きパタンにおける前記映像フレームの間引き数に基づき、一の間引きパタンを選択し、該選択した間引きパタンに従い前記映像フレームを間引く、映像表示方法。 - 第1の表示装置および前記第1の表示装置よりもユーザから見て手前に配置された第2の表示装置により、表示対象を表示し、前記第1の表示装置の表示映像と前記第2の表示装置の表示映像とを重畳して前記ユーザに視認させる映像表示装置であって、
前記ユーザ側から見た前記表示対象の奥行き方向の距離を計測する計測部と、
前記計測部により計測された距離に基づき、前記表示対象を前記第1の表示装置および前記第2の表示装置のいずれかに表示する表示制御部と、を備える映像表示装置。 - コンピュータを、請求項5に記載の映像表示装置として機能させるためのプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022568012A JP7495644B2 (ja) | 2020-12-11 | 2020-12-11 | 映像表示方法、映像表示装置およびプログラム |
PCT/JP2020/046302 WO2022123772A1 (ja) | 2020-12-11 | 2020-12-11 | 映像表示方法、映像表示装置およびプログラム |
US18/266,206 US20240038201A1 (en) | 2020-12-11 | 2020-12-11 | Image display method, image display device, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2020/046302 WO2022123772A1 (ja) | 2020-12-11 | 2020-12-11 | 映像表示方法、映像表示装置およびプログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022123772A1 true WO2022123772A1 (ja) | 2022-06-16 |
Family
ID=81974302
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/046302 WO2022123772A1 (ja) | 2020-12-11 | 2020-12-11 | 映像表示方法、映像表示装置およびプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US20240038201A1 (ja) |
JP (1) | JP7495644B2 (ja) |
WO (1) | WO2022123772A1 (ja) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63100898A (ja) * | 1986-10-17 | 1988-05-02 | Hitachi Ltd | 立体テレビジヨン装置 |
JP2001333438A (ja) * | 2000-05-23 | 2001-11-30 | Nippon Hoso Kyokai <Nhk> | 立体表示装置 |
JP2005236821A (ja) * | 2004-02-23 | 2005-09-02 | Sony Corp | 映像表示方法、映像表示方法のプログラム、映像表示方法のプログラムを記録した記録媒体及び映像表示装置 |
JP2007053496A (ja) * | 2005-08-16 | 2007-03-01 | Sony Corp | 映像表示方法、映像表示方法のプログラム、映像表示方法のプログラムを記録した記録媒体及び映像表示装置 |
JP2019188855A (ja) * | 2018-04-18 | 2019-10-31 | 株式会社東海理化電機製作所 | 車両用視認装置 |
-
2020
- 2020-12-11 WO PCT/JP2020/046302 patent/WO2022123772A1/ja active Application Filing
- 2020-12-11 US US18/266,206 patent/US20240038201A1/en active Pending
- 2020-12-11 JP JP2022568012A patent/JP7495644B2/ja active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63100898A (ja) * | 1986-10-17 | 1988-05-02 | Hitachi Ltd | 立体テレビジヨン装置 |
JP2001333438A (ja) * | 2000-05-23 | 2001-11-30 | Nippon Hoso Kyokai <Nhk> | 立体表示装置 |
JP2005236821A (ja) * | 2004-02-23 | 2005-09-02 | Sony Corp | 映像表示方法、映像表示方法のプログラム、映像表示方法のプログラムを記録した記録媒体及び映像表示装置 |
JP2007053496A (ja) * | 2005-08-16 | 2007-03-01 | Sony Corp | 映像表示方法、映像表示方法のプログラム、映像表示方法のプログラムを記録した記録媒体及び映像表示装置 |
JP2019188855A (ja) * | 2018-04-18 | 2019-10-31 | 株式会社東海理化電機製作所 | 車両用視認装置 |
Also Published As
Publication number | Publication date |
---|---|
US20240038201A1 (en) | 2024-02-01 |
JPWO2022123772A1 (ja) | 2022-06-16 |
JP7495644B2 (ja) | 2024-06-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10659769B2 (en) | Image processing apparatus, image processing method, and storage medium | |
CN103139463B (zh) | 扩增实境的方法、系统及移动装置 | |
JP5791433B2 (ja) | 情報処理プログラム、情報処理システム、情報処理装置および情報処理方法 | |
JP6340017B2 (ja) | 被写体と3次元仮想空間をリアルタイムに合成する撮影システム | |
KR20190129093A (ko) | 증강 현실 데이터를 레코딩하기 위한 기술 | |
US20200068188A1 (en) | Generating apparatus, generating method, and storage medium | |
JP6419278B1 (ja) | 制御装置、制御方法、及びプログラム | |
Tomioka et al. | Approximated user-perspective rendering in tablet-based augmented reality | |
JPWO2017183346A1 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
JP2012058968A (ja) | プログラム、情報記憶媒体及び画像生成システム | |
US10748341B2 (en) | Terminal device, system, program and method for compositing a real-space image of a player into a virtual space | |
US11521346B2 (en) | Image processing apparatus, image processing method, and storage medium | |
JP2013050883A (ja) | 情報処理プログラム、情報処理システム、情報処理装置および情報処理方法 | |
CN106843790B (zh) | 一种信息展示系统和方法 | |
JP2023103265A (ja) | 制御装置、制御方法、及びプログラム | |
JP2013050882A (ja) | 情報処理プログラム、情報処理システム、情報処理装置および情報処理方法 | |
JP2021016547A (ja) | プログラム、記録媒体、物体検出装置、物体検出方法及び物体検出システム | |
WO2022123772A1 (ja) | 映像表示方法、映像表示装置およびプログラム | |
WO2022123771A1 (ja) | 映像表示方法、映像表示装置およびプログラム | |
US11961190B2 (en) | Content distribution system, content distribution method, and content distribution program | |
CN110313021A (zh) | 用于提供增强现实的方法和设备以及计算机程序 | |
KR101850134B1 (ko) | 3차원 동작 모델 생성 방법 및 장치 | |
KR20200004754A (ko) | 정보 처리장치, 그 제어방법 및 컴퓨터 프로그램 | |
US20240185543A1 (en) | Head-mounted display apparatus that controls exposure timings of plurality of imaging units | |
US20240046552A1 (en) | Generation apparatus, generation method, and non-transitory computer-readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20965154 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022568012 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18266206 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20965154 Country of ref document: EP Kind code of ref document: A1 |