WO2023062936A1 - 情報処理装置、情報処理方法、プログラム、及び情報処理システム - Google Patents

情報処理装置、情報処理方法、プログラム、及び情報処理システム Download PDF

Info

Publication number
WO2023062936A1
WO2023062936A1 PCT/JP2022/031149 JP2022031149W WO2023062936A1 WO 2023062936 A1 WO2023062936 A1 WO 2023062936A1 JP 2022031149 W JP2022031149 W JP 2022031149W WO 2023062936 A1 WO2023062936 A1 WO 2023062936A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
information processing
user
eye
confirmation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/031149
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
貴之 栗原
祐治 中畑
友哉 谷野
真幹 堀川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to US18/697,881 priority Critical patent/US20250240397A1/en
Priority to JP2023554944A priority patent/JPWO2023062936A1/ja
Publication of WO2023062936A1 publication Critical patent/WO2023062936A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H04N13/125—Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues for crosstalk reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/327—Calibration thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/04—Diagnosis, testing or measuring for television systems or their details for receivers

Definitions

  • the present technology relates to an information processing device, an information processing method, a program, and an information processing system applicable to image display and the like.
  • Patent Document 1 discloses a test three-dimensional image in which, when an event requiring a viewing position check occurs, a stereoscopic image of a plurality of vertical bars arranged at different depth positions is perceived when viewed from a predetermined viewing zone.
  • a three-dimensional image display device for displaying on a display is described. This allows the user to easily confirm whether or not the current viewing position is within the 3D viewing zone (description paragraphs [0045] to [0061] FIG. 7 of Patent Document 1, etc.).
  • an object of the present technology is to provide an information processing device, an information processing method, a program, and an information processing system capable of realizing a high-quality viewing experience.
  • an information processing device includes an image generator.
  • the image generation unit generates a crosstalk confirmation image based on the user's viewpoint position.
  • a crosstalk-related confirmation image is generated based on the user's viewpoint position. This makes it possible to achieve a high-quality viewing experience.
  • the confirmation image may include a left-eye image that is incident on the user's left eye and a right-eye image that is different from the left-eye image that is incident on the user's right eye.
  • the left eye image may include a predetermined pattern.
  • the right-eye image may include a predetermined pattern.
  • the predetermined pattern may include at least one of a position of an object, brightness of the object, depth of the object, or shape of the object.
  • the information processing apparatus may further include a determination unit that determines whether the user has closed the left eye or the right eye based on the captured image including the user.
  • the image generation unit may generate the confirmation image based on the user's discrimination threshold based on the determination result of the determination unit.
  • the image generation unit may generate the confirmation image including the predetermined pattern that enables confirmation that the user is visually recognizing with the left eye or the right eye.
  • the image generation unit may generate the left-eye image or the right-eye image including luminance information regarding crosstalk values when inspected at a predetermined timing, based on the determination result of the determination unit.
  • the confirmation image may be an image based on display parameters relating to display of the predetermined pattern.
  • the image generator generates the left-eye image or the right-eye image based on the first display parameter when inspected at a predetermined timing, and generates the second display parameter different from the first display parameter. may generate the other image based on
  • the information processing apparatus may further include a guidance image generation unit that generates a guidance image that guides the user to a position suitable for observing the confirmation image based on the viewpoint position.
  • An information processing method is an information processing method executed by a computer system, and includes generating a crosstalk-related confirmation image based on a user's viewpoint position.
  • a recording medium recording a program causes a computer system to perform the following steps. Generating a confirmation image for crosstalk based on the user's viewpoint position.
  • An information processing system includes a camera, an information processing device, and an image display device.
  • the camera photographs the user.
  • the information processing apparatus includes an image generation unit that generates a crosstalk confirmation image based on the user's viewpoint position.
  • the image display device displays the confirmation image.
  • the camera may capture the confirmation image reflected by a mirror.
  • the information processing device may include a crosstalk determination unit that determines occurrence and degree of the crosstalk from the reflected confirmation image.
  • the image display device may display an image formed from the left-eye image and the right-eye image to the user.
  • the information processing device may include a second image generator that generates an image that guides the user to a position suitable for viewing the image.
  • FIG. 4 is a diagram schematically showing an autostereoscopic display and a confirmation image
  • 1 is a block diagram showing a configuration example of an autostereoscopic display and an information processing device
  • FIG. 6 is a flow showing an example of execution timing of an evaluation application
  • It is a flow which shows an example when an evaluation application is performed based on determination.
  • FIG. 10 is a schematic diagram showing an example of a confirmation image in consideration of a discrimination threshold
  • FIG. 4 is a schematic diagram showing an example of a confirmation image that facilitates perception of left and right
  • FIG. 4 is a schematic diagram showing a confirmation image for evaluating the level of crosstalk
  • FIG. 10 is a schematic diagram showing an example of a confirmation image when display parameters of a predetermined pattern are changed;
  • FIG. 11 is a schematic diagram showing another example of a confirmation image when display parameters are changed;
  • FIG. 10 is a diagram showing a flow chart and a guidance image when guiding to a recommended observation position;
  • FIG. 4 is a schematic diagram showing an example of determination of crosstalk by the system side;
  • FIG. 10 is a schematic diagram showing another example of a confirmation image;
  • FIG. 10 is a schematic diagram showing an example of an image for guiding the user to a confirmation position; It is a block diagram which shows the hardware structural example of an information processing apparatus.
  • FIG. 1 is a diagram schematically showing a naked-eye stereoscopic display (naked-eye stereoscopic image display device) and a confirmation image according to the present technology.
  • FIG. 1A is a diagram schematically showing an information processing system 100.
  • FIG. 1B is a diagram schematically showing a confirmation image.
  • FIG. 1C is a diagram schematically showing crosstalk.
  • an information processing system 100 has an autostereoscopic display 1 and an information processing device 10.
  • FIG. 1A an information processing system 100 has an autostereoscopic display 1 and an information processing device 10.
  • the autostereoscopic display 1 is a display device capable of displaying a stereoscopic image.
  • the user 5 can use the autostereoscopic display 1 to view stereoscopic 3D video by viewing different parallax images with the right eye and the left eye from different viewpoints.
  • the autostereoscopic display 1 has a camera 2 .
  • the user 5 is captured by the camera 2 and the captured image is supplied to the information processing device 10 .
  • the information processing device 10 acquires position information of the user 5 based on the captured image of the user 5 acquired by the camera 2 .
  • the position information includes the position of the viewpoint of the user 5, the direction of the line of sight, the position of the face of the user 5, and the like.
  • the autostereoscopic display 1 may have a trackable configuration such as a depth camera or a motion sensor for acquiring position information of the user 5 .
  • the information processing device 10 generates a crosstalk-related confirmation image based on the viewpoint position of the user 5 .
  • the confirmation image is an image prompting the user 5 to determine whether or not crosstalk is occurring.
  • the confirmation image includes a right-eye image that is incident on the right eye of the user 5 and a left-eye image that is different from the right-eye image that is incident on the left eye of the user 5, and has a predetermined pattern that allows crosstalk to be confirmed. is displayed.
  • the predetermined pattern includes at least one of the position of an object, the brightness of the object, the depth of the object, or the shape of the object. For example, it includes striped objects with a large amount of parallax and contrast, objects with discrimination thresholds such as color and brightness (brightness of video), and different objects that are easily perceived in right-eye and left-eye images. For example, in FIG. 1B, left-eye image 6 and right-eye image 7 are displayed with different horizontal and vertical stripes, respectively. Other examples of confirmation image patterns will be described later with reference to FIGS.
  • the left-eye image 6 leaks into the right eye of the user 5 .
  • the user 5 views a confirmation image 8 that is an image obtained by adding a left-eye image 6 that leaks into the right-eye of the user 5 to a right-eye image 7 .
  • the luminance of the pattern (horizontal stripes) of the left-eye image 6 in FIG. 1C changes according to the amount of crosstalk.
  • FIG. 2 is a block diagram showing a configuration example of the autostereoscopic display 1 and the information processing device 10. As shown in FIG.
  • the autostereoscopic display 1 has a camera 2 and a display section 3.
  • the camera 2 images the user.
  • the captured image captured by the camera 2 is supplied to the viewpoint position detection unit 11 and the determination unit 12 .
  • the display unit 3 displays content for the autostereoscopic display 1 .
  • the user can view contents such as moving images and still images as stereoscopic images.
  • the display unit 3 displays a confirmation image when an evaluation application for confirming crosstalk is activated.
  • the information processing device 10 has a viewpoint position detection unit 11 , a determination unit 12 , and an image generation unit 13 .
  • the information processing apparatus 10 has hardware necessary for configuring a computer, such as processors such as CPU, GPU, and DSP, memories such as ROM and RAM, and storage devices such as HDD (see FIG. 14).
  • processors such as CPU, GPU, and DSP
  • memories such as ROM and RAM
  • storage devices such as HDD (see FIG. 14).
  • the information processing method according to the present technology is executed by the CPU loading a program according to the present technology pre-recorded in the ROM or the like into the RAM and executing the program.
  • the information processing device 10 can be realized by any computer such as a PC.
  • hardware such as FPGA and ASIC may be used.
  • the image generator as a functional block is configured by the CPU executing a predetermined program.
  • dedicated hardware such as an IC (integrated circuit) may be used to implement the functional blocks.
  • the program is installed in the information processing device 10 via various recording media, for example. Alternatively, program installation may be performed via the Internet or the like.
  • the type of recording medium on which the program is recorded is not limited, and any computer-readable recording medium may be used.
  • any computer-readable non-transitory storage medium may be used.
  • the viewpoint position detection unit 11 detects the user's viewpoint position.
  • the viewpoint position detection unit 11 detects the viewpoint position of the user 5 based on the captured image captured by the camera 2 .
  • the detected viewpoint position is supplied to the image generator 13 .
  • the method of detecting the viewpoint position is not limited, and may be detected by any method such as image analysis or machine learning.
  • the determination unit 12 determines whether the user's right eye or left eye is closed based on the captured image.
  • the determination unit 12 also determines whether or not a predetermined condition for starting the evaluation application is satisfied. For example, conditions such as the number of head movements of the user, the number of head movements within a predetermined time period, the amount of head movement, the number of blinks, etc. are set, and the determination unit 12 determines whether or not the number of times exceeds the threshold. is determined, and the evaluation application is activated.
  • the predetermined condition may be arbitrarily set.
  • the image generation unit 13 has a three-dimensional image generation unit 14, a confirmation image generation unit 15, and a guidance image generation unit 16.
  • the three-dimensional image generation unit 14 generates a right-eye image and a left-eye image related to the contents of the autostereoscopic display 1 . That is, a right-eye image that is incident on the right eye and a left-eye image that is incident on the left eye are generated in order to view a video work or the like as a stereoscopic image. The generated image is supplied to the display section 3 .
  • the confirmation image generation unit 15 generates a confirmation image.
  • the confirmation image generator 15 generates an appropriate confirmation image based on the user's viewpoint position detected by the viewpoint position detector 11 .
  • the confirmation image generation unit 15 generates a confirmation image for the open eye according to the determination result of the determination unit 12, that is, whether the right eye or the left eye is closed.
  • the generated confirmation image is supplied to the display section 3 .
  • the guidance image generation unit 16 generates a guidance image that guides the user to a position suitable for observing the confirmation image.
  • the guidance image generation unit 16 generates a guidance image based on the user's viewpoint position detected by the viewpoint position detection unit 11 .
  • the generated guidance image is supplied to the display section 3 .
  • the autostereoscopic display 1 corresponds to an image display device that displays a confirmation image.
  • the camera 2 corresponds to a camera that takes an image of the user.
  • the determination unit 12 corresponds to a determination unit that determines whether or not the user's left eye or right eye is closed based on the captured image including the user.
  • the confirmation image generation unit 15 corresponds to an image generation unit that generates a confirmation image regarding crosstalk based on the user's viewpoint position.
  • the guidance image generation unit 16 corresponds to a guidance image generation unit that generates a guidance image that guides the user to a position suitable for observing the confirmation image based on the viewpoint position.
  • FIG. 3 is a flow showing an example of execution timing of the evaluation application.
  • FIG. 3 shows a flow when crosstalk determination is started by a user's operation.
  • the user activates the evaluation application (step 101). For example, when the user recognizes occurrence of crosstalk such as degradation of video quality or loss of fusion between left and right eye videos while viewing content, the user activates the evaluation application.
  • the evaluation application For example, when the user recognizes occurrence of crosstalk such as degradation of video quality or loss of fusion between left and right eye videos while viewing content, the user activates the evaluation application.
  • a confirmation image is displayed on the display unit 3 by the confirmation image generation unit 15 when the evaluation application is started (step 102).
  • the displayed confirmation image is viewed by the user to confirm whether or not crosstalk is occurring (step 103).
  • FIG. 4 is a flow showing an example of the evaluation application being executed based on the determination.
  • the user activates content for the autostereoscopic display 1 (step 201).
  • the viewpoint position detection unit 11 measures the amount of movement of the user's viewpoint (head) based on the captured image of the user acquired from the camera 2 (step 202).
  • the determination unit 12 determines whether or not the user has satisfied a predetermined condition for starting the evaluation application (step 203). For example, the determination unit 12 determines that the difference between the position information of the user's head when the content is activated and the position information of the user's head when the user moves, which is detected by the viewpoint position detection unit 11, is the threshold value. is exceeded.
  • the evaluation application is activated (step 204).
  • the display unit 3 displays a message prompting the user to evaluate. Is displayed.
  • the text may be presented to the user by voice from a speaker.
  • a confirmation image is displayed on the display unit 3.
  • 5 to 9 show examples of confirmation images displayed on the display unit 3.
  • the user has one eye closed. For example, a message such as "Please close one eye" is displayed on the display unit 3, and the determination unit 12 determines whether or not the user closes one eye based on the captured image. This makes it easier for the user to recognize crosstalk.
  • FIG. 5 is a schematic diagram showing an example of a confirmation image considering the discrimination threshold.
  • FIG. 5A is a schematic diagram showing a left-eye image and a right-eye image.
  • FIG. 5B is a schematic diagram showing a confirmation image when crosstalk is small.
  • FIG. 5C is a schematic diagram showing a confirmation image when there is a crosstalk amount at the time of shipment.
  • FIG. 5D is a schematic diagram showing a confirmation image when crosstalk is large.
  • FIG. 5 the situation where the user closes the left eye is taken as an example.
  • the open eye is hereinafter referred to as the observing side.
  • the left-eye image 20 is an image containing a pattern of horizontal stripes 21.
  • the right-eye image 22 is an image including vertical stripes 23 and a pattern in which the background 24 is colored.
  • the right eye image 22 also includes a pattern of different color horizontal stripes 25 in the same locations as the horizontal stripes 21 of the left eye image 20 .
  • This horizontal stripe 25 is colored based on the user's discrimination threshold.
  • the background 24 is displayed in black in FIG. 5, it is not limited to this and may be white.
  • the left-eye image 20 does not leak into the right eye, so the user can visually recognize the horizontal stripes 25 of the right-eye image 22 as in the confirmation image 26. can.
  • the amount of leakage from the left-eye image 20 increases. That is, the brightness of the left-eye image 20 is increased, and the brightness of the horizontal stripes 21 is seen brighter than the background 24 .
  • FIG. 6 is a schematic diagram showing an example of a confirmation image in which left and right perception is easy.
  • FIG. 6A is a schematic diagram showing a left-eye image and a right-eye image.
  • FIG. 6B is a schematic diagram showing a confirmation image when actually viewed by the user.
  • the display unit 3 displays a left-eye image 31 including the wording 30 "left eye” and a right-eye image 33 including the wording 32 "right eye”. If the user does not have one eye closed, the user observes confirmation image 35 shown in FIG. 6B.
  • a notification may be given by voice or text, such as a circular symbol if the right eye is closed and a square symbol if the left eye is closed.
  • FIG. 7 is a schematic diagram showing a confirmation image for evaluating the level (degree) of crosstalk.
  • FIG. 7A is a schematic diagram showing a left-eye image and a right-eye image.
  • FIG. 7B is a schematic diagram showing a confirmation image when actually viewed by the user.
  • a right-eye image 40 incident on the observer's eye includes a pattern of horizontal stripes 41 displayed at a brightness level equivalent to the crosstalk value at the time of inspection of the autostereoscopic display 1 before shipping.
  • the left eye image 42 also includes a pattern of horizontal stripes 43 for crosstalk.
  • the user can check the crosstalk level by comparing it with the state at the time of shipment by observing the confirmation image 44 . If the crosstalk level is normal, the user can observe a pattern 45 in which horizontal stripes 41 and horizontal stripes 43 have the same brightness as in a confirmation image 44 .
  • the user can easily make a determination by referring to the level.
  • FIG. 8 is a schematic diagram showing an example of a confirmation image when display parameters of a predetermined pattern are changed.
  • FIG. 8A is a schematic diagram showing an example of a confirmation image.
  • FIG. 8B is a schematic diagram showing a confirmation image when display parameters are changed.
  • a display parameter is a parameter related to the display of a predetermined pattern. For example, it includes the depth and brightness of the object (pattern 50 in FIG. 8), the position of the displayed object (vertical coordinate and horizontal coordinate), and the like.
  • FIG. 8 a situation in which the user has both eyes open is taken as an example.
  • the display parameters of the patterns 50 and 51 displayed in the right-eye image and the left-eye image are different.
  • a left-eye image 52 and a right-eye image 53 having patterns of the same shape but different depths are displayed. That is, as shown in FIG. 8A, the user observes a state in which a pattern (square 50) is displayed in front of the display section 3 or a pattern 50 is displayed in the back side of the display section.
  • the change in the depth of the pattern may be changed automatically, or may be changed by the user's own operation. Also, the display parameter changes may be changed based on the initial crosstalk level.
  • FIG. 9 is a schematic diagram showing another example of a confirmation image when display parameters are changed.
  • FIG. 9A is a schematic diagram showing an example of a confirmation image.
  • FIG. 9B is a schematic diagram showing a confirmation image when display parameters are changed.
  • FIG. 9 a situation in which the user has both eyes open is taken as an example.
  • the brightness of patterns 60 and 61 is changed as a display parameter of the confirmation image.
  • the depth of the pattern 60 is set to be displayed in front as shown in FIG. 9A.
  • the left-eye image 62 and the right-eye image 63 include patterns of the same shape and brightness.
  • an area 65 that looks blurry like the confirmation image 64 is generated.
  • the user confirms the luminance at which the luminance of patterns 60 and 61 is changed and crosstalk cannot be observed. This makes it possible to grasp the degree (level) of crosstalk that has occurred.
  • the user can confirm the occurrence and degree of crosstalk.
  • the user views the content by completing crosstalk confirmation (step 205).
  • the information processing apparatus 10 As described above, the information processing apparatus 10 according to the present embodiment generates a confirmation image regarding crosstalk based on the viewpoint position of the user 5 . This makes it possible to achieve a high-quality viewing experience.
  • the viewpoint position detection unit 11 is installed in the information processing device 10.
  • the viewpoint position detection unit 11 is not limited to this, and may be mounted on the autostereoscopic display 1 . This makes it possible to reduce the load on the information processing apparatus 10 .
  • the image generation unit 13 is installed in the information processing device 10 .
  • the image generator 13 is not limited to this, and may be mounted on the autostereoscopic display 1 .
  • the information processing device 10 may generate only the left-eye image and the right-eye image to be input to the 3D image generation unit 14 from the 3D object data based on the user's viewpoint position. This makes it possible to further reduce the load on the information processing apparatus 10 .
  • the processes executed by the viewpoint position detection unit 11 and the image generation unit 13 may be processed by either the autostereoscopic display 1 or the information processing device 10 .
  • the autostereoscopic display 1 does not need to be equipped with a dedicated FPGA or the like, and the cost can be reduced.
  • the load on the information processing apparatus 10 can be reduced because the autostereoscopic display 1 performs most of the processing for 3D display.
  • the camera 2 is mounted on the autostereoscopic display 1.
  • the configuration is not limited to this, and a configuration capable of tracking the user, such as a camera, may be provided outside.
  • a camera and the autostereoscopic display 1 may be connected by wire or wirelessly, and captured images may be supplied.
  • a confirmation image regarding crosstalk was generated for the user.
  • a guidance image may be generated for guiding the user to the recommended observation position.
  • FIG. 10 is a diagram showing a flow chart and a guidance image when guiding to the recommended observation position.
  • FIG. 10A is a flow chart for guidance to the recommended observation position.
  • FIG. 10B is a diagram showing a guidance image.
  • the evaluation application is activated according to the flow shown in FIG. 3 or 4 (step 301).
  • the viewpoint position of the user is detected by the viewpoint position detector 11 (step 302).
  • the guidance image generation unit 16 If the user's viewpoint position deviates from the recommended observation position (YES in step 303), the guidance image generation unit 16 generates a guidance image 70 prompting the user to return to the recommended observation position, and displays it on the display unit 3. (step 304).
  • a recommended viewing position is a position suitable for viewing content for the autostereoscopic display 1 .
  • a guidance image 70 is displayed to prompt the user to move leftward.
  • the guiding image 70 shows an arrow 71 indicating the direction to guide the user and the moving distance of the user by the shading of the arrow 71 .
  • the guide image is not limited, and may be an image or the like that guides the user to a position where the text or image can be seen correctly.
  • a confirmation image is displayed (step 305).
  • the user visually confirms the confirmation images shown in FIGS. 5 to 9 to confirm the occurrence and degree of crosstalk (step 306).
  • the user ends the evaluation application (step 307) and views the content (step 308).
  • the user observes the confirmation image and determines whether or not crosstalk occurs.
  • the system is not limited to this, and the occurrence of crosstalk may be determined by the system side.
  • FIG. 11 is a schematic diagram showing an example of determination of crosstalk by the system side.
  • a mirror 75 is arranged in front of the autostereoscopic display 1 as shown in FIG.
  • Mirror 75 reflects the confirmation image emitted from autostereoscopic display 1 .
  • a camera 2 mounted on the autostereoscopic display 1 captures a confirmation image projected on the mirror 75 .
  • the information processing apparatus 10 may include a crosstalk determination unit that determines the occurrence and degree of crosstalk based on the captured confirmation image.
  • the crosstalk determination unit determines the occurrence of crosstalk based on whether the crosstalk is equal to or less than a preset allowable value.
  • the mirror 75 may be mounted on the autostereoscopic display 1 or may be prepared by the user.
  • the confirmation image pattern was displayed in the center. It is not limited to this, and the shape, position, etc. of the pattern of the confirmation image may be set arbitrarily.
  • FIG. 12 is a schematic diagram showing another example of the confirmation image.
  • FIG. 12A is a schematic diagram showing a right-eye image and a left-eye image.
  • FIG. 12B is a schematic diagram showing a confirmation image when actually viewed by the user.
  • horizontal stripes 81 and vertical stripes 83 of left-eye image 80 and right-eye image 82 may be displayed outside the center.
  • the user can observe the confirmation image 84 shown in FIG. 12B.
  • determination of the presence or absence of crosstalk is made with respect to a location 85 where the horizontal stripes 81 and the vertical stripes 83 intersect.
  • the pattern contained in the confirmation image may be displayed in multiple locations.
  • a guidance image is displayed to guide the user to the recommended observation position. It is not limited to this, and an image may be displayed to guide the user to a confirmation position suitable for checking crosstalk.
  • FIG. 13 is a schematic diagram showing an example of an image for guiding the user to the confirmation position.
  • FIG. 13A is a schematic diagram showing the viewing position of the user.
  • FIG. 13B is a schematic diagram showing an example of an image.
  • the viewpoint position detection unit 11 detects the current viewing position 90 of the user.
  • FIG. 13A when the confirmation position 91 suitable for checking crosstalk is on the right side with respect to the viewing position 90, an image 92 shown in FIG. 13B is displayed.
  • the image 92 shows an arrow 93 indicating the direction to guide the user and the moving distance of the user with the shading of the arrow 93 .
  • the degree of crosstalk changes depending on the position or angle at which the user observes the display, by guiding the user to the confirmation position at an appropriate angle as shown in FIG. It is possible to grasp the degree of talk.
  • the display of the image eliminates the need for the user to determine an appropriate position when checking for crosstalk, thereby improving usability.
  • FIG. 14 is a block diagram showing a hardware configuration example of the information processing apparatus 10. As shown in FIG.
  • the information processing apparatus 10 includes a CPU 201, a ROM 202, a RAM 203, an input/output interface 205, and a bus 204 that connects these to each other.
  • a display unit 206, an input unit 207, a storage unit 208, a communication unit 209, a drive unit 210, and the like are connected to the input/output interface 205.
  • the display unit 206 is, for example, a display device using liquid crystal, EL, or the like.
  • the input unit 207 is, for example, a keyboard, pointing device, touch panel, or other operating device. When input unit 207 includes a touch panel, the touch panel can be integrated with display unit 206 .
  • the storage unit 208 is a non-volatile storage device, such as an HDD, flash memory, or other solid-state memory.
  • the drive unit 210 is a device capable of driving a removable recording medium 211 such as an optical recording medium or a magnetic recording tape.
  • the communication unit 209 is a modem, router, and other communication equipment for communicating with other devices that can be connected to a LAN, WAN, or the like.
  • the communication unit 209 may use either wired or wireless communication.
  • the communication unit 209 is often used separately from the information processing apparatus 10 .
  • Information processing by the information processing apparatus 10 having the hardware configuration as described above is realized by cooperation between software stored in the storage unit 208 or the ROM 202 or the like and hardware resources of the information processing apparatus 10 .
  • the information processing method according to the present technology is realized by loading a program constituting software stored in the ROM 202 or the like into the RAM 203 and executing the program.
  • the program is installed in the information processing device 10 via the recording medium 211, for example.
  • the program may be installed in the information processing device 10 via a global network or the like.
  • any computer-readable non-transitory storage medium may be used.
  • An information processing method and a program according to the present technology are executed by linking a computer installed in a communication terminal with another computer that can communicate via a network or the like, and an image generation unit according to the present technology is constructed. good too.
  • the information processing system, information processing apparatus, and information processing method according to the present technology can be executed not only in a computer system configured by a single computer, but also in a computer system in which a plurality of computers work together.
  • a system means a set of multiple components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules within a single housing, are both systems.
  • Execution of the information processing device, information processing method, program, and information processing system according to the present technology by the computer system is performed by a single computer, for example, detection of the viewpoint position, determination of the evaluation application, generation of the confirmation image, and the like. and each process is executed by a different computer. Execution of each process by a predetermined computer includes causing another computer to execute part or all of the process and obtaining the result.
  • the information processing device, information processing method, program, and information processing system according to the present technology can be applied to a configuration of cloud computing in which a single function is shared by a plurality of devices via a network and processed jointly. is possible.
  • An information processing apparatus comprising: an image generator that generates a crosstalk confirmation image based on a user's viewpoint position.
  • the confirmation image includes a left-eye image incident on the user's left eye and a right-eye image different from the left-eye image incident on the user's right eye.
  • the left eye image includes a predetermined pattern; the right-eye image includes a predetermined pattern;
  • the information processing apparatus wherein the predetermined pattern includes at least one of a position of an object, brightness of the object, depth of the object, or shape of the object.
  • the information processing device further comprising: An information processing apparatus, comprising: a determination unit that determines whether the user has his/her left eye or right eye closed based on a captured image including the user.
  • An information processing apparatus comprising: a determination unit that determines whether the user has his/her left eye or right eye closed based on a captured image including the user.
  • the information processing device (4), The information processing apparatus, wherein the image generation section generates the confirmation image based on the discrimination threshold of the user based on the determination result of the determination section.
  • the information processing device according to (4), The information processing apparatus, wherein the image generation unit generates the confirmation image including the predetermined pattern that enables confirmation that the user is viewing the image with the left eye or the right eye.
  • the image generation unit generates the left-eye image or the right-eye image including luminance information regarding a crosstalk value when inspected at a predetermined timing, based on the determination result of the determination unit.
  • the confirmation image is an image based on display parameters related to display of the predetermined pattern, The image generator generates the left-eye image or the right-eye image based on the first display parameter when inspected at a predetermined timing, and generates the left-eye image or the right-eye image based on the second display parameter different from the first display parameter.
  • An information processing device that generates an image of (9) The information processing device according to (1), further comprising: An information processing apparatus comprising: a guidance image generation unit that generates a guidance image that guides the user to a position suitable for observing the confirmation image based on the viewpoint position. (10) An information processing method in which a computer system generates a crosstalk confirmation image based on a user's viewpoint position. (11) A program that causes a computer system to generate a crosstalk confirmation image based on a user's viewpoint position. (12) a camera that captures a user; an information processing device comprising an image generation unit that generates a crosstalk-related confirmation image based on the user's viewpoint position; An information processing system comprising: an image display device that displays the confirmation image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Eye Examination Apparatus (AREA)
PCT/JP2022/031149 2021-10-13 2022-08-18 情報処理装置、情報処理方法、プログラム、及び情報処理システム Ceased WO2023062936A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/697,881 US20250240397A1 (en) 2021-10-13 2022-08-18 Information processing apparatus, information processing method, program, and information processing system
JP2023554944A JPWO2023062936A1 (https=) 2021-10-13 2022-08-18

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021168349 2021-10-13
JP2021-168349 2021-10-13

Publications (1)

Publication Number Publication Date
WO2023062936A1 true WO2023062936A1 (ja) 2023-04-20

Family

ID=85987371

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/031149 Ceased WO2023062936A1 (ja) 2021-10-13 2022-08-18 情報処理装置、情報処理方法、プログラム、及び情報処理システム

Country Status (3)

Country Link
US (1) US20250240397A1 (https=)
JP (1) JPWO2023062936A1 (https=)
WO (1) WO2023062936A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10174127A (ja) * 1996-12-13 1998-06-26 Sanyo Electric Co Ltd 立体表示方法および立体表示装置
JP2001186549A (ja) * 1999-12-27 2001-07-06 Nippon Hoso Kyokai <Nhk> 立体表示クロストーク量測定装置
JP2013051636A (ja) * 2011-08-31 2013-03-14 Toshiba Corp 映像処理装置
JP2016177281A (ja) * 2015-03-20 2016-10-06 任天堂株式会社 動的自動立体３ｄ画面の較正方法及び装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPP048097A0 (en) * 1997-11-21 1997-12-18 Xenotech Research Pty Ltd Eye tracking apparatus
US8687050B2 (en) * 2010-12-02 2014-04-01 Tektronix, Inc. Stereoscopic extinction ratio test pattern
KR101868654B1 (ko) * 2011-01-22 2018-06-18 휴먼아이즈 테크놀로지즈 리미티드 렌티큘러 인쇄 및 디스플레이에서 흐림 아티팩트를 감소시키는 방법 및 시스템
JP6050941B2 (ja) * 2011-05-26 2016-12-21 サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ 表示装置および方法、並びにプログラム
WO2013094192A1 (ja) * 2011-12-19 2013-06-27 パナソニック株式会社 表示装置
US8970390B2 (en) * 2012-08-29 2015-03-03 3M Innovative Properties Company Method and apparatus of aiding viewing position adjustment with autostereoscopic displays
KR102250821B1 (ko) * 2014-08-20 2021-05-11 삼성전자주식회사 디스플레이 장치 및 디스플레이 장치 동작 방법
US10070118B2 (en) * 2015-09-17 2018-09-04 Lumii, Inc. Multi-view displays and associated systems and methods
JP2019066753A (ja) * 2017-10-04 2019-04-25 三菱電機株式会社 立体画像表示装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10174127A (ja) * 1996-12-13 1998-06-26 Sanyo Electric Co Ltd 立体表示方法および立体表示装置
JP2001186549A (ja) * 1999-12-27 2001-07-06 Nippon Hoso Kyokai <Nhk> 立体表示クロストーク量測定装置
JP2013051636A (ja) * 2011-08-31 2013-03-14 Toshiba Corp 映像処理装置
JP2016177281A (ja) * 2015-03-20 2016-10-06 任天堂株式会社 動的自動立体３ｄ画面の較正方法及び装置

Also Published As

Publication number Publication date
JPWO2023062936A1 (https=) 2023-04-20
US20250240397A1 (en) 2025-07-24

Similar Documents

Publication Publication Date Title
JP5830987B2 (ja) 表示制御装置、表示制御方法およびコンピュータプログラム
US8345086B2 (en) Apparatus, method, and computer program for analyzing image data
US9049423B2 (en) Zero disparity plane for feedback-based three-dimensional video
JP6048819B2 (ja) 表示装置、表示方法、集積回路、プログラム
US20200242335A1 (en) Information processing apparatus, information processing method, and recording medium
KR102402381B1 (ko) 정보 처리 장치, 정보 처리 방법, 및 프로그램
JP2011004388A (ja) 多視点映像表示装置および方法
TWI657431B (zh) 動態顯示系統
CN103109158A (zh) 根据空间光图案生成深度数据
US9477305B2 (en) Stereoscopic image display apparatus and computer-readable recording medium storing program thereon
US10389976B2 (en) Information processing apparatus, information processing system, and information processing method
US9639944B2 (en) Method and apparatus for determining a depth of a target object
TWI486054B (zh) A portrait processing device, a three-dimensional image display device, a method and a program
JPH10322724A (ja) 立体視検査装置および立体視検査プログラムを記録したコンピュータ読み取り可能な記録媒体
JP2019032713A (ja) 情報処理装置、情報処理方法及びプログラム
WO2023062936A1 (ja) 情報処理装置、情報処理方法、プログラム、及び情報処理システム
US9269177B2 (en) Method for processing image and apparatus for processing image
US20180101226A1 (en) Information processing apparatus
KR101192121B1 (ko) 양안시차 및 깊이 정보를 이용한 애너그리프 영상 생성 방법 및 장치
TW201304505A (zh) 立體影像處理裝置以及立體影像處理方法
US20140362197A1 (en) Image processing device, image processing method, and stereoscopic image display device
JP5868055B2 (ja) 画像処理装置および画像処理方法
JP4507843B2 (ja) 画像表示装置
JP2012182678A (ja) 立体映像処理装置および立体映像処理方法
CN121193910A (zh) 图像处理的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22880633

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18697881

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2023554944

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22880633

Country of ref document: EP

Kind code of ref document: A1

WWP Wipo information: published in national office

Ref document number: 18697881

Country of ref document: US