US12489877B2 - Control apparatus, image pickup apparatus, and lens apparatus - Google Patents

Control apparatus, image pickup apparatus, and lens apparatus

Info

Publication number
US12489877B2
US12489877B2 US18/636,488 US202418636488A US12489877B2 US 12489877 B2 US12489877 B2 US 12489877B2 US 202418636488 A US202418636488 A US 202418636488A US 12489877 B2 US12489877 B2 US 12489877B2
Authority
US
United States
Prior art keywords
imaging position
driving unit
eye
optical image
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US18/636,488
Other versions
US20240388686A1 (en
Inventor
Gaku Takahashi
Tomonori Ishikawa
Kohei Karasawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of US20240388686A1 publication Critical patent/US20240388686A1/en
Application granted granted Critical
Publication of US12489877B2 publication Critical patent/US12489877B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32Means for focusing
    • G03B13/34Power focusing
    • G03B13/36Autofocus systems
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/08Stereoscopic photography by simultaneous recording
    • G03B35/12Stereoscopic photography by simultaneous recording involving recording of different viewpoint images in different colours on a colour film
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/246Calibration of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/327Calibration thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof

Definitions

  • One of the aspects of the embodiments relates to a control apparatus, an image pickup apparatus, and a lens apparatus.
  • a pair of left-eye and right-eye images are to be focused on the same object.
  • International Publication No. WO 2011/118078 discloses a configuration that independently moves left and right optical systems using two actuators for autofocus (AF) respectively.
  • Japanese Patent Laid-Open No. 2021-51282 discloses a configuration that integrally moves left and right optical systems using a single actuator.
  • Japanese Patent No. 5670786 discloses a configuration that performs AF using one of two lens apparatuses and enables a user to determine an input value to offset a lens position and adjust a focus difference between left and right (LR focus difference hereinafter) while viewing images.
  • the configuration disclosed in International Publication No. WO 2011/118078 drives two actuators during AF and thus needs high power consumption and a complicated driving circuit.
  • the configuration disclosed in Japanese Patent Laid-Open No. 2021-51282 adjusts the LR focus difference using a spacer during assembly, but tilting of the camera sensor also causes the LR focus difference not only during assembly but also during attachment of the camera sensor.
  • a control apparatus for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, and an operation unit operable to adjust the second driving unit includes a memory storing instructions, and a processor configured to execute the instructions to acquire information regarding the first imaging position and the second imaging position, and cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit.
  • An image pickup apparatus and a lens apparatus each having the above control apparatus also constitutes another aspect of the disclosure.
  • FIG. 1 is a block diagram illustrating a basic configuration of a stereoscopic image display apparatus according to a first embodiment.
  • FIG. 2 explains LR focus difference adjustment.
  • FIG. 3 explains the LR focus difference adjustment.
  • FIG. 4 explains the LR focus difference adjustment.
  • FIG. 5 is a flowchart illustrating LR focus difference adjustment processing.
  • FIG. 6 illustrates a display example of a display device according to the first embodiment.
  • FIG. 7 illustrates a display example of a display device according to a second embodiment.
  • the term “unit” may refer to a software context, a hardware context, or a combination of software and hardware contexts.
  • the term “unit” refers to a functionality, an application, a software module, a function, a routine, a set of instructions, or a program that can be executed by a programmable processor such as a microprocessor, a central processing unit (CPU), or a specially designed programmable device or controller.
  • a memory contains instructions or programs that, when executed by the CPU, cause the CPU to perform operations corresponding to units or functions.
  • the term “unit” refers to a hardware element, a circuit, an assembly, a physical structure, a system, a module, or a subsystem.
  • the term “unit” may include mechanical, optical, or electrical components, or any combination of them.
  • the term “unit” may include active (e.g., transistors) or passive (e.g., capacitor) components.
  • the term “unit” may include semiconductor devices having a substrate and other layers of materials having various concentrations of conductivity. It may include a CPU or a programmable processor that can execute a program stored in a memory to perform specified functions.
  • the term “unit” may include logic elements (e.g., AND, OR) implemented by transistor circuits or any other switching circuits.
  • the term “unit” or “circuit” refers to any combination of the software and hardware contexts as described above.
  • the term “element,” “assembly,” “component,” or “device” may also refer to “circuit” with or without integration with packaging materials.
  • FIG. 1 is a block diagram illustrating a basic configuration of a stereoscopic image display apparatus (image display system) 100 according to this embodiment.
  • the stereoscopic image display apparatus 100 includes a camera body (image pickup apparatus) 110 and an interchangeable lens 200 .
  • the interchangeable lens 200 is attachable to and detachable from the camera body 110 .
  • the interchangeable lens 200 includes an optical system 210 , a mode switch (SW) 220 , a lens microcomputer 230 , an operation unit 240 , a first driving unit 300 , and a second driving unit 400 .
  • SW mode switch
  • the interchangeable lens 200 includes an optical system 210 , a mode switch (SW) 220 , a lens microcomputer 230 , an operation unit 240 , a first driving unit 300 , and a second driving unit 400 .
  • the optical system 210 includes a right-eye optical system 210 R and a left-eye optical system 210 L.
  • One of the right-eye optical system 210 R and the left-eye optical system 210 L is defines as a first optical system, and the other is defined as a second optical system.
  • This embodiment sets the left-eye optical system 210 L to the first optical system, and the right-eye optical system 210 R to the second optical system.
  • the right-eye optical system 210 R and the left-eye optical system 210 L are arranged along a horizontal (lateral) direction and form optical images of the same object.
  • the first driving unit 300 simultaneously adjusts (moves) a right-eye focus position (second imaging position) for a right-eye optical image (second optical image) formed by the right-eye optical system 210 R and a left-eye focus position (first imaging position) for a left-eye optical image (first optical image) formed by the left-eye optical system 210 L.
  • the first driving unit 300 adjusts the right-eye focus position by moving at least one lens included in the right-eye optical system 210 R along the optical axis direction.
  • the first driving unit 300 adjusts the left and right-eye focus positions by moving at least one lens included in the left-eye optical system 210 L along the optical axis direction.
  • a right-eye focus position and a left-eye focus position will be collectively referred to as a focus position.
  • the second driving unit 400 adjusts (moves) only the right-eye focus position.
  • the second driving unit 400 adjusts the right-eye focus position by moving at least one lens included in the right-eye optical system 210 R along the optical axis direction.
  • the left-eye optical system 210 L is the first optical system
  • the right-eye optical system 210 R is the second optical system
  • the second driving unit 400 controls the right-eye focus position.
  • this embodiment is not limited to this example.
  • the second driving unit 400 adjusts the left-eye focus position. That is, the second driving unit 400 may be configured to adjust one of the right-eye focus position and the left-eye focus position.
  • the operation unit 240 is used by the user to adjust the focus position.
  • the lens microcomputer 230 determines driving amounts and driving directions of the first driving unit 300 and the second driving unit 400 based on the operation amount and operation direction of the operation unit 240 .
  • the operation unit 240 is a so-called focus ring that is provided on the barrel exterior of the interchangeable lens 200 rotatably around an axis parallel to the optical axis, but this embodiment is not limited to this example.
  • the mode SW 220 is a switch for switching the stereoscopic image display apparatus 100 between an imaging mode and an LR focus difference adjustment mode.
  • the lens microcomputer 230 sends a command only to the first driving unit 300 , and performs focusing by extending the entire optical system.
  • the lens microcomputer 230 sends a command only to the second driving unit 400 , moves only the right-eye optical system 210 R, and adjusts the LR focus difference.
  • the camera body 110 includes an image sensor 120 , a signal processing circuit 130 , a camera microcomputer (control apparatus) 140 , and a display device (display unit) 150 .
  • the image sensor 120 photoelectrically converts (captures) a right-eye optical image formed by the right-eye optical system 210 R and a left-eye optical image formed by the left-eye optical system 210 L, and outputs an analog imaging signal as an electrical signal.
  • the analog imaging signal is converted into a digital imaging signal by an unillustrated A/D converter circuit.
  • the signal processing circuit 130 generates a video signal (captured image) by performing various image processing for the digital imaging signal and outputs it to the camera microcomputer 140 .
  • Pixel signals output from phase difference focus detecting pixels provided to the image sensor 120 are similarly output to the camera microcomputer 140 .
  • the camera microcomputer 140 centrally controls the entire stereoscopic image display apparatus 100 .
  • the camera microcomputer 140 also adjusts the focus position. More specifically, the camera microcomputer 140 detects a focus shift amount (defocus amount) by the phase difference detecting method based on the pixel signal acquired from the phase difference focus detecting pixels, and calculates a driving amount of the first driving unit 300 or the second driving unit 400 according to the defocus amount.
  • the camera microcomputer 140 functions as an acquiring configured to acquire the right-eye focus position and the left-eye focus position. In adjusting the right-eye focus position, the camera microcomputer 140 functions as a display control unit configured to cause the display device 150 to display information regarding the right-eye focus position and the left-eye focus position.
  • the lens microcomputer 230 may have the functions of the acquiring unit and the display control unit.
  • the camera microcomputer 140 and the lens microcomputer 230 may have a function of a memory configured to store the right-eye focus position and the left-eye focus position.
  • the display device 150 is, for example, a rear LCD of the camera body 110 or an electronic viewfinder, and displays a video signal as a live-view image, and various information regarding changing imaging parameters and adjusting the focus position.
  • FIGS. 2 to 4 a description will be given of adjustment of a focus difference between left and right (LR focus difference adjustment).
  • FIGS. 2 to 4 explain the LR focus difference adjustment.
  • the interchangeable lens 200 is attached to the camera body 110 via a camera mount unit provided to the camera body 110 and a lens mount unit provided to the interchangeable lens 200 .
  • the image sensor 120 is installed so that the image sensor surface is parallel to the lens mount units, but in reality, it is difficult to install the image sensor 120 so that the image sensor surface is parallel to the lens mount units, due to manufacturing errors. That is, as illustrated in FIG. 2 , the image sensor 120 is fixed with a slight slope (S/L) of the image sensor surface relative to the lens mount units.
  • the manufacturing process adjusts distances of a right-eye focus position BP R and a left-eye focus position BP L from the respective lens mount units, so-called flange back distances so that a difference between them approaches zero.
  • the distances of the right-eye focus position BPR and the left-eye focus position BPL from the image sensor surface become different.
  • the LR focus difference occurs.
  • the second driving unit 400 moves at least one lens included in the right-eye optical system 210 R along the optical axis direction, thereby adjusting the LR focus difference.
  • the left-eye focus position which is a reference for the LR focus difference adjustment
  • the user shifts the stereoscopic image display apparatus 100 to the LR focus difference adjustment mode using the mode SW 220 .
  • the user adjusts the LR focus difference by driving the second driving unit 400 using the operation unit 240 while viewing the display device 150 .
  • FIG. 3 illustrates a state in which a focus difference corresponding to a left-eye focus position is D L1 due to AF.
  • the user determines that the adjustment is completed when the user feels an in-focus state after viewing a right-eye image on the display device 150 .
  • the LR focus difference is the sum of the focus differences D L1 and D R1 .
  • the LR focus difference may fall outside the permissible range that provides the natural three-dimensional sense.
  • the camera microcomputer 140 in adjusting the right-eye focus position, causes the display device to display information regarding the right-eye focus position and the left-eye focus position. More specifically, as illustrated in FIG. 4 , in adjusting the right-eye focus position, the camera microcomputer 140 displays an LR focus difference permissible range R in the left-eye focus position and the left-eye focus position are distributed from the center. Thereby, the user can know an LR focus difference ⁇ D between the focus difference D R2 corresponding to the right-eye focus position and the focus difference D L2 corresponding to the left-eye focus position, and adjust the right-eye focus position so that the LR focus difference ⁇ D falls within the LR focus difference permissible range R.
  • FIG. 5 is a flowchart illustrating LR focus difference adjustment processing. Among the processes relating to the flowchart in FIG. 5 , lens control is performed by the lens microcomputer 230 , and camera control is performed by the camera microcomputer 140 .
  • step S 101 the camera microcomputer 140 determines whether the user starts AF to adjust the left-eye focus position, which is the reference for the LR focus difference adjustment, and to suppress a focus difference between left and right images. For example, the camera microcomputer 140 determines that the user has started AF in a case where a shutter button (not illustrated) of the camera body 110 is half-pressed. In a case where the camera microcomputer 140 determines that the user has started AF, the flow proceeds to step S 102 , and in a case where the camera microcomputer 140 determines that the user has not started AF, the flow returns to step S 101 (to stand by until AF starts).
  • step S 102 the camera microcomputer 140 executes AF processing and acquires a left-eye defocus amount.
  • step S 103 the lens microcomputer 230 determines whether the user has turned on the mode SW 220 . In a case where the lens microcomputer 230 determines that the mode SW 220 has been turned on by the user, it transmits the fact that the mode SW 220 is turned on to the camera microcomputer 140 , and the flow proceeds to step S 104 . In a case where the lens microcomputer 230 determines that the user has not turned on the mode SW 220 , the flow returns to step S 103 (to stand by until the mode SW 220 is turned on).
  • step S 104 the camera microcomputer 140 transfers the stereoscopic image display apparatus 100 to the LR focus difference adjustment mode.
  • step S 105 the camera microcomputer 140 enables the user to move a guide frame for manual focusing for the autofocused object while viewing the right-eye image in order to adjust the right-eye focus position, and determines whether the user has finalized the position of the guide frame. In a case where the camera microcomputer 140 determines that the user has finalized the position of the guide frame, the flow proceeds to step S 106 , and in a case where it determines that the user has finalized the position of the guide frame, the flow returns to step S 106 (to stand by until the position of the guide frame is finalized).
  • step S 106 the camera microcomputer 140 acquires the right-eye defocus amount at the position of the guide frame specified in step 105 .
  • the camera microcomputer 140 determines a LR focus difference permissible range based on a preset LR focus difference permissible value and the above left-eye defocus amount.
  • the left-eye focus position may be equally distributed in the plus and minus directions so that the left-eye focus position is located at the center of the LR focus difference permissible range.
  • step S 107 the camera microcomputer 140 causes the display device 150 to display information regarding the left-eye focus position and the right-eye focus position.
  • the display device 150 displays the LR focus difference permissible range, a marker corresponding to the left-eye focus position, and a marker corresponding to the current right-eye focus position in the guide frame.
  • the user operates the operation unit 240 using the content displayed on the display device 150 and adjusts the LR focus difference.
  • the content displayed on the display device 150 is not limited to the content of this embodiment as long as the content enables the user to facilitate the LR focus difference adjustment.
  • FIG. 6 illustrates a display example of the display device 150 in step S 107 .
  • a left-eye image based on a left-eye optical image formed by the left-eye optical system 210 L and a right-eye image based on a right-eye optical image formed by the right-eye optical system 210 R are displayed side by side on the display device 150 .
  • the left-eye image is an image obtained by aligning an AF frame 510 with an eye of object A and performing AF in step S 101 .
  • the right-eye image is an image in which the user has moved a guide frame 520 to the eye of the object A, which is located at the position where AF was performed, and finalized the position of the guide frame 520 in step S 105 .
  • the right-eye image includes a marker 530 corresponding to the left-eye focus position, markers 540 corresponding to the current right-eye focus position in the guide frame 520 , and a LR focus difference permissible range 550 .
  • the two markers 540 are separated at left and right positions, and a distance between the two markers 540 represents the LR focus difference.
  • the distance between the two markers 540 reduces (the two markers 540 come closer together).
  • the distance between the two markers 540 increases (the two markers 540 move farther apart).
  • the two overlapping markers 540 and the marker 530 are aligned on the same straight line. In this state, the LR focus difference is zero.
  • the LR focus difference permissible range 550 is a range determined from the preset LR focus difference permissible value based on the marker 530 , and is determined according to the resolution of the optical system 210 and the resolution of the display device 150 .
  • the LR focus difference permissible range 550 is expressed by a separation amount between the left and right markers 540 .
  • the user can easily adjust the LR focus difference in the LR focus difference adjustment by displaying the marker 530 corresponding to the left-eye focus position as the adjustment reference, and the LR focus difference permissible range 550 on the display device 150 .
  • images to be displayed on the display device 150 may be left and right images displayed side by side or displayed while one of them is enlarged and switchable to the other in order to facilitate the LR focus difference adjustment.
  • step S 108 the lens microcomputer 230 determines whether the user has operated the operation unit 240 , by detecting an operation amount and operation direction of the operation unit 240 . In a case where the lens microcomputer 230 determines that the user has operated the operation unit 240 , the flow proceeds to step S 109 , and in a case where it determines that the user has not operated the operation unit 240 , the flow returns to step S 108 (to stand by until the user operates the operation unit 240 ).
  • step S 109 the lens microcomputer 230 sends the driving direction and driving amount according to the operation amount and operation direction of the operation unit 240 to the second driving unit 400 , and moves the right-eye optical system 210 R.
  • step S 110 the lens microcomputer 230 determines whether the right-eye focus position is outside (beyond) the LR focus difference permissible range. In a case where the lens microcomputer 230 determines that the right-eye focus position is outside the LR focus difference permissible range, the flow proceeds to step S 111 . On the other hand, in a case where the lens microcomputer 230 determines that the right-eye focus position is not outside the LR focus difference permissible range (it is within the LR focus difference permissible range), the flow proceeds to step S 113 .
  • step S 111 the lens microcomputer 230 stops the right-eye optical system 210 R regardless of the operation on the operation unit 240 . In other words, the user is unable to move the right-eye focus position.
  • the camera microcomputer 140 may have a function of a notifying unit configured to notify the user that the right-eye focus position is outside the LR focus difference permissible range.
  • the notification method may cause the display device 150 to display information (letters, marks, etc.) indicating that the right-eye focus position is outside the LR focus difference permissible range, vibrate a part of the stereoscopic image display apparatus 100 , or emit a notification sound.
  • the lens microcomputer 230 may have a function of the notifying unit.
  • step S 112 the lens microcomputer 230 detects the operation direction of the operation unit 240 , and determines whether the operation direction is a direction that moves the right-eye focus position to the inside of the LR focus difference permissible range. In a case where the lens microcomputer 230 determines that the operation direction is the direction that moves the right-eye focus position to the inside of the LR focus difference permissible range, the flow proceeds to step S 109 . In a case where the lens microcomputer 230 determines that the operation direction is not the direction that moves the right-eye focus position to the inside of the LR focus difference permissible range, the flow proceeds to step S 111 (maintains the right-eye optical system 210 R stopped).
  • step S 113 the camera microcomputer 140 updates the information regarding the right-eye focus position displayed on the display device 150 .
  • the camera microcomputer 140 changes the marker corresponding to the current right-eye focus position on the guide frame.
  • step S 114 the lens microcomputer 230 determines whether the user has turned off the mode SW 220 . In a case where the lens microcomputer 230 determines that the mode SW 220 has been turned off by the user, it transmits to the camera microcomputer 140 that the mode SW 220 is turned off, and the flow proceeds to step S 115 . In a case where the lens microcomputer 230 determines that the user has not turned off the mode SW 220 , the flow returns to step S 108 .
  • step S 115 the camera microcomputer 140 transfers the stereoscopic image display apparatus 100 to an imaging mode.
  • the camera microcomputer 140 may perform part of the determination processing performed by the lens microcomputer 230 .
  • the configuration according to this embodiment enables the user to easily adjust the LR focus difference using a simple configuration so as to maintain AF performance and capture stereoscopic images that do not provide the discomfort sense.
  • the first embodiment moves the markers along the circumferential direction, and narrows or widens a gap between the two markers to visualize the LR focus difference, but this example linearly visualize the LR focus difference (using a bar).
  • the stereoscopic image display apparatus has a configuration similar to that of the stereoscopic image display apparatus 100 according to the first embodiment. This embodiment will discuss only a different configuration from the first embodiment, and omit a description of the common configuration.
  • FIG. 7 illustrates a display example of the display device 150 in a case where the user adjusts the LR focus difference.
  • a left-eye image based on a left-eye optical image formed by the left-eye optical system 210 L and a right-eye image based on a right-eye optical image formed by the right-eye optical system 210 R are displayed side by side on the display device 150 .
  • the left-eye image is an image obtained by aligning the AF frame 510 with the eye of the object A and performing AF in step S 101 .
  • the right-eye image is an image in which the user has moved the guide frame 520 to the eye of the object A, which is located at the position where AF was performed, and finalized the position of the guide frame 520 in step S 105 .
  • the right-eye image includes a marker 530 corresponding to the left-eye focus position, a bar 560 corresponding to the current right-eye focus position in the guide frame 520 , and a LR focus difference permissible range 570 .
  • the LR focus difference permissible range 570 is linearly displayed, and the bar 560 is configured to linearly move on the LR focus difference permissible range 570 .
  • the LR focus difference permissible range 570 is a range determined from a preset LR focus difference permissible value based on the marker 530 , and is determined according to the resolution of the optical system 210 and the resolution of the display device 150 .
  • the LR focus difference permissible range 550 is expressed by the length in the horizontal direction.
  • this embodiment linearly displays the LR focus difference permissible range 570 based on the marker 530 , the user can be notified of the LR focus difference with a plus or minus sign. More specifically, in a case where the bar 560 is on the left side of the marker 530 , the sign may be set to a minus, and the user can recognize that the right-eye focus position is focused in front of the left-eye focus position (so-called front focus).
  • the configuration according to this embodiment enables the user to easily adjust the LR focus difference using a simple configuration so as to maintain AF performance and capture stereoscopic images that do not provide the discomfort sense.
  • Embodiment(s) of the disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer-executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
  • ASIC application specific integrated circuit
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer-executable instructions.
  • the computer-executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read-only memory (ROM), a storage of distributed computing systems, an optical disc (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.
  • Each embodiment can provide a control apparatus that enables a user to easily adjust a focus difference between left and right using a simple configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Lens Barrels (AREA)
  • Cameras In General (AREA)
  • Structure And Mechanism Of Cameras (AREA)
  • Indication In Cameras, And Counting Of Exposures (AREA)
  • Studio Devices (AREA)

Abstract

A control apparatus for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, and an operation unit operable to adjust the second driving unit includes a memory storing instructions, and a processor configured to execute the instructions to acquire information regarding the first imaging position and the second imaging position, and cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit.

Description

BACKGROUND Technical Field
One of the aspects of the embodiments relates to a control apparatus, an image pickup apparatus, and a lens apparatus.
Description of Related Art
In order for a viewer to obtain the natural three-dimensional sense using a stereoscopic image display apparatus such as VR goggles or a three-dimensional display, a pair of left-eye and right-eye images are to be focused on the same object. International Publication No. WO 2011/118078 discloses a configuration that independently moves left and right optical systems using two actuators for autofocus (AF) respectively. Japanese Patent Laid-Open No. 2021-51282 discloses a configuration that integrally moves left and right optical systems using a single actuator. Japanese Patent No. 5670786 discloses a configuration that performs AF using one of two lens apparatuses and enables a user to determine an input value to offset a lens position and adjust a focus difference between left and right (LR focus difference hereinafter) while viewing images.
The configuration disclosed in International Publication No. WO 2011/118078 drives two actuators during AF and thus needs high power consumption and a complicated driving circuit. The configuration disclosed in Japanese Patent Laid-Open No. 2021-51282 adjusts the LR focus difference using a spacer during assembly, but tilting of the camera sensor also causes the LR focus difference not only during assembly but also during attachment of the camera sensor. In the configuration disclosed in Japanese Patent No. 5670786, it is up to the user to determine whether the LR focus difference is within a desired range, and whether or not the LR focus difference causes a sense of discomfort is unknown until a stereoscopic image is generated.
SUMMARY
A control apparatus according to one aspect of the disclosure for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, and an operation unit operable to adjust the second driving unit includes a memory storing instructions, and a processor configured to execute the instructions to acquire information regarding the first imaging position and the second imaging position, and cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit. An image pickup apparatus and a lens apparatus each having the above control apparatus also constitutes another aspect of the disclosure.
Further features of various embodiments of the disclosure will become apparent from the following description of embodiments with reference to the attached drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram illustrating a basic configuration of a stereoscopic image display apparatus according to a first embodiment.
FIG. 2 explains LR focus difference adjustment.
FIG. 3 explains the LR focus difference adjustment.
FIG. 4 explains the LR focus difference adjustment.
FIG. 5 is a flowchart illustrating LR focus difference adjustment processing.
FIG. 6 illustrates a display example of a display device according to the first embodiment.
FIG. 7 illustrates a display example of a display device according to a second embodiment.
DESCRIPTION OF THE EMBODIMENTS
In the following, the term “unit” may refer to a software context, a hardware context, or a combination of software and hardware contexts. In the software context, the term “unit” refers to a functionality, an application, a software module, a function, a routine, a set of instructions, or a program that can be executed by a programmable processor such as a microprocessor, a central processing unit (CPU), or a specially designed programmable device or controller. A memory contains instructions or programs that, when executed by the CPU, cause the CPU to perform operations corresponding to units or functions. In the hardware context, the term “unit” refers to a hardware element, a circuit, an assembly, a physical structure, a system, a module, or a subsystem. Depending on the specific embodiment, the term “unit” may include mechanical, optical, or electrical components, or any combination of them. The term “unit” may include active (e.g., transistors) or passive (e.g., capacitor) components. The term “unit” may include semiconductor devices having a substrate and other layers of materials having various concentrations of conductivity. It may include a CPU or a programmable processor that can execute a program stored in a memory to perform specified functions. The term “unit” may include logic elements (e.g., AND, OR) implemented by transistor circuits or any other switching circuits. In the combination of software and hardware contexts, the term “unit” or “circuit” refers to any combination of the software and hardware contexts as described above. In addition, the term “element,” “assembly,” “component,” or “device” may also refer to “circuit” with or without integration with packaging materials.
Referring now to the accompanying drawings, a detailed description will be given of embodiments according to the disclosure. Corresponding elements in respective figures will be designated by the same reference numerals, and a duplicate description thereof will be omitted.
First Embodiment
FIG. 1 is a block diagram illustrating a basic configuration of a stereoscopic image display apparatus (image display system) 100 according to this embodiment. The stereoscopic image display apparatus 100 includes a camera body (image pickup apparatus) 110 and an interchangeable lens 200. The interchangeable lens 200 is attachable to and detachable from the camera body 110.
A description will now be given of the configuration of the interchangeable lens 200. The interchangeable lens 200 includes an optical system 210, a mode switch (SW) 220, a lens microcomputer 230, an operation unit 240, a first driving unit 300, and a second driving unit 400.
The optical system 210 includes a right-eye optical system 210R and a left-eye optical system 210L. One of the right-eye optical system 210R and the left-eye optical system 210L is defines as a first optical system, and the other is defined as a second optical system. This embodiment sets the left-eye optical system 210L to the first optical system, and the right-eye optical system 210R to the second optical system. The right-eye optical system 210R and the left-eye optical system 210L are arranged along a horizontal (lateral) direction and form optical images of the same object.
The first driving unit 300 simultaneously adjusts (moves) a right-eye focus position (second imaging position) for a right-eye optical image (second optical image) formed by the right-eye optical system 210R and a left-eye focus position (first imaging position) for a left-eye optical image (first optical image) formed by the left-eye optical system 210L. The first driving unit 300 adjusts the right-eye focus position by moving at least one lens included in the right-eye optical system 210R along the optical axis direction. The first driving unit 300 adjusts the left and right-eye focus positions by moving at least one lens included in the left-eye optical system 210L along the optical axis direction. In the following description, a right-eye focus position and a left-eye focus position will be collectively referred to as a focus position.
The second driving unit 400 adjusts (moves) only the right-eye focus position. The second driving unit 400 adjusts the right-eye focus position by moving at least one lens included in the right-eye optical system 210R along the optical axis direction.
In this embodiment, as described above, the left-eye optical system 210L is the first optical system, the right-eye optical system 210R is the second optical system, and the second driving unit 400 controls the right-eye focus position. However, this embodiment is not limited to this example. In a case where the right-eye optical system 210R is the first optical system and the left-eye optical system 210L is the second optical system, the second driving unit 400 adjusts the left-eye focus position. That is, the second driving unit 400 may be configured to adjust one of the right-eye focus position and the left-eye focus position.
The operation unit 240 is used by the user to adjust the focus position. In a case where the user operates the operation unit 240, the lens microcomputer 230 determines driving amounts and driving directions of the first driving unit 300 and the second driving unit 400 based on the operation amount and operation direction of the operation unit 240. In this embodiment, the operation unit 240 is a so-called focus ring that is provided on the barrel exterior of the interchangeable lens 200 rotatably around an axis parallel to the optical axis, but this embodiment is not limited to this example.
The mode SW 220 is a switch for switching the stereoscopic image display apparatus 100 between an imaging mode and an LR focus difference adjustment mode. In the imaging mode, the lens microcomputer 230 sends a command only to the first driving unit 300, and performs focusing by extending the entire optical system. On the other hand, in the LR focus difference adjustment mode, the lens microcomputer 230 sends a command only to the second driving unit 400, moves only the right-eye optical system 210R, and adjusts the LR focus difference.
A description will now be given of the configuration of the camera body 110. The camera body 110 includes an image sensor 120, a signal processing circuit 130, a camera microcomputer (control apparatus) 140, and a display device (display unit) 150.
The image sensor 120 photoelectrically converts (captures) a right-eye optical image formed by the right-eye optical system 210R and a left-eye optical image formed by the left-eye optical system 210L, and outputs an analog imaging signal as an electrical signal. The analog imaging signal is converted into a digital imaging signal by an unillustrated A/D converter circuit.
The signal processing circuit 130 generates a video signal (captured image) by performing various image processing for the digital imaging signal and outputs it to the camera microcomputer 140. Pixel signals output from phase difference focus detecting pixels provided to the image sensor 120 are similarly output to the camera microcomputer 140.
The camera microcomputer 140 centrally controls the entire stereoscopic image display apparatus 100. The camera microcomputer 140 also adjusts the focus position. More specifically, the camera microcomputer 140 detects a focus shift amount (defocus amount) by the phase difference detecting method based on the pixel signal acquired from the phase difference focus detecting pixels, and calculates a driving amount of the first driving unit 300 or the second driving unit 400 according to the defocus amount. The camera microcomputer 140 functions as an acquiring configured to acquire the right-eye focus position and the left-eye focus position. In adjusting the right-eye focus position, the camera microcomputer 140 functions as a display control unit configured to cause the display device 150 to display information regarding the right-eye focus position and the left-eye focus position. The lens microcomputer 230 may have the functions of the acquiring unit and the display control unit. The camera microcomputer 140 and the lens microcomputer 230 may have a function of a memory configured to store the right-eye focus position and the left-eye focus position.
The display device 150 is, for example, a rear LCD of the camera body 110 or an electronic viewfinder, and displays a video signal as a live-view image, and various information regarding changing imaging parameters and adjusting the focus position.
Referring now to FIGS. 2 to 4 , a description will be given of adjustment of a focus difference between left and right (LR focus difference adjustment). FIGS. 2 to 4 explain the LR focus difference adjustment.
A description will now be given of a reason for the LR focus difference adjustment. The interchangeable lens 200 is attached to the camera body 110 via a camera mount unit provided to the camera body 110 and a lens mount unit provided to the interchangeable lens 200. Ideally, the image sensor 120 is installed so that the image sensor surface is parallel to the lens mount units, but in reality, it is difficult to install the image sensor 120 so that the image sensor surface is parallel to the lens mount units, due to manufacturing errors. That is, as illustrated in FIG. 2 , the image sensor 120 is fixed with a slight slope (S/L) of the image sensor surface relative to the lens mount units. In the interchangeable lens 200, the manufacturing process adjusts distances of a right-eye focus position BPR and a left-eye focus position BPL from the respective lens mount units, so-called flange back distances so that a difference between them approaches zero. However, due to the tilting of the image sensor 120, the distances of the right-eye focus position BPR and the left-eye focus position BPL from the image sensor surface become different. In other words, the LR focus difference occurs. In a case where this LR focus difference falls outside a permissible range, the user feels uncomfortable between left and right images, and it will be difficult for the user to obtain the three-dimensional sense from the left and right images. In this embodiment, as described above, the second driving unit 400 moves at least one lens included in the right-eye optical system 210R along the optical axis direction, thereby adjusting the LR focus difference.
A description will now be given of a schematic procedure of the LR focus difference adjustment. First, the left-eye focus position, which is a reference for the LR focus difference adjustment, is adjusted by AF using the first driving unit 300. Next, the user shifts the stereoscopic image display apparatus 100 to the LR focus difference adjustment mode using the mode SW 220. Finally, the user adjusts the LR focus difference by driving the second driving unit 400 using the operation unit 240 while viewing the display device 150.
Generally, AF uses an AF accuracy range defined by a permissible circle of confusion diameter δ, which is considered to be in focus, and an F-number (aperture value) F. FIG. 3 illustrates a state in which a focus difference corresponding to a left-eye focus position is DL1 due to AF. In the state illustrated in FIG. 3 , the user determines that the adjustment is completed when the user feels an in-focus state after viewing a right-eye image on the display device 150. In a case where a focus difference corresponding to the right-eye focus position at this time is DR1, the LR focus difference is the sum of the focus differences DL1 and DR1. In other words, in a case where the left-eye and right-eye focus positions are adjusted for their respective best focus positions, due to variations in AF accuracy and manual adjustment, the LR focus difference may fall outside the permissible range that provides the natural three-dimensional sense.
Accordingly, in this embodiment, in adjusting the right-eye focus position, the camera microcomputer 140 causes the display device to display information regarding the right-eye focus position and the left-eye focus position. More specifically, as illustrated in FIG. 4 , in adjusting the right-eye focus position, the camera microcomputer 140 displays an LR focus difference permissible range R in the left-eye focus position and the left-eye focus position are distributed from the center. Thereby, the user can know an LR focus difference ΔD between the focus difference DR2 corresponding to the right-eye focus position and the focus difference DL2 corresponding to the left-eye focus position, and adjust the right-eye focus position so that the LR focus difference ΔD falls within the LR focus difference permissible range R.
FIG. 5 is a flowchart illustrating LR focus difference adjustment processing. Among the processes relating to the flowchart in FIG. 5 , lens control is performed by the lens microcomputer 230, and camera control is performed by the camera microcomputer 140.
In step S101, the camera microcomputer 140 determines whether the user starts AF to adjust the left-eye focus position, which is the reference for the LR focus difference adjustment, and to suppress a focus difference between left and right images. For example, the camera microcomputer 140 determines that the user has started AF in a case where a shutter button (not illustrated) of the camera body 110 is half-pressed. In a case where the camera microcomputer 140 determines that the user has started AF, the flow proceeds to step S102, and in a case where the camera microcomputer 140 determines that the user has not started AF, the flow returns to step S101 (to stand by until AF starts).
In step S102, the camera microcomputer 140 executes AF processing and acquires a left-eye defocus amount.
In step S103, the lens microcomputer 230 determines whether the user has turned on the mode SW 220. In a case where the lens microcomputer 230 determines that the mode SW 220 has been turned on by the user, it transmits the fact that the mode SW 220 is turned on to the camera microcomputer 140, and the flow proceeds to step S104. In a case where the lens microcomputer 230 determines that the user has not turned on the mode SW 220, the flow returns to step S103 (to stand by until the mode SW 220 is turned on).
In step S104, the camera microcomputer 140 transfers the stereoscopic image display apparatus 100 to the LR focus difference adjustment mode.
In step S105, the camera microcomputer 140 enables the user to move a guide frame for manual focusing for the autofocused object while viewing the right-eye image in order to adjust the right-eye focus position, and determines whether the user has finalized the position of the guide frame. In a case where the camera microcomputer 140 determines that the user has finalized the position of the guide frame, the flow proceeds to step S106, and in a case where it determines that the user has finalized the position of the guide frame, the flow returns to step S106 (to stand by until the position of the guide frame is finalized).
In step S106, the camera microcomputer 140 acquires the right-eye defocus amount at the position of the guide frame specified in step 105. The camera microcomputer 140 determines a LR focus difference permissible range based on a preset LR focus difference permissible value and the above left-eye defocus amount. For example, the left-eye focus position may be equally distributed in the plus and minus directions so that the left-eye focus position is located at the center of the LR focus difference permissible range.
In step S107, the camera microcomputer 140 causes the display device 150 to display information regarding the left-eye focus position and the right-eye focus position. In this embodiment, the display device 150 displays the LR focus difference permissible range, a marker corresponding to the left-eye focus position, and a marker corresponding to the current right-eye focus position in the guide frame. The user operates the operation unit 240 using the content displayed on the display device 150 and adjusts the LR focus difference. The content displayed on the display device 150 is not limited to the content of this embodiment as long as the content enables the user to facilitate the LR focus difference adjustment.
FIG. 6 illustrates a display example of the display device 150 in step S107. A left-eye image based on a left-eye optical image formed by the left-eye optical system 210L and a right-eye image based on a right-eye optical image formed by the right-eye optical system 210R are displayed side by side on the display device 150. The left-eye image is an image obtained by aligning an AF frame 510 with an eye of object A and performing AF in step S101. The right-eye image is an image in which the user has moved a guide frame 520 to the eye of the object A, which is located at the position where AF was performed, and finalized the position of the guide frame 520 in step S105. The right-eye image includes a marker 530 corresponding to the left-eye focus position, markers 540 corresponding to the current right-eye focus position in the guide frame 520, and a LR focus difference permissible range 550.
The two markers 540 are separated at left and right positions, and a distance between the two markers 540 represents the LR focus difference. In this embodiment, as the user operates the operation unit 240 so as to reduce the LR focus difference, the distance between the two markers 540 reduces (the two markers 540 come closer together). On the other hand, as the user operates the operation unit 240 to increase the LR focus difference, the distance between the two markers 540 increases (the two markers 540 move farther apart). In a case where the two markers 540 overlap each other, the two overlapping markers 540 and the marker 530 are aligned on the same straight line. In this state, the LR focus difference is zero.
The LR focus difference permissible range 550 is a range determined from the preset LR focus difference permissible value based on the marker 530, and is determined according to the resolution of the optical system 210 and the resolution of the display device 150. In this embodiment, the LR focus difference permissible range 550 is expressed by a separation amount between the left and right markers 540. Thus, the user can easily adjust the LR focus difference in the LR focus difference adjustment by displaying the marker 530 corresponding to the left-eye focus position as the adjustment reference, and the LR focus difference permissible range 550 on the display device 150.
In the LR focus difference adjustment, images to be displayed on the display device 150 may be left and right images displayed side by side or displayed while one of them is enlarged and switchable to the other in order to facilitate the LR focus difference adjustment.
In step S108, the lens microcomputer 230 determines whether the user has operated the operation unit 240, by detecting an operation amount and operation direction of the operation unit 240. In a case where the lens microcomputer 230 determines that the user has operated the operation unit 240, the flow proceeds to step S109, and in a case where it determines that the user has not operated the operation unit 240, the flow returns to step S108 (to stand by until the user operates the operation unit 240).
In step S109, the lens microcomputer 230 sends the driving direction and driving amount according to the operation amount and operation direction of the operation unit 240 to the second driving unit 400, and moves the right-eye optical system 210R.
In step S110, the lens microcomputer 230 determines whether the right-eye focus position is outside (beyond) the LR focus difference permissible range. In a case where the lens microcomputer 230 determines that the right-eye focus position is outside the LR focus difference permissible range, the flow proceeds to step S111. On the other hand, in a case where the lens microcomputer 230 determines that the right-eye focus position is not outside the LR focus difference permissible range (it is within the LR focus difference permissible range), the flow proceeds to step S113.
In step S111, the lens microcomputer 230 stops the right-eye optical system 210R regardless of the operation on the operation unit 240. In other words, the user is unable to move the right-eye focus position.
The camera microcomputer 140 may have a function of a notifying unit configured to notify the user that the right-eye focus position is outside the LR focus difference permissible range. The notification method may cause the display device 150 to display information (letters, marks, etc.) indicating that the right-eye focus position is outside the LR focus difference permissible range, vibrate a part of the stereoscopic image display apparatus 100, or emit a notification sound. The lens microcomputer 230 may have a function of the notifying unit.
In step S112, the lens microcomputer 230 detects the operation direction of the operation unit 240, and determines whether the operation direction is a direction that moves the right-eye focus position to the inside of the LR focus difference permissible range. In a case where the lens microcomputer 230 determines that the operation direction is the direction that moves the right-eye focus position to the inside of the LR focus difference permissible range, the flow proceeds to step S109. In a case where the lens microcomputer 230 determines that the operation direction is not the direction that moves the right-eye focus position to the inside of the LR focus difference permissible range, the flow proceeds to step S111 (maintains the right-eye optical system 210R stopped).
In step S113, the camera microcomputer 140 updates the information regarding the right-eye focus position displayed on the display device 150. In this embodiment, the camera microcomputer 140 changes the marker corresponding to the current right-eye focus position on the guide frame.
In step S114, the lens microcomputer 230 determines whether the user has turned off the mode SW 220. In a case where the lens microcomputer 230 determines that the mode SW 220 has been turned off by the user, it transmits to the camera microcomputer 140 that the mode SW 220 is turned off, and the flow proceeds to step S115. In a case where the lens microcomputer 230 determines that the user has not turned off the mode SW 220, the flow returns to step S108.
In step S115, the camera microcomputer 140 transfers the stereoscopic image display apparatus 100 to an imaging mode.
In the flow of FIG. 5 , the camera microcomputer 140 may perform part of the determination processing performed by the lens microcomputer 230.
As described above, even when the lens apparatus is interchanged in the lens interchangeable type stereoscopic image pickup apparatus, the configuration according to this embodiment enables the user to easily adjust the LR focus difference using a simple configuration so as to maintain AF performance and capture stereoscopic images that do not provide the discomfort sense.
Second Embodiment
The first embodiment moves the markers along the circumferential direction, and narrows or widens a gap between the two markers to visualize the LR focus difference, but this example linearly visualize the LR focus difference (using a bar).
The stereoscopic image display apparatus according to this embodiment has a configuration similar to that of the stereoscopic image display apparatus 100 according to the first embodiment. This embodiment will discuss only a different configuration from the first embodiment, and omit a description of the common configuration.
FIG. 7 illustrates a display example of the display device 150 in a case where the user adjusts the LR focus difference. A left-eye image based on a left-eye optical image formed by the left-eye optical system 210L and a right-eye image based on a right-eye optical image formed by the right-eye optical system 210R are displayed side by side on the display device 150. The left-eye image is an image obtained by aligning the AF frame 510 with the eye of the object A and performing AF in step S101. The right-eye image is an image in which the user has moved the guide frame 520 to the eye of the object A, which is located at the position where AF was performed, and finalized the position of the guide frame 520 in step S105. The right-eye image includes a marker 530 corresponding to the left-eye focus position, a bar 560 corresponding to the current right-eye focus position in the guide frame 520, and a LR focus difference permissible range 570. In this embodiment, the LR focus difference permissible range 570 is linearly displayed, and the bar 560 is configured to linearly move on the LR focus difference permissible range 570.
By visualizing the difference between the bar 560 and the marker 530, the user can intuitively recognize the LR focus difference. The LR focus difference permissible range 570 is a range determined from a preset LR focus difference permissible value based on the marker 530, and is determined according to the resolution of the optical system 210 and the resolution of the display device 150. In this embodiment, the LR focus difference permissible range 550 is expressed by the length in the horizontal direction.
Since this embodiment linearly displays the LR focus difference permissible range 570 based on the marker 530, the user can be notified of the LR focus difference with a plus or minus sign. More specifically, in a case where the bar 560 is on the left side of the marker 530, the sign may be set to a minus, and the user can recognize that the right-eye focus position is focused in front of the left-eye focus position (so-called front focus).
As described above, even when the lens apparatus is interchanged in the lens interchangeable type stereoscopic image pickup apparatus, the configuration according to this embodiment enables the user to easily adjust the LR focus difference using a simple configuration so as to maintain AF performance and capture stereoscopic images that do not provide the discomfort sense.
Other Embodiments
Embodiment(s) of the disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer-executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read-only memory (ROM), a storage of distributed computing systems, an optical disc (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the disclosure has described example embodiments, it is to be understood that some embodiments are not limited to the disclosed embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Each embodiment can provide a control apparatus that enables a user to easily adjust a focus difference between left and right using a simple configuration.
This application claims priority to Japanese Patent Application No. 2023-081749, which was filed on May 17, 2023, and which is hereby incorporated by reference herein in its entirety.

Claims (9)

What is claimed is:
1. A control apparatus for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, and an operation unit operable to adjust the second driving unit, the control apparatus comprising:
a memory storing instructions; and
a processor configured to execute the instructions to:
acquire information regarding the first imaging position and the second imaging position, and
cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit,
wherein in a case where the second driving unit moves the second imaging position in accordance with the operation of the operation unit and thereby the second imaging position falls outside a permissible range, the processor is configured to notify that the second imaging position falls outside the permissible range.
2. The control apparatus according to claim 1, wherein the memory further stores the information.
3. The control apparatus according to claim 1, wherein the information includes information regarding the first imaging position that does not change in accordance with the operation on the operation unit.
4. The control apparatus according to claim 1, wherein the information includes information regarding the second imaging position that changes in accordance with the operation on the operation unit.
5. The control apparatus according to claim 1, wherein the information includes information regarding a permissible range of the second imaging position.
6. The control apparatus according to claim 1, wherein in the case where the second driving unit moves the second imaging position in accordance with the operation of the operation unit and thereby the second imaging position falls outside the permissible range, the processor is configured to stop the second driving unit.
7. A control apparatus for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, and an operation unit operable to adjust the second driving unit, the control apparatus comprising:
a memory storing instructions; and
a processor configured to execute the instructions to:
acquire information regarding the first imaging position and the second imaging position, and
cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit,
wherein in a case where the second driving unit moves the second imaging position in accordance with an operation of the operation unit and thereby the second imaging position falls outside a permissible range, and an operation direction of the operation unit is a direction that moves the second imaging position to inside of the permissible range, the processor is configured to move the second imaging position using the second driving unit.
8. An image pickup apparatus comprising:
a control apparatus for an image display system that includes a first optical system configured to form a first optical image of an object, a second optical system configured to form a second optical image of the object, a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image, a second driving unit configured to move the second imaging position, an operation unit operable to adjust the second driving unit; and
an image sensor configured to photoelectrically convert the first optical image and the second optical image; and
a display unit configured to display information regarding the first imaging position and the second imaging position,
wherein the control apparatus includes:
a memory storing instructions; and
a processor configured to execute the instructions to:
acquire the information, and
cause the display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit,
wherein in a case where the second driving unit moves the second imaging position in accordance with the operation of the operation unit and thereby the second imaging position falls outside a permissible range, the processor is configured to notify that the second imaging position falls outside the permissible range.
9. A lens apparatus comprising:
a control apparatus;
a first optical system configured to form a first optical image of an object;
a second optical system configured to form a second optical image of the object;
a first driving unit configured to move a first imaging position of the first optical image and a second imaging position of the second optical image;
a second driving unit configured to move the second imaging position; and
an operation unit operable to adjust the second driving unit,
wherein the control apparatus includes:
a memory storing instructions; and
a processor configured to execute the instructions to:
acquire information regarding the first imaging position and the second imaging position, and
cause a display unit to display the information in a case where the second driving unit moves the second imaging position in accordance with an operation on the operation unit,
wherein in a case where the second driving unit moves the second imaging position in accordance with the operation of the operation unit and thereby the second imaging position falls outside a permissible range, the processor is configured to notify that the second imaging position falls outside the permissible range.
US18/636,488 2023-05-17 2024-04-16 Control apparatus, image pickup apparatus, and lens apparatus Active 2044-07-11 US12489877B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2023-081749 2023-05-17
JP2023081749A JP2024165497A (en) 2023-05-17 2023-05-17 Control device, imaging device, and lens device

Publications (2)

Publication Number Publication Date
US20240388686A1 US20240388686A1 (en) 2024-11-21
US12489877B2 true US12489877B2 (en) 2025-12-02

Family

ID=93463841

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/636,488 Active 2044-07-11 US12489877B2 (en) 2023-05-17 2024-04-16 Control apparatus, image pickup apparatus, and lens apparatus

Country Status (2)

Country Link
US (1) US12489877B2 (en)
JP (1) JP2024165497A (en)

Citations (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6507359B1 (en) * 1993-09-20 2003-01-14 Canon Kabushiki Kaisha Image display system
US20080219654A1 (en) * 2007-03-09 2008-09-11 Border John N Camera using multiple lenses and image sensors to provide improved focusing capability
US20100134651A1 (en) * 2008-11-28 2010-06-03 Samsung Digital Imaging Co., Ltd. Photographing apparatus and method
US20110007133A1 (en) * 2009-07-09 2011-01-13 Imanishi Kazutaka Digital camera and method for controlling the same
US20110018970A1 (en) * 2009-07-21 2011-01-27 Fujifilm Corporation Compound-eye imaging apparatus
US20110025824A1 (en) * 2009-07-31 2011-02-03 Fujifilm Corporation Multiple eye photography method and apparatus, and program
US20110050944A1 (en) * 2009-08-28 2011-03-03 Satoshi Nakamura Audiovisual data recording device and method
US20110069151A1 (en) * 2009-09-24 2011-03-24 Fujifilm Corporation Multi-lens camera and control method
WO2011118078A1 (en) 2010-03-25 2011-09-29 富士フイルム株式会社 Three dimensional imaging device and method for automatically adjusting the focal point of a three dimensional imaging device
US20110279655A1 (en) * 2009-01-07 2011-11-17 Jianmin Tan Stereoscopic imaging apparatus and method
US20110316975A1 (en) * 2009-01-07 2011-12-29 Jianmin Tan Stereo imaging apparatus and method
US20120051732A1 (en) * 2010-08-31 2012-03-01 Panasonic Corporation Camera body, imaging device, method for controlling camera body, program, and storage medium storing program
US20120050578A1 (en) * 2010-08-31 2012-03-01 Panasonic Corporation Camera body, imaging device, method for controlling camera body, program, and storage medium storing program
US20120154547A1 (en) * 2010-07-23 2012-06-21 Hidekuni Aizawa Imaging device, control method thereof, and program
US20130070061A1 (en) * 2010-05-14 2013-03-21 Fujifilm Corporation Three-dimensional imaging device and autofocus adjustment method for three-dimensional imaging device
US20130088580A1 (en) * 2010-07-27 2013-04-11 Panasonic Corporation Camera body, interchangeable lens unit, image capturing device, method for controlling camera body, program, and recording medium on which program is recorded
US20130128003A1 (en) * 2010-08-19 2013-05-23 Yuki Kishida Stereoscopic image capturing device, and stereoscopic image capturing method
US20130162784A1 (en) * 2011-12-21 2013-06-27 Sony Corporation Imaging device, autofocus method and program of the same
US20140168383A1 (en) * 2011-09-01 2014-06-19 Panasonic Corporation Image pickup device and program
US20140210957A1 (en) * 2011-09-30 2014-07-31 Fujifilm Corporation Stereoscopic imaging apparatus and method of displaying in-focus state confirmation image
JP5670786B2 (en) 2011-03-16 2015-02-18 富士フイルム株式会社 Stereoscopic lens system for television camera, stereoscopic camera control device for television camera, and stereoscopic camera control method for television camera
US20160065833A1 (en) * 2014-09-01 2016-03-03 Lite-On Electronics (Guangzhou) Limited Image capturing device and auto-focusing method thereof
US20160065941A1 (en) * 2014-09-03 2016-03-03 Canon Kabushiki Kaisha Three-dimensional image capturing apparatus and storage medium storing three-dimensional image capturing program
US20170011525A1 (en) * 2015-07-07 2017-01-12 Samsung Electronics Co., Ltd. Image capturing apparatus and method of operating the same
US20170223275A1 (en) * 2016-02-03 2017-08-03 Canon Kabushiki Kaisha Display control apparatus and control method thereof
US9880672B2 (en) * 2010-07-26 2018-01-30 Olympus Corporation Display apparatus, display method, and computer-readable recording medium
US20180042465A1 (en) * 2015-05-12 2018-02-15 Olympus Corporation Stereoscopic endoscope apparatus
US20190068889A1 (en) * 2017-08-22 2019-02-28 Samsung Electronics Co., Ltd. Electronic device for storing depth information in connection with image depending on properties of depth information obtained using image and control method thereof
US10616568B1 (en) * 2019-01-03 2020-04-07 Acer Incorporated Video see-through head mounted display and control method thereof
US20200183121A1 (en) * 2016-05-20 2020-06-11 Makoto Takamiya Camera System
US20210034150A1 (en) * 2019-07-30 2021-02-04 Canon Kabushiki Kaisha Electronic device for receiving line of sight input, method of controlling electronic device, and non-transitory computer readable medium
JP2021051282A (en) 2019-09-19 2021-04-01 キヤノン株式会社 Lens device and imaging apparatus
USD924761S1 (en) * 2016-12-16 2021-07-13 Gentex Corporation Rearview assembly
US20220385828A1 (en) * 2021-05-31 2022-12-01 Canon Kabushiki Kaisha Electronic equipment, method for controlling the same, and recording medium
US20220385877A1 (en) * 2021-05-31 2022-12-01 Canon Kabushiki Kaisha Electronic equipment, control method therefor, and storage medium
US20220400208A1 (en) * 2021-06-11 2022-12-15 Canon Kabushiki Kaisha Apparatus and method executed by apparatus
US20230209177A1 (en) * 2021-12-23 2023-06-29 Canon Kabushiki Kaisha Imaging apparatus
US20230300453A1 (en) * 2022-02-14 2023-09-21 Canon Kabushiki Kaisha Electronic apparatus, control method of electronic apparatus, and non-transitory computer readable medium
US20240114241A1 (en) * 2022-09-30 2024-04-04 Canon Kabushiki Kaisha Lens apparatus and image pickup apparatus
US20240214541A1 (en) * 2022-12-23 2024-06-27 Canon Kabushiki Kaisha Image pickup apparatus, stereoscopic lens apparatus, and control method
US20250133288A1 (en) * 2023-10-24 2025-04-24 Toyota Jidosha Kabushiki Kaisha Information processing device

Patent Citations (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6507359B1 (en) * 1993-09-20 2003-01-14 Canon Kabushiki Kaisha Image display system
US20080219654A1 (en) * 2007-03-09 2008-09-11 Border John N Camera using multiple lenses and image sensors to provide improved focusing capability
US20100134651A1 (en) * 2008-11-28 2010-06-03 Samsung Digital Imaging Co., Ltd. Photographing apparatus and method
US20110279655A1 (en) * 2009-01-07 2011-11-17 Jianmin Tan Stereoscopic imaging apparatus and method
US20110316975A1 (en) * 2009-01-07 2011-12-29 Jianmin Tan Stereo imaging apparatus and method
US20110007133A1 (en) * 2009-07-09 2011-01-13 Imanishi Kazutaka Digital camera and method for controlling the same
US20110018970A1 (en) * 2009-07-21 2011-01-27 Fujifilm Corporation Compound-eye imaging apparatus
US20110025824A1 (en) * 2009-07-31 2011-02-03 Fujifilm Corporation Multiple eye photography method and apparatus, and program
US20110050944A1 (en) * 2009-08-28 2011-03-03 Satoshi Nakamura Audiovisual data recording device and method
US20110069151A1 (en) * 2009-09-24 2011-03-24 Fujifilm Corporation Multi-lens camera and control method
WO2011118078A1 (en) 2010-03-25 2011-09-29 富士フイルム株式会社 Three dimensional imaging device and method for automatically adjusting the focal point of a three dimensional imaging device
US20130002830A1 (en) 2010-03-25 2013-01-03 Yi Pan Stereoscopic imaging device and method for automatically adjusting the focal point of a stereoscopic imaging device
US20130070061A1 (en) * 2010-05-14 2013-03-21 Fujifilm Corporation Three-dimensional imaging device and autofocus adjustment method for three-dimensional imaging device
US20120154547A1 (en) * 2010-07-23 2012-06-21 Hidekuni Aizawa Imaging device, control method thereof, and program
US9880672B2 (en) * 2010-07-26 2018-01-30 Olympus Corporation Display apparatus, display method, and computer-readable recording medium
US20130088580A1 (en) * 2010-07-27 2013-04-11 Panasonic Corporation Camera body, interchangeable lens unit, image capturing device, method for controlling camera body, program, and recording medium on which program is recorded
US20130128003A1 (en) * 2010-08-19 2013-05-23 Yuki Kishida Stereoscopic image capturing device, and stereoscopic image capturing method
US20120050578A1 (en) * 2010-08-31 2012-03-01 Panasonic Corporation Camera body, imaging device, method for controlling camera body, program, and storage medium storing program
US20120051732A1 (en) * 2010-08-31 2012-03-01 Panasonic Corporation Camera body, imaging device, method for controlling camera body, program, and storage medium storing program
JP5670786B2 (en) 2011-03-16 2015-02-18 富士フイルム株式会社 Stereoscopic lens system for television camera, stereoscopic camera control device for television camera, and stereoscopic camera control method for television camera
US20140168383A1 (en) * 2011-09-01 2014-06-19 Panasonic Corporation Image pickup device and program
US20140210957A1 (en) * 2011-09-30 2014-07-31 Fujifilm Corporation Stereoscopic imaging apparatus and method of displaying in-focus state confirmation image
US20130162784A1 (en) * 2011-12-21 2013-06-27 Sony Corporation Imaging device, autofocus method and program of the same
US20160065833A1 (en) * 2014-09-01 2016-03-03 Lite-On Electronics (Guangzhou) Limited Image capturing device and auto-focusing method thereof
US20160065941A1 (en) * 2014-09-03 2016-03-03 Canon Kabushiki Kaisha Three-dimensional image capturing apparatus and storage medium storing three-dimensional image capturing program
US20180042465A1 (en) * 2015-05-12 2018-02-15 Olympus Corporation Stereoscopic endoscope apparatus
US20170011525A1 (en) * 2015-07-07 2017-01-12 Samsung Electronics Co., Ltd. Image capturing apparatus and method of operating the same
US20170223275A1 (en) * 2016-02-03 2017-08-03 Canon Kabushiki Kaisha Display control apparatus and control method thereof
US20200183121A1 (en) * 2016-05-20 2020-06-11 Makoto Takamiya Camera System
USD924761S1 (en) * 2016-12-16 2021-07-13 Gentex Corporation Rearview assembly
US20190068889A1 (en) * 2017-08-22 2019-02-28 Samsung Electronics Co., Ltd. Electronic device for storing depth information in connection with image depending on properties of depth information obtained using image and control method thereof
US10616568B1 (en) * 2019-01-03 2020-04-07 Acer Incorporated Video see-through head mounted display and control method thereof
US20210034150A1 (en) * 2019-07-30 2021-02-04 Canon Kabushiki Kaisha Electronic device for receiving line of sight input, method of controlling electronic device, and non-transitory computer readable medium
JP2021051282A (en) 2019-09-19 2021-04-01 キヤノン株式会社 Lens device and imaging apparatus
US20220385828A1 (en) * 2021-05-31 2022-12-01 Canon Kabushiki Kaisha Electronic equipment, method for controlling the same, and recording medium
US20220385877A1 (en) * 2021-05-31 2022-12-01 Canon Kabushiki Kaisha Electronic equipment, control method therefor, and storage medium
US11949977B2 (en) * 2021-05-31 2024-04-02 Canon Kabushiki Kaisha Electronic equipment, method for controlling the same, and recording medium
US12301777B2 (en) * 2021-05-31 2025-05-13 Canon Kabushiki Kaisha Electronic equipment, control method therefor, and storage medium
US20220400208A1 (en) * 2021-06-11 2022-12-15 Canon Kabushiki Kaisha Apparatus and method executed by apparatus
US20230209177A1 (en) * 2021-12-23 2023-06-29 Canon Kabushiki Kaisha Imaging apparatus
US20230300453A1 (en) * 2022-02-14 2023-09-21 Canon Kabushiki Kaisha Electronic apparatus, control method of electronic apparatus, and non-transitory computer readable medium
US20240114241A1 (en) * 2022-09-30 2024-04-04 Canon Kabushiki Kaisha Lens apparatus and image pickup apparatus
US20240214541A1 (en) * 2022-12-23 2024-06-27 Canon Kabushiki Kaisha Image pickup apparatus, stereoscopic lens apparatus, and control method
US20250133288A1 (en) * 2023-10-24 2025-04-24 Toyota Jidosha Kabushiki Kaisha Information processing device

Also Published As

Publication number Publication date
US20240388686A1 (en) 2024-11-21
JP2024165497A (en) 2024-11-28

Similar Documents

Publication Publication Date Title
US9769384B2 (en) Imaging apparatus capable of detecting position of movable image pickup device at first resolving power and at second resolving power higher than first resolving power and, at which second resolving power, deviation amount is less than or equal to pixel shift amount
US10498965B2 (en) Image stabilization apparatus, method of controlling the same, and storage medium
JP2012063396A (en) Focus adjustment device
KR20190141080A (en) Image processing apparatus, image processing method, image capturing apparatus, and lens apparatus
WO2012035877A1 (en) Imaging device
JP5896763B2 (en) Optical instrument and method for autofocusing
US20250355223A1 (en) Control apparatus, lens apparatus, image pickup apparatus, camera system, and control method
US9781330B2 (en) Focus detection apparatus and control method for focus detection apparatus
JP2011239131A (en) Imaging apparatus
US20260019705A1 (en) Lens apparatus and image pickup apparatus
US9008499B2 (en) Optical viewfinder
US20250350847A1 (en) Interchangeable lens and image pickup apparatus
US20250142212A1 (en) Image pickup apparatus and its control method
US12489877B2 (en) Control apparatus, image pickup apparatus, and lens apparatus
JP2013061560A (en) Distance measuring device, and imaging device
JP6168827B2 (en) Image stabilization apparatus and optical apparatus
JP2013231870A (en) Imaging apparatus
JP2016142895A (en) Focusing control device, control method of the same, and control program thereof, as well as imaging device
US20240361569A1 (en) Lens apparatus and image pickup apparatus
US20220353428A1 (en) Image pickup apparatus, lens apparatus, control method and apparatus, and storage medium
US20250076738A1 (en) Control apparatus, lens apparatus, image pickup apparatus, control method, and storage medium
US20250155780A1 (en) Accessory apparatus
US20230280565A1 (en) Control apparatus, lens apparatus, optical apparatus, and storage medium
US20230194830A1 (en) Lens barrel and control apparatus
US20250071420A1 (en) Accessory apparatus, image pickup apparatus, control method, and storage medium

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAHASHI, GAKU;ISHIKAWA, TOMONORI;KARASAWA, KOHEI;REEL/FRAME:067201/0068

Effective date: 20240404

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: ALLOWED -- NOTICE OF ALLOWANCE NOT YET MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE