WO2018097495A1 - Dispositif d'imagerie omnidirectionnelle et dispositif électronique le comportant - Google Patents

Dispositif d'imagerie omnidirectionnelle et dispositif électronique le comportant Download PDF

Info

Publication number
WO2018097495A1
WO2018097495A1 PCT/KR2017/012021 KR2017012021W WO2018097495A1 WO 2018097495 A1 WO2018097495 A1 WO 2018097495A1 KR 2017012021 W KR2017012021 W KR 2017012021W WO 2018097495 A1 WO2018097495 A1 WO 2018097495A1
Authority
WO
WIPO (PCT)
Prior art keywords
optical system
group
group optical
lens
image
Prior art date
Application number
PCT/KR2017/012021
Other languages
English (en)
Korean (ko)
Inventor
석문기
진성기
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of WO2018097495A1 publication Critical patent/WO2018097495A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/18—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/18—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors
    • G02B7/1805—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors for prisms
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/18—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors
    • G02B7/182—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors for mirrors
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/02—Bodies
    • G03B17/17—Bodies with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/02—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with scanning movement of lens or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/58—Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • Various embodiments of the present disclosure relate to an omnidirectional image capturing apparatus and an electronic device including the same.
  • the omnidirectional imaging apparatus refers to a device that captures the scenery, which the observer observes 360 degrees in place, into a single image.
  • the omnidirectional imaging apparatus uses at least two image sensors to acquire a subject by photographing a subject with a lens having a certain angle of view (eg, a fisheye lens having a field of view of 180 degrees) in each viewing direction, and seamlessly acquiring the acquired image.
  • One panorama image can be generated using a technique for compositing (eg stitching).
  • the omnidirectional imaging apparatus has been used not only in traditional fields such as architecture, natural scenery, and celestial bodies, but also in security and surveillance systems using CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor), real estate or Researches and developments are being conducted to apply to virtual tours of hotels, tourist attractions, etc., or mobile robots or drones.
  • CCD charge-coupled device
  • CMOS complementary metal-oxide-semiconductor
  • the omnidirectional image photographing apparatus may include at least two lens groups, and may acquire an image of a subject refracted through the lens group by forming an image on each corresponding image sensor.
  • the obtained image may be synthesized into one image through the image processor of the device, and the synthesized image may be output through the display device.
  • the conventional omnidirectional image processing apparatus has a plurality of image sensors corresponding to a plurality of lens groups, so that the cost is increased, and the problem of counteracting the slimming of the device due to the consideration of the layout space according to the arrangement of the plurality of image sensors This can happen.
  • an omnidirectional image capturing apparatus and an electronic device including the same may be provided.
  • an omnidirectional image photographing apparatus capable of obtaining an efficient omnidirectional image by constructing a structure capable of acquiring a plurality of images collected by a plurality of lens groups with one image sensor and an electronic device including the same Can be provided.
  • an omnidirectional image capturing apparatus comprising: a first lens group each having an angle of view of at least 180, a second lens group disposed at a position opposite to the first lens group and having an angle of view of at least 180 degrees; And an image sensor for simultaneously capturing light incident from the first lens group and light incident from the second lens group, wherein the first lens group includes at least one unit lens sequentially disposed therein.
  • the second group optical system disposed on a line perpendicular to the arrangement line of the first group optical system, and the first group optical system and the second group optical system And a first reflection member for totally reflecting the reflected light to a second group optical system
  • the second lens group includes a third group optical system in which at least one unit lens is sequentially disposed and receives external light;
  • the fourth group optical system disposed on a line perpendicular to the arrangement line of the third group optical system and the light introduced from the third group optical system interposed between the third group optical system and the fourth group optical system are transferred to the fourth group optical system. It is possible to provide an omnidirectional image capturing apparatus comprising a second reflecting member for total reflection.
  • an accessory device detachably mounted to an electronic device including a camera device includes: a clip unit and a clip unit fixing the accessory device to at least a partial region including the camera of the electronic device; And a barrel portion having an optical system disposed in the internal space to collect surrounding omnidirectional light, wherein the optical system is disposed at a position opposite to the first lens group and the first lens group, each having an angle of view of at least 180; And a second lens group having an angle of view of at least 180 degrees, wherein the first lens group includes at least one unit lens and a first group optical system configured to sequentially receive external light, and a first group optical system.
  • At least one first reflecting member for totally reflecting the light from the first group optical system to the camera device through a second group optical system
  • the second lens group includes at least one unit lens sequentially And a third group optical system for receiving external light, and a fourth group optical system arranged on a line perpendicular to an arrangement line of the third group optical system, and on a light transmission path of the third group optical system and the fourth group optical system.
  • an at least one second reflecting member interposed therebetween and totally reflects the light introduced from the third group optical system to the camera device through the fourth group optical system.
  • a cost can be reduced by providing a structure in which a plurality of images collected by a plurality of lens groups, respectively, can be acquired by a single image sensor, and an installation space can be efficiently applied to contribute to slimming of the device. have.
  • FIG. 1A is a perspective view of an omnidirectional image photographing apparatus according to various embodiments of the present disclosure.
  • FIG. 1B is a side view of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • FIG. 2 is a block diagram illustrating a configuration of an optical system of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • FIG. 3 is a block diagram illustrating an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • FIGS. 4A and 4B are diagrams illustrating a state in which an accessory device to which an optical system for omnidirectional image capturing is applied to an electronic device according to various embodiments of the present disclosure.
  • FIGS. 4A and 4B are block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.
  • FIGS. 4A and 4B are block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.
  • FIG. 7A and 7B are views illustrating a state in which an accessory device to which an optical system for capturing omnidirectional images is applied to an electronic device according to various embodiments of the present disclosure.
  • FIG. 7C is a diagram illustrating a state in which an image received from an accessory device to which an optical system for capturing omnidirectional images is applied, is displayed on a display of an electronic device according to various embodiments of the present disclosure.
  • any (eg first) component is said to be “connected” or “connected” to another (eg second) component, the other component is said other
  • the component may be directly connected or connected through another component (eg, a third component).
  • the expression “device configured to” may mean that the device “can” together with other devices or components.
  • processor configured (or configured to) perform A, B, and C may be implemented by executing a dedicated processor (eg, an embedded processor) to perform its operation, or one or more software programs stored in a memory device. It may mean a general purpose processor (eg, a CPU or an application processor) capable of performing the corresponding operations.
  • An electronic device may be, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, or a wearable device. Wearable devices may be accessory (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs), textiles or clothing integrated (e.g.
  • HMDs head-mounted-devices
  • an electronic device may comprise, for example, a television, a digital video disk (DVD) player, Audio, Refrigerator, Air Conditioner, Cleaner, Oven, Microwave Oven, Washing Machine, Air Purifier, Set Top Box, Home Automation Control Panel, Security Control Panel, Media Box (e.g. Samsung HomeSync TM , Apple TV TM , or Google TV TM ) , A game console (eg, Xbox TM , PlayStation TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.
  • DVD digital video disk
  • the electronic device may include a variety of medical devices (e.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), cameras or ultrasounds), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), automotive infotainment devices, ship electronics (E.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), cameras or ultrasounds), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), automotive infotainment devices, ship electronics (E.g.
  • various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters
  • MRA magnetic resonance angiography
  • an electronic device may be a part of a furniture, building / structure or automobile, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, Gas, or a radio wave measuring instrument).
  • the electronic device may be flexible or a combination of two or more of the aforementioned various devices.
  • Electronic devices according to embodiments of the present disclosure are not limited to the above-described devices.
  • the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.
  • an accessory device including an exclusive device for capturing omnidirectional images or an optical system for capturing omnidirectional images is described, but the optical system is a general portable electronic device (eg, a smart phone) including an image sensor. It may be arranged directly inside the.
  • a general portable electronic device eg, a smart phone
  • 1A is a perspective view of an omnidirectional image photographing apparatus according to various embodiments of the present disclosure.
  • 1B is a side view of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • the omnidirectional image capturing apparatus 100 may include a pair of lenses 111 and 121.
  • the first lens 111 may be disposed on the first surface 110 (eg, the front surface) of the omnidirectional image photographing apparatus 100.
  • the second lens 121 may be disposed on the second surface 120 (eg, the rear surface) of the omnidirectional image photographing apparatus 100 facing the first surface 110.
  • the first lens 111 and the second lens 121 may include a wide-angle lens having a rotationally symmetrical shape.
  • the wide-angle lens may include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method.
  • the present invention is not limited thereto, and the first lens 111 and the second lens 121 may include all kinds of rotationally symmetrical wide-angle lenses such as a reflective refractive fisheye lens.
  • the omnidirectional image capturing apparatus 100 may include a display 112 on the first surface 110. According to an embodiment, the omnidirectional image capturing apparatus 100 obtains an image incident through the first lens 111 and the second lens 121 through one image sensor and converts the obtained images into one image. The display may be controlled to be synthesized and output through the display 112. According to an embodiment, the omnidirectional image capturing apparatus 100 acquires an image incident through the first lens 111 and the second lens 121 through one image sensor and captures the acquired images. The display 112 may control the output to the preview image. According to an embodiment, the preview image output to the display 112 includes an image obtained from each of the first lens 111 and the second lens 121, or the first lens 111 and the second lens 121.
  • the display 112 may include a touch screen device including a touch sensor.
  • the display 112 may include a pressure-sensitive touch screen device further including a force sensor responsive to touch pressure.
  • the omnidirectional image capturing apparatus 100 may include a communication circuit. According to an embodiment, the omnidirectional image capturing apparatus 100 may be functionally connected to an external electronic device through a communication circuit. According to an embodiment, the omnidirectional image capturing apparatus 100 is functionally connected to an external electronic device through short-range communication (eg, Bluetooth, WiFi, Zigbee, etc.), and then transmits the above-described preview image or composite image to the external electronic device. It may be. According to an embodiment, the external electronic device may output image data received from the omnidirectional image capturing apparatus 100 to the display.
  • short-range communication eg, Bluetooth, WiFi, Zigbee, etc.
  • the external electronic device may control a corresponding function of the omnidirectional image capturing apparatus 100 (for example, initiation of an image synthesizing function, output of a preview image of a synthesized image, or capturing a preview image). .
  • the omnidirectional image capturing apparatus 100 may include at least one sensor module 115 on the first surface 110.
  • the sensor module 115 may include at least one of a fingerprint sensor, an illumination sensor (for example, an optical sensor), a proximity sensor, an infrared sensor, an ultrasonic sensor, and an iris recognition sensor.
  • the present invention is not limited thereto, and the sensor module 115 may be disposed on the second surface 120 of the omnidirectional image photographing apparatus 100 or may be disposed together on the first surface 110 and the second surface 120.
  • the omnidirectional image capturing apparatus 100 may include at least one key button 113 and 114.
  • the key button may include a front button 113 disposed on the first surface 110 and a side key button 114 disposed on the side surface thereof.
  • the omnidirectional image capturing apparatus 100 may include at least one touch pad as a data input means instead of a physical key button.
  • the first lens 111 may accommodate the foreground having an angle of view of up to 180 degrees in the -X direction of the omnidirectional photographing apparatus 100
  • the second lens 121 is the omnidirectional photographing apparatus 100. It can accommodate a foreground having an angle of view of up to 180 degrees in the X direction of.
  • the omnidirectional image capturing apparatus 100 may control to process the images collected by the first lens 111 and the second lens 121 together through one image sensor.
  • the omnidirectional image capturing apparatus 100 may include an optical system that may acquire an image collected through the first lens 111 and the second lens 121 through one image sensor.
  • FIG. 2 is a block diagram illustrating a configuration of an optical system of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • the optical system 200 illustrated in FIG. 2 may be similar to the optical system disposed inside the omnidirectional image photographing apparatus 100 illustrated in FIGS. 1A and 1B, or may include another embodiment of the optical system.
  • the optical system 200 provided to the omnidirectional image capturing apparatus may include a first lens group 210 having an angle of view of at least 180 and a first lens group 210.
  • the first lens group 210 may have an angle of view of up to 180 degrees and collect the foreground of the illustrated -X axis direction.
  • the first lens group 210 includes at least one unit lens sequentially disposed, and includes a first group optical system 211 that receives external light and an arrangement line of the first group optical system 211.
  • the first reflecting member 213 may be totally reflected by the optical system 212.
  • the above-described second lens group 220 may have an angle of view of up to 180 degrees and collect the foreground in the X-axis direction shown.
  • the second lens group 220 includes at least one unit lens sequentially disposed, and includes a third group optical system 221 for receiving external light and an arrangement line of the third group optical system 221. The light from the third group optical system 221 interposed between the fourth group optical system 222 and the third group optical system 221 and the fourth group optical system 222 disposed on a line perpendicular to the fourth group optical system 222. And a second reflecting member 223 which totally reflects to 222.
  • the first reflection member 213 and the second reflection member 223 may include a mirror member or a prism member.
  • the light introduced from the first group optical system path 211 of the first lens group 210 is totally reflected in the -Z axis direction through the first reflecting member 213, the second group optical system 212 It may be transmitted to the image sensor 230 through.
  • the light introduced from the third group optical system 221 of the second lens group 220 is totally reflected in the -Z axis direction through the second reflecting member 223 to the fourth group optical system 222. It may be delivered to the image sensor 230 through.
  • the first lens group 210 and the second lens group 220 may have the same configuration.
  • the arrangement structure of at least one unit lens of the first group optical system 211 may be the same as the arrangement structure of at least one unit lens of the third group optical system 221.
  • the arrangement structure of at least one unit lens of the second group optical system 212 may be the same as the arrangement structure of at least one unit lens of the fourth group optical system 222.
  • the present invention is not limited thereto, and the first lens group 210 and the second lens group 220 may have different arrangement structures.
  • the optical system 200 may include a blocking member 240 (eg, a partition wall) disposed between the second group optical system 212 and the fourth group optical system 222.
  • the blocking member 240 may minimize interference between the second group optical system 212 and the fourth group optical system 222 due to diffuse reflection of external light and internal reflection of the two optical axes. Can be arranged.
  • the blocking member 240 may block mutual interference due to an image obtained from the first lens group 210 and an image obtained from the second lens group 220.
  • the omnidirectional image capturing apparatus receives light introduced from the first lens group 210 and the second lens group 220 through one image sensor 230 by the above-described configuration of the optical system 200. It can be acquired and processed, which contributes to the slimmer device through cost reduction and efficient use of the layout space.
  • FIG. 3 is a block diagram illustrating an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.
  • the omnidirectional image capturing apparatus of FIG. 3 may be similar to the omnidirectional image capturing apparatus 100 of FIGS. 1A and 1B or may include another embodiment of the omnidirectional image capturing apparatus.
  • the omnidirectional image capturing apparatus may include an image acquisition unit 310, an image processing unit 320, and an image display unit 330. .
  • the image acquisition unit 310 may include, for example, an optical system including the first lens group 210, the second lens group 220, and the image sensor 230 of FIG. 2. .
  • the image acquisition unit 310 may acquire a still image or a moving image through an optical system and an image sensor (for example, a photoelectric device such as a CCD or a CMOS).
  • the image collected through the first lens group (eg, the first lens group 210 of FIG. 2) and the second lens group (eg, the second lens group 220 of FIG. 2) is an image. It may be formed on the sensor surface of the sensor (for example, the image sensor 230 of FIG. 2), and the image processed by the image processor 320 after being converted into an electrical signal by the image sensor is displayed on the image display unit 330. Can be.
  • the image processor 320 may correct an image acquired by the image acquirer 310.
  • the image processing may be software image processing by a computer, and may include hardware image processing by a reconfigurable semiconductor (FPGA) or an ARM core.
  • FPGA reconfigurable semiconductor
  • the image display unit 330 may include a first lens group (eg, the first lens group 210 of FIG. 2) and a second lens group (eg, the second lens group 220 of FIG. 2).
  • the incident image may be output through the image processing unit 320.
  • the image may be a preview image or may include an image stored through image processing and captured.
  • FIGS. 4A and 4B are diagrams illustrating a state in which an accessory device to which an optical system for omnidirectional image capturing is applied to an electronic device according to various embodiments of the present disclosure.
  • the optical system included in the accessory device 410 of FIGS. 4A and 4B may be similar to the optical system 200 of FIG. 2 or may include other embodiments of the optical system.
  • the accessory device 410 may include a clip portion 411 and a barrel portion 412 extending from the clip portion 411.
  • the clip unit 411 may include a structure for fixing the accessory device 410 to at least a portion of the electronic device 420.
  • the barrel 412 may include the above-described optical system (eg, 200 of FIG. 2).
  • the barrel 412 may structurally include an optical system 200 including, for example, the first lens group 210 and the second lens group 220 of FIG. 2. have.
  • the barrel 412 may include only an optical system, and an image provided from the barrel may be provided to the camera device 422 of the electronic device 420.
  • the accessory device 410 may include a pair of lens groups (eg, 210 and 220 of FIG. 2).
  • one lens group eg, 210 of FIG. 2
  • the accessory device 410 when the accessory device 410 is fixed to the electronic device 420 by the clip 411, one lens group (eg, 210 of FIG. 2) may display the display of the electronic device 420. It is arranged to acquire an image related to the foreground of the front direction (X-axis direction) of the electronic device 420 that is the same as the arrangement direction of the 421, and the other lens group (eg, 220 of FIG. 2) is the electronic device 420.
  • the electronic device 420 may be arranged to acquire an image related to the foreground of the rear direction (-X axis direction) of the same electronic device 420 as that of the camera device 422.
  • the electronic device 420 may include an image sensor for controlling the camera device 422 to process an image provided from the accessory device 410, an image processor, and a display 421.
  • the electronic device 420 acquires an image incident through the optical system disposed on the barrel 412 of the accessory device 410 through the image sensor of the camera device 422, and acquires the obtained images. By synthesizing into an image of the can be controlled to output through the display 421.
  • the electronic device 420 acquires an image incident through the optical system provided to the barrel 412 of the accessory device 410 through the image sensor of the camera device 422, and captures the acquired images. It may be controlled to output a preview image through the display 421 before capturing.
  • the preview image output to the display 421 includes at least two images provided by the barrel portion 412 of the accessory device 410, or is provided by the barrel portion 412 of the accessory device 410. At least two images may include one image synthesized.
  • the accessory device 410 may include a sensing member.
  • the electronic device 420 may include a sensing member capable of sensing the sensing member to recognize the mounted accessory device 410.
  • the sensing member may include a hall sensor for sensing the magnetic force of the magnet used as the sensing member.
  • the sensing member may include a proximity sensor for detecting proximity of accessory device 410.
  • the electronic device 420 detects the mounting of the accessory device 410 by the sensing member, acquires an image through the accessory device 410, and then synthesizes at least two acquired images (eg, It is possible to execute a dedicated program (eg, an application program for panorama photography) that can be stitched.
  • a dedicated program eg, an application program for panorama photography
  • the image photographed by the accessory device 410 is a 3D image, and is added to metadata, and thus, another electronic device (eg, a 360 editor or VR device, etc.) may be displayed to be used immediately.
  • the electronic device 420 may process the image information received from the accessory device 410 according to the sensor information of the electronic device 420 to process and play back the image without shaking.
  • the electronic device 420 may detect a moving direction of the user and generate an image around the corresponding direction.
  • the accessory device 410 may further include an image processor (or a controller) for self-processing the received image and a communication circuit for functionally (wirelessly) connecting the electronic device 420.
  • the electronic device 420 may detect mounting of the accessory device 410 by a sensing member, and may be functionally connected to the accessory device 410 through a communication circuit.
  • the accessory device 410 may display the composite image processed by the barrel 412 and the image processing unit therein, or the preview image (eg, a still image or a moving image) before synthesis through the communication circuit. You can also provide.
  • FIGS. 4A and 4B are block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.
  • the accessory device 500 of FIG. 5 may be similar to the accessory device 410 of FIGS. 4A and 4B, or may include other embodiments of the accessory device.
  • the configuration of the lens group disposed in the space 5101 in the barrel 510 of the accessory device 500 is excluded, but a lens group similar or identical to the optical system 200 of FIG. 2 may be disposed. It can be obvious.
  • the barrel 510 of the accessory device 500 may be fixed to include an area in which the camera device of the electronic device 520 is disposed, and is positioned at a position corresponding to the image sensor 522 of the camera device. Can be deployed.
  • the first reflecting member 511 in the internal space 5101 of the barrel portion 510, is disposed to have a predetermined inclination in the X axis direction and the second is disposed to have a predetermined inclination in the -X axis direction.
  • the first, second, and third reflective members 511, 513, and 512 may include a mirror member or a prism member disposed according to the circumstances of the internal space 5101 of the barrel portion 510 of the accessory device 500.
  • the light flowing in the X-axis direction of the barrel portion 510 of the accessory device 500 is totally vertically reflected by the first reflecting member 511, and again by the third reflecting member 512.
  • the total reflection in the direction of the device 520 may be provided to the image sensor 522.
  • the light introduced in the -X axis direction of the barrel portion 510 of the accessory device 500 is totally reflected vertically by the second reflecting member 513 and again by the third reflecting member 512. Total reflection in the direction of the electronic device 520 may be provided to the image sensor 522.
  • the images provided in the X-axis and -X-axis directions of the barrel 510 of the accessory device 500 are respectively displayed by the first, second, and third reflective members 511, 513, and 512 of the camera of the electronic device 520.
  • the image sensor 522 provided in the apparatus may be provided and processed.
  • FIGS. 4A and 4B are block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.
  • the accessory device 600 of FIG. 6 may be similar to the accessory device 410 of FIGS. 4A and 4B, or may include other embodiments of the accessory device.
  • the configuration of the lens group disposed in the barrel 610 of the accessory device 600 is excluded, but it is apparent that a lens group similar or identical to the optical system 200 of FIG. 2 may be disposed.
  • the barrel 610 of the accessory device 600 may be fixed to include an area in which the camera device of the electronic device 620 is disposed, and is positioned at a position corresponding to the image sensor 622 of the camera device. Can be deployed.
  • a second reflecting member 612 for total reflection in the 622 direction (in the -X axis direction).
  • the barrel 610 is directed toward the image sensor 622 in the direction of the image sensor 622 and the light reflected from the third reflection member 613 and the third reflection member 613 disposed to have a predetermined inclination toward the -X axis direction.
  • a fourth reflecting member 614 for total reflection (in the -X axis direction).
  • the first, second, third, and fourth reflective members 611, 612, 613, 614 may include a mirror member or a prism member disposed according to the circumstances of the inner space 6101 of the barrel portion 610 of the accessory device 600. Can be.
  • the light flowing in the X-axis direction of the barrel portion 610 of the accessory device 600 is totally reflected vertically by the first reflecting member 611, and again by the second reflecting member 612. Total reflection in the direction of the device 620 may be provided to the image sensor 622.
  • the light introduced in the -X axis direction of the barrel portion 610 of the accessory device 600 is totally vertically reflected by the third reflecting member 613, and again by the fourth reflecting member 614. Total reflection in the direction of the electronic device 620 may be provided to the image sensor 622.
  • the images provided in the X-axis and -X-axis directions of the barrel 610 of the accessory device 600 are respectively displayed by the first, second, third, and fourth reflective members 611, 612, 613, and 614.
  • One image sensor 622 provided in the camera device of 620 may be provided and processed.
  • FIG. 7A and 7B are views illustrating a state in which an accessory device to which an optical system for capturing omnidirectional images is applied to an electronic device according to various embodiments of the present disclosure.
  • the optical system included in the accessory device 710 of FIGS. 7A and 7B may be similar to the optical system 200 of FIG. 2, or may include other embodiments of the optical system.
  • the accessory device 710 may include a first lens 7121 and a second lens 7122 extending from the clip portion 711 and the clip portion 711 and disposed in opposite directions to each other.
  • a barrel portion 712 may be included.
  • the clip unit 711 may include a structure for fixing the accessory device 710 to at least a portion of the electronic device 720.
  • the barrel 712 may include the above-described optical system (eg, 200 of FIG. 2).
  • the barrel 712 may include, for example, an optical system 200 including the first lens group 710 and the second lens group 720 of FIG. 2.
  • the barrel 712 may include only an optical system, and an image provided from the barrel may be provided to the camera device 722 of the electronic device 720.
  • the accessory device 710 may include a pair of lens groups (eg, 210 and 220 of FIG. 2).
  • one lens group including the first lens eg, 210 of FIG. 2
  • the other lens group including the second lens is disposed to acquire an image related to the foreground in the left direction (-Y axis direction).
  • it may be arranged to acquire an image related to the foreground in the right direction (Y axis direction).
  • the electronic device 720 may include an image sensor for controlling the camera device 722 to process an image provided from the accessory device 710, an image processor, and a display 721.
  • the electronic device 720 acquires an image incident through the optical system disposed on the barrel 712 of the accessory device 710 through the image sensor of the camera device 722, and acquires the obtained images. By synthesizing into an image of the can be controlled to output through the display 721.
  • the electronic device 720 acquires an image incident through the optical system provided to the barrel 712 of the accessory device 710 through the image sensor of the camera device 722, and captures the acquired images. It may be controlled to output a preview image through the display 721 before capturing.
  • the preview image output to the display 721 may include at least two images provided by the barrel portion 712 of the accessory device 710 or may be provided by the barrel portion 712 of the accessory device 710. At least two images may comprise one combined image.
  • the accessory device 710 may include a sensing member.
  • the electronic device 720 may include a sensing member capable of sensing the sensing member to recognize the mounted accessory device 710.
  • the sensing member may include a hall sensor for sensing the magnetic force of the magnet used as the sensing member.
  • the sensing member may include a proximity sensor for detecting proximity of accessory device 710.
  • the electronic device 720 detects mounting of the accessory device 710 by the sensing member, acquires an image through the accessory device 710, and then synthesizes at least two acquired images (eg, It is possible to execute a dedicated program (eg, an application program for panorama photography) that can be stitched.
  • a dedicated program eg, an application program for panorama photography
  • the image photographed by the accessory device 710 may be a 3D image, and may be added to the metadata, and thus, another electronic device (eg, 360 editor or VR device, etc.) may be displayed to be used immediately.
  • the electronic device 720 may process the image information received from the accessory device 710 according to the sensor information of the electronic device 720 to process and play back the image without shaking.
  • the electronic device 720 may detect a moving direction of the user and generate an image around the corresponding direction.
  • the accessory device 710 may further include an image processing unit (or control unit) for self-processing the received image and a communication circuit for functionally (wirelessly) connecting the electronic device 720.
  • the electronic device 720 may detect mounting of the accessory device 710 by the sensing member, and may be functionally connected to the accessory device 710 through a communication circuit.
  • the accessory device 710 may display the composite image processed by the barrel 712 and the image processing unit therein, or a preview image (eg, a still image or a moving image) before synthesis through the communication circuit. You can also provide.
  • FIG. 7C is a diagram illustrating a state in which an image received from an accessory device to which an optical system for capturing omnidirectional images is applied, is displayed on a display of an electronic device according to various embodiments of the present disclosure.
  • the electronic device 720 may display the front image 7141 and the rear image 7212 through the first lens 7121 and the second lens 7122 of the accessory device. Can be obtained. According to an embodiment of the present disclosure, the obtained two images may be passed through and displayed as two spherical images on the display 721 of the electronic device 720.
  • the execution program of the electronic device 720 may recognize the 360-degree omnidirectional image pattern (scene recognition), and the electronic device 720 recognizes the 360-camera image and executes a 360-degree omnidirectional screen conversion program to perform a composite conversion operation. You can also perform stitching automatically.
  • an omnidirectional image capturing apparatus comprising: a first lens group each having an angle of view of at least 180, a second lens group disposed at a position opposite to the first lens group and having an angle of view of at least 180 degrees; And an image sensor for simultaneously capturing light incident from the first lens group and light incident from the second lens group, wherein the first lens group includes at least one unit lens sequentially disposed therein.
  • the second group optical system disposed on a line perpendicular to the arrangement line of the first group optical system, and the first group optical system and the second group optical system And a first reflection member for totally reflecting the reflected light to a second group optical system
  • the second lens group includes a third group optical system in which at least one unit lens is sequentially disposed and receives external light;
  • the fourth group optical system disposed on a line perpendicular to the arrangement line of the third group optical system and the light introduced from the third group optical system interposed between the third group optical system and the fourth group optical system are transferred to the fourth group optical system. It is possible to provide an omnidirectional image capturing apparatus comprising a second reflecting member for total reflection.
  • the arrangement structure of at least one unit lens of the first group optical system may be the same as the arrangement structure of at least one unit lens of the third group optical system.
  • the arrangement structure of at least one unit lens of the second group optical system may be the same as the arrangement structure of at least one unit lens of the fourth group optical system.
  • the first reflecting member and the second reflecting member may include a mirror member or a prism member.
  • the first lens group and the second lens group may include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method.
  • the omnidirectional image photographing apparatus may include a display for outputting an image collected from the first lens group and the second lens group and processed by an image sensor.
  • the omnidirectional image capturing apparatus may output an image collected from the first lens group and the second lens group and processed by an image sensor as a preview image including a still image or a moving image.
  • an accessory device detachably mounted to an electronic device including a camera device includes: a clip unit and a clip unit fixing the accessory device to at least a partial region including the camera of the electronic device; And a barrel portion having an optical system disposed in the internal space to collect surrounding omnidirectional light, wherein the optical system is disposed at a position opposite to the first lens group and the first lens group, each having an angle of view of at least 180; And a second lens group having an angle of view of at least 180 degrees, wherein the first lens group includes at least one unit lens and a first group optical system configured to sequentially receive external light, and a first group optical system.
  • At least one first reflecting member for totally reflecting the light from the first group optical system to the camera device through a second group optical system
  • the second lens group includes at least one unit lens sequentially And a third group optical system for receiving external light, and a fourth group optical system arranged on a line perpendicular to an arrangement line of the third group optical system, and on a light transmission path of the third group optical system and the fourth group optical system.
  • an at least one second reflecting member interposed therebetween and totally reflects the light introduced from the third group optical system to the camera device through the fourth group optical system.
  • the arrangement structure of at least one unit lens of the first group optical system may be the same as the arrangement structure of at least one unit lens of the third group optical system.
  • the arrangement structure of at least one unit lens of the second group optical system may be the same as the arrangement structure of at least one unit lens of the fourth group optical system.
  • the at least one first reflecting member and the at least one second reflecting member may include a mirror member or a prism member.
  • the first lens group and the second lens group may include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method.
  • the at least one first reflecting member may include a first vertical reflecting member and the first vertical reflecting member for totally reflecting the light from the first group optical system vertically in the direction of the second group optical system.
  • the light reflected by the light may include a first horizontal reflection member for total reflection in the direction of the camera device through the second group optical system.
  • the at least one second reflecting member may include a second vertical reflecting member and the second vertical reflecting member for totally reflecting light introduced from the third group optical system in a direction perpendicular to the fourth group optical system.
  • the light reflected by the light passing through the second group of the optical system may include a second horizontal reflection member for total reflection in the direction of the camera device.
  • the first horizontal reflective member and the second horizontal reflective member may be integrally formed.
  • the accessory device may include an image sensor for generating an image by processing light introduced through the first lens group and the second lens group, and a communication circuit for functionally connecting with the electronic device.
  • the image processed by the image sensor may be transmitted to the electronic device through the communication circuit.
  • the electronic device may include a display, and an image provided from the accessory device may be output through the display.
  • the first lens group faces the front surface of the electronic device
  • the second lens group faces the rear surface facing the front surface of the electronic device. Can be deployed.
  • the first lens group faces one side perpendicular to the front surface of the electronic device
  • the second lens group may correspond to one side surface of the electronic device. It may be arranged to face the other side opposite.
  • the accessory device may include at least one sensing member arranged to sense mounting by a sensing member included in the electronic device.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Cameras In General (AREA)

Abstract

Selon divers modes de réalisation, l'invention concerne un dispositif d'imagerie omnidirectionnelle comprenant : un premier groupe de lentilles, ayant chacun un angle de vue d'au moins 180°; un second groupe de lentilles, ayant chacun un angle de vue d'au moins 180°, le second groupe de lentilles étant positionné pour faire face au premier groupe de lentilles; et un capteur d'image pour imager simultanément une lumière incidente à partir du premier groupe de lentilles et la lumière incidente à partir du second groupe de lentilles. Le premier groupe de lentilles comprend un premier groupe de systèmes optiques ayant au moins une lentille unitaire agencée successivement de manière à recevoir une lumière externe; un second groupe de systèmes optiques agencés sur une ligne perpendiculaire à une ligne sur laquelle le premier groupe de systèmes optiques est agencé; et un premier élément réfléchissant interposé entre le premier groupe de systèmes optiques et le second groupe de systèmes optiques de façon à réfléchir totalement la lumière introduite depuis le premier groupe de systèmes optiques vers le second groupe de systèmes optiques. Le deuxième groupe de lentilles comprend un troisième groupe de systèmes optiques ayant au moins une lentille unitaire agencée successivement de manière à recevoir une lumière externe; un quatrième groupe de systèmes optiques agencés sur une ligne perpendiculaire à une ligne sur laquelle le troisième groupe de systèmes optiques est agencé; et un second élément réfléchissant interposé entre le troisième groupe de systèmes optiques et le quatrième groupe de systèmes optiques de façon à réfléchir totalement la lumière introduite depuis le troisième groupe de systèmes optiques vers le quatrième groupe de systèmes optiques. Divers autres modes de réalisation sont également possibles.
PCT/KR2017/012021 2016-11-22 2017-10-27 Dispositif d'imagerie omnidirectionnelle et dispositif électronique le comportant WO2018097495A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2016-0155491 2016-11-22
KR1020160155491A KR102613487B1 (ko) 2016-11-22 2016-11-22 전방위 영상 촬영 장치 및 그것을 포함하는 전자 장치

Publications (1)

Publication Number Publication Date
WO2018097495A1 true WO2018097495A1 (fr) 2018-05-31

Family

ID=62196233

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/012021 WO2018097495A1 (fr) 2016-11-22 2017-10-27 Dispositif d'imagerie omnidirectionnelle et dispositif électronique le comportant

Country Status (2)

Country Link
KR (1) KR102613487B1 (fr)
WO (1) WO2018097495A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11280985B2 (en) * 2018-09-17 2022-03-22 Google Llc Optical arrangement for producing virtual reality stereoscopic images
KR102521096B1 (ko) * 2020-05-08 2023-04-12 (주)에이피텍 광각 촬영이 가능한 카메라 패키징 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100624051B1 (ko) * 2005-07-11 2006-09-15 주식회사 나노포토닉스 Ｃｍｏｓ 이미지 센서 및 그를 포함하는 전방위 영상시스템
KR101395354B1 (ko) * 2012-10-16 2014-05-14 재단법인 씨윗코리아 파노라마 카메라
KR20150122422A (ko) * 2014-04-23 2015-11-02 (주) 픽셀플러스 입체(3d) 영상 센서용 카메라 모듈
KR20160114947A (ko) * 2015-03-25 2016-10-06 (주)아솔 실린더리컬 렌즈를 이용한 무초점 3차원 광학 장치
KR101672889B1 (ko) * 2015-04-27 2016-11-04 (주)시원광기술 휴대폰 접사 촬영용 액세서리

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100624051B1 (ko) * 2005-07-11 2006-09-15 주식회사 나노포토닉스 Ｃｍｏｓ 이미지 센서 및 그를 포함하는 전방위 영상시스템
KR101395354B1 (ko) * 2012-10-16 2014-05-14 재단법인 씨윗코리아 파노라마 카메라
KR20150122422A (ko) * 2014-04-23 2015-11-02 (주) 픽셀플러스 입체(3d) 영상 센서용 카메라 모듈
KR20160114947A (ko) * 2015-03-25 2016-10-06 (주)아솔 실린더리컬 렌즈를 이용한 무초점 3차원 광학 장치
KR101672889B1 (ko) * 2015-04-27 2016-11-04 (주)시원광기술 휴대폰 접사 촬영용 액세서리

Also Published As

Publication number Publication date
KR20180057171A (ko) 2018-05-30
KR102613487B1 (ko) 2023-12-14

Similar Documents

Publication Publication Date Title
WO2018128355A1 (fr) Robot et dispositif électronique servant à effectuer un étalonnage œil-main
KR102609464B1 (ko) 영상을 촬영하는 전자 장치
US11611824B2 (en) Microphone pattern based on selected image of dual lens image capture device
EP3472822A1 (fr) Dispositif d'affichage électronique flexible
CN102708120B (zh) 生活流式传输
WO2017119653A1 (fr) Dispositif électronique compotant un module appareil photographique
EP3337156A1 (fr) Procédé d'obtention d'une image panoramique et dispositif électronique le prenant en charge
WO2017111332A1 (fr) Dispositif électronique et procédé de commande de dispositif électronique
WO2018151396A1 (fr) Dispositif électronique comprenant un biocapteur
WO2020055045A1 (fr) Dispositif électronique pour la fourniture d'un service de commande de dispositifs ido, et son procédé de commande
WO2015046677A1 (fr) Casque immersif et procédé de commande
WO2019203579A1 (fr) Procédé de génération d'informations de profondeur et dispositif électronique prenant en charge ledit procédé
CN106101687B (zh) Vr图像拍摄装置及其基于移动终端的vr图像拍摄系统
WO2015030307A1 (fr) Dispositif d'affichage monté sur tête (hmd) et procédé pour sa commande
WO2019098567A1 (fr) Procédé de prise d'image d'un dispositif électronique, et dispositif électronique
WO2017161871A1 (fr) Monture de lentille optique pour photographie à grand angle
KR20170095716A (ko) 볼-형 하우징에 수용된 360도 이미지 캡처 장치
WO2017179954A1 (fr) Procédé de capture d'image et dispositif électronique prenant en charge ce dernier
WO2018097495A1 (fr) Dispositif d'imagerie omnidirectionnelle et dispositif électronique le comportant
WO2017161850A1 (fr) Accessoire objectif optique pour prise de vue panoramique
WO2019135550A1 (fr) Dispositif électronique de commande d'un affichage d'image sur la base d'une entrée de défilement et procédé associé
CN106210701A (zh) 一种用于拍摄vr图像的移动终端及其vr图像拍摄系统
WO2018004115A1 (fr) Dispositif électronique et son procédé de fonctionnement
WO2017213373A1 (fr) Dispositif électronique, serveur externe et procédé de commande de ceux-ci
WO2019045245A1 (fr) Synchronisation de captures d'image dans de multiples dispositifs du type capteurs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17874180

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17874180

Country of ref document: EP

Kind code of ref document: A1