WO2018097495A1

WO2018097495A1 - Omnidirectional imaging device and electronic device comprising same

Info

Publication number: WO2018097495A1
Application number: PCT/KR2017/012021
Authority: WO
Inventors: 석문기; 진성기
Original assignee: 삼성전자주식회사
Priority date: 2016-11-22
Filing date: 2017-10-27
Publication date: 2018-05-31
Also published as: KR102613487B1; KR20180057171A

Abstract

According to various embodiments, there may be provided an omnidirectional imaging device comprising: a first group of lenses, each having a view angle of at least 180º; a second group of lenses, each having a view angle of at least 180º, the second group of lenses being positioned to face the first group of lenses; and an image sensor for simultaneously imaging light incident from the first group of lenses and light incident from the second group of lenses. The first group of lenses comprises a first group of optical systems having at least one unit lens arranged successively so as to receive external light; a second group of optical systems arranged on a line perpendicular to a line on which the first group of optical systems is arranged; and a first reflecting member interposed between the first group of optical systems and the second group of optical systems so as to totally reflect light introduced from the first group of optical systems to the second group of optical systems. The second group of lenses comprises a third group of optical systems having at least one unit lens arranged successively so as to receive external light; a fourth group of optical systems arranged on a line perpendicular to a line on which the third group of optical systems is arranged; and a second reflecting member interposed between the third group of optical systems and the fourth group of optical systems so as to totally reflect light introduced from the third group of optical systems to the fourth group of optical systems. Other various embodiments are also possible.

Description

Omnidirectional imaging device and electronic device including the same

Various embodiments of the present disclosure relate to an omnidirectional image capturing apparatus and an electronic device including the same.

The omnidirectional imaging apparatus refers to a device that captures the scenery, which the observer observes 360 degrees in place, into a single image. The omnidirectional imaging apparatus uses at least two image sensors to acquire a subject by photographing a subject with a lens having a certain angle of view (eg, a fisheye lens having a field of view of 180 degrees) in each viewing direction, and seamlessly acquiring the acquired image. One panorama image can be generated using a technique for compositing (eg stitching).

In recent years, the omnidirectional imaging apparatus has been used not only in traditional fields such as architecture, natural scenery, and celestial bodies, but also in security and surveillance systems using CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor), real estate or Researches and developments are being conducted to apply to virtual tours of hotels, tourist attractions, etc., or mobile robots or drones.

According to various embodiments of the present disclosure, the omnidirectional image photographing apparatus may include at least two lens groups, and may acquire an image of a subject refracted through the lens group by forming an image on each corresponding image sensor. According to an embodiment, the obtained image may be synthesized into one image through the image processor of the device, and the synthesized image may be output through the display device.

However, the conventional omnidirectional image processing apparatus has a plurality of image sensors corresponding to a plurality of lens groups, so that the cost is increased, and the problem of counteracting the slimming of the device due to the consideration of the layout space according to the arrangement of the plurality of image sensors This can happen.

According to various embodiments of the present disclosure, an omnidirectional image capturing apparatus and an electronic device including the same may be provided.

According to various embodiments of the present disclosure, an omnidirectional image photographing apparatus capable of obtaining an efficient omnidirectional image by constructing a structure capable of acquiring a plurality of images collected by a plurality of lens groups with one image sensor and an electronic device including the same Can be provided.

According to various embodiments, an omnidirectional image capturing apparatus comprising: a first lens group each having an angle of view of at least 180, a second lens group disposed at a position opposite to the first lens group and having an angle of view of at least 180 degrees; And an image sensor for simultaneously capturing light incident from the first lens group and light incident from the second lens group, wherein the first lens group includes at least one unit lens sequentially disposed therein. Incoming from the first group optical system interposed between the first group optical system to be accommodated, the second group optical system disposed on a line perpendicular to the arrangement line of the first group optical system, and the first group optical system and the second group optical system And a first reflection member for totally reflecting the reflected light to a second group optical system, wherein the second lens group includes a third group optical system in which at least one unit lens is sequentially disposed and receives external light; The fourth group optical system disposed on a line perpendicular to the arrangement line of the third group optical system and the light introduced from the third group optical system interposed between the third group optical system and the fourth group optical system are transferred to the fourth group optical system. It is possible to provide an omnidirectional image capturing apparatus comprising a second reflecting member for total reflection.

According to various embodiments of the present disclosure, an accessory device detachably mounted to an electronic device including a camera device includes: a clip unit and a clip unit fixing the accessory device to at least a partial region including the camera of the electronic device; And a barrel portion having an optical system disposed in the internal space to collect surrounding omnidirectional light, wherein the optical system is disposed at a position opposite to the first lens group and the first lens group, each having an angle of view of at least 180; And a second lens group having an angle of view of at least 180 degrees, wherein the first lens group includes at least one unit lens and a first group optical system configured to sequentially receive external light, and a first group optical system. Interposed on a second group optical system and a light transmission path of the first group optical system and the second group optical system disposed on a line perpendicular to the arrangement line; At least one first reflecting member for totally reflecting the light from the first group optical system to the camera device through a second group optical system, wherein the second lens group includes at least one unit lens sequentially And a third group optical system for receiving external light, and a fourth group optical system arranged on a line perpendicular to an arrangement line of the third group optical system, and on a light transmission path of the third group optical system and the fourth group optical system. And an at least one second reflecting member interposed therebetween and totally reflects the light introduced from the third group optical system to the camera device through the fourth group optical system.

According to various embodiments, a cost can be reduced by providing a structure in which a plurality of images collected by a plurality of lens groups, respectively, can be acquired by a single image sensor, and an installation space can be efficiently applied to contribute to slimming of the device. have.

1A is a perspective view of an omnidirectional image photographing apparatus according to various embodiments of the present disclosure.

1B is a side view of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.

2 is a block diagram illustrating a configuration of an optical system of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.

3 is a block diagram illustrating an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.

4A and 4B are diagrams illustrating a state in which an accessory device to which an optical system for omnidirectional image capturing is applied to an electronic device according to various embodiments of the present disclosure.

5 is a block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.

6 is a block diagram illustrating a configuration of an optical system of an accessory device applied to FIGS. 4A and 4B according to various embodiments of the present disclosure.

7A and 7B are views illustrating a state in which an accessory device to which an optical system for capturing omnidirectional images is applied to an electronic device according to various embodiments of the present disclosure.

7C is a diagram illustrating a state in which an image received from an accessory device to which an optical system for capturing omnidirectional images is applied, is displayed on a display of an electronic device according to various embodiments of the present disclosure.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. The examples and terms used herein are not intended to limit the techniques described in this document to specific embodiments, but should be understood to include various modifications, equivalents, and / or alternatives to the examples. In connection with the description of the drawings, similar reference numerals may be used for similar components. Singular expressions may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B" or "at least one of A and / or B" may include all possible combinations of items listed together. Expressions such as "first," "second," "first," or "second," etc. may modify the components in any order or importance, and distinguish one component from another. It is used only for the purpose of not limiting the corresponding components. When any (eg first) component is said to be "connected" or "connected" to another (eg second) component, the other component is said other The component may be directly connected or connected through another component (eg, a third component).

In this document, "configured to" is modified to have the ability to "suitable," "to," "to," depending on the circumstances, for example, hardware or software. Can be used interchangeably with "made to", "doing", or "designed to". In some situations, the expression “device configured to” may mean that the device “can” together with other devices or components. For example, the phrase “processor configured (or configured to) perform A, B, and C” may be implemented by executing a dedicated processor (eg, an embedded processor) to perform its operation, or one or more software programs stored in a memory device. It may mean a general purpose processor (eg, a CPU or an application processor) capable of performing the corresponding operations.

An electronic device according to various embodiments of the present disclosure may be, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, or a wearable device. Wearable devices may be accessory (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs), textiles or clothing integrated (e.g. electronic clothing), And may include at least one of a body-attachable (eg, skin pad or tattoo), or bio implantable circuit, In certain embodiments, an electronic device may comprise, for example, a television, a digital video disk (DVD) player, Audio, Refrigerator, Air Conditioner, Cleaner, Oven, Microwave Oven, Washing Machine, Air Purifier, Set Top Box, Home Automation Control Panel, Security Control Panel, Media Box (e.g. Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ) , A game console (eg, Xbox ^™ , PlayStation ^™ ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include a variety of medical devices (e.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), cameras or ultrasounds), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), automotive infotainment devices, ship electronics (E.g. marine navigation systems, gyro compasses, etc.), avionics, security devices, vehicle head units, industrial or household robots, drones, ATMs in financial institutions, point of sale (POS) points in stores or Internet of Things devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). . According to some embodiments, an electronic device may be a part of a furniture, building / structure or automobile, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, Gas, or a radio wave measuring instrument). In various embodiments, the electronic device may be flexible or a combination of two or more of the aforementioned various devices. Electronic devices according to embodiments of the present disclosure are not limited to the above-described devices. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.

In describing the present invention, an accessory device including an exclusive device for capturing omnidirectional images or an optical system for capturing omnidirectional images is described, but the optical system is a general portable electronic device (eg, a smart phone) including an image sensor. It may be arranged directly inside the.

1A is a perspective view of an omnidirectional image photographing apparatus according to various embodiments of the present disclosure. 1B is a side view of an omnidirectional image capturing apparatus according to various embodiments of the present disclosure.

1A and 1B, the omnidirectional image capturing apparatus 100 may include a pair of lenses 111 and 121. According to an embodiment, the first lens 111 may be disposed on the first surface 110 (eg, the front surface) of the omnidirectional image photographing apparatus 100. According to an embodiment of the present disclosure, the second lens 121 may be disposed on the second surface 120 (eg, the rear surface) of the omnidirectional image photographing apparatus 100 facing the first surface 110. According to an embodiment, the first lens 111 and the second lens 121 may include a wide-angle lens having a rotationally symmetrical shape. According to an embodiment, the wide-angle lens may include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method. However, the present invention is not limited thereto, and the first lens 111 and the second lens 121 may include all kinds of rotationally symmetrical wide-angle lenses such as a reflective refractive fisheye lens.

According to various embodiments, the omnidirectional image capturing apparatus 100 may include a display 112 on the first surface 110. According to an embodiment, the omnidirectional image capturing apparatus 100 obtains an image incident through the first lens 111 and the second lens 121 through one image sensor and converts the obtained images into one image. The display may be controlled to be synthesized and output through the display 112. According to an embodiment, the omnidirectional image capturing apparatus 100 acquires an image incident through the first lens 111 and the second lens 121 through one image sensor and captures the acquired images. The display 112 may control the output to the preview image. According to an embodiment, the preview image output to the display 112 includes an image obtained from each of the first lens 111 and the second lens 121, or the first lens 111 and the second lens 121. ) May include one image synthesized by image processing. According to an embodiment, the display 112 may include a touch screen device including a touch sensor. According to an embodiment, the display 112 may include a pressure-sensitive touch screen device further including a force sensor responsive to touch pressure.

According to various embodiments, although not shown, the omnidirectional image capturing apparatus 100 may include a communication circuit. According to an embodiment, the omnidirectional image capturing apparatus 100 may be functionally connected to an external electronic device through a communication circuit. According to an embodiment, the omnidirectional image capturing apparatus 100 is functionally connected to an external electronic device through short-range communication (eg, Bluetooth, WiFi, Zigbee, etc.), and then transmits the above-described preview image or composite image to the external electronic device. It may be. According to an embodiment, the external electronic device may output image data received from the omnidirectional image capturing apparatus 100 to the display. According to an embodiment of the present disclosure, the external electronic device may control a corresponding function of the omnidirectional image capturing apparatus 100 (for example, initiation of an image synthesizing function, output of a preview image of a synthesized image, or capturing a preview image). .

According to various embodiments of the present disclosure, the omnidirectional image capturing apparatus 100 may include at least one sensor module 115 on the first surface 110. According to an embodiment of the present disclosure, the sensor module 115 may include at least one of a fingerprint sensor, an illumination sensor (for example, an optical sensor), a proximity sensor, an infrared sensor, an ultrasonic sensor, and an iris recognition sensor. However, the present invention is not limited thereto, and the sensor module 115 may be disposed on the second surface 120 of the omnidirectional image photographing apparatus 100 or may be disposed together on the first surface 110 and the second surface 120. According to an embodiment, the omnidirectional image capturing apparatus 100 may include at least one

key button

113 and 114. According to an embodiment of the present disclosure, the key button may include a front button 113 disposed on the first surface 110 and a side key button 114 disposed on the side surface thereof. Although not shown, the omnidirectional image capturing apparatus 100 may include at least one touch pad as a data input means instead of a physical key button.

According to various embodiments, the first lens 111 may accommodate the foreground having an angle of view of up to 180 degrees in the -X direction of the omnidirectional photographing apparatus 100, and the second lens 121 is the omnidirectional photographing apparatus 100. It can accommodate a foreground having an angle of view of up to 180 degrees in the X direction of. According to an embodiment of the present disclosure, the omnidirectional image capturing apparatus 100 may control to process the images collected by the first lens 111 and the second lens 121 together through one image sensor. According to an embodiment, the omnidirectional image capturing apparatus 100 may include an optical system that may acquire an image collected through the first lens 111 and the second lens 121 through one image sensor.

Hereinafter, the configuration of the optical system will be described in detail.

The optical system 200 illustrated in FIG. 2 may be similar to the optical system disposed inside the omnidirectional image photographing apparatus 100 illustrated in FIGS. 1A and 1B, or may include another embodiment of the optical system.

Referring to FIG. 2, the optical system 200 provided to the omnidirectional image capturing apparatus (eg, the omnidirectional image capturing apparatus 100 of FIG. 1A) may include a first lens group 210 having an angle of view of at least 180 and a first lens group 210. An image for simultaneously capturing the second lens group 220 disposed at a position opposite to the lens group 210, the light incident from the first lens group 210, and the light incident from the second lens group 220. It may include a sensor 230.

According to various embodiments of the present disclosure, the first lens group 210 may have an angle of view of up to 180 degrees and collect the foreground of the illustrated -X axis direction. According to an embodiment, the first lens group 210 includes at least one unit lens sequentially disposed, and includes a first group optical system 211 that receives external light and an arrangement line of the first group optical system 211. The light transmitted from the first group optical system 211 interposed between the second group optical system 212 and the first group optical system 211 and the second group optical system 212 disposed on a line perpendicular to the second group. The first reflecting member 213 may be totally reflected by the optical system 212.

According to various embodiments, the above-described second lens group 220 may have an angle of view of up to 180 degrees and collect the foreground in the X-axis direction shown. According to an embodiment, the second lens group 220 includes at least one unit lens sequentially disposed, and includes a third group optical system 221 for receiving external light and an arrangement line of the third group optical system 221. The light from the third group optical system 221 interposed between the fourth group optical system 222 and the third group optical system 221 and the fourth group optical system 222 disposed on a line perpendicular to the fourth group optical system 222. And a second reflecting member 223 which totally reflects to 222.

According to various embodiments, the first reflection member 213 and the second reflection member 223 may include a mirror member or a prism member. According to one embodiment, the light introduced from the first group optical system path 211 of the first lens group 210 is totally reflected in the -Z axis direction through the first reflecting member 213, the second group optical system 212 It may be transmitted to the image sensor 230 through. According to one embodiment, the light introduced from the third group optical system 221 of the second lens group 220 is totally reflected in the -Z axis direction through the second reflecting member 223 to the fourth group optical system 222. It may be delivered to the image sensor 230 through. According to an embodiment, the first lens group 210 and the second lens group 220 may have the same configuration. Therefore, the arrangement structure of at least one unit lens of the first group optical system 211 may be the same as the arrangement structure of at least one unit lens of the third group optical system 221. According to an embodiment, the arrangement structure of at least one unit lens of the second group optical system 212 may be the same as the arrangement structure of at least one unit lens of the fourth group optical system 222. However, the present invention is not limited thereto, and the first lens group 210 and the second lens group 220 may have different arrangement structures.

According to various embodiments, the optical system 200 may include a blocking member 240 (eg, a partition wall) disposed between the second group optical system 212 and the fourth group optical system 222. According to an embodiment, the blocking member 240 may minimize interference between the second group optical system 212 and the fourth group optical system 222 due to diffuse reflection of external light and internal reflection of the two optical axes. Can be arranged. According to an exemplary embodiment, the blocking member 240 may block mutual interference due to an image obtained from the first lens group 210 and an image obtained from the second lens group 220.

According to various embodiments of the present disclosure, the omnidirectional image capturing apparatus receives light introduced from the first lens group 210 and the second lens group 220 through one image sensor 230 by the above-described configuration of the optical system 200. It can be acquired and processed, which contributes to the slimmer device through cost reduction and efficient use of the layout space.

The omnidirectional image capturing apparatus of FIG. 3 may be similar to the omnidirectional image capturing apparatus 100 of FIGS. 1A and 1B or may include another embodiment of the omnidirectional image capturing apparatus.

Referring to FIG. 3, the omnidirectional image capturing apparatus may include an image acquisition unit 310, an image processing unit 320, and an image display unit 330. .

According to various embodiments, the image acquisition unit 310 may include, for example, an optical system including the first lens group 210, the second lens group 220, and the image sensor 230 of FIG. 2. . According to an embodiment, the image acquisition unit 310 may acquire a still image or a moving image through an optical system and an image sensor (for example, a photoelectric device such as a CCD or a CMOS). According to an embodiment, the image collected through the first lens group (eg, the first lens group 210 of FIG. 2) and the second lens group (eg, the second lens group 220 of FIG. 2) is an image. It may be formed on the sensor surface of the sensor (for example, the image sensor 230 of FIG. 2), and the image processed by the image processor 320 after being converted into an electrical signal by the image sensor is displayed on the image display unit 330. Can be.

According to various embodiments, the image processor 320 may correct an image acquired by the image acquirer 310. According to an embodiment, the image processing may be software image processing by a computer, and may include hardware image processing by a reconfigurable semiconductor (FPGA) or an ARM core.

According to various embodiments, the image display unit 330 may include a first lens group (eg, the first lens group 210 of FIG. 2) and a second lens group (eg, the second lens group 220 of FIG. 2). The incident image may be output through the image processing unit 320. According to an embodiment of the present disclosure, the image may be a preview image or may include an image stored through image processing and captured.

The optical system included in the accessory device 410 of FIGS. 4A and 4B may be similar to the optical system 200 of FIG. 2 or may include other embodiments of the optical system.

4A and 4B, the accessory device 410 may include a clip portion 411 and a barrel portion 412 extending from the clip portion 411. According to an embodiment of the present disclosure, the clip unit 411 may include a structure for fixing the accessory device 410 to at least a portion of the electronic device 420. According to an embodiment, the barrel 412 may include the above-described optical system (eg, 200 of FIG. 2). According to an embodiment, the barrel 412 may structurally include an optical system 200 including, for example, the first lens group 210 and the second lens group 220 of FIG. 2. have. According to an embodiment, the barrel 412 may include only an optical system, and an image provided from the barrel may be provided to the camera device 422 of the electronic device 420.

According to various embodiments, the accessory device 410 may include a pair of lens groups (eg, 210 and 220 of FIG. 2). According to an embodiment of the present disclosure, when the accessory device 410 is fixed to the electronic device 420 by the clip 411, one lens group (eg, 210 of FIG. 2) may display the display of the electronic device 420. It is arranged to acquire an image related to the foreground of the front direction (X-axis direction) of the electronic device 420 that is the same as the arrangement direction of the 421, and the other lens group (eg, 220 of FIG. 2) is the electronic device 420. The electronic device 420 may be arranged to acquire an image related to the foreground of the rear direction (-X axis direction) of the same electronic device 420 as that of the camera device 422.

According to various embodiments, the electronic device 420 may include an image sensor for controlling the camera device 422 to process an image provided from the accessory device 410, an image processor, and a display 421. According to an embodiment of the present disclosure, the electronic device 420 acquires an image incident through the optical system disposed on the barrel 412 of the accessory device 410 through the image sensor of the camera device 422, and acquires the obtained images. By synthesizing into an image of the can be controlled to output through the display 421. According to an embodiment, the electronic device 420 acquires an image incident through the optical system provided to the barrel 412 of the accessory device 410 through the image sensor of the camera device 422, and captures the acquired images. It may be controlled to output a preview image through the display 421 before capturing. According to one embodiment, the preview image output to the display 421 includes at least two images provided by the barrel portion 412 of the accessory device 410, or is provided by the barrel portion 412 of the accessory device 410. At least two images may include one image synthesized.

According to various embodiments, the accessory device 410 may include a sensing member. According to an embodiment of the present disclosure, the electronic device 420 may include a sensing member capable of sensing the sensing member to recognize the mounted accessory device 410. According to an embodiment, the sensing member may include a hall sensor for sensing the magnetic force of the magnet used as the sensing member. According to one embodiment, the sensing member may include a proximity sensor for detecting proximity of accessory device 410. According to an embodiment, the electronic device 420 detects the mounting of the accessory device 410 by the sensing member, acquires an image through the accessory device 410, and then synthesizes at least two acquired images (eg, It is possible to execute a dedicated program (eg, an application program for panorama photography) that can be stitched. According to an embodiment of the present disclosure, the image photographed by the accessory device 410 is a 3D image, and is added to metadata, and thus, another electronic device (eg, a 360 editor or VR device, etc.) may be displayed to be used immediately. According to an embodiment of the present disclosure, the electronic device 420 may process the image information received from the accessory device 410 according to the sensor information of the electronic device 420 to process and play back the image without shaking. According to an embodiment, when recording an image with the accessory device 410, the electronic device 420 may detect a moving direction of the user and generate an image around the corresponding direction.

According to various embodiments of the present disclosure, the accessory device 410 may further include an image processor (or a controller) for self-processing the received image and a communication circuit for functionally (wirelessly) connecting the electronic device 420. According to an embodiment of the present disclosure, the electronic device 420 may detect mounting of the accessory device 410 by a sensing member, and may be functionally connected to the accessory device 410 through a communication circuit. According to an embodiment of the present disclosure, the accessory device 410 may display the composite image processed by the barrel 412 and the image processing unit therein, or the preview image (eg, a still image or a moving image) before synthesis through the communication circuit. You can also provide.

The accessory device 500 of FIG. 5 may be similar to the accessory device 410 of FIGS. 4A and 4B, or may include other embodiments of the accessory device. In FIG. 5, the configuration of the lens group disposed in the space 5101 in the barrel 510 of the accessory device 500 is excluded, but a lens group similar or identical to the optical system 200 of FIG. 2 may be disposed. It can be obvious.

Referring to FIG. 5, the barrel 510 of the accessory device 500 may be fixed to include an area in which the camera device of the electronic device 520 is disposed, and is positioned at a position corresponding to the image sensor 522 of the camera device. Can be deployed. According to one embodiment, in the internal space 5101 of the barrel portion 510, the first reflecting member 511 is disposed to have a predetermined inclination in the X axis direction and the second is disposed to have a predetermined inclination in the -X axis direction. Third reflecting member 512 for totally reflecting the light flowing from the reflecting member 513, the first reflecting member 511, and the second reflecting member 513 toward the image sensor 522 (in the -X axis direction) at the same time. ) May be included. The first, second, and third

reflective members

511, 513, and 512 may include a mirror member or a prism member disposed according to the circumstances of the internal space 5101 of the barrel portion 510 of the accessory device 500.

According to various embodiments, the light flowing in the X-axis direction of the barrel portion 510 of the accessory device 500 is totally vertically reflected by the first reflecting member 511, and again by the third reflecting member 512. The total reflection in the direction of the device 520 may be provided to the image sensor 522. According to one embodiment, the light introduced in the -X axis direction of the barrel portion 510 of the accessory device 500 is totally reflected vertically by the second reflecting member 513 and again by the third reflecting member 512. Total reflection in the direction of the electronic device 520 may be provided to the image sensor 522. Therefore, the images provided in the X-axis and -X-axis directions of the barrel 510 of the accessory device 500 are respectively displayed by the first, second, and third

reflective members

511, 513, and 512 of the camera of the electronic device 520. The image sensor 522 provided in the apparatus may be provided and processed.

The accessory device 600 of FIG. 6 may be similar to the accessory device 410 of FIGS. 4A and 4B, or may include other embodiments of the accessory device. In FIG. 6, the configuration of the lens group disposed in the barrel 610 of the accessory device 600 is excluded, but it is apparent that a lens group similar or identical to the optical system 200 of FIG. 2 may be disposed.

Referring to FIG. 6, the barrel 610 of the accessory device 600 may be fixed to include an area in which the camera device of the electronic device 620 is disposed, and is positioned at a position corresponding to the image sensor 622 of the camera device. Can be deployed. According to one embodiment, the light reflected totally from the first reflecting member 611 and the first reflecting member 611 disposed in the inner space 6101 of the barrel portion 610 to have a predetermined inclination toward the X axis direction. And a second reflecting member 612 for total reflection in the 622 direction (in the -X axis direction). According to one embodiment, the barrel 610 is directed toward the image sensor 622 in the direction of the image sensor 622 and the light reflected from the third reflection member 613 and the third reflection member 613 disposed to have a predetermined inclination toward the -X axis direction. And a fourth reflecting member 614 for total reflection (in the -X axis direction). The first, second, third, and fourth

reflective members

611, 612, 613, 614 may include a mirror member or a prism member disposed according to the circumstances of the inner space 6101 of the barrel portion 610 of the accessory device 600. Can be.

According to various embodiments, the light flowing in the X-axis direction of the barrel portion 610 of the accessory device 600 is totally reflected vertically by the first reflecting member 611, and again by the second reflecting member 612. Total reflection in the direction of the device 620 may be provided to the image sensor 622. According to one embodiment, the light introduced in the -X axis direction of the barrel portion 610 of the accessory device 600 is totally vertically reflected by the third reflecting member 613, and again by the fourth reflecting member 614. Total reflection in the direction of the electronic device 620 may be provided to the image sensor 622.

Therefore, the images provided in the X-axis and -X-axis directions of the barrel 610 of the accessory device 600 are respectively displayed by the first, second, third, and fourth

reflective members

611, 612, 613, and 614. One image sensor 622 provided in the camera device of 620 may be provided and processed.

The optical system included in the accessory device 710 of FIGS. 7A and 7B may be similar to the optical system 200 of FIG. 2, or may include other embodiments of the optical system.

7A and 7B, the accessory device 710 may include a first lens 7121 and a second lens 7122 extending from the clip portion 711 and the clip portion 711 and disposed in opposite directions to each other. A barrel portion 712 may be included. According to an embodiment of the present disclosure, the clip unit 711 may include a structure for fixing the accessory device 710 to at least a portion of the electronic device 720. According to one embodiment, the barrel 712 may include the above-described optical system (eg, 200 of FIG. 2). According to an embodiment, the barrel 712 may include, for example, an optical system 200 including the first lens group 710 and the second lens group 720 of FIG. 2. . According to an embodiment, the barrel 712 may include only an optical system, and an image provided from the barrel may be provided to the camera device 722 of the electronic device 720.

According to various embodiments, the accessory device 710 may include a pair of lens groups (eg, 210 and 220 of FIG. 2). According to an embodiment of the present disclosure, when the accessory device 710 is fixed to the electronic device 720 by the clip portion 711, one lens group including the first lens (eg, 210 of FIG. 2) may correspond to the electronic device. When viewed from the front of 720, the other lens group (eg, 220 of FIG. 2) including the second lens is disposed to acquire an image related to the foreground in the left direction (-Y axis direction). When viewed from the front of 720, it may be arranged to acquire an image related to the foreground in the right direction (Y axis direction).

According to various embodiments, the electronic device 720 may include an image sensor for controlling the camera device 722 to process an image provided from the accessory device 710, an image processor, and a display 721. According to an embodiment of the present disclosure, the electronic device 720 acquires an image incident through the optical system disposed on the barrel 712 of the accessory device 710 through the image sensor of the camera device 722, and acquires the obtained images. By synthesizing into an image of the can be controlled to output through the display 721. According to an embodiment, the electronic device 720 acquires an image incident through the optical system provided to the barrel 712 of the accessory device 710 through the image sensor of the camera device 722, and captures the acquired images. It may be controlled to output a preview image through the display 721 before capturing. According to an embodiment, the preview image output to the display 721 may include at least two images provided by the barrel portion 712 of the accessory device 710 or may be provided by the barrel portion 712 of the accessory device 710. At least two images may comprise one combined image.

According to various embodiments, the accessory device 710 may include a sensing member. According to an embodiment of the present disclosure, the electronic device 720 may include a sensing member capable of sensing the sensing member to recognize the mounted accessory device 710. According to an embodiment, the sensing member may include a hall sensor for sensing the magnetic force of the magnet used as the sensing member. According to one embodiment, the sensing member may include a proximity sensor for detecting proximity of accessory device 710. According to an embodiment, the electronic device 720 detects mounting of the accessory device 710 by the sensing member, acquires an image through the accessory device 710, and then synthesizes at least two acquired images (eg, It is possible to execute a dedicated program (eg, an application program for panorama photography) that can be stitched. According to an embodiment of the present disclosure, the image photographed by the accessory device 710 may be a 3D image, and may be added to the metadata, and thus, another electronic device (eg, 360 editor or VR device, etc.) may be displayed to be used immediately. According to an embodiment of the present disclosure, the electronic device 720 may process the image information received from the accessory device 710 according to the sensor information of the electronic device 720 to process and play back the image without shaking. According to an embodiment, when recording an image with the accessory device 710, the electronic device 720 may detect a moving direction of the user and generate an image around the corresponding direction.

According to various embodiments of the present disclosure, the accessory device 710 may further include an image processing unit (or control unit) for self-processing the received image and a communication circuit for functionally (wirelessly) connecting the electronic device 720. According to an embodiment of the present disclosure, the electronic device 720 may detect mounting of the accessory device 710 by the sensing member, and may be functionally connected to the accessory device 710 through a communication circuit. According to an embodiment, the accessory device 710 may display the composite image processed by the barrel 712 and the image processing unit therein, or a preview image (eg, a still image or a moving image) before synthesis through the communication circuit. You can also provide.

Referring to FIG. 7C, when the electronic device 720 detects the mounting of the accessory device, the electronic device 720 may display the front image 7141 and the rear image 7212 through the first lens 7121 and the second lens 7122 of the accessory device. Can be obtained. According to an embodiment of the present disclosure, the obtained two images may be passed through and displayed as two spherical images on the display 721 of the electronic device 720. In this case, the execution program of the electronic device 720 may recognize the 360-degree omnidirectional image pattern (scene recognition), and the electronic device 720 recognizes the 360-camera image and executes a 360-degree omnidirectional screen conversion program to perform a composite conversion operation. You can also perform stitching automatically.

According to various embodiments, the arrangement structure of at least one unit lens of the first group optical system may be the same as the arrangement structure of at least one unit lens of the third group optical system.

According to various embodiments, the arrangement structure of at least one unit lens of the second group optical system may be the same as the arrangement structure of at least one unit lens of the fourth group optical system.

According to various embodiments, the first reflecting member and the second reflecting member may include a mirror member or a prism member.

According to various embodiments, the first lens group and the second lens group may include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method.

According to various embodiments of the present disclosure, the omnidirectional image photographing apparatus may include a display for outputting an image collected from the first lens group and the second lens group and processed by an image sensor.

According to various embodiments of the present disclosure, the omnidirectional image capturing apparatus may output an image collected from the first lens group and the second lens group and processed by an image sensor as a preview image including a still image or a moving image.

According to various embodiments, the at least one first reflecting member and the at least one second reflecting member may include a mirror member or a prism member.

According to various embodiments, the at least one first reflecting member may include a first vertical reflecting member and the first vertical reflecting member for totally reflecting the light from the first group optical system vertically in the direction of the second group optical system. The light reflected by the light may include a first horizontal reflection member for total reflection in the direction of the camera device through the second group optical system.

According to various embodiments of the present disclosure, the at least one second reflecting member may include a second vertical reflecting member and the second vertical reflecting member for totally reflecting light introduced from the third group optical system in a direction perpendicular to the fourth group optical system. The light reflected by the light passing through the second group of the optical system may include a second horizontal reflection member for total reflection in the direction of the camera device.

According to various embodiments, the first horizontal reflective member and the second horizontal reflective member may be integrally formed.

According to various embodiments of the present disclosure, the accessory device may include an image sensor for generating an image by processing light introduced through the first lens group and the second lens group, and a communication circuit for functionally connecting with the electronic device. However, the image processed by the image sensor may be transmitted to the electronic device through the communication circuit.

According to various embodiments of the present disclosure, the electronic device may include a display, and an image provided from the accessory device may be output through the display.

According to various embodiments of the present disclosure, when the accessory device is mounted on the electronic device, the first lens group faces the front surface of the electronic device, and the second lens group faces the rear surface facing the front surface of the electronic device. Can be deployed.

According to various embodiments of the present disclosure, when the accessory device is mounted on the electronic device, the first lens group faces one side perpendicular to the front surface of the electronic device, and the second lens group may correspond to one side surface of the electronic device. It may be arranged to face the other side opposite.

According to various embodiments of the present disclosure, the accessory device may include at least one sensing member arranged to sense mounting by a sensing member included in the electronic device.

In addition, the embodiments of the present invention disclosed in the specification and the drawings merely present specific examples to easily explain the technical contents according to the embodiments of the present invention and to help the understanding of the embodiments of the present invention. It is not intended to be limiting. Therefore, the scope of various embodiments of the present invention should be construed that all changes or modifications derived based on the technical spirit of the various embodiments of the present invention in addition to the embodiments disclosed herein are included in the scope of the various embodiments of the present invention. .

Claims

In the omnidirectional imaging device,

A first lens group each having an angle of view of at least 180;

A second lens group disposed at a position opposite to the first lens group and having an angle of view of at least 180 degrees; And

And an image sensor for simultaneously capturing light incident from the first lens group and light incident from the second lens group.

The first lens group,

At least one unit lens is disposed sequentially, the first group optical system for receiving the external light;

A second group optical system disposed on a line perpendicular to an arrangement line of the first group optical system; And

A first reflection member interposed between the first group optical system and the second group optical system and totally reflecting the light introduced from the first group optical system to the second group optical system,

The second lens group,

A third group optical system in which at least one unit lens is sequentially disposed to receive external light;

A fourth group optical system disposed on a line perpendicular to an arrangement line of the third group optical system; And

And a second reflecting member interposed between the third group optical system and the fourth group optical system to totally reflect the light introduced from the third group optical system to the fourth group optical system.
The method of claim 1,

The arrangement structure of the at least one unit lens of the first group optical system is the same as the arrangement structure of the at least one unit lens of the third group optical system.
The method of claim 1,

The arrangement structure of the at least one unit lens of the second group optical system is the same as the arrangement structure of the at least one unit lens of the fourth group optical system.
The method of claim 1,

And the first reflecting member and the second reflecting member include a mirror member or a prism member.
The method of claim 1,

And the first lens group and the second lens group include a fisheye lens having an angle of view of 180 degrees or more in an equidistant projection method.
The method of claim 1,

And the omnidirectional image photographing apparatus includes a display for outputting an image collected from the first lens group and the second lens group and processed by an image sensor.
The method of claim 6,

And the omnidirectional image photographing apparatus is configured to output an image collected from the first lens group and the second lens group and processed by an image sensor as a preview image including a still image or a moving image.
An accessory device detachably mounted to an electronic device including a camera device, the accessory device comprising:

A clip unit fixing the accessory device to at least a portion of the electronic device including the camera; And

It includes a barrel extending from the clip portion and the optical system is disposed in the internal space to collect the omnidirectional light surrounding,

The optical system,

A first lens group each having an angle of view of at least 180; And

A second lens group disposed at a position opposite to the first lens group and having an angle of view of at least 180 degrees;

The first lens group,

At least one unit lens is disposed sequentially, the first group optical system for receiving the external light;

A second group optical system disposed on a line perpendicular to an arrangement line of the first group optical system; And

At least one first reflecting member interposed on the light transmission paths of the first group optical system and the second group optical system and totally reflects the light introduced from the first group optical system to the camera device through the second group optical system. and,

The second lens group,

A third group optical system in which at least one unit lens is sequentially disposed to receive external light;

A fourth group optical system disposed on a line perpendicular to an arrangement line of the third group optical system; And

At least one second reflecting member interposed on the light transmission paths of the third group optical system and the fourth group optical system and totally reflecting the light introduced from the third group optical system to the camera device through the fourth group optical system; Accessory device characterized in that.
The method of claim 8,

The arrangement structure of at least one unit lens of the first group optical system is the same as the arrangement structure of at least one unit lens of the third group optical system.
The method of claim 8,

The arrangement structure of the at least one unit lens of the second group optical system is the same as the arrangement structure of the at least one unit lens of the fourth group optical system.
The method of claim 8,

Wherein said at least one first reflecting member and at least one second reflecting member comprise a mirror member or a prism member.
The method of claim 8,

The at least one first reflecting member,

A first vertical reflecting member for totally reflecting light vertically from the first group optical system toward the second group optical system; And

And a first horizontal reflecting member for reflecting light reflected by the first vertical reflecting member through the second group optical system and totally reflecting toward the camera apparatus.
The method of claim 12,

The at least one second reflecting member,

A second vertical reflecting member for totally reflecting light vertically from the third group optical system in the direction of the fourth group optical system; And

And a second horizontal reflecting member for reflecting light reflected by the second vertical reflecting member through the second group optical system and totally reflecting toward the camera apparatus.
The method of claim 8,

The accessory device,

An image sensor for generating an image by processing light introduced through the first lens group and the second lens group; And

A communication circuit for functionally connecting with the electronic device,

And the image processed by the image sensor is transmitted to the electronic device through the communication circuit.
The method of claim 14,

The electronic device includes a display, and an image provided from the accessory device is output through the display.