KR20210072607A - The smartphone camera case realizing 360 degree stereoscopic videos - Google Patents

Abstract

The present invention relates to a 360 degree stereoscopic smartphone camera case, and specifically includes a smartphone case, and a plurality of lenses installed inside an edge of the smartphone case, thereby adjusting a focus of an image on a CCD. According to the present invention, it is possible to obtain a 3D image around the smartphone without a separate lens through the image obtained from the CCD, to minimize the increase in economic cost by using the CCD and the plurality of lenses at a level, in which a minimal analysis of surrounding images is possible, and to estimate the speed of an object approaching from the front, back, left and right by analyzing the image obtained in real time, which secures the stability of a pedestrian using the smartphone.

Description

360 degree stereoscopic smartphone camera case {The smartphone camera case realizing 360 degree stereoscopic videos}

The present invention relates to a 360-degree stereoscopic smartphone camera case, and more particularly, a 360-degree stereoscopic smartphone camera case that acquires a three-dimensional image of the user's surroundings through refraction of light using the curvature of the edge of the smartphone and the edge of the liquid crystal protection. is about

As the functions of smartphones such as communication, finance, web surfing, photo taking, and file sharing are diversified and advanced, smartphones have become a necessity of modern life, and will continue to develop in the direction of further strengthening their functions as a complex convenience means.

However, the CCD for analyzing the surrounding image is high cost used in the front and rear cameras of the smartphone.

Here, when a 360-degree 3D stereoscopic image is generated using a plurality of wide-angle lenses such as a fisheye lens, image distortion occurs in the stereoscopic image because the depth is generated in the distorted area captured from the fisheye image in the step of generating the depth. There is a problem in providing a low three-dimensional effect. The distorted image has a problem in that it is difficult to restore the depth.

Commercial 360-degree cameras have a problem in that they require a hemispherical attachment with a curvature like a fisheye lens.

With the development of smartphone technology, humans have become more convenient, but safety accidents due to smartphone use continue to occur every year.

As described above, an object of the present invention is to provide a 360-degree stereoscopic smartphone camera case name that can acquire a 3D image of the user's surroundings through refraction of light using the corner curvature of the smartphone case.

360-degree stereoscopic smartphone camera case according to a preferred embodiment of the present invention for achieving the above object is a smartphone case; It is characterized in that it is possible to adjust the focus of the image on the CCD including; a plurality of lenses installed inside the edge of the smartphone case.

And, according to the present invention, the plurality of lenses is characterized in that by installing cameras at the four corners of the smartphone case, it is possible to obtain all three-dimensional peripheral images of front, back, left and right, and up and down.

And, according to the present invention, the three-dimensional peripheral image is a plurality of images using a plurality of cameras, and dividing each of the plurality of images into a left-eye image and a right-eye image to generate a left-eye spherical image and a right-eye spherical image, It is characterized in that depth information is obtained using the generated left/right eye spherical image, and a 360-degree 3D stereoscopic image in which a three-dimensional effect is adjusted is generated using the acquired depth information.

According to the 360-degree stereoscopic smartphone camera case according to the present invention according to the above configuration, there is an effect that a 3D image around the smartphone can be obtained without a separate lens through the image obtained from the CCD.

In addition, according to the present invention, an increase in economic cost can be minimized by using a CCD and a plurality of lenses at a level capable of minimally analyzing the surrounding image.

In addition, according to the present invention, it is possible to estimate the speed of an object approaching from the front, back, left and right by analyzing the image obtained in real time, which becomes a base technology for securing the stability of pedestrians using smartphones.

1 is a view illustrating the refraction of light generated at a corner having a curvature of a 360-degree stereoscopic smartphone camera case according to the present invention.
2 is a view showing a state in which a plurality of lenses and a CCD are installed at a corner according to the present invention;
3 is a view illustrating an angle of view through a camera installed at four corners according to the present invention;
4 is an exemplary view for explaining extracting an undistorted image in the present invention;
5 is a view for explaining the prevention of pedestrian safety accidents through three-dimensional image shooting according to the present invention, and
6 is a view for explaining an embodiment of a position determination through 3D image analysis according to the present invention, respectively.

Specific details including the problems to be solved in the present invention as described above, the means for solving the problems, and the effects of the invention are included in the embodiments and drawings to be described below. Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings.

In addition, when a certain part "includes" or "includes" a certain component throughout the specification, it does not exclude other components unless otherwise stated, but may further include or include other components. means that

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, it should be noted that in adding reference numerals to the components of each drawing, the same components are given the same reference numerals as possible even if they are indicated on different drawings. In addition, in describing the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a view illustrating refraction of light generated at a corner having a curvature of a 360-degree stereoscopic smartphone camera case according to the present invention, and FIG. 2 is a view showing a state in which a plurality of lenses and a CCD are installed at the corner according to the present invention , FIG. 3 is a view illustrating an angle of view through a camera installed at four corners according to the present invention, FIG. 4 is an exemplary view for explaining extracting an undistorted image in the present invention, and FIG. 5 is a 3 according to the present invention A view for explaining the prevention of a pedestrian safety accident through taking a 3D image, and FIG. 6 are views for explaining an embodiment of a location determination through a 3D image analysis according to the present invention, respectively.

As shown in Figures 1 to 6, the 360-degree stereoscopic smartphone camera case in the present invention is when light enters the edge of the smartphone case 10, the curvature of the edge acts as a fisheye lens 20, This was done to induce refraction.

A three-dimensional image around the smartphone can be obtained without a separate lens through the image obtained from a charge coupled device (CCD) installed at the focal point where the refracted light gathers as shown in FIG. 1 .

Here, as shown in FIGS. 1 and 2 , by installing a plurality of lenses 20 inside the edge 10 of the smartphone case, the focus of the image on the CCD can be adjusted. Unlike the high-cost/high-resolution CCD used in the front and rear cameras of smartphones, the CCD for peripheral image analysis minimizes the increase in economic cost by using the CCD and multiple lenses that allow the minimum analysis of the surrounding image. .

If all the camera lenses 20 are installed at the four corners of the smartphone case 10 in this way, as shown in FIG. 3 , it is possible to obtain all three-dimensional peripheral images of the front and rear, left and right, and top and bottom. The distortion that occurs in the surrounding image according to the refraction of light can be corrected through a software technique. In addition, using the same principle (binocular parallax) as a human estimating the distance to an object through the difference in images obtained from both eyes, objects that exist in front, back, left and right through the difference in angles of images obtained from two or more corners distance can be estimated. Therefore, it is possible to estimate the speed of an object approaching from the front, back, left and right by analyzing the images obtained in real time, which becomes a basic technology to secure the stability of pedestrians using smartphones. This means that smartphones can go one step further into technology that can protect young children and the elderly who are exposed to safety accidents due to a decrease in concentration or reaction speed beyond the level of technology that provides convenience.

Here, when a 360-degree 3D stereoscopic image is generated using a plurality of wide-angle lenses such as a fisheye lens, image distortion occurs in the stereoscopic image because the depth is generated in the distorted area photographed from the fisheye image in the step of generating the depth. There is a problem in providing a low three-dimensional effect. An electronic device for generating a 360-degree 3D stereoscopic image and a method thereof are used to compensate for the difficulty in depth restoration of the distorted image. A plurality of images are photographed using a plurality of cameras, each of the plurality of images is divided into a left eye image and a right eye image, a left eye spherical image and a right eye spherical image are generated, and depth information using the generated left and right eye spherical images , and using the acquired depth information, a technology is used to generate a 360-degree 3D stereoscopic image in which a three-dimensional effect is adjusted.

As described above, the case according to the present invention has the following advantages.

First, the technology can be implemented without hardware changes. Although a commercially available 360-degree camera requires a hemispherical additional device with a curvature like a fisheye lens, the present invention uses the edge curvature of the smartphone case to acquire a 3D image around the user through refraction of light, so a separate hardware change It is possible to implement the technology without requiring This has the advantage of not damaging the design of the smartphone. In addition, if a case suitable for the model is manufactured, it can be attached and detached to an existing smartphone, making it easy to carry.

Second, the process of acquiring images and processing information is similar to the human sensory system. For modern people, smartphones are no longer an accessory, but a necessity. The process of acquiring a 360-degree stereoscopic image and processing information in real time through the smartphone combined with the present invention is similar to the human sensory processing step. Therefore, it is possible to change the information acquired by humans into concrete information (computer language, etc.), acquire information that humans are not aware of, and share someone else's information without a human being directly.

Third, the present invention conforms to the consumption trend of modern people. Modern people spare no expense for leisure and entertainment. Typical examples of smartphone accessories include the Nintendo Game Boy smartphone case, dual display, joystick, and handle. The present invention for obtaining more information conforms to the consumption trend of modern people, which can obtain industrial effects.

Fourth, you can get not only the convenience of a smartphone, but also the safety. With the development of smartphone technology, humans have become more convenient, but safety accidents due to smartphone use continue to occur every year. Through the present invention, the user will be safer if the surrounding image is constantly acquired and a warning about the danger is given. Just as self-driving cars change from a simple means of transportation to a variety of uses, smartphones will also change to a role that protects not only convenience and speed, but also safety.

Fifth, the increase in economic cost can be minimized. Unlike the high-cost/high-resolution CCD used in the front and rear cameras of the CCD for analyzing the surrounding image, the increase in economic cost can be minimized by using the CCD and multiple lenses that allow the minimum analysis of the surrounding image. .

As such, the present invention will be described by way of example.

The first case of the present invention is an embodiment for preventing safety accidents while walking.

As shown in FIG. 5 , when the screen is turned on while the movement of the pedestrian is detected through an acceleration or gyro sensor, the smartphone automatically operates all cameras installed at the corners of the case. Pedestrians stare at the smartphone in landscape mode in the case of games or video viewing, and use the smartphone in portrait mode when texting/SNS, etc., even if one or two corners are covered by hands. The cameras at the two corners get the surrounding image. By calculating the distance through the binocular disparity between the two cameras, it is possible to predict the distance to and collision with an obstacle in front or an object approaching from the side. When there is a risk of collision, a warning about this is output on the screen of the smartphone to prevent a pedestrian safety accident using the smartphone in advance. Existing technologies for preventing pedestrian safety accidents using smartphones have to recognize obstacles through distance sensors or ultrasonic sensors, so the recognition range is extremely limited. In addition, the existing procedure for recognizing obstacles using the rear camera also recognized obstacles within the limited angle of view of the front, and since the image obtained using a single rear camera is analyzed, the function of preventing complex accidents using speed or distance is insufficient. .

In the present invention, using the same principle (binocular disparity) of estimating the distance to an object through the difference in images obtained from the two eyes of a person, the image obtained in real time through the angle difference between the images obtained from two corners or more By analyzing it, it is possible to estimate the velocity of an object that exists before, after, on the left and right. This will become the basis for securing the stability of pedestrians using smartphones. If this technology is utilized, it means that the smartphone can be developed one step further into a technology that can protect children and the elderly who are exposed to safety accidents due to a decrease in concentration or reaction speed, beyond the level of technology that provides convenience. .

The second example of the present invention is an embodiment of location determination through 3D image analysis. Positioning using a smartphone is usually done by triangulating through GPS or signal detection from a base station. Therefore, in the case of high-rise buildings, large shopping malls, and department stores, the possibility of damage is very high because the exact location of survivors cannot be accurately identified in emergency evacuation situations such as fire, earthquake, and terrorism. In recent years, as buildings become larger and travel routes become more complicated for commercial purposes, accurate location identification of visitors within a building is emerging as a very important essential technology. When a 3D surrounding image is acquired in real time by taking a 360-degree 3D image, it is possible to track the exact location of the user in real time by comparing it with the existing images in the building using the upper and lower, left and right surrounding images. For example, as shown in FIG. 6 , when using a smartphone in a building or carrying it in a hand, a camera installed at the edge of the smartphone case captures a surrounding image in real time. Through the software that has obtained the user's consent to provide information, or upon the user's urgent request, the smartphone transmits the surrounding image captured by wireless communication to the server of the building, and compares it with the image for each area of the building stored in the server. The location of the phone user can be accurately identified in real time. In addition, after the user leaves the building, the image transmitted from the user and the information identifying the user's location in the building are deleted.

As such, in order to have a technology platform that can provide a higher level of convenience and safety to the smartphone, a technology for acquiring a 3D image of the surroundings from the smartphone case in real time can be used.

A third example of the present invention is an embodiment related to virtual reality (VR) content implementation. Recently, a small wearable device technology capable of experiencing virtual reality such as a head mounted display (HMD) has been developed. On the other hand, compared to the number of devices that can provide virtual reality content, virtual reality content is insufficient. Therefore, the need for virtual reality content creation technology that can be applied to small wearable device technology is increasing. [Prior Document Publication No. 10-2017-0017700 Electronic device for generating 360-degree 3D stereoscopic image and method therefor] 360-degree distortion covering the entire 360-degree area by shooting with multiple cameras using a stereoscopic smartphone camera case A three-dimensional image around the smartphone can be obtained by extracting a plurality of sub-images that do not exist. In order to create a three-dimensional (3D) stereoscopic image, a three-dimensional camera and a program having a configuration different from that of a two-dimensional camera are generally required. In general, 3D cameras are expensive due to the complicated configuration of equipment such as mounting two lenses, and the shooting technology is also more complicated than that of a general camera. This technology can solve these problems. In addition, the problem of large memory due to the result of video is implemented in a cloud-based manner regardless of the consumer's hardware specifications in line with the 5G era, and it can be streamed in real time, so that users can enjoy it easily without the need for additional equipment. This allows the supplier to provide a lot of content with just one case.

A fourth example of the present invention is an embodiment related to the activation of a 3D printer due to the simplification of 3D scanning. You can use the 360-degree stereoscopic smartphone camera case to send data from your smartphone to a 3D printer for printing. Until now, 3D scanners have a limitation in size to scan a three-dimensional model and have to take pictures one by one. This is inconvenient to have to separately input numerical values into the 3D printer. In addition, in the case of a portable scanner, there is a disadvantage in that the user's hand shake needs to be corrected when scanning. If you obtain a stereoscopic image through a camera case and use the distance measuring method and device technology using BLE [Prior Document Application No. 10-2017-0162859 Distance measuring method and device using BLE], the data obtained from the image can be You can give your smartphone an accurate distance figure. Using this, you can easily use 3D printing.

As such, those skilled in the art to which the present invention pertains will understand that the above-described technical configuration of the present invention may be implemented in other specific forms without changing the technical spirit or essential characteristics of the present invention.

Therefore, the embodiments described above are to be understood as illustrative and not restrictive in all respects, and the scope of the present invention is indicated by the following claims rather than the above detailed description, and the meaning and scope of the claims and their equivalents All changes or modifications derived from the concept should be construed as being included in the scope of the present invention.

10. Smartphone case 20. Lens

Claims (3)

smartphone case;
A 360-degree stereoscopic smartphone camera case, characterized in that it is possible to adjust the focus of the image on the CCD, including; a plurality of lenses installed inside the corner of the smartphone case. According to claim 1, wherein the plurality of lenses
360-degree stereoscopic smartphone camera case, characterized in that by installing cameras at the four corners of the smartphone case, it is possible to obtain all three-dimensional surrounding images of front, back, left and right, and up and down. The method of claim 2, wherein the 3D surrounding image is
A plurality of images are photographed using a plurality of cameras, each of the plurality of images is divided into a left eye image and a right eye image, a left eye spherical image and a right eye spherical image are generated, and depth information using the generated left/right eye spherical images A 360-degree stereoscopic smartphone camera case, characterized in that it generates a 360-degree 3D stereoscopic image in which a three-dimensional effect is adjusted by using the acquired depth information.

Images