WO2017007105A1 - Device having omnidirectional photographing camera lens module, and control method therefor - Google Patents

Abstract

An embodiment according to the present invention provides a device comprising: an image capturing unit including a lens module including a first lens having a convex first light-incident face formed on one surface, a first light-emitting face formed on the other surface, and a first reflective face formed at the center of the first light-incident face, and a second lens having a second light-incident face formed on one surface, a convex second reflective face formed on the other surface, and a second light-emitting face formed at the center of the second reflective face, wherein the first and second lenses are formed of the same material, the first light-emitting face is formed to be concave, the second light-incident face is formed to be convex, and the first light-emitting face and the second light-incident face are connected and the radius of curvature are the same, thereby enabling an omnidirectional image to be captured; a storage unit for storing the captured omnidirectional image; and an omnidirectional photographing camera lens module detecting an object within a preset range from the captured omnidirectional image so as to feed back and display the detected object.

Description

Apparatus having a camera lens module for photographing an omnidirectional image and a control method thereof

The present invention relates to a device having a camera lens module for photographing the omnidirectional and a control method thereof, and more particularly, to a device having a camera lens module for photographing the omnidirectional with a lens module for photographing the omnidirectional image and control thereof. It is about a method.

With the development of electronic technology, various types of electronic products are being developed and distributed. For example, as the Internet of Things emerged, a variety of technologies were created to transmit and receive information between and control various electronic products.

In particular, due to the development of image processing technology and optical technology, there is an increasing demand for later monitoring by storing or transmitting images anytime and anywhere, which is currently implemented as a black box.

Various attempts have been made to apply such a black box related function to a safety device worn by a user. In this regard, conventionally, there is a problem in that the black box is separately mounted to a peripheral device other than a safety device worn by a user, or the viewing angle is limited to the front.

The present invention has been made to solve the above-described problems, an object of the present invention is to shoot the omnidirectional image and transmit the photographed omnidirectional image to an external device when an emergency situation occurs to inform the emergency situation and provide feedback to the user The present invention provides a device having a camera lens module for photographing an omnidirectional image, and a control method thereof.

According to an embodiment of the present invention, a device having a camera lens module for photographing omnidirectionally has a convex first incidence surface formed on one surface thereof, a first outgoing surface formed on the other surface thereof, and a first reflective surface in the center of the first incidence surface thereof. The first lens is formed and a second incident surface is formed on one surface and a second reflective surface is formed on the other surface is convex, and a second lens having a second exit surface is formed in the center of the second reflection surface, the first lens The lens and the second lens are formed of the same material, the first exit surface is concave, the second entrance surface is convex, and the radius of curvature of the first exit surface and the second entrance surface are the same. An image pickup unit including a lens module that is bonded to each other and is capable of capturing omnidirectional images; A storage unit for storing the photographed omnidirectional image; A device having a camera lens module for sensing an object within a preset range within the photographed omnidirectional image and feeding back and displaying the object may be provided.

In addition, in the apparatus having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, a convex first incident surface is formed on one surface, a first exit surface is formed on the other surface, and a first half at the center of the first incident surface. A first lens having a slope formed thereon, and a second lens having a second incident surface formed on one surface thereof, a second reflective surface formed on the other surface thereof, and a second lens having a second exit surface formed at the center of the second reflective surface; The first lens and the second lens are formed of the same material, the first exit surface is concave, the second entrance surface is convex, and the radius of curvature of the first exit surface and the second entrance surface is the same. An imaging unit including a lens module formed and bonded to enable omnidirectional image capturing; A microphone unit for receiving sound; A storage unit for storing the photographed omnidirectional image and sound; A speaker unit for outputting an audio signal; And when it is determined that at least one object enters a predetermined speed or more within a preset range within the photographed omnidirectional image, a point in time at which the at least one object enters within the preset range and then outside the preset range. And a processor for storing the photographed omnidirectional image and the received external sound to the storage unit and providing visual feedback and auditory feedback through the light source unit and the speaker unit. An apparatus having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention may include: a support including a rear opening through which a user's head is drawn and a face opening through which a face part of the head is exposed; A face mask movable in combination with the support to cover or expose the face part; An endothelial disposed inside the support; And a capturing unit including a lens module capable of capturing an omnidirectional image, a storage unit storing the captured omnidirectional image, and disposed between the support and the endothelium, wherein the user's head according to the user's wearing is formed while pressing the endothelium. And a pressure sensor unit for sensing pressure, a processor for storing the omnidirectional image from the imaging unit in the storage unit, and a power supply unit for supplying power to the imaging unit, the storage unit, and the processor; In addition, the power supply unit may provide an apparatus having a camera lens module for photographing the omnidirectional power output when sensing the pressure through the pressure sensor unit.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the system board further comprises a wireless charging unit for receiving a wireless power from the outside to charge the battery of the power supply, the wireless charging unit When sensing the pressure through the pressure sensor unit may provide a device having a camera lens module for photographing the omni-directional to stop wireless charging.

In addition, in the apparatus having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the face mask is disposed on the face opening to move the face mask to turn on or turn by the face mask when the face opening is covered or exposed Further comprising a; off the mask opening and closing detection switch, the system board to provide an apparatus having a camera lens module for photographing the omnidirectional further comprising a mask opening and closing detection unit for detecting the turn on or off of the mask opening and closing detection switch. It may be.

In addition, in the apparatus having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, the system board is controlled by the processor and installed on the support to turn on or turn off the mask opening and closing detection switch of the mask opening and closing detection unit It is also possible to provide a device having a camera lens module for photographing the omni-directional further comprising a speaker unit for adjusting the output sound in response to the detection of the off.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the system board to remove the noise of the sound introduced in accordance with the detection of the turn on or off of the mask opening and closing detection switch of the mask opening and closing detection unit It is also possible to provide a device having a camera lens module for photographing the omni-directional further comprising a microphone to be controlled.

In addition, in the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, the processor is a camera for photographing the omnidirectional storing the frame image of the unit of minutes from the omnidirectional image photographed from the imaging unit It is also possible to provide a device having a lens module.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the system board further includes a shock detection unit for detecting an applied impact and a gyro sensor for detecting the rotation angle, the processor It is also possible to provide a device having a camera lens module for photographing the omni-directional to store the patterned rotation angle stored in the storage unit.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the system board further comprises a communication unit for communicating with an external device, the processor is the detected shock is more than a predetermined value When the detected rotation angle is different from the rotation angle pattern stored in the storage unit before the shock signal is detected, a difference of more than a predetermined value occurs, and transmits the frame image of the minute unit stored in the storage unit to the external device through the communication unit. It is also possible to provide a device having a camera lens module for photographing the omnidirectional.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the system board further comprises a light source unit and a microphone unit for receiving sound from the outside, a speaker unit for outputting the sound stored in the storage unit; If it is determined that at least one object enters a predetermined speed or more within a preset range within the photographed omnidirectional image, the processor sets the preset value from the time when the at least one object enters within the preset range. Camera lens module for storing the captured omnidirectional image and the external sound received through the microphone unit to the point of time out of range, and capture the omnidirectional image providing visual feedback and auditory feedback through the light source unit and the speaker unit. To provide a device with It may be.

In addition, in the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, the system board further comprises a GPS (Global Positioning System) unit for calculating position information, the processor, the stored omnidirectional image, It is also possible to provide a device having a camera lens module for photographing the omnidirectional for transmitting the external sound and the location information to the external device.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the processor, based on at least one of the size, the movement speed and the direction of movement of the object is set whether or not the collision with the object A device having a camera lens module for determining the rating and capturing omnidirectionally providing the visual feedback and the auditory feedback differently according to the determined rating may be provided.

In addition, in the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, the system board further comprises an input unit for receiving a user operation, the processor, according to the user operation, the photographed omnidirectional It is also possible to provide an apparatus having a camera lens module for capturing the omnidirectional image storing the image and the received external sound in the storage.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the processor, at least one of the fire, smoke, natural disasters, vehicle accidents and life accidents occur in the photographed omnidirectional image If it is determined, the apparatus may be provided with a camera lens module for capturing the omnidirectional image, characterized in that the captured omnidirectional image is stored in the storage unit and transmitted to the external device.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the processor, the captured omnidirectional image and the pre-stored image about the fire, smoke, natural disasters, vehicle accidents and life accidents It is also possible to provide a device having a camera lens module for photographing the omnidirectional to determine whether or not to occur.

In addition, in the apparatus having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the lens module, a convex first incident surface is formed on one surface, the first exit surface is formed on the other surface, the first incident A first lens having a first reflective surface formed in the center of the surface thereof, a second incident surface formed on one surface thereof, and a second reflective surface formed with a convex shape formed on the other surface thereof, and a second lens having a second exit surface formed at the center of the second reflective surface formed thereon; Wherein the first lens and the second lens are formed of the same material, the first emission surface is concave, the second entrance surface is convex, the first emission surface and the second entrance surface. The radius of curvature of the same may be provided with an apparatus having a camera lens module for photographing the same omnidirectional bonding.

In addition, in the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention, the radius of curvature of the first incident surface is 21mm to 23mm, the radius of curvature of the second reflective surface is 10mm to 12mm, A device having a camera lens module having a radius of curvature of the first exit surface and the second entrance surface is 29 mm to 31 mm to photograph an omnidirectional image in which focal points are not formed on the joint surfaces of the first lens and the second lens. You can also provide

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the imaging unit, to provide a device having a camera lens module for photographing the omnidirectional located in the rear region from the center of the upper end of the support. It may be.

In addition, in the device having a camera lens module for photographing the omni-directional according to an embodiment of the present invention, the imaging unit includes a plurality of lens modules, each of the plurality of lens modules, the front, rear, left and right sides of the support. It is also possible to provide a device having a camera lens module for photographing the omnidirectional position located in each.

According to various embodiments of the present disclosure as described above, a device having a camera lens module for capturing omnidirectional images may be automatically threatened to the user while capturing omnidirectional images to automatically capture a photographed image and the user. By providing feedback to the user, the user can prevent accidents in advance.

In addition, in case of a user's emergency, it can be notified to an external server so that a user can quickly handle an emergency.

1A is a diagram illustrating an apparatus including a camera lens module for photographing omnidirectional according to a first embodiment of the present invention.

FIG. 1B is a block diagram showing the configuration of a system board for driving an apparatus having a camera lens module for photographing omnidirectional according to the first embodiment.

1C is a detailed configuration diagram of the light source unit.

2 is a view illustrating a omnidirectional image according to an embodiment of the present invention.

3 is a block diagram illustrating a detailed configuration of a system board of an apparatus having a camera lens module for photographing omnidirectional according to a first embodiment of the present invention.

4 and 5a illustrate detailed configurations of a lens module capable of capturing an omnidirectional image according to an embodiment of the present invention.

FIG. 5B illustrates the path of the light beam incident on the omnidirectional lens module.

6 and 7 are views illustrating positions of lens modules disposed in a device having a camera lens module for photographing omnidirectional according to another embodiment of the present invention.

8 is a flowchart illustrating a control method of an apparatus having a camera lens module for photographing omnidirectional according to an embodiment of the present invention.

9A is a configuration diagram of a system board of an apparatus having a camera lens module for photographing omnidirectional according to a second embodiment of the present invention.

9B is a detailed configuration diagram of the pressure sensor unit and the power supply unit.

9C is a view for explaining the principle that the pressure is applied to the device having a camera lens module for photographing the omnidirectional.

10A is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a third embodiment of the present invention.

10B is a detailed configuration diagram of a wireless charging unit and a power supply unit.

11A is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a fourth embodiment of the present invention.

11B is a view illustrating a principle of mask opening and closing detection.

12A is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a fifth embodiment of the present invention.

12B is a detailed configuration diagram of the pressure sensor unit.

FIG. 13 is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a sixth embodiment of the present invention.

14 is a block diagram of a safety system having a device with a camera lens module for photographing the omnidirectional according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail. In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the present invention, and may vary according to intention or relationship of a user or an operator. Therefore, the definition should be made based on the contents throughout the specification.

FIG. 1A is a view illustrating a device having a camera lens module for photographing omnidirectional according to a first embodiment of the present invention, and FIG. 1B is a view illustrating a device having a camera lens module for photographing omnidirectional according to a first embodiment. This is a block diagram showing the configuration of a system board. 1C is a detailed configuration diagram of the light source unit.

1A and 1B, the apparatus 100 having a camera lens module for photographing an omnidirectional image includes a rear opening 100c through which a user's head is drawn and a face opening 100d through which a face part of the head is exposed. The support 100b and the support 100b are coupled to each other, and a face mask 100e made of a transparent plastic material to secure a user's field of view, a lens module 110a installed on the support 100b, and the support ( It may be installed on the bottom rear portion of the 100b, and may include a system board 1000 embedded in the support (100b).

In addition, the face mask 100e is movable in combination with the support 100b to cover or expose the face of the user.

The system board 1000 includes an image capturing unit 110, a microphone unit 190, a storage unit 120, a light source unit 130, a speaker unit 140, and a processor for capturing an image received from the lens module 110a. 150 and the power supply unit 300 may be included.

Here, the device 100 having a camera lens module for photographing the omnidirectional includes all wearable caps capable of capturing an image through the lens module 110a and storing the photographed image. A helmet, a helmet used in a baseball game, a safety helmet worn in an industrial site, and a general hat may be implemented.

The imaging unit 110 may capture an image from the lens module 110a capable of capturing the omnidirectional image. Here, the omnidirectional image may include all images that can be photographed 360 degrees around the lens module 110a. The lens module 110a capable of capturing the omnidirectional image may include a plurality of lenses, which will be described later with reference to FIGS. 4 and 5.

In addition, the microphone 190 may receive external sound. Here, the external sound may include not only the voice of the user but also all kinds of sounds generated from the outside. In addition, the microphone 190 may be implemented as a removable structure inside the device 100 having a camera lens module for photographing the omnidirectional, and may be mounted in the form of a built-in jaw portion of the helmet.

The storage unit 120 may store the omnidirectional image captured by the imaging unit 110 and the external sound received through the microphone 190. Here, the storage unit 120 may sort and store the photographed omnidirectional image by year, date, and time, and insert a search tag to be used for a later search.

In addition, the storage unit 120 may separately store the image photographed by the imaging unit 110 by one frame for each minute.

The light source unit 130 includes a converter unit 132 for applying a DC signal to the light source 131 by changing the level of the DC signal input from the light source 131 and the power supply unit 300 as shown in FIG. 1C. can do. The converter unit 132 may be a direct current DC converter, and adjusts the level of the DC signal input from the power supply unit 300 based on the light source control signal from the processor 150 to output to the light source 131. Can be.

The light source 131 may be a light-emitting diode (LED), may include a plurality of LEDs, and the plurality of LEDs may display different colors.

In addition, the speaker unit 140 may output a sound signal.

If it is determined that the at least one object enters a predetermined speed or more within a preset range within the omnidirectional image captured by the lens module 110a, the processor 150 starts from the time when the at least one object enters the preset range. The omnidirectional image and the received external sound photographed up to a point outside the preset range may be stored in the storage 120.

For example, if it is determined that the car enters more than 10 kilometers per hour within a radius of 3 meters within the captured omnidirectional image, the processor 150 may move from the time when the vehicle enters within a radius of 3 meters to a time outside the range of 3 meters. The captured omnidirectional image and the received external sound may be stored in the storage 120. Herein, the object is a car, but it has been described as an example, but the object may be a person, an animal, an object, etc. in addition to the car, and the object may include all objects that are moving.

In addition, the processor 150 may provide visual feedback and auditory feedback through the LED unit 130 and the speaker unit 140.

For example, when the processor 150 determines that the object is entering a predetermined speed or more within a preset range, the processor 150 may drive a red LED indicating an emergency situation through the LED unit 130. If it is determined that it is out of the set range can be driven through the LED unit 130 of the green color indicating that the safe situation. The color of these LEDs allows the user to determine if he or she is currently in a dangerous situation, and at the same time, to alert those around him that he or she is in a dangerous situation.

In addition, when it is determined that the object enters the predetermined speed or more within the preset range, the processor 150 may output an alarm sound informing of the emergency situation through the speaker unit 140.

2 is a view illustrating a omnidirectional image according to an embodiment of the present invention.

Referring to FIG. 2, an image photographed 360 degrees around the lens module 110a is illustrated. Referring to the photographed image, the user wearing the device 100 having a camera lens module for photographing the current omnidirectional can be seen that you are crossing the crosswalk.

At this time, the processor 150 is an object at a predetermined speed or more within the preset range (1) centering on the lens module (110a) included in the device 100 having a camera lens module for photographing the user wearing the omnidirectional. It may be determined whether to enter.

When the processor 150 determines that the car 2 enters the preset range 1 or more at a preset speed, the processor 150 determines that the vehicle 2 enters the preset range 1. The omnidirectional image and the received external sound captured from the viewpoint to the point of time outside the preset range 1 may be stored in the storage 120.

In addition, when the processor 150 determines that the vehicle 2 is entering a preset speed or more within the preset range 1, the visual feedback is performed through the light source unit 130 and the speaker unit 140 as described above. And by providing the auditory feedback, a user wearing the device 100 having a camera lens module for photographing the omnidirectional can be made aware of the danger.

Of course, the processor 150 may enter the speed of the car 2 even if the car 2 does not enter the preset range 1, or even if the car 2 enters the preset range 1. If it is not abnormal, it may be determined that it is not a dangerous situation. Accordingly, the captured omnidirectional image may not be stored in the storage unit 120, and visual feedback and auditory feedback may not be provided to the user.

Meanwhile, the processor 150 determines at least one of the size, the movement speed, and the movement direction of the object in the captured omnidirectional image, and determines whether or not the collision with the object is based on at least one of the determined size, the movement speed, and the movement direction. Can be determined for each preset level. In addition, the processor 150 may provide the visual section feedback and the auditory feedback differently according to the determined grade.

That is, the processor 150 may analyze the omnidirectional image photographed for each time to determine the size, movement speed, and direction of the object in the omnidirectional image, and determine the size, movement speed, and direction of the object. On the basis of this, it is possible to predict whether the collision with the user wearing the device 100 having the camera lens module for photographing the object and the omnidirectional.

In addition, the processor 150 may determine whether the collision with the user wearing the device 100 having the camera lens module photographing the object and the omnidirectional one of the predetermined grade, for example, upper, middle, lower grade. have.

For example, when it is determined that the collision is a phase grade, the processor 150 may store the captured omnidirectional image in the storage unit 120, drive a red LED indicating an emergency situation, and output an alarm sound. have.

In addition, when it is determined whether the collision is a medium grade, the processor 150 may store the photographed omnidirectional image in the storage unit 120 and drive a yellow color LED indicating that the situation should be alerted.

In addition, if it is determined that the collision is a lower grade, the processor 150 may drive the green color LED indicating that the safe situation without storing the captured omnidirectional image in the storage 120.

3 is a block diagram illustrating a detailed configuration of a system board of an apparatus having a camera lens module for photographing omnidirectional according to a first embodiment of the present invention.

Referring to FIG. 3, the system board 1000 of the apparatus 100 having a camera lens module for photographing omnidirectional according to the first embodiment of the present invention may include an imaging unit 110, a storage unit 120, and a light source unit ( 130, the speaker unit 140, the processor 150, and the power supply unit 300 may further include a communication unit 160, a GPS (Global Positioning System) unit 170, and an input unit 180.

Here, the communication unit 160 may communicate with an external device. The external device may be implemented as a server, a user terminal device, a notebook computer, a desktop computer, a PDA, etc. The communication unit 160 may communicate with the external device through at least one of a wireless communication method and a wired communication method.

In addition, the GPS unit 170 may calculate location information of the device 100 having the camera lens module photographing the omnidirectional image. Specifically, the GPS unit 170 may calculate the position information of the device 100 having the camera lens module to photograph the omnidirectional by the GPS sensor built in the GPS unit 170, and this calculation process is well known Since it is a well-known technique, detailed description is abbreviate | omitted.

In addition, the processor 150 converts the location information of the device 100 including the omnidirectional image, the external sound, and the omnidirectional image calculated by the GPS unit 170 into the external device stored in the storage unit 120 to the external device. Can transmit

The external device that receives the location information of the device 100 including the omnidirectional image and the camera lens module for capturing the omnidirectional image is a device having a camera lens module for capturing the omnidirectional image at the time when the omnidirectional image is captured. The location information of the 100, the omnidirectional image, and the received external sound may be classified into a year, date, time, region, and the like by storing a database.

In addition, the storage unit 120 may separately store the image photographed by the imaging unit 110 by one frame for each minute.

In addition, in the case of an external device having a display unit (not shown), the external device may allow the user to monitor the received omnidirectional image through the display unit (not shown).

In addition, in the case of an external device having a display unit (not shown), the external device may receive a preview image captured in real time through the image capture unit 110 of the device 100 having a camera lens module for capturing the omnidirectional image. It may be displayed through a display unit (not shown). Accordingly, the user can check the image captured by the imaging unit 110 in real time through the display unit (not shown) of the external device while wearing the device 100 having the camera lens module for photographing the omnidirectional. have.

In detail, the processor 150 may transmit an image captured by the imaging unit 100 to an external device through the communication unit 160, and the user may access the user interface screen displayed on a user terminal device (not shown). An image captured by the device 100 having the camera lens module for photographing the omnidirectional image may be transmitted to an external device.

In this case, the user terminal device (not shown) may display a user interface screen for controlling the device 100 having the camera lens module for photographing the omnidirectional, such a user interface screen is a camera lens module for photographing the omnidirectional Various functions for controlling the device 100, for example, to perform omnidirectional image capture, external sound reception, storage of captured images and received external sound within a preset time, monitoring function, and warning message display function. It may include a graphical user interface.

In addition, the input unit 180 may receive a user manipulation. In addition, the processor 150 may store the captured omnidirectional image and the received external sound in the storage 120 according to a user manipulation.

That is, the processor does not store the photographed omnidirectional image only when it is determined that at least one object enters the predetermined speed or more within a preset range within the photographed omnidirectional image, but through the input unit 180. The omnidirectional image taken when the operation was entered And a received external sound.

Accordingly, the processor 150 may store the captured image and the received external sound in the time interval set according to the user's manipulation.

In this way, the user may capture and store a desired captured image and an external sound within a desired time period in a desired time zone.

Meanwhile, when it is determined that at least one of fire, smoke, natural disaster, vehicle accident, and human accident occurs in the captured omnidirectional image, the processor 150 stores the photographed omnidirectional image in the storage unit 120 and stores the external device. Can be sent to.

In detail, the processor 150 may determine whether or not an occurrence occurs by comparing the photographed omnidirectional image with previously stored images related to fire, smoke, natural disaster, vehicle accident, and human accident.

For example, when a red color of flame and smoke is included in the captured omnidirectional image, the processor 150 compares the pre-stored image of the fire and smoke with the captured image and the pre-stored image of the fire and smoke. If the degree of similarity is greater than or equal to a preset threshold, it may be determined that there is a fire and smoke situation within the currently captured omnidirectional image, the captured omnidirectional image may be stored in the storage 120, and transmitted to an external device.

4 and 5A illustrate detailed configurations of a lens module capable of capturing an omnidirectional image according to an embodiment of the present invention. 5B illustrates a movement path of light rays incident on the omnidirectional lens module. Referring to FIG. 4, the lens module has a convex first incidence surface 11 formed on one surface thereof, and a first emission surface 13 on the other surface thereof. ) Is formed, the first lens 10 having the first reflective surface 15 formed at the center of the first incident surface 11, and the second reflective surface having the second incident surface 21 formed on one surface thereof and convex on the other surface thereof. 23 is formed, and includes a second lens 20 having a second emission surface 25 formed at the center of the second reflection surface 23, and the first lens 10 and the second lens 20 It is formed of the same material, the first exit surface 13 is formed concave, the second incident surface 21 is formed convex, the radius of curvature of the first exit surface 13 and the second incident surface 21 is The same is formed and joined.

Here, the first lens 10 and the second lens 20 are reflective refraction lenses using reflection and refraction of light rays, and acquire 360-degree omnidirectional images through the first lens 10 and the second lens 20. can do.

In addition, a material capable of reflecting visible light, for example, aluminum or silver, may be coated on the first reflective surface 15 and the second reflective surface 23, and the first reflective surface 15 may be coated. Although the second emission surface 25 is concave and convex, respectively, in FIG. 4, this is only one embodiment, and the first reflection surface 15 and the second emission surface 25 may both be flat. The first reflecting surface 15 and the second emitting surface 25 may be embossed and concave, respectively.

The first lens 10 is a lens in which external light rays are incident, and the first incident surface 11 is formed to be convex on one surface thereof, and the external light rays are incident through the first incident surface 11. In addition, a first emission surface 13 is formed on the other surface of the first lens 10, and light rays incident on the first entrance surface 11 are emitted to the first emission surface 13. In addition, the first reflective surface 15 is formed in the center of the first incident surface 11.

The second lens 20 is a lens that is bonded to the first lens 10. Specifically, a second incident surface 21 is formed on one surface of the second lens 20, and the second incident surface 21 is formed. It joins with this 1st output surface 13. A second convex reflective surface 23 is formed on the other surface of the second lens 20, and a second light beam incident through the first incident surface 11 at the center of the second reflective surface 23 can emit light. An exit surface 25 is formed.

The radius of curvature of the first incident surface 11 is 21 mm to 23 mm, and the radius of curvature of the second reflective surface 23 is 10 mm to 12 mm, and the first exit surface 13 and the second incident surface 21 The radius of curvature is formed to be 29mm to 31mm so that the focal point is not formed on the bonding surface of the first lens and the second lens.

Specifically, in the case of the lens module mounted on the imaging unit 110 of the apparatus 100 having the camera lens module for photographing the omnidirectional, the radius of curvature of the first exit surface 13 and the second incident surface 21 is It is appropriate that the thickness is 30mm, but may include a radius of curvature of 29mm to 31mm due to manufacturing tolerances (± 1mm). Here, when the radius of curvature of the first exit surface 13 and the second entrance surface 21 is greater than 31 mm, the size of the second lens 20 is increased, and when smaller than 29 mm, the convexity is increased. There arises a problem that lens processing becomes difficult.

In addition, the radius of curvature of the first incident surface 11 is suitably 21 to 23 mm. Since the radius of curvature of the first incident surface 11 is formed to be 21 to 23 mm, a field of view may be secured in the range of 40 ° to 85 °.

Here, when the radius of curvature of the first incident surface 11 deviates from 21 to 23 mm, shielding may occur at the second emission surface 25, thereby preventing a proper angle of view. Specifically, since the degree of refraction of the light incident on the first incident surface 11 is different according to the wavelength, when the radius of curvature of the first incident surface 11 deviates from the above radius of curvature, the light of some wavelengths is emitted to the second. There is a problem that can not secure the intended angle of view because it does not exit to the surface (25).

Therefore, in consideration of manufacturing tolerances (± 1mm), it is most appropriate to manufacture the radius of curvature of the first incident surface 11 to 22 mm.

On the other hand, the radius of curvature of the second reflective surface 23 is appropriately 10 to 12mm. If the radius of curvature of the second reflecting surface 23 is not formed to 10 to 12mm, shielding may occur in the first reflecting surface 15, thereby preventing a proper angle of view.

Therefore, in consideration of manufacturing tolerances (± 1mm), it is most appropriate to manufacture the radius of curvature of the second reflective surface 23 to 11 mm.

In addition, when the first lens 10 and the second lens 20 are made of the same material, refraction does not occur between the first lens 10 and the second lens 20. When bonding the first lens 10 and the second lens 20, a UV bond is used. The UV bond refers to a bond that is hardened by applying UV (Ultraviolet Ray). The UV bond has a refractive index of 1.5, similar to that of glass, and has good transmittance characteristics in the visible light region, and does not affect light in the visible light region (wavelengths of 400 nm to 700 nm). A representative example of such a UV bond is Balsam.

As described above, when the first lens 10 and the second lens 20 are bonded together, the light incident on the first lens 10 is focused once inside the first lens 10 or the second lens 20. Conclude. In addition, when the focal point is formed at the bonding surface of the first lens 10 and the second lens 20, scattering may occur and affect the sharpness of an image formed on the image sensor.

When the first lens 10 and the second lens 20 have the radius of curvature as described above, the focal point is not formed at the bonding surface of the first lens 10 and the second lens 20 to prevent scattering of light. can do.

On the other hand, the material of the lens in the optical field is largely divided into low refractive index crown series and high refractive index low dispersion Flint series. Abbe's number is the inverse of the variance, and the Abbe number 50 or more is called the crown series and the Abbe number 50 or less is called the flint series.

The lens module according to an embodiment of the present invention covers a visible light region having a wavelength of 400 nm to 700 nm, and thus it is necessary to use a combination of a crown-based lens and a flint-based lens to correct chromatic aberration.

Meanwhile, referring to FIGS. 5A and 5B, the lens module includes a plurality of lenses disposed below the second emission surface 25 in addition to the first lens 10 and the second lens 20 (hereinafter, referred to as a relay lens unit). It can be configured to include more). The plurality of lenses of the relay lens unit are arranged in a row while forming the same optical axis, and as described above, a lens of a crown series and a flint series are combined to correct chromatic aberration. For example, the crown series may be made of NBK7 material, the flint series may be made of NSF15, NSF8 material. As such, when the material of the lens is limited to three types, the kind of material can be reduced, which is advantageous for mass production.

In addition, as illustrated in FIG. 5A, the relay lens unit may be configured using the third lens 30 to the ninth lens 90.

In FIG. 5A, C means a lens of a crown-based material, and F means a material of a flint-based material.

When arranging a plurality of lenses of the relay lens unit, there is a problem that it is difficult to accurately match the optical axis of the lens when two different types of lenses are successively bonded twice.

For example, when the fifth convex lens 50 of the crown series, the sixth concave lens 60 of the flint series, and the seventh convex lens 70 of the crown series are continuously bonded to each other, the fifth lens 50 and the fifth lens 50 are formed. When the bonding surfaces of the six lenses 60 and the bonding surfaces of the sixth lens 60 and the seventh lens 70 are completely bonded to each other, it is difficult to measure the eccentricity and it is difficult to align the optical axis between the lenses.

However, as illustrated in FIG. 5A, the fifth lens 60 and the sixth lens 60 have different curvature radii, and the fifth lens 50 and the fifth lens 50 are formed in an edge contact method that contacts only the edge of the lens. By bonding only the edges of the six lenses 60, the measurement of the eccentricity can be facilitated, and the optical axis between the lenses can be easily adjusted.

When the fifth lens 50 and the sixth lens 60 are bonded by the edge contact method, a space of a predetermined interval is formed between the fifth lens 50 and the sixth lens 60, and the space of the space is If it is formed too large or too small, the image formed on the image sensor may be misaligned and a proper angle of view may not be obtained. In order to prevent this, the radius of curvature of the fifth lens 50 and the radius of curvature of the sixth lens 60 should be appropriately selected and manufactured.

In addition, the relay lens unit may further include a shutter-type infrared filter 100. The infrared filter 100 may be closed to block infrared rays, and the infrared filter 100 may be opened to pass infrared rays.

As shown in FIG. 5A, the infrared filter 100 has an advantage of being more convenient in manufacturing than being disposed between the plurality of lenses of the relay lens unit.

6 and 7 are views illustrating a position of a lens module disposed in a device having a camera lens module for photographing omnidirectional according to another embodiment of the present invention.

Referring to FIG. 6, the imaging unit 110 is located in the rear region from the center of the top of the apparatus 100 having the camera lens module for photographing the omnidirectional image. Here, the reason why the imaging unit 110 is located in the rear region from the center of the upper end of the support 100b of the apparatus 100 having the camera lens module for photographing the omnidirectional is the apparatus having the camera lens module for photographing the omnidirectional ( This is to secure a space in which the face mask 100e constituting 100 is moved.

However, when the image capturing unit 110 is detachable to the apparatus 100 having the camera lens module for capturing the omnidirectional image, the image capturing unit 110 necessarily includes the device 100 having the camera lens module capturing the omnidirectional image. It is not necessary to be located in the rear region from the top center, but may be located in the top center of the device 100 having a camera lens module for photographing the omnidirectional. In this case, when the user raises the face mask 100e of the device 100 having the camera lens module for photographing the omnidirectional image, the user may remove the imaging unit 110.

In addition, the speaker unit 140 may be provided at the joint 100f of the face mask 110e and the support 100b. As described above, the processor 150 alerts the user through the speaker unit 140. It can sound.

In addition, the input unit 180 provided at the bottom of the device 100 having the camera lens module for photographing the omnidirectional can receive a user operation, and accordingly, the processor 150 is photographed according to the input user operation. The omnidirectional image may be stored, the stored image may be transmitted to an external device, and other functions may be matched to user operations.

Meanwhile, referring to FIG. 7, unlike FIG. 6, the imaging unit 110 includes a plurality of lens modules, and each of the plurality of lens modules 110a, 110b, and 110c includes a camera lens module for photographing an omnidirectional image. It may be located on the front, rear, left side and right side of the 100, respectively.

In particular, in FIG. 7, the lens module is not positioned on the right side of the device 100 having the camera lens module for photographing omnidirectional, but the device having the camera lens module for photographing the omnidirectional lens module 110c. It may be located on the right side as it is located on the left side of the.

As shown in FIG. 7, when the plurality of lens modules 110a, 110b, and 110c are present on each side of the device 100 including the camera lens module for photographing the omnidirectional image, the processor 150 omnidirectional images at different positions. It can be obtained, it is possible to create a more three-dimensional, precise and wide view angle image.

On the other hand, the input unit 180 provided at the bottom of the device 100 having a camera lens module for photographing the omnidirectional can receive a user operation, accordingly, the processor 150 is photographed according to the input user operation The omnidirectional image may be stored, the stored image may be transmitted to an external device, and other functions may be matched to user operations.

6 and 7, the memory card slot corresponding to the storage unit 120, the GPS sensor corresponding to the GPS unit 170, the plurality of LEDs corresponding to the LED unit 130, and the communication unit 160. Antennas, etc.) may also be provided in the device 100 having the camera lens module for photographing the omnidirectional or attached to the outside.

In addition, in FIG. 7, the plurality of lens modules 110a, 110b, and 110c are positioned on all of the front, rear, right side, and left side of the apparatus 100 having the camera lens module for photographing the omnidirectional image. And it may be located only on the rear side, may be located only on the right side and left side, the position of such a lens module is changeable.

8 is a flowchart illustrating a control method of an apparatus having a camera lens module for photographing omnidirectional according to an embodiment of the present invention.

According to the method illustrated in FIG. 8, in a method of controlling an apparatus including a camera module for capturing omnidirectional images, including a lens module capable of capturing omnidirectional images and a microphone unit for receiving external sound, photographs omnidirectional images (S810). .

In operation S820, it is determined that at least one object enters a preset speed or more within a preset range within the captured omnidirectional image.

In operation S830, the captured omnidirectional image and the received external sound are stored from the time when the at least one object enters within the preset range to the time when the at least one object enters the preset range.

Thereafter, visual feedback and auditory feedback are provided (S840).

On the other hand, the control method of the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention performing a communication with an external device, calculating the position information of the device having a camera lens module for photographing the omnidirectional The method may further include transmitting the stored omnidirectional image, external sound, and location information to the external device.

In addition, determining (S820), based on at least one of the size, the movement speed and the movement direction of the object to determine whether or not the collision with the object for each of the predetermined class, and providing (S840), the determined level Accordingly, visual feedback and audio feedback may be provided differently.

In operation S830, when a user operation is input, the captured omnidirectional image and the received external sound may be stored according to the user operation.

On the other hand, the control method of the device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention is determined that at least one of fire, smoke, natural disasters, vehicle accidents and life accidents occur in the photographed omnidirectional image The method may further include storing the captured omnidirectional image and transmitting the captured omnidirectional image to an external device.

In the determining of whether at least one of fire, smoke, natural disaster, vehicle accident, and human life accident occurs, the captured omnidirectional image is compared with pre-stored images of fire, smoke, natural disaster, vehicle accident, and human accident. It can be determined whether or not the occurrence.

Meanwhile, the lens module includes a first lens having a convex first incidence surface formed on one surface thereof, a first emission surface formed on the other surface thereof, and a first reflecting surface formed in the center of the first incident surface thereof and a second incident surface formed on one surface thereof. And a second reflective surface having a convex second reflection surface formed on the other surface, and having a second exit surface formed at the center of the second reflective surface, wherein the first lens and the second lens are formed of the same material. The exit surface may be concave, the second entrance surface may be convex, and the radius of curvature of the first exit surface and the second entrance surface may be the same, and may be joined.

The radius of curvature of the first incident surface is 21 mm to 23 mm, the radius of curvature of the second reflective surface is 10 mm to 12 mm, and the radius of curvature of the first exit surface and the second incident surface is 29 mm to 31 mm. The focal point may not be formed on the bonding surface of the lens and the second lens.

9A is a configuration diagram of a system board of an apparatus having a camera lens module for photographing omnidirectional according to a second embodiment of the present invention. 9B is a detailed configuration diagram of the pressure sensor unit and the power supply unit. 9C is a view for explaining the principle that the pressure is applied to the device having the camera lens module for photographing the omnidirectional.

The system board 100 of the device 101 with the camera lens module for photographing omnidirectional according to the second embodiment is the system board of the device 100 with the camera lens module for photographing omnidirectional according to the first embodiment. In the pressure sensor unit 210 may further include. In addition, since the second embodiment may have the same function as all components of the first embodiment except for the power supply unit 300 of the first embodiment, detailed description thereof will be omitted.

Referring to FIG. 9A, the pressure sensor unit 200 detects whether the user of the device 100 having the camera lens module photographing the omnidirectional device is worn by the user. can do. In addition, the pressure sensor unit 200 is connected to the bridge circuit 202 of the pressure sensor unit 200 on the system board 1000, the gauge 201 and the system board 1000 disposed in the upper region of the support (100b) And a bridge circuit 202 connected to the gauge 201.

The gauge 201 may be a metal wire strain gauge subjected to an external force pressure. The bridge circuit 202 may detect a change in resistance caused by the strain gauge and output different output voltages according to the change in resistance. Specifically, when an external force is applied to the load cell, the receiver is compressed to change the electrical resistance of the strain gauge in proportion to the external force. The change in the resistance value can be output by the bridge circuit 202 as a voltage.

The power supply unit 300 may include a battery management unit 301 and a battery 302, and the battery 302 may be charged by power supplied by an external wired or wirelessly. In addition, the battery manager 301 may function to adjust the power input to the battery 302 from a wire or wirelessly from the outside, and to control whether to output the power charged in the battery 302. Can be.

The battery manager 301 reads the value of the output voltage output from the bridge circuit 202 and controls whether or not the charged power of the battery 302 is output according to the output voltage of the bridge circuit 202. Can be. That is, when the pressure is formed by the external force, it is detected as the output voltage of the bridge circuit 202, so that the charging power is output from the battery 302, if there is no pressure by the external force, this is the case of the bridge circuit 202 By sensing the output voltage, charging power may not be output from the battery 302.

Specifically, the principle of applying pressure from the outside will be described in detail with reference to FIG. 9C. In FIG. 9C, a circle indicated by a dotted line is a diagram schematically showing the inside of the apparatus 101 having a camera lens module for photographing an omnidirectional image. When the user wears the device 101 having the camera lens module for photographing the omnidirectional image, the user may attach the device 101 to the endothelium 100a disposed inside the support 100b of the device 101 having the camera lens module for photographing the omnidirectional image. As the pressure of the user's head is applied in the direction of the arrow, the endothelial 100a may move as indicated by the dotted line, and pressure may be applied to the gauge 201 disposed between the endothelial 100a and the support 100b. Therefore, when the user wears the device 101 having the camera lens module for photographing the omnidirectional, pressure is applied to the gauge 210, and the user takes off the device 101 having the camera lens module for photographing the omnidirectional. Since no pressure is applied to the gauge 210, it may be determined whether power is output from the power supply unit 300 according to whether the device 101 including the camera lens module photographing the user's omnidirectional image is worn.

As such, before the user wears the device 101 having the camera lens module to photograph the omnidirectional power, the power charged in the battery 302 of the power supply unit 300 uses only the minimum power for driving the pressure sensor unit 200. In addition, after the user wears the device 101 having the camera lens module to photograph the omnidirectional power, the power charged in the battery 302 of the power supply unit 300 may be used to operate all the components other than the pressure sensor unit 200. In this way, waste of power of the battery 302 can be prevented.

On the other hand, it is described that the wearing of the device 101 having a camera lens module for photographing the user's omnidirectional based on the operation of the metal wire strain gauge, but is not limited to this, if any configuration that can measure the pressure May be possible.

In addition, according to FIG. 9A, the system board 1000 of the apparatus 101 including the camera lens module for photographing the omnidirectional according to the second embodiment includes a light source unit 130, a speaker unit 140, a GPS unit 170, and a microphone. It is not necessary to include all or part of the unit 190, but if included, the same function as described in the first embodiment can be performed.

10A is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a third embodiment of the present invention. 10B is a detailed configuration diagram of the wireless charging unit and the power supply unit.

The system board 1000 of the device 103 having a camera lens module for photographing omnidirectional according to the third embodiment is a wireless charging unit in the device 101 with a camera lens module for photographing omnidirectional according to the second embodiment. 400 may further include. In addition, since the third embodiment may have all the functions of the second embodiment except for the power supply unit 300 of the second embodiment, detailed description thereof will be omitted.

Referring to FIG. 10A, the system board 100 of the apparatus 103 having the camera lens module for photographing the omnidirectional orientation of the device having the camera lens module for photographing the omnidirectional according to the third embodiment is connected to the wireless charging unit 400. It may further include.

The wireless charging unit 400 is a wireless charging receiver, may receive the wireless power from the outside to charge the battery 302 of the power supply unit 300.

Referring to FIG. 10B, the wireless charger 400 may receive wireless power from an external transmitter 401 that generates wireless power. That is, the wireless charging unit 400 may receive an AC signal transmitted from the transmitter 401. The wireless charging unit 400 is a coil unit 410, a matching unit 420 for impedance matching, a first power converter 430 that can convert the AC signal input from the matching unit 420 into a DC signal. The second power converter 440 and the controller 450 may output the DC signal by changing the level of the DC signal input from the first power converter 430. The first power converter 430 may be referred to as a rectifier that rectifies an AC signal into a DC signal.

The coil unit 410 may receive power through a magnetic induction method or a magnetic resonance method. As such, it may include at least one of an induction coil and a resonant coil according to a power reception method. The coil unit 410 may be accommodated between the supporter 100b and the endothelium 100a.

The matching unit 420 performs impedance matching between the transmitter 401 and the wireless charging unit 400.

The first power converter 430 rectifies the AC signal output from the coil unit 410 to generate a DC signal. The second power converter 440 may adjust the level of the DC signal output from the first power converter 430 according to the capacity of the battery 302. In addition, the battery manager 301 may detect a charging state of the battery 302 and adjust a voltage and a current applied to the battery 302.

The controller 450 may be activated by the wake-up power from the transmitter 401, perform communication with the communication unit of the transmitter 401, and control the operation of the configuration constituting the wireless charging unit 400.

On the other hand, the control unit 450 of the wireless charging unit 400 may receive the output voltage of the bridge circuit 202 of the pressure sensor unit 200, the device 103 having a camera lens module for the user to shoot the omnidirectional When the output voltage is changed by wearing a wearer, the control unit 450 may detect this and stop the wireless power reception from the transmitter 401 or do not start the wireless power reception. This is to prevent the magnetic field of wireless power charging from affecting the user's head when the user wears the device 103 having the camera lens module for photographing the omnidirectional image.

In addition, according to FIG. 10A, the system board 1000 of the apparatus 103 having the camera lens module for photographing the omnidirectional according to the third embodiment includes a light source unit 130, a speaker unit 140, a GPS unit 170, and a microphone. It is not necessary to include all or part of the unit 190, but if included, the same function as described in the second embodiment may be performed.

11A is a block diagram of a smart helmet according to a fourth embodiment of the present invention. 11B is a view illustrating a mask opening and closing detection principle.

The device 104 including the camera lens module for photographing omnidirectional according to the fourth embodiment includes the mask opening / closing detection unit 500 in the device 101 including the camera lens module for photographing omnidirectional according to the second embodiment. It may further include.

Referring to FIG. 11A, the processor 150 of the apparatus 104 having the camera lens module for photographing the omnidirectional according to the fourth embodiment may check whether the face mask is closed through the mask opening / closing detection unit 500. .

When the processor 150 determines that the face mask is closed through the mask opening and closing detection unit 500, the processor 150 may reduce the sound to be output through the speaker unit 140 and output the same through the speaker unit 140. When it is determined that the face mask is opened through the mask opening and closing detection unit 500, the sound output through the speaker unit 140 may be amplified and output through the speaker unit 140. This is because when a user wearing a device 104 having a camera lens module for photographing an omnidirectional driving a motorcycle or the like with the face mask open, external noise flows in, and the sound output through the speaker unit 140 is output. In consideration of the fact that it is not recognized, the mask opening and closing detection unit 500 automatically adjusts the output sound of the speaker unit 140 according to whether the face mask is opened or closed, so that the user can accurately perceive the auditory feedback. You can do that.

However, the mask opening and closing detection unit 500 may detect whether the face mask is opened or closed only when a pressure caused by an external force is detected by the pressure sensor unit 200. That is, the mask opening and closing detection unit 500 may receive the output voltage of the bridge circuit 202 of the pressure sensor unit 200, and the user wears the device 104 having a camera lens module for photographing the omnidirectional image. When the output voltage is changed, the mask open / close detection unit 500 may perform a mask open / close detection operation.

In addition, when it is determined that the face mask is opened through the mask opening and closing detection unit 500, the processor 150 may remove the noise signal of the sound input through the microphone unit 190 and store the noise signal in the storage unit 120. This is because when the user wearing the device 104 having a camera lens module for photographing the omnidirectional driving a motorcycle with the face mask open, the external noise is greatly introduced, it is input through the microphone 190 It is necessary to eliminate the noise signal contained in the sound.

The processor 150 may include a band pass filter to remove the noise signal, and the band pass filter may filter external noise having a frequency band different from that of the voice signal.

However, the mask opening and closing detection unit 500 may detect whether the face mask is opened or closed only when a pressure caused by an external force is detected by the pressure sensor unit 200. That is, the mask opening and closing detection unit 500 may receive the output voltage of the bridge circuit 202 of the pressure sensor unit 200, and the user wears the device 104 having a camera lens module for photographing the omnidirectional image. When the output voltage is changed, the mask open / close detection unit 500 may perform a mask open / close detection operation.

In addition, the microphone unit 190 may include two microphone units, and one microphone unit may be disposed inside the device 104 having a camera lens module for capturing the omnidirectional image, and may receive a user voice. One may be disposed outside of the device 104 having a camera lens module for photographing the omnidirectional image to receive external sound. In this case, when the processor 150 determines that the face mask is opened through the mask opening and closing detection unit 500, the processor 150 inputs the microphone through the microphone unit disposed inside the device 104 having the camera lens module for photographing the omnidirectional image. The noise signal of the sound may be removed and stored in the storage 120.

As described above, only when it is determined that the face mask is opened through the mask opening and closing detection unit 500, the operation of removing the noise of the sound introduced through the microphone unit 190 is performed, which is unnecessary when the noise removal is not necessary. Power consumption can be prevented from occurring.

Referring to FIG. 11B, the support 100b of the apparatus 104 having the camera lens module for photographing omnidirectionally has a rear opening 100c into which a human head can be inserted and a camera lens module for photographing omnidirectionally. The face mask 100e of the device 104 including a face opening 100d for exposing a user's face when the device 104 is worn, and having a camera lens module for photographing an omnidirectional image is supported by a support ( Coupling to the joint 100f of 100b may cover the face opening 100d and is movable as indicated by the arrows in both directions. When the user wears the device 104 having the camera lens module for photographing all directions, and moves the face mask 100e to cover the face opening 100d, the face mask 100e faces the face of the support 100b. The mask opening / closing detection switch 510 may be turned on by pressing the mask opening / closing detection switch 510 disposed on the opening 100d as indicated by the arrow direction. The mask opening / closing detection unit 500 may detect that the face mask 100e is closed by detecting that the switch of the mask opening / closing detection switch 510 is turned on, and the switch of the mask opening / closing detection switch 510 is The face mask 100e may be opened by detecting that the face mask 100e is turned off.

On the other hand, the system board 1000 of the device 104 having the camera lens module for photographing the omnidirectional according to the fourth embodiment does not necessarily include all or part of the light source 130 and the GPS unit 170, but is included. In this case, the same function as described in the second embodiment may be performed.

In addition, the system board 1000 of the device 104 having the camera lens module for photographing the omnidirectional according to the fourth embodiment may further include the wireless charging unit 400 described in the third embodiment.

12A is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a fifth embodiment of the present invention. 12B is a detailed configuration diagram of the pressure sensor unit.

The device 105 including the camera lens module for photographing omnidirectional according to the fifth embodiment is the impact detecting unit 230 and the gyro in the device 104 having the camera lens module for photographing omnidirectional according to the fourth embodiment. The sensor 240 may further include.

The shock detector 230 may detect an external shock and output it to the processor 150.

In detail, the shock detector 230 amplifies the shock signal introduced through the microphone 231 with the amplifier 232, removes the noise through the low pass filter 233, and rectifies the comparator through the rectifier 234. By comparing the reference signal with the reference signal through 235, the shock detection signal according to the comparison result may be output to the processor 150. However, the present invention is not limited thereto, and the shock detection unit 230 may be configured of a known acceleration sensor to detect an impact based on a change amount of capacitance between two electrodes.

In addition, the gyro sensor 240 may detect the inertial force of the device 105 having the camera lens module for photographing the omnidirectional with an electrical signal, and may detect the rotation angle.

The processor 150 may detect a rotation angle of the device 105 having the camera lens module photographing the omnidirectional sensed by the seat 240 and store the pattern of the rotation angle. That is, when the user wearing the device 105 having the camera lens module for photographing the omnidirectional driving a two-wheeled vehicle, such as a motorcycle, the rotation angle detected in the normal driving is patterned and stored in the storage unit 120. Can be.

An operation process of the processor 150 according to an emergency will be described.

The emergency situation herein refers to a case where a user wearing a device 105 having a camera lens module for photographing an omnidirectional vehicle collides with an external object while driving a two-wheeled vehicle such as a motorcycle.

The processor 150 is a shock detected from the shock detection unit 230 is more than a predetermined value, the rotation angle of the device 105 having a camera lens module for photographing the omnidirectional detected by the gyro sensor 240 is a shock signal If the difference occurs more than a predetermined value compared with the rotation angle pattern stored in the storage unit 120 until the detection of, may be determined as an emergency situation.

That is, the processor 150 may recognize as an emergency situation when an ideal displacement of the rotation angle detected from the gyro sensor 240 is detected on the premise that an impact is detected through the impact detector 230. Thus, the processor 150 may be configured for an ideal displacement of the rotation angle detected by the gyro sensor 240 according to an accident-induced accidental behavior by a user wearing only the device 105 having a camera lens module which photographs only omnidirectionally. By making it negligible, it is possible to improve the accuracy of judgment in an emergency situation.

In addition, the processor 150 may transmit the minute frame image stored in the storage unit 120 to the external server through the communication unit 160. At this time, the external server may be a server such as a public office that has jurisdiction over the processing according to the emergency.

In this way, by minimizing the capacity of the minute frame image, i.e., the image file, which is transmitted to the external server, the transmission speed of the position information for the user of the device 105 having the camera lens module for capturing the omnidirectional image in an emergency situation can do.

In addition, after detecting the impact accurately detects the accident of the user wearing the device 105 having a camera lens module to shoot the omnidirectional by comparing the rotation angle pattern, and transmits the minute frame image to an external server, The minute frame image can quickly track the user's current location.

In addition, when the processor 150 determines that it is an emergency, the light is emitted in a predetermined color through the light source unit 130 so that an emergency is recognized from the outside, and the storage unit 120 through the speaker unit 140. By playing back the voice stored in advance, it is possible to induce the user of an emergency not to lose consciousness.

FIG. 13 is a block diagram of an apparatus including a camera lens module for photographing omnidirectional according to a sixth embodiment of the present invention.

Referring to FIG. 13, the apparatus 106 including the camera lens module for photographing omnidirectional according to the sixth embodiment of the present invention is an apparatus including a camera lens module for photographing omnidirectional according to the first to fifth embodiments. The image processing unit 800 may be further included in at least one embodiment of (100, 101, 103, 104, 105).

The image processor 800 may include a frame storage unit 810 and a frame comparator 820, and the frame storage unit 810 may store a previous frame image photographed by the image capture unit 110, and may store the frame. The comparator 820 may compare the current frame image photographed by the imaging unit 110 and the previous frame image stored in the frame storage unit 810 with each other, and transmit a comparison result to the processor 150. The image processor 800 may compare the gray level difference between a plurality of frame images by repeatedly performing the above-described operation.

When the gray level difference between the frames continuously exceeds the predetermined value for the predetermined time based on a plurality of comparison results received during the predetermined time from the image processor 800, the processor 150 will be described later. The warning message may be output through at least one of the wearable device 700, the light source unit 130, and the speaker unit 140. That is, a red display image is displayed through the wearable device 700, a specific warning sound signal or a vibration effect is generated, light of a specific color is emitted through the light source unit 130, or the speaker unit 140 is turned on. A predetermined warning sound signal can be output through this.

This is because the device 106 including the camera lens module for photographing the omnidirectional image is framed by the destruction of the support base, walls, and various natural and artificial structures, such as construction sites, fire suppression, and places where there is a risk of building collapse. When the user wears the embodiment in a place where the gradation difference may change rapidly, the user may be provided with a visual feedback and an audio feedback about an emergency situation. In particular, since the 360-degree camera can shoot 360 degrees, it is possible to quickly feed back to the user a dangerous situation occurring in a blind spot that is difficult to recognize the user's field of view.

Safety system 600 using a device having a camera lens module for photographing the omnidirectional according to an embodiment of the present invention device 100, 101 with a camera lens module for photographing the omnidirectional according to the first to fifth embodiments The apparatus 107 may further include a device 107 having a camera lens module and a wearable device 700 according to at least one of the embodiments 103, 104, and 105.

The wearable device 700 may be a band type that can be worn on a user's wrist or forearm. The wearable device 700 may include an output unit 710 and an input unit 720, the output unit 710 may include a display device, and the output unit 710 may vibrate to a user. It may include a vibration device for transmitting a specific message and a sound device for outputting a sound, the input unit 720 may input a command through a touch panel device and an input button that can recognize the user's touch. It may include an input button device.

The wearable device 700 may receive the omnidirectional image captured by the image capturing unit 110 of the device 107 including the camera lens module for capturing the omnidirectional image, and display the omnidirectional image through the output unit 710. In addition, when the light source 131 of the device 107 having the camera lens module for photographing the omnidirectional light is driven to emit light, the wearable device 700 may display a color of the same color through the output unit 710. Can be. In detail, the background screen of the display screen displayed through the display device of the output unit 710 may be displayed in the same color as the color of the light source 131, and for a predetermined time to attract the user's attention. It may be displayed in a blinking form at intervals. In addition, the wearable device 700 may output the same sound signal through the output unit 710 when the speaker unit 140 of the device 107 having the camera lens module photographing the omnidirectional sound outputs the sound signal. Can be. However, the present invention is not limited thereto, and only one of the speaker unit 140 and the output unit 710 may operate to output a sound signal.

In addition, the output unit 710 may provide the above-described visual feedback and auditory feedback to the user.

In addition, the communication unit 160 of the device 107 (hereinafter referred to as the first safety device) equipped with a camera lens module for photographing omnidirectional is provided with a camera lens module for photographing at least one other omnidirectional device (hereinafter referred to as second safety device). ) Can be communicated with. Therefore, the visual feedback and the audio feedback provided to the first user wearing the first safety device 107 may also be provided to the second user wearing the second safety device 108.

In addition, the first safety device 107 of the first user may receive the omnidirectional image captured by the second safety device 108 of the second user and display the image on the wearable device 700 of the first user. Therefore, when there are a plurality of users who wear the device 107 having the camera lens module for photographing the omnidirectional, it is possible to check the captured image from the safety device provided by each of the users. In addition, the position sensing between the user through the GPS unit 170 of each safety device 108, and the position of the user in the form of a map (Map) through the wearable device 700 can be displayed. This enables users to collaborate with each other when dealing with a disaster situation and to quickly identify a colleague's situation. In addition, when an accident occurs in at least one of the disaster relief workers, it is possible to quickly identify the accident's location and situation by using the omnidirectional image and the location information according to the location sensing so that the accident can be rescued from the dangerous situation as soon as possible.

14 is a block diagram of a safety system having a device with a camera lens module for photographing the omnidirectional according to an embodiment of the present invention.

Referring to FIG. 14, the safety system 600 using the apparatus 107 having the camera lens module for photographing omnidirectional according to the embodiment may further include a biosignal sensing unit 900. The biosignal sensing unit 900 includes various biometric sensors, and the biometric sensor includes a motion detection sensor for detecting a user's movement, a pulse detection sensor disposed at the wearable device 700, and detecting a user's pulse; The iris retina sensor may be disposed on the face mask 100e to recognize the iris or the retina of the user.

Periodically, the result sensed by the sensing unit 900 may be displayed through the wearable device 700, and the sensed result may be transmitted to the wearable device 700 of another user. In particular, when motion is not detected from the motion sensor for a predetermined time, when a pulse is not detected from the pulse sensor or when there is a sudden change, when an abnormal signal is sensed from the iris retina sensor, visual feedback and Acoustic feedback can be provided to enable rapid identification and handling of incidents or collaborations between users who handle multiple disaster situations.

Meanwhile, a non-transitory computer readable medium may be provided in which a program for sequentially performing a control method according to the present invention is stored.

For example, photographing a omnidirectional image, determining that at least one object enters a predetermined speed or more within a preset range within the photographed omnidirectional image, and from the time when the at least one object enters the preset range A non-transitory computer readable medium may be provided in which a program for storing the omnidirectional image photographed to a point outside the preset range and providing the visual feedback and the audio feedback are stored. .

The non-transitory readable medium refers to a medium that stores data semi-permanently and is readable by a device, not a medium storing data for a short time such as a register, a cache, a memory, and the like. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

In addition, although a bus is not shown in the above-described block diagram of a device having a camera lens module for photographing an omnidirectional image, communication between each component in a device having a camera lens module for omnidirectional photographing is a bus. It may also be through. In addition, each device may further include a processor such as a CPU, a microprocessor, and the like for performing the above-described various steps.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the above-described specific embodiment, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

The present invention includes all wearable caps as safety devices for protecting the head, and can be applied to motorcycle helmets, helmets used in baseball games, safety helmets worn in industrial sites, general hats and the like.

Claims (20)

1. A first lens having a convex first incidence surface formed on one surface, a first emission surface formed on the other surface, and a first reflective surface formed in the center of the first incidence surface;

   A second lens having a second incident surface formed on one surface thereof, a second reflective surface convex formed on the other surface thereof, and a second lens having a second exit surface formed on the center of the second reflective surface,

   The first lens and the second lens are formed of the same material, the first exit surface is concave, the second incident surface is formed convex, the radius of curvature of the first exit surface and the second incident surface is An imaging unit including a lens module formed in the same manner and bonded to enable omnidirectional image capturing;

   A storage unit for storing the photographed omnidirectional image;

   And a camera lens module for capturing an omnidirectional image which detects an object within a preset range within the photographed omnidirectional image and feeds it back.
2. A first lens having a convex first incidence surface formed on one surface, a first emission surface formed on the other surface, and a first reflective surface formed in the center of the first incidence surface;

   A second lens having a second incident surface formed on one surface thereof, a second reflective surface convex formed on the other surface thereof, and a second lens having a second exit surface formed on the center of the second reflective surface,

   The first lens and the second lens are formed of the same material, the first exit surface is concave, the second incident surface is formed convex, the radius of curvature of the first exit surface and the second incident surface is An imaging unit including a lens module formed in the same manner and bonded to enable omnidirectional image capturing; A microphone unit for receiving sound; A storage unit for storing the photographed omnidirectional image and sound; A speaker unit for outputting an audio signal; And when it is determined that at least one object enters a predetermined speed or more within a preset range within the photographed omnidirectional image, a point in time at which the at least one object enters within the preset range and then outside the preset range. And a processor for storing the photographed omnidirectional image and the received external sound to the storage unit and providing visual feedback and auditory feedback through the light source unit and the speaker unit. .
3. A support including a back opening through which a user's head is drawn and a face opening through which a face portion of the head is exposed;

   A face mask movable in combination with the support to cover or expose the face part;

   An endothelial disposed inside the support; And

   An imaging unit including a lens module capable of capturing an omnidirectional image, a storage unit storing the captured omnidirectional image, a pressure disposed between the support and the endothelium, and the pressure of the user's head formed by pressing the endothelium according to a user's wearing It includes a pressure sensor for sensing a, a system board installed on the support including a processor for storing the omnidirectional image from the imaging unit in the storage unit and a power supply for supplying power to the imaging unit, the storage unit and the processor; ,

   The power supply unit is provided with a camera lens module for photographing the omnidirectional power is output when the pressure is sensed through the pressure sensor.
4. The method of claim 3, wherein

   The system board further includes a wireless charging unit for receiving a wireless power from the outside to charge the battery of the power supply,

   The wireless charging unit includes a camera lens module for photographing the omni-directional to stop wireless charging when the pressure is sensed through the pressure sensor.
5. The method of claim 3, wherein

   And a mask opening / closing detection switch disposed on the face opening to turn on or off by the face mask when the face mask is moved to cover or expose the face opening.

   The system board is provided with a camera lens module for photographing the omnidirectional further comprises a mask opening and closing detection unit for detecting the turn on or off of the mask opening and closing detection switch.
6. The method of claim 5,

   The system board is controlled by the processor and installed on the support camera lens for photographing the omni-directional further comprising a speaker unit for controlling the output sound according to the detection of the turn-on or turn-off of the mask opening and closing detection switch of the mask opening and closing detection unit Device with modules.
7. The method of claim 6,

   The system board includes a camera lens module for photographing the omnidirectional direction further comprises a microphone for controlling whether or not the noise of the incoming sound in accordance with the detection of the turn on or off of the mask opening and closing detection switch of the mask opening and closing detection unit.
8. The method of claim 3, wherein

   The processor is provided with a camera lens module for photographing the omnidirectional to store the frame image of the unit of minutes of the omnidirectional image photographed from the imaging unit in the storage unit.
9. The method of claim 8,

   The system board and the shock detection unit for detecting the impact applied

   Further comprising a gyro sensor for detecting the rotation angle,

   The processor includes a camera lens module for photographing the omni-directional to pattern the detected rotation angle to store in the storage.
10. The method of claim 8,

    The system board further includes a communication unit for communicating with an external device,

    When the detected shock is greater than or equal to a preset value, and the detected rotation angle is greater than or equal to the preset rotation angle pattern compared to the rotation angle pattern stored in the storage unit until the shock signal is detected, Apparatus comprising a camera lens module for photographing the omni-directional for transmitting a frame image to the external device through the communication unit.
11. The method of claim 3, wherein

    The system board further includes a light source unit and a microphone unit for receiving sound from the outside, a speaker unit for outputting the sound stored in the storage unit,

    The processor,

    If it is determined that the at least one object enters the preset range within the preset range or more within the preset range, from the time when the at least one object enters the preset range to the time outside the preset range And a camera lens module configured to store the photographed omnidirectional image and external sound received through the microphone unit in the storage unit and photograph the omnidirectional unit providing visual feedback and audio feedback through the light source unit and the speaker unit.
12. The method of claim 11, wherein

    The system board further includes a GPS (Global Positioning System) unit for calculating the position information,

    The processor,

    And a camera lens module for photographing the omnidirectional image, wherein the stored omnidirectional image, the external sound, and the location information are transmitted to the external device.
13. The method of claim 12,

    The processor,

    Determining whether or not the object collides with the object based on at least one of the size, the movement speed, and the direction of movement of the object for each preset level, and providing an omnidirectional signal that provides the visual feedback and the auditory feedback differently according to the determined level. Device having a camera lens module for photographing.
14. The method of claim 13,

    The system board further includes an input unit for receiving a user operation,

    The processor,

    And a camera lens module for photographing the omnidirectional image storing the photographed omnidirectional image and the received external sound in the storage unit according to the user manipulation.
15. The method of claim 14,

    The processor,

    If it is determined that at least one of fire, smoke, natural disasters, vehicle accidents, and life accidents occur in the captured omnidirectional images, the photographed omnidirectional images are stored in the storage unit and transmitted to the external device. Device equipped with a camera lens module.
16. The method of claim 15,

    The processor,

    And a camera lens module for photographing the omnidirectional image to determine whether or not it occurs by comparing the photographed omnidirectional image with previously stored images related to the fire, smoke, natural disaster, vehicle accident, and human accident.
17. The method of claim 3, wherein

    The lens module,

    A first lens having a convex first incidence surface formed on one surface, a first emission surface formed on the other surface, and a first reflective surface formed in the center of the first incidence surface;

    A second lens having a second incident surface formed on one surface thereof, a second reflective surface convex formed on the other surface thereof, and a second lens having a second exit surface formed on the center of the second reflective surface,

    The first lens and the second lens are formed of the same material, the first exit surface is concave, the second incident surface is formed convex, the radius of curvature of the first exit surface and the second incident surface is Apparatus having a camera lens module for photographing the same omnidirectionally formed and bonded.
18. The method of claim 17,

    The radius of curvature of the first incident surface is 21 mm to 23 mm, the radius of curvature of the second reflective surface is 10 mm to 12 mm, and the radius of curvature of the first exit surface and the second incident surface is 29 mm to 31 mm. Apparatus having a camera lens module for photographing the omnidirectional focus is not formed on the bonding surface of the first lens and the second lens.
19. The method of claim 3, wherein

    The imaging unit,

    Apparatus having a camera lens module for photographing the omnidirectional position located in the rear region from the top center of the support.
20. The method of claim 3, wherein

    The imaging unit includes a plurality of lens modules,

    Each of the plurality of lens modules is provided with a camera lens module for photographing the omnidirectional located on each of the front, rear, left and right sides of the support.

Images