KR20150049168A - Mobile terminal and operating method thereof - Google Patents
Mobile terminal and operating method thereof Download PDFInfo
- Publication number
- KR20150049168A KR20150049168A KR1020130129379A KR20130129379A KR20150049168A KR 20150049168 A KR20150049168 A KR 20150049168A KR 1020130129379 A KR1020130129379 A KR 1020130129379A KR 20130129379 A KR20130129379 A KR 20130129379A KR 20150049168 A KR20150049168 A KR 20150049168A
- Authority
- KR
- South Korea
- Prior art keywords
- subject
- mobile terminal
- frame
- image
- laser
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/246—Calibration of cameras
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephone Function (AREA)
Abstract
The present embodiment includes a femto photographic camera for sensing a photon returning from a hidden object by a frame as a frame, and a controller for analyzing the frame to implement the object as a 3D image, A mirror system for splitting the laser beam and changing a firing position; and a photodetector for reflecting the laser beam reflected and scattered by the reflection wall and the photon, And a streak camera for sensing the frame.
According to the present invention, it is possible to take a 3D image of a subject hidden by an obstacle.
Description
The present invention relates to a mobile terminal and an operation method thereof, and more particularly, to a mobile terminal equipped with a femto photographic camera and a control method thereof.
A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.
Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .
In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.
Recently, a femto-photography camera has been developed, which visualizes the propagation of light and implements it as an image.
The femto photographic camera is a camera that can capture a hidden object that exists behind a corner of a wall or a building and can embody an obstructed object as a 3D image.
The development of such a femto photographic camera and researches on technologies applied thereto have been actively performed. Especially, when a femtosophotol camera is applied to a mobile terminal, various advantages are expected to be manifested.
The present invention is intended to effectively obtain a high-quality photograph by mounting a femto photographic camera on a mobile terminal and providing various shooting modes.
The present embodiment includes a femto photographic camera for sensing a photon returning from a hidden object by a frame as a frame, and a control unit for analyzing the frame and implementing the subject as a 3D image, A mirror system for splitting the laser beam and changing a firing position; and a photodetector for reflecting the laser beam reflected and scattered by the reflection wall and the photon, And a streak camera for sensing the frame.
According to another aspect of the present invention, there is provided a method of controlling a mobile terminal equipped with a femto photographic camera and equipped with a wearable mobile terminal, the method comprising the steps of: receiving a video call execution command to activate a femto photographic camera; The method includes the steps of emitting a reflected laser beam to a subject through a reflecting wall, sensing the laser beam scattered and reflected by the reflecting wall and a subject in a frame, continuously changing a firing position of the laser, Analyzing the sensed frames and analyzing the subject into a 3D image, and transmitting the 3D image to the video call counterpart.
According to the embodiment of the present invention, there is an advantage that a subject hidden by the obstacle can be photographed in a 3D image.
In addition, according to the embodiment of the present invention, the user can easily make a video call while wearing the wearable mobile terminal.
Further, according to another embodiment of the present invention, a photograph can be taken at a high angle angle from the top of the subject.
Finally, according to another embodiment of the present invention, there is an advantage that a four-sided image of a subject can be photographed and realized as a 3D image.
1 is a block diagram of a mobile terminal equipped with a femto photographic camera of the present invention.
FIG. 2 is a schematic view of a femto photographic camera photographing a subject obstructed by an obstacle according to an embodiment of the present invention.
Figure 3 shows frames sensed in a streaming camera, according to an embodiment of the present invention.
FIG. 4 shows a sequence of (a) to (i) sequentially capturing a subject having a complicated shape using a femto photographic camera and then rendering the subject as a 3D image according to an embodiment of the present invention.
5 illustrates a video call using a femto photographic camera mounted on a wearable mobile terminal according to a first embodiment of the present invention.
6 shows a state in which a subject is photographed in a high angle photographing mode according to the second embodiment of the present invention.
FIG. 7 shows a photograph photographed in the high angle photographing mode according to the second embodiment of the present invention.
8 shows a state in which a subject is photographed in a stereoscopic shooting mode according to the third embodiment of the present invention.
9 shows a 3D image of a subject photographed in a stereoscopic shooting mode according to a third embodiment of the present invention.
Hereinafter, the present embodiment will be described in detail with reference to the accompanying drawings. It should be understood, however, that the scope of the inventive concept of the present embodiment can be determined from the matters disclosed in the present embodiment, and the spirit of the present invention possessed by the present embodiment is not limited to the embodiments in which addition, Variations.
The suffix "module" and "part" used in the description of the mobile terminal according to the present invention are given or mixed in consideration of ease of specification, and do not have their own meaning or role.
The mobile terminal described in this specification may include a mobile phone, a smart phone, a tablet PC, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), and navigation. However, the configuration according to the embodiment described herein can be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, except when it is applicable only to a mobile terminal.
The configuration of the mobile terminal to which the idea of the present invention can be applied
1 is a block diagram showing the configuration of a mobile terminal according to the present embodiment.
The
Each component of the mobile terminal is examined in order.
The
The
The broadcast-related information includes information related to a broadcast channel, a broadcast program, or a broadcast service provider, and the broadcast-related information can be provided through a mobile communication network. When broadcast-related information is provided through the mobile communication network, the
The broadcast-related information may exist in various forms, for example, an electronic program guide (EPG) of Digitla Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of Digital Vid vs. Broadcast-Handheld And the like.
For example, the
The broadcast signal and / or the broadcast-related information received through the
The
The
The short-
The
Particularly, in the
The femto
The
FIG. 2 schematically shows a femto photographic camera according to an embodiment of the present invention photographing a hidden object covered by corners.
2, the
The photon reaching the
The
More specifically, the
Figure 3 shows frames sensed in a streaming camera, according to an embodiment of the present invention.
Referring to FIG. 3, when a laser beam is emitted in a direction different from a
The reason why the
That is, it can be considered that the hidden
Therefore, in order to adjust the firing direction of the laser wave, a
That is, the
The
At this time, the
FIGS. 3 (b) to 3 (c) illustrate frames reconstructed using the above algorithm. Blue pixels indicate that the intensity of the photons is strong, and red pixels indicate that the intensity of the photons is weak. From this, it can be analyzed that the hidden
FIG. 4 is a flowchart illustrating a process (a) to (i) for capturing a subject having a complicated shape with a femto photographic camera and implementing the 3D image through a rendering process according to an embodiment of the present invention.
Fig. 4 (a) shows hidden objects, Fig. 4 (b) shows frames photographed in a stricken camera, Fig. 4 (c) shows such frames as a back map, The figure shows a specific example of the subject. 4 (d) shows a state after filtering to obtain the z value of the object by differentiating the heat map with xy in order to realize the intensity of the photon and the depth of the object, (e) shows the depth of the object (f) represents a confidence frame, and (g) represents a 3D image that implements the appearance of the hidden object by rendering the 3D frames by rendering the frames above.
Through the series of processes performed by the
The
The image frame processed by the
The
The
The motion sensor 142 may sense motion, direction, direction, speed, etc. of the mobile terminal, and may include, for example, a geomagnetic sensor, an acceleration sensor, a gyro sensor, an altimeter, and the like.
The geomagnetic sensor is a sensor that can detect the direction of the magnetic field generated by the earth and detect the orientation like a compass. The acceleration sensor is a sensor capable of detecting a change in the operation vibration (acceleration) of a sensor moving body that specifies a physical quantity called a change in velocity. The gyro sensor is a sensor that senses the vertical force by the same principle as the acceleration sensor when the coriolis force is generated in the vertical direction of the rotating angle. The altimeter is a sensor that measures the pressure difference (pressure) that varies with altitude. The fingerprint sensor is a sensor capable of scanning the user's fingerprint on the front or rear surface of the mobile terminal, and can perform image extraction and data processing on a specific area of the fingerprint.
The
The
The
According to the embodiment of the
In the case where the
The touch sensor is a sensor for detecting a change in a capacitance applied to a specific area of the
When a touch input is detected by the touch sensor, a signal corresponding to the touch input is sent to the touch controller, and the touch controller transmits data corresponding to the received signal to the
The proximity sensor 141 detects presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor 141 may be disposed near the touch screen or inside the mobile terminal.
Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is made electrostatic, proximity of the pointer can be detected by the change of the electric field along the proximity of the pointer. In this case, the touch screen may be classified as a proximity sensor.
Hereinafter, for the sake of convenience, it is referred to as "proximity touch" for recognizing that the pointer is positioned on the touch screen in a state in which the pointer is not in contact with the touch screen, Quot; contact touch "is an action that the pointer actually touches.
The proximity sensor 141 may sense a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, . Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.
The
The
The
The
The
The
The
The identification module is a chip for storing various information for authenticating the use right of the mobile terminal and includes a user identity module (UIM), a subscriber identity module (SIM), a universal user identity module Module, USIM), and the like. The device (identification device) provided with the identification module can be manufactured in the form of a smart card, and can be connected to the mobile terminal through the identification device.
The
The
The
The
The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.
According to a hardware implementation, a plurality of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) , Micro-controllers, micro-processors, and other electronic units for performing other functions. In some cases, the embodiments described herein may be implemented by the
According to a software implementation, embodiments such as the procedures and functions described herein may be implemented in separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the
Hereinafter, the various Examples 5 To 9.
As described above, the embodiments of the present invention show embodiments in which the module of the
5 illustrates a video call using a femto photographic camera mounted on a wearable mobile terminal according to a first embodiment of the present invention.
A wearable mobile terminal (100) is a mobile terminal (100) which is worn on a body of a user and has a shape such as a clock, glasses, clothes, necklace, ring, etc., And the
However, in the case of the wearable
Referring to FIG. 5, the wearable
In the case of the necklace-type
Particularly, in recent years, a video call is becoming common. If the
In order to overcome this problem, the first embodiment is to mount a femto
Hereinafter, a process of providing the video call mode in the necklace-
When the user inputs a video call execution command to the necklace-
The activated femtocell
The emitted laser wave is scattered and reflected by the reflecting wall by the photon, reaches the
Thereafter, the
The
At this time, if the image transmitted from the video communication partner is projected on the reflecting wall using the small beam device, it is also possible to make a video call while watching the image of the other party.
FIG. 6 shows a state in which a subject is photographed in a high angle photographing mode according to a second embodiment of the present invention, and FIG. 7 shows a photograph photographed in a high angle photographing mode according to the second embodiment of the present invention.
Since the
6, the
If the ceiling is used as a reflecting wall and the
In more detail, a process of providing the high-angle photographing mode in the
First, when the user enters an instruction to enter the high angle photographing mode, the
When the
The emitted laser waves are scattered and reflected on the ceiling with photons, reaching the
Thereafter, the
The
The
Fig. 8 shows a state in which a subject is photographed in a stereoscopic imaging mode according to a third embodiment of the present invention, and Fig. 9 shows a 3D image of a subject photographed in a stereoscopic imaging mode according to a third embodiment of the present invention .
The stereoscopic image capture mode is a mode of capturing images of a subject in a 3D image.
The femto
Hereinafter, a method of implementing a subject as a 3D image using the femto
First, when the user inputs a shooting command for a subject in the stereoscopic shooting mode, the
At this time, in order to photograph the back side of the subject, there must be a
The femtocell
The emitted laser waves are directly scattered and reflected by the
The
The
In addition, the
Claims (5)
And a controller for analyzing the frame to implement the subject as a 3D image,
The femtosecond camera includes: a laser for emitting the laser beam to a reflecting wall facing the subject; a mirror system for splitting the laser beam and changing a firing position; And a streak camera for sensing the photons reflected back to the frame.
Wherein the outer shape of the mobile terminal is a shape of a clock, a necklace, a ring, or glasses that can be worn on the body.
Receiving a video call execution command to activate a femto photographic camera;
The laser emitting a laser wave through the reflecting wall to the object,
Sensing the laser beam scattered and reflected by the reflection wall and the object with a frame;
Continuously changing the firing position of the laser and sensing the reflected laser wave as a frame,
Analyzing the sensed frames and analyzing the subject into a 3D image;
And transmitting the 3D image to the video call counterpart.
Activating a femto photographic camera by receiving a user's command to enter the high angle shooting mode;
Firing a laser beam on a ceiling located above the object;
Sensing the scattered and reflected photons in the ceiling and the object as a frame,
Changing a firing position of the laser wave, sensing the photons scattered and reflected by the changed laser wave in a frame,
And analyzing the sensed frame and outputting the photographed image as a high angle perspective photograph.
Receiving a stereoscopic mode entry instruction from a user and activating a femtosecond camera;
Firing a laser beam to the subject and a reflecting wall located behind the subject,
Sensing the photons scattered and reflected by the subject and the reflecting wall by the laser wave in a frame,
Changing a firing position of the laser wave, sensing the photons scattered and reflected by the changed laser wave in a frame,
And analyzing the sensed frame to implement the subject as a 3D image.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130129379A KR20150049168A (en) | 2013-10-29 | 2013-10-29 | Mobile terminal and operating method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130129379A KR20150049168A (en) | 2013-10-29 | 2013-10-29 | Mobile terminal and operating method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20150049168A true KR20150049168A (en) | 2015-05-08 |
Family
ID=53387304
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020130129379A KR20150049168A (en) | 2013-10-29 | 2013-10-29 | Mobile terminal and operating method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20150049168A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018164316A1 (en) * | 2017-03-07 | 2018-09-13 | 링크플로우 주식회사 | Omnidirectional image capturing method and device for performing method |
-
2013
- 2013-10-29 KR KR1020130129379A patent/KR20150049168A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018164316A1 (en) * | 2017-03-07 | 2018-09-13 | 링크플로우 주식회사 | Omnidirectional image capturing method and device for performing method |
US10419670B2 (en) | 2017-03-07 | 2019-09-17 | Linkflow Co. Ltd | Omnidirectional image capturing method and apparatus performing the method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102497683B1 (en) | Method, device, device and storage medium for controlling multiple virtual characters | |
CN106371782B (en) | Mobile terminal and control method thereof | |
KR102153436B1 (en) | Mobile terminal and method for controlling the same | |
KR102083595B1 (en) | Mobile terminal and control method thereof | |
KR102155094B1 (en) | Mobile terminal and method for controlling the same | |
US11790612B2 (en) | Information display method and device, terminal, and storage medium | |
KR102471447B1 (en) | Mirror type display device andmethod for controlling the same | |
KR20160017991A (en) | Mobile terminal having smart measuring tape and object size measuring method thereof | |
KR20170014355A (en) | Mobile terminal and method of controlling the same | |
US20180267663A1 (en) | Terminal and method of controlling therefor | |
KR20140125212A (en) | Mobile terminal and control method thereof | |
KR20170055869A (en) | Mobile terminal and method for controlling the same | |
KR20170025177A (en) | Mobile terminal and method for controlling the same | |
US20160178905A1 (en) | Facilitating improved viewing capabitlies for glass displays | |
KR20150131815A (en) | Mobile terminal and controlling method thereof | |
KR20170025413A (en) | Mobile terminal and method for controlling the same | |
KR20170089653A (en) | Mobile terminal and method for controlling the same | |
KR20160032565A (en) | Mobile terminal and control method for the mobile terminal | |
KR20180048170A (en) | Display apparatus | |
KR20160026532A (en) | Mobile terminal and method for controlling the same | |
KR20170011183A (en) | Mobile terminal and method for controlling the same | |
KR20190054727A (en) | Smart mirror device and and method the same | |
KR20150025268A (en) | Electronic Device And Method Of Controlling The Same | |
KR20150049168A (en) | Mobile terminal and operating method thereof | |
KR102130802B1 (en) | Mobile terminal and method for controlling the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |