KR20130029862A - Mobile terminal and method for controlling thereof - Google Patents

Abstract

PURPOSE: A portable terminal and a control method thereof are provided to offer a convenient holography UI(User Interface). CONSTITUTION: A holography storage medium records interference fringes generated by a light interference phenomenon. A holography output module outputs a first holography image by generating the interference fringe and a diffraction phenomenon with light emitted from the holography storage medium based on a control unit(180) when one of the trigger events is generated. The control unit controls the holography output module to output the first holography image including first information for notifying an emergency situation to a user. [Reference numerals] (110) Wireless communication unit; (111) Broadcasting reception module; (112) Mobile communication module; (113) Wireless Internet module; (114) Local area communication module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (150) Output unit; (151) Display unit; (152) Sound output module; (153) Alarm unit; (154) Haptic module; (155) Projector module; (156) Holography module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supplying unit

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a mobile terminal capable of providing a holographic user interface.

Terminals may be divided into mobile / portable terminals and stationary terminals according to their mobility. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Recently, as holography images can be realized through a terminal, more convenient operation methods through a holography user interface are required. In addition, there is a need for a method of utilizing a holographic image to effectively notify an emergency of the surroundings.

The present invention is to provide a more convenient holographic user interface.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A mobile terminal according to an embodiment of the present invention for realizing the above object includes at least one of a control unit, a holographic storage medium for recording an interference pattern generated by an interference phenomenon of light, and a plurality of preset trigger events. And a holographic output module for outputting a first holographic image generated by light emitted from the holographic storage medium under the control of the controller to cause the interference fringe and a diffraction phenomenon under the control of the controller. However, the controller may control the first holographic image including the first information set in advance in order to notify the user of an emergency situation.

The preset plurality of trigger events may include a specific key input event, a touch input event of a specific pattern, a voice recognition event, a motion recognition event, a fingerprint recognition event, an eye-tracking recognition event, and a wind recognition event. It may include.

The apparatus may further include a wireless communication unit, and the controller may control to output the first holographic image when a call connection attempt or a message is received from the preset object through the wireless communication unit.

The apparatus may further include a sensing unit and a wireless communication unit, and the first information may be voice information of the user recognized through the sensing unit or message information received from a predetermined object through the wireless communication unit.

The controller may control the first information to be the voice information or the message information when the voice information or the message information includes at least part of preset keyword information.

The controller may be configured to output the first holographic image according to at least one preset holographic pattern, and the at least one holographic pattern may include a distance difference between the holographic output module and the output holographic image and the output. It is determined by at least one of the shape of the holographic image, the distance difference and the shape of the output holographic image may be changed over time.

The controller may be configured to output the first holographic image according to at least one preset holographic pattern, and the at least one holographic pattern may be moved, rotated, changed in color, changed in size, or flickered in the output holographic image. Determined by at least one, the movement, rotation, color change, size change, flashing may change over time.

The controller may further include an alarm unit and a wireless communication unit, and when the first holographic image is output, the controller may output a signal for notifying the emergency situation of the user through the alarm unit or may be a preset object through the wireless communication unit. A call connection attempt or a preset message can be sent.

The apparatus may further include a location information module, and the controller may transmit the location information of the mobile terminal obtained through the location information module when the call connection attempt or the preset message is transmitted to the preset object. .

The apparatus may further include a wireless communication unit, and the controller may establish a data path with at least one external device through the wireless communication unit, and transmit the first information to the at least one external device through the constructed data path. have.

The controller may separate the first information into a plurality of pieces of information, and the mobile terminal and the at least one external device may output each of the separated pieces of information as a holographic image.

The apparatus may further include a camera configured to face the same direction as the holographic output module, and when a predetermined shape is recognized by the camera, the controller may control the first holographic image not to be output.

In addition, when the predetermined shape is not recognized through the camera, the first holographic image may be controlled to be output again.

The controller may control the first holographic image to be output when the distance difference between the mobile terminal and the user exceeds a preset threshold distance.

On the other hand, the mobile terminal control method according to an embodiment of the present invention for realizing the above problem is a step of setting a plurality of trigger events and first information for informing the user of an emergency situation, the plurality of triggers (trigger) ) Generating at least one event and outputting a first holographic image including the first information by the holographic output module.

The plurality of trigger events may include a specific key input event, a touch input event of a specific pattern, a voice recognition event, a motion recognition event, a fingerprint recognition event, an eye-tracking recognition event, and a wind recognition event. can do.

The first information may be voice information of the user recognized through the sensing unit or message information received from a preset object through the wireless communication unit.

In addition, when the voice information or the message information includes at least some preset keyword information, the first information may be the voice information or the message information.

The method may further include outputting a signal for notifying the emergency situation of the user through an alarm unit or transmitting a call connection attempt or a preset message to a preset object through a wireless communication unit when the first holographic image is output. Can be.

The method may further include establishing a data path with at least one external device through a wireless communication unit, and transmitting the first information to the at least one external device through the established data path.

The mobile terminal according to at least one embodiment of the present invention configured as described above may be more conveniently operated through a holographic user interface.

In addition, according to the present invention, a predetermined holography function may be provided to a user based on an event recognized by the terminal.

In addition, according to the present invention, it is possible to project a holographic image provided with a holographic pattern effect.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention;
3 is a front view of a mobile terminal for explaining an operation state of the mobile terminal according to the present invention;
4 illustrates a mobile terminal including a holography module in accordance with one embodiment of the present invention.
5 is a conceptual diagram for explaining the holographic principle.
6 is a conceptual diagram for explaining a transmissive holography method.
7 is a conceptual diagram for explaining a reflective holography method.
8 illustrates an example of a trigger event for projecting a SOS holographic image in accordance with one embodiment of the present invention.
FIG. 9 illustrates an example in which preset text is projected onto an SOS holographic image in accordance with an embodiment of the present invention. FIG.
FIG. 10 is a diagram for one example of projecting a voice or message received by a terminal into a holographic image in accordance with one embodiment of the present invention; FIG.
FIG. 11 illustrates an example of projecting an SOS holographic image using a preset keyword in accordance with an embodiment of the present invention. FIG.
12 is a diagram illustrating an example in which an SOS holographic image is projected according to a preset pattern in accordance with an embodiment of the present invention;
FIG. 13 is a view showing an example of executing an additional function together while projecting an SOS holographic image according to an embodiment of the present invention; FIG.
FIG. 14 illustrates an example of sharing SOS holographic image related information with another external device in accordance with an embodiment of the present invention. FIG.
15 illustrates an example of a method for protecting a user from projection of a holographic image in accordance with one embodiment of the present invention.
FIG. 16 illustrates an example of a method for preventing theft of a terminal capable of projecting a holographic image in accordance with an embodiment of the present invention. FIG.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

Overall configuration

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

Furthermore, the sensing unit 140 generates a sensing signal by measuring the ambient noise (for example, 20db) of the mobile terminal 100 or the ambient brightness (for example, 20lm) of the mobile terminal 100 as an illuminance sensor. It is also possible to generate a sensing signal by measuring.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet port, grazing to the skin surface, contact of an electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

Next, the holography module 156 may include a holographic storage medium and a holographic output module, and project the holographic image to the outside.

Holographic storage medium is a storage medium for recording the interference pattern generated by the interference of the irradiated object wave and the reference wave is composed of a material that reacts according to the intensity of light, such as a photopolymer.

At this time, according to the control of the controller 180, the holographic output module irradiates a reproduction wave identical to the reference wave to the holographic storage medium, and the generated reproduction wave is generated by causing an interference fringe and a diffraction phenomenon recorded on the holographic storage medium. The holographic image can be output.

A detailed projection method of the holographic image will be described below in detail with reference to FIGS. 4 to 7.

In addition, in the above description, the holographic storage medium and the holographic output module are included in the holography module 156 to be implemented together, but this is merely a mere example and may be included in the mobile terminal 100 in a separate configuration.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

Furthermore, in order to support the holographic image projection of the holography module 156, information about the holographic interference fringe may be stored. That is, the user's voice, the execution result of the application, and the like can be output to the outside through the holography module 156 through the information stored in the memory unit 160.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Organization description

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

Front touch

Hereinafter, the operation of the display unit 151 and the touch pad 135 will be described with reference to FIG. 3.

3 is a front view of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

3 illustrates inputting of a touch applied to the virtual keypad through the front surface of the terminal body.

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a virtual keypad 151c is displayed in which a number for inputting a telephone number or the like is displayed. When the virtual keypad 151c is touched, numbers and the like corresponding to the touched virtual keypad are displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

Hereinafter, a holographic image representation method of a mobile terminal and a structure therefor that can be applied to embodiments of the present invention will be described.

Prior to the description of the holographic image, a form of a mobile terminal including the holography module 156 will be described with reference to FIG. 4.

The holography module 156 may be disposed and mounted on the front or rear side of the mobile terminal.

4 is a diagram illustrating a mobile terminal including a holography module according to an embodiment of the present invention.

First, referring to FIG. 4A, the holography module 156 is illustrated in front of a mobile terminal. In this case, the holography module 156 may be provided on the front surface of the mobile terminal together with the camera 121 and may project and display the holographic image 411 generated under the control of the controller 180.

In addition, as illustrated in FIG. 4B, the holography module 156 may be included in a partial region of the rear surface of the mobile terminal, may be included together with the camera 121, and a holographic image generated under the control of the controller 180. Project and display (412).

The holographic image that may be implemented through the holography module 156 may include both a planar image and a stereoscopic image.

In this case, the stereoscopic image implemented through the holography module 156 may be largely divided into a 2D stereoscopic image and a 3D stereoscopic image.

The 2D stereoscopic image method is a monoscopic method of providing the same image in both eyes, and arranges a polyhedron generated through one or more points, lines, faces, or a combination thereof in a virtual stereoscopic space under the control of the controller 180. , How to display the image that he viewed at a certain point in time.

Next, the 3D stereoscopic image method is a method of providing different images to both eyes (stereo scopic), a method using a principle that the human body feels a three-dimensional feeling when viewing the object. In other words, the two eyes of a person see different plane images when they see the same thing by the distance between them. These different planar images are transmitted to the brain through the retina, and the brain fuses them to feel the depth and reality of the stereoscopic image. Therefore, although there is a slight difference for each person, the binocular disparity due to the distance between the two eyes makes a sense of three-dimensional feeling, and a method of displaying an image using the binocular disparity.

The holographic image generated by the holography module 156 to be described later may include both the above-described planar image and stereoscopic image, but for convenience of description, the holographic image will be described on the assumption that it is displayed in a 2D stereoscopic image. However, the content of the present invention is not limited thereto.

Hereinafter, a holographic image representation method and a structure therefor of a mobile terminal that can be applied in embodiments of the present invention will be described in detail.

While the conventional image only records the distribution of the bright and dark sides of the object, the holographic image representation method can be understood as an image display method that simultaneously accumulates and reproduces all information, ie, amplitude and phase, of the light as the wave.

A holographic image representation method will be described with reference to FIG. 5.

5 is a conceptual diagram for explaining the holographic principle.

First, referring to FIG. 5A, the coherent light from the laser light source 501 is divided into two through a splitter 502.

If one of the beams is made to shine on the subject 507, the light may be reflected on the surface of the subject. Hereinafter, the beam is referred to as an object wave.

In addition, the other light ray can be diffused through the lens to directly illuminate the entire holographic photosensitive material 505, which is hereinafter referred to as a reference wave.

The object wave and the reference wave interfere with each other on the holographic photosensitive material 505, making about 500 to 1,500 very delicate and complex. At this time, the photo recording such interference pattern is called hologram.

Subsequently, when a light beam such as a reference wave generated as shown in FIG. 5B is projected onto the photosensitive material 505, the interference pattern serves to diffract light at a position different from the direction in which the reference wave is incident, and the diffracted light gathers. By forming the light reflected by the first object, the holographic image 509 is projected. That is, the first object light can be reproduced in the hologram, and the image expression method through the hologram is called a holographic image expression method.

At this time, when looking inside the reproduced wavefront, the first object is visible, but it looks as if the object is inside. And as you move to the point of view, the position of the object changes as well, making it look as if you are looking at it. In addition, since the wavefront of the original object is reproduced, it can also interfere with the wavefront coming from a very deformed object.

According to the reproduction method, the holographic image representation method may be classified into a transmissive holographic image representation method and a reflective polographic image display method.

(1) transmission holographic image representation

This is a way to see the image transmitted through the light behind the hologram in front of the hologram. In the transmission holographic image representation method, the object wave and the reference wave are exposed to the photographic film in the same direction during production, and the generated holographic image is characterized by vivid and bright colors.

(2) reflective holographic image display system

It is manufactured so that the direction of the object wave and the reference wave are incident on the photosensitive material in opposite directions so that the image reflected by the light in front of the hologram can be observed in front of the hologram. The holographic image generated by the reflective holographic image display method is characterized by excellent stereoscopic effect.

The transmissive holographic image representation method and the reflective polygraphy image display method will be described in detail with reference to FIGS. 6 and 7.

6 is a conceptual diagram for describing a transmissive holography method.

Referring to FIG. 6A, light emitted from the laser light source 601 passes through a spatial filter 602 and then spreads into a smooth spherical wave. One of the spherical waves divided into two rays in a 50:50 splitter (605) is illuminated on the object 608 to produce an object wave, and the other is illuminated on the film 607 to create a reference wave. The object wave film 607 illuminated by the object 608 is illuminated.

At this time, the object wave and the reference wave illuminated on the film cause interference with each other to create an interference fringe, and the interference fringe is recorded on the film 607.

That is, as illustrated in FIG. 6B, the object wave and the reference wave are projected together on the same surface of the film 607 to generate an interference fringe.

Subsequently, as shown in FIG. 6C, when the reference wave is projected onto the film 607, the object wave is transmitted in a direction opposite to the plane where the previous object wave and the reference wave are incident to generate a holographic image.

Next, FIG. 7 is a conceptual diagram for describing a reflective holography method.

Referring to FIG. 7A, light emitted from the laser light source 701 passes through a spatial filter 702 and then spreads out as a smooth spherical wave as shown in FIG. 6A, and then passes through two 50:50 splitters 705. It is divided into light rays, one of which is illuminated by the object 708 to produce an object wave, and the other of which is illuminated by the film 707 as it is to create a reference wave.

However, unlike FIG. 6A, the reference wave and the object wave are illuminated by the film 707 at positions opposite to each other.

That is, as shown in FIG. 7B, the reference wave is projected onto the left side of the film 707, and the object wave is projected through the upper right side of the film 707. Then, as shown in Figure 7c, when the reference wave is projected on the film, the object wave is transmitted in the opposite direction to generate a holographic image.

The films 607 and 707 described above are represented by the holographic storage medium in this specification, and other components capable of generating a holographic image by emitting light to the film are represented by the holographic output module.

As described above, for convenience of description, in the present specification, the holographic storage medium and the holographic output module will be described as being implemented together with the holography module 156. 100).

In addition, for convenience of description, it is assumed that the mobile terminal mentioned below includes at least one of the components shown in FIG. 1, and the display unit 151 is a touch screen.

Usually, a graphic in the form of an arrow or a finger for pointing a specific object or selecting a menu on the display unit 151 is called a pointer or a cursor.

However, in the case of a pointer, it often means a finger or a stylus pen for a touch operation or the like.

Therefore, in the present specification, the graphic displayed on the display unit 151 is referred to as a cursor to clearly distinguish the two, and a physical means capable of performing touch, proximity touch, and gesture such as a finger or a stylus pen is referred to as a pointer. It is called.

In addition, as described above, the holographic image may include both a planar image and a stereoscopic image, but for convenience of description, the holographic image will be described below on the assumption that it is displayed in a 2D stereoscopic image.

Conventional mobile terminals have been frequently used as a means for informing a user of an emergency situation. For example, the alarm sound output through the alarm unit 153 may be used to notify an emergency situation around the user or to transmit a preset emergency message or emergency call signal to an institution such as a hospital or a police station through the wireless communication unit 110. Could.

Recently, as holography images can be implemented through a terminal, a convenient holography user interface is provided to a user. Therefore, there is a demand for a method of utilizing holographic images to effectively inform the user of an emergency situation.

Accordingly, the present invention provides a method for a terminal to recognize an emergency situation of a user through a predetermined event and to express a holographic image for notifying the user of an emergency situation to the surroundings.

Hereinafter, in order to distinguish between a general holographic image and a holographic image informing the user of an emergency, the holographic image for informing the user of an emergency is referred to as an SOS holography image.

The steps for implementing the present invention largely comprise two steps.

First, the terminal may recognize that the user is in an emergency situation through a preset trigger event. That is, a step of generating a trigger event for projecting the SOS holographic image is required.

Next, the terminal may project the preset content in the holographic image according to the recognized emergency of the user. For example, the predetermined text, the voice content of the user recognized by the sensing unit 140, and the message content received through the wireless communication unit 110 may be projected as a holographic image.

In this case, the terminal may project the holographic image as an additional function and simultaneously output a warning sound through the alarm unit 153 or transmit a call signal or a message to a preset organ. In this regard, a detailed description of the additional function will be described later.

Hereinafter, a trigger event for projecting the SOS holographic image and the contents of the SOS holographic image output through the trigger event will be described in detail.

First, a trigger event for projecting an SOS holographic image will be described.

The trigger event for projecting the SOS holographic image includes an event according to a specific key input, an event according to a touch input of a specific pattern, an event according to voice recognition, an event according to a movement or tilt change of the terminal based on a gyro sensor, and a fingerprint recognition. Event, wind event, eye-tracking event, event through an external device, an event of receiving a call signal or a message from a preset object, and the like.

That is, a terminal having a specific key for projecting the SOS holographic image may be manufactured separately, and an event in which the specific key is selected by a user's operation may be used as a trigger event. In addition, an event of pressing a predetermined key included in the existing user input unit 130 for a predetermined time or a predetermined pattern may be included. For example, an event of pressing the "1" number key for three seconds or more, or an event of pressing the "1" number key three times in succession among the plurality of number keys included in the keypad.

In addition, an event in which a touch of a specific pattern recognized through the sensing unit 140 is input may be used as a trigger event. Examples of the touch input having a specific pattern may include a touch input in which a user touches a part of the mobile terminal or grabs a touch area with a palm that exceeds a certain area of the touch screen. In addition, the touch screen may be a long touch, a proximity touch, a long proximity touch, or a multi-touch on the touch screen.

In addition, when a voice is recognized through the sensing unit 140, the recognized voice may be analyzed and the analyzed voice may be set to be an event. For example, when a voice such as “Help Me” is recognized by the user, the SOS holographic image may be output to the outside.

In addition, since the gyro sensor may recognize a change in the movement of the terminal or a change in the tilt, the gyro sensor may use the trigger event as an event according to the number of times the user shakes the terminal, the intensity or the angle at which the terminal is tilted, and the intensity.

In addition, the trigger event may be set according to whether the sensing unit 140 recognizes one of a plurality of fingerprints of the user. That is, since the fingerprints of the thumb, index finger, middle finger, and little finger of the user are different from each other, the trigger event may be set according to the fingerprint of each finger or the trigger event may be set accordingly because the fingerprint is different for each user.

In addition, as an event according to wind recognition, the wind intensity and wind pattern by the user may be set as a trigger event for the SOS holographic image.

In addition, an event according to eye-tracking recognition may also be utilized. That is, after the terminal recognizes the eye tracking of the user, the number of eye blinks and the pattern of eye blinking of the user may be set to be a trigger event.

In addition, an event through an external device may also be a trigger event. The external device may include a health care device. The health care device checks user state information such as breathing, pulse, body temperature, and blood pressure in real time, and notifies the terminal when a user's movement is not detected or an emergency detection signal is generated. The terminal recognizes the situation from the health care device by remote communication or short-range communication through the wireless communication unit 110, and may use it as a trigger event for the SOS holographic image.

In addition, an event for receiving a call signal or a message from a preset object may be a trigger event. The preset object includes an external terminal, an external organization, and the like. For example, external agencies may include disaster safety response headquarters, road traffic centers, meteorological offices, firefighting headquarters, and police offices. When an event of receiving a message or call signal from a preset object occurs, the terminal may project the SOS holographic image. In this case, the preset object may be changed by a user's manipulation.

However, the trigger events for projecting the above-mentioned SOS holographic image are merely exemplary, and other events directly related to a dangerous situation of the user may also be set as trigger events, and the present disclosure is not limited thereto. .

Next, when a trigger event occurs, the contents of the SOS holographic image projected through the holography module 156 will be described.

The content of the projected SOS holography image includes preset text, a message received from an external object, a user's voice recognized through the sensing unit 140, and the like.

First, the content of the projected SOS holography image may be preset text. For example, texts such as “Help Me”, “Help”, “Contact a hospital”, and the like may be preset by the user, and the terminal may project the set text onto the SOS holographic image. At this time, it is obvious that the text for the SOS holographic image can be modified by the user.

In addition, the terminal may project a message received from an external object as the content of the holographic image. The external object includes an external terminal, an external organization, and the like. External organizations include disaster safety measures headquarters, road traffic centers, meteorological offices, firefighting headquarters, and police offices. For example, “Tsunamis are coming from the Disaster Safety Response Headquarters. Please evacuate to a higher location ”. You can output the received message as an SOS holographic image to the outside.

In this case, when there are many contents included in the received message, the terminal may divide the contents of the message into a preset size, and output the message or the compressed SOS holographic image at predetermined time intervals.

For example, “Tsunamis are coming from the Disaster Safety Response Headquarters. If you receive the message "Please evacuate to a higher location.", The terminal will first project the "Tsunami is coming" as a holographic image, and after a certain time, please evacuate to a higher location. Can project. It can also be compressed to project "tsunamis, evacuation to higher positions" as holographic images.

In addition, the terminal may project the user voice recognized by the sensing unit 140 as the content of the holographic image. For example, “A lot of heat is coming from the user. Please contact the hospital. ”If the voice is recognized, the recognized voice content can be output to the outside as an SOS holographic image.

In this case, when the recognized voice content is many, the terminal may divide the voice content into a preset size, output or compress the voice content according to a predetermined time interval, and output the SOS holographic image.

For example, “I have a lot of fever. If it recognizes a voice such as "Please contact the hospital.", The terminal will first project a "hot fever" as a holographic image, and after a certain time has elapsed, "Please contact the hospital." Can be. It can also be compressed to project "heat, contact hospital" as a holographic image.

In addition, when projecting a user's voice recognized through a message received from an external object or the sensing unit 140 to the SOS holographic image, the terminal does not unconditionally project the above content into the holographic image, and only when a preset keyword is included. You can also project.

For example, assume that "hospital" is set as a keyword by the user. If there is a tsunami coming, Please evacuate to a higher location. ”Since the received message does not contain the keyword“ hospital, ”the received message will not be projected as a holographic image. Also, the user said, “There is a lot of heat. Please contact the hospital. ”Since the recognized voice content includes the keyword“ hospital, ”the terminal projects the voice content recognized through the holography module 156 as the SOS holographic image.

Meanwhile, the projected SOS holographic image may be controlled to be projected according to a predetermined holography pattern to be distinguished from a general holographic image.

The holographic pattern means that the holographic image projected through the holography module 156 is changed to a preset pattern over time and provided to the user.

The holographic pattern may be variously set in the manner described below.

First, the holographic pattern may be set by changing the distance difference between the holographic output module and the holographic image over time.

That is, by changing the distance difference between the holography module 156 and the holographic image with time, the holographic image projected through the holography module 156 can be moved up and down, so that a predetermined holography pattern can be set.

Next, the holographic pattern may be set by changing the shape of the holographic image projected by the holography module 156 over time.

For example, the controller 180 may control the holographic image projected by the holography module 156 to have a circular shape at first, and then change the rectangular shape as time passes. As a result, the holographic image is changed into various shapes according to time, so that the holographic pattern can be set.

In addition, a method of moving or rotating the holographic image projected through the holography module 156 to the left or right may be applied.

That is, while maintaining the same distance difference between the holographic module and the holographic image, the holographic pattern can be set by rotating the projected holographic image to move left and right, rotate, or move side to side according to time.

In addition, the holographic pattern may be set by changing the color or size of the projected holographic image or adjusting the holographic image to blink. Furthermore, the holographic pattern may be set through projection brightness, refresh rate, illumination, vibration feedback, sound insertion, image insertion, repetitive projection, and the like.

In the above description, it is assumed that the holographic pattern is set by individual elements, but the holographic pattern may be set by a plurality of elements.

For example, the holographic pattern may be set to rotate and rotate the projected holographic image from side to side while changing the distance difference between the holographic module 156 and the holographic image over time.

In addition, in the above description, it is assumed that the holographic pattern is set for the entire holographic image. However, the holographic pattern is merely exemplary, and the holographic pattern may be applied to only a part of the holographic image.

Meanwhile, the duration of displaying the projected SOS holographic image or the number of times of repeatedly displaying the SOS holographic image may be specified by the user.

For example, the SOS holographic image may be designated to be projected through a 10 minute east holography module. In addition, the SOS holographic image may be set to be repeatedly displayed 20 times.

Hereinafter, the trigger event for projecting the SOS holographic image and the contents of the SOS holographic image output through the trigger event will be described in detail with reference to FIGS. 8 to 12.

First, a trigger event applied to the present invention will be described with reference to FIG. 8.

8 illustrates an example of a trigger event for projecting an SOS holographic image in accordance with an embodiment of the present invention.

First, FIG. 8A illustrates an example of an event according to a specific key input.

In FIG. 8A, the terminal separately includes a specific key 811 for projecting the SOS holographic image. Therefore, when the user selects a specific key 811, the SOS holographic image is projected. Although not shown, an event according to a specific key input may include an event of pressing a predetermined key included in the existing user input unit 130 for a predetermined time or a predetermined pattern.

8B illustrates an event according to a touch input of a specific pattern.

In FIG. 8B, when the predetermined area on the touch screen is long touched, the SOS holographic image is projected. Although not shown, an event according to a touch input of a specific pattern may include a proximity touch, a long proximity touch, and a multi-touch input event.

8C illustrates an event according to voice recognition.

When a voice such as “Help Me 813” is recognized by the user, the SOS holographic image may be output to the outside.

In addition, FIG. 8D illustrates an event according to a movement or tilt change of the terminal based on the gyro sensor.

Referring to FIG. 8D, the user may adjust the position of the terminal from 814 to 815 to 816 to adjust the output of the SOS holographic image to the outside.

In FIG. 8D, the change of the position of the terminal has been described, but an event according to the number of times the user shakes the terminal, the strength or the angle of tilting the terminal, or the like may be used as a trigger event.

8E illustrates an event according to fingerprint recognition.

Since each of the plurality of fingerprints of the user has a different shape, the trigger event may be set so that the SOS holographic image is projected according to whether the fingerprint 140 recognizes the fingerprint. Although not shown, a fingerprint recognition event may be applied for each user.

8F illustrates an event according to wind recognition.

As shown in FIG. 8F, the wind intensity and the wind pattern by the user may be set as a trigger event for the SOS holographic image.

8G illustrates an event according to eye-tracking recognition.

As illustrated in FIG. 8G, after the terminal recognizes the eye tracking of the user, the number of eye blinks and the pattern of eye blinking of the user may be set to be a trigger event.

8H illustrates an event through an external device.

In FIG. 8H, it is assumed that the external device is a health care device.

The health care device checks the user's breathing, pulse, body temperature, blood pressure, etc., and notifies the terminal of the user through telecommunication or short-range communication when the user's movement is not detected or an emergency detection signal is generated (817). At this time, the terminal recognizes the situation and projects the SOS holographic image.

In addition, FIG. 8I illustrates an event of receiving a call signal or a message from a preset object.

In FIG. 8I, it is assumed that the disaster safety measures headquarters is set as a preset object. Therefore, when the terminal receives the call signal or message 818 from the disaster safety response headquarters, the SOS holographic image is projected.

Next, the contents of the SOS holographic image output through the trigger event will be described in detail with reference to FIGS. 9 to 12.

FIG. 9 illustrates an example in which preset text is projected onto an SOS holographic image in accordance with an embodiment of the present invention.

In FIG. 9A, it is assumed that an event according to voice recognition is a trigger event, and a voice such as “SOS hospital” is recognized by a user.

At this time, when the voice such as "SOS hospital" is recognized through the sensing unit 140, the holography module 156 under the control of the control unit 180, the text of the pre-set "Please send me to Seoul St. Mary's Hospital (911) ) ”Or“ Please call me father. Hong Gil-dong 010-1234-5678 (912) ”is projected on the SOS holographic image.

In FIG. 9B, it is assumed that an event according to a specific key selection is a trigger event, and a specific key is selected by a user.

When it is recognized that a specific key is selected through the sensing unit 140, the holography module 156 under the control of the controller 180 may take the preset text “Please sit down 921” or “take me to the hospital. 922 ”as a SOS holographic image.

Also, FIG. 10 is a diagram illustrating an example of projecting a voice or a message received by a terminal as a holographic image according to an embodiment of the present invention.

First, in FIG. 10A, it is assumed that the voice received by the terminal is projected as a holographic image.

When the voice “Help Me 1011” is recognized through the sensing unit 140, the terminal externally outputs the recognized voice “Help Me 1011” under the control of the controller 180 as the SOS holographic image 1012. Output to.

Next, in FIG. 10B, it is assumed that the message received by the terminal is projected as a holographic image.

The terminal may receive an emergency information message 1021 from an external object and project the received message as a holographic image.

In Figure 10b, “Tsunamis are coming. When you receive this message, please evacuate to a higher location as soon as possible. Project the “Disaster and Safety Countermeasures Headquarter” message 1022 on the SOS holographic image.

11 is a diagram illustrating an example of projecting an SOS holographic image by using a preset keyword in accordance with an embodiment of the present invention.

In FIG. 11, it is assumed that "Help ME" is designated as a keyword.

In addition, in FIG. 11, it is assumed that when there are many recognized voice content or message content, the content is pre-designated to compress and output the content as an SOS holographic image.

Referring to Figure 11a, the terminal through the sensing unit 140 "Please send me to Seoul St. Mary's Hospital. Help Me ”(1111). At this time, the controller 180 determines whether the keyword “Help ME” is included in the recognized voice, and the keyword is included in the recognized voice in FIG. 11A. At this time, “Please take me to Seoul St. Mary's Hospital. Since there are many audio contents of “Help Me 1111”, the controller 180 may control to display only the compressed “Help Me” as the SOS holographic image 1112.

Next, referring to FIG. 11B, the terminal uses the “Help Me. Please take me to Seoul St. Mary's Hospital. Please help me (1121) ”. In this case, the controller 180 determines whether the keyword “Help ME” is included in the received message, and confirms that the keyword is included in the message received by the terminal in FIG. 11B. At this time, “Help Me. Please take me to Seoul St. Mary's Hospital. Please help. 1112 ”, the controller 180 may control to display only the compressed“ Help Me ”as the SOS holographic image 1122.

12 is a diagram illustrating an example in which an SOS holographic image is projected according to a preset pattern in accordance with an embodiment of the present invention.

In FIG. 12, while maintaining the same distance difference between the holographic module and the holographic image, the SOS holographic image is projected according to a holographic pattern that rotates the projected holographic image over time.

The SOS holographic image projected through this can be easily distinguished from the general holographic image.

In addition, although not shown, as described above, the holographic pattern may be set by changing the distance difference between the holographic output module and the holographic image over time or by changing the shape of the projected holographic image over time.

Meanwhile, according to an exemplary embodiment of the present invention, an additional function set in the terminal may be simultaneously executed while projecting the SOS holographic image.

Additional functions implemented with the SOS holographic image include an emergency bell output function, SOS call signal transmission function, SOS message transmission function, and multi-holography function.

First, the emergency bell output function is a function of projecting the SOS holographic image through the holography module 156 and simultaneously outputting a warning sound through the alarm unit 153.

Projecting a beep and SOS holographic image together is advantageous because it can alert you to the surroundings more quickly.

Next, the SOS call signal transmission function is a function of transmitting a call signal through the wireless communication unit 110 to a predetermined object while simultaneously projecting the SOS holographic image.

Here, the preset object includes an external terminal, an external organization, and the like. Examples of external agencies include disaster safety response headquarters, road traffic centers, meteorological offices, firefighting headquarters, and police offices.

Furthermore, when the call signal attempt is successful, the voice stored in the memory 160 may be transmitted to a preset object. For example, when a hospital is set as an object and a call signal attempt is successful, a "help" voice stored in the memory 160 may be transmitted.

In addition, the SOS message transmission function is a function of transmitting a message through the wireless communication unit 110 to a predetermined object while simultaneously projecting the SOS holographic image.

Here, the preset object includes an external terminal, an external organization, and the like as described in the SOS call signal transmission function. Examples of external agencies include disaster safety response headquarters, road traffic centers, meteorological offices, firefighting headquarters, and police offices.

The message transmitted to the preset object may be previously designated at the time of terminal manufacture or may be arbitrarily modified by the user. For example, “Help Me. Please take me to Seoul St. Mary's Hospital. Please help me ”.

Furthermore, in the case of transmitting a message, the current location of the user may be determined through the location information module 115, and the detected location information may be transmitted together. In this case, it is advantageous to notify the surroundings of the user's dangerous situation and the location at the same time.

In addition, a multi-holography function is a function in which a plurality of terminals project a holographic image by separating contents included in the SOS holographic image.

The size of a holographic image that one terminal can output is limited. Accordingly, by separating the contents included in the SOS holographic image and projecting the plurality of terminals to the holographic image, a larger holographic image can be realized and the user's risk can be informed more quickly.

For example, if three terminals want to project an SOS holographic image of “Please transfer me to Seoul St. Mary's Hospital”, the first terminal is “Me” and the second terminal is “Seoul St. Mary's Hospital”, The third terminal may project the "please send" to each SOS holographic image.

Further, by adjusting the positions of the three terminals to display a separate content, it is possible to connect the three output SOS holographic images. This enables the creation of much larger SOS holographic images, which effectively communicates the user's risks to the surroundings.

However, the additional function executed together with the aforementioned SOS holographic image is merely exemplary, and other functions of the terminal may be executed together with the SOS holographic image according to a user's manipulation.

Hereinafter, referring to FIG. 13, an additional function executed together with the SOS holographic image will be described in detail.

FIG. 13 is a diagram for one example of executing an additional function together while projecting an SOS holographic image according to an embodiment of the present invention.

First, FIG. 13A illustrates an emergency bell output function, and simultaneously outputs an SOS holographic image through the holography module 156 and outputs an emergency bell 1310 to the outside.

In addition, FIG. 13B illustrates the SOS call signal transmission function, and simultaneously transmits the call signal 1320 through the wireless communication unit 110 to a predetermined object while projecting the SOS holographic image.

In addition, Figure 13C shows the SOS message transmission function. In this case, at the same time as projecting the SOS holographic image through the wireless communication unit 110 as a predetermined object “Help Me. Please take me to Seoul St. Mary's Hospital. Please help me ”(1330).

In addition, FIG. 13D illustrates an example of transmitting the SOS message 1341 including the current location information 1342 of the user identified through the location information module to a preset object.

As shown in FIG. 13D, the current location information 1342 of the user is included in the message and transmitted, and the object receiving the message can grasp the user's emergency situation and the user's location at a time, thereby effectively coping with the situation.

13E illustrates an example of a multi-holography function.

In FIG. 13E, it is assumed that two terminals execute a multi-holography function and adjust the position of the terminal so that the projected holographic images are connected and displayed.

Referring to FIG. 13E, the first terminal and the second terminal are “Help. Please divide the word “Help” into “Help (1351)” and “Please (1352)” and project it as a holographic image.

In this case, as a result, the projected holographic image may be connected to project the SOS holographic image at twice the size of the holographic image displayed by one terminal.

Meanwhile, according to an embodiment of the present invention, the terminal may share the SOS holographic image with another external device.

That is, it is possible to establish a data path with a plurality of external devices through the wireless communication unit 110 and share information related to the SOS holographic image.

For example, when a trigger event occurs in one of the terminals, the situation and the information may be transmitted to a peripheral device that establishes a data path while simultaneously projecting a predetermined content to the SOS holographic image. In this case, the SOS holographic image together with the plurality of holographic devices that establish the data path with the terminal where the trigger event occurs may also effectively notify the user of the dangerous situation to the surroundings.

Specific details related to this will be described with reference to FIG. 14.

FIG. 14 is a diagram for one example of sharing SOS holographic image related information with another external device in accordance with one embodiment of the present invention.

In FIG. 14, it is assumed that a user possessing a first terminal is in an emergency situation.

When an emergency occurs in the first terminal, information 1410 related thereto is automatically or manually transmitted to a plurality of external devices that have established a data path with the first terminal.

The plurality of external devices that receive the information 1410 related to the emergency situation project the preset contents to the SOS holographic image. In FIG. 14A, a plurality of external devices project the SOS holographic image of “Hong Gil Dong has not used the mobile phone for 24 hours.”

Next, in FIG. 14B, the SOS message 1420 including the current location information of the user identified through the location information module is transmitted to a plurality of external devices that have established a data path with the first terminal.

The plurality of external devices that receive the information 1420 related to the emergency situation project the SOS holographic images 1421, 4122, 1423, 1424, and 1425 including the current location information of the user to the outside. Therefore, the emergency situation of the user and the location of the user can be grasped at a time, thus enabling effective coping.

Meanwhile, according to an embodiment of the present invention, various functions may be provided to protect the user from the projection of the holographic image.

That is, when directly projecting the holographic image into the eyes of the user may cause a risk, a function for preventing this will be described with reference to FIG. 15.

15 illustrates an example of a method for protecting a user from projection of a holographic image in accordance with one embodiment of the present invention.

In FIG. 15, it is assumed that the camera 121 and the holography module 156 are provided in the terminal to face the same direction.

In this case, when a predetermined shape is recognized through the lens of the camera 121 using the predetermined menu 1511, the user may prevent the holography module 156 from projecting the holographic image.

That is, when a predetermined shape is recognized through the lens of the camera 121, the holographic image is not projected (1512). In addition, the holographic image 1513 is projected only when a predetermined shape is not recognized through the lens of the camera 121.

Next, referring to FIG. 15B, a method of notifying that the holographic image is projected immediately before and / or immediately after projecting the holographic image is applied.

When the user selects a specific key 1521 to command the holographic image to be projected, the controller 180 may control to output a voice, a message, etc., such as “It is very dangerous to see the holographic laser light directly”. Can be. In addition, it is also possible to project a holographic image 1522, such as "looking directly at the holographic laser light is very dangerous" within a distance that does not reach the eyes of the user.

In addition, as shown in FIG. 15C, the projection of the holographic image may be paused (PAUSE) / resume (RESUME) depending on the presence or absence of shape recognition.

That is, when the holographic image 1541 is projected and the shape is recognized through the camera 121, the controller 180 performs a pause function so that the holography module 156 does not project the holographic image 1541. To execute (1542).

Thereafter, if the shape is not recognized through the camera 121, the controller 180 executes a resumption function so that the holography module 156 projects the holographic image 1541.

Therefore, it is possible to determine whether or not to project the holographic image in a flexible manner depending on the shape recognition.

Meanwhile, according to an embodiment of the present invention, a method of utilizing a holography function may be provided to prevent the loss or theft of a terminal.

For example, when the threshold distance between the user and the terminal is set in advance, and the distance difference between the user and the terminal is outside the preset threshold distance, the controller 180 may control the predetermined holographic image to be projected from the terminal. In this case, a holographic image including contents such as “theft alarm” may be projected.

In addition, when the user confirms that the terminal has been stolen, the user may remotely control the terminal through an external device to project the holographic image. At this time, by allowing the holographic image to be projected such as "It is a lost mobile phone", it is possible to quickly inform the surroundings of an emergency situation.

 This will be described in detail with reference to FIG. 16.

FIG. 16 illustrates an example of a method for preventing theft of a terminal capable of projecting a holographic image in accordance with an embodiment of the present invention.

First, referring to FIG. 16A, an example of a method of presetting a threshold distance between a user and a terminal is illustrated.

In FIG. 16A, it is assumed that 50m is set as a threshold distance between the user and the terminal.

Therefore, when the distance between the user and the terminal exceeds 50m, the controller 180 can project a holographic image having a content such as "theft alarm <50m away from the owner of the phone>" which is a preset content. .

In addition, referring to FIG. 16B, an example of projecting a holographic image by remotely controlling a terminal is illustrated.

When the user confirms the loss or theft of the terminal, the terminal may remotely control the holographic image to be projected through an external device (1621).

Accordingly, the controller 180 is “lost cell phone. If you contact us at <Hong Gil-dong 010-1234-5678>, we will revert. ”

However, the method described with reference to FIG. 16 is merely exemplary, and the contents of the present invention may be implemented through other methods using a holography function.

Meanwhile, according to an embodiment of the present invention, the above-described method may be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

A mobile terminal having a display unit capable of displaying a stereoscopic image as described above is not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified in various ways. All or some of these may optionally be combined.

Claims (20)

A control unit;
A holographic storage medium for recording an interference fringe generated by an interference phenomenon of light; And
When at least one of a plurality of preset trigger events occurs, the first light generated by the interference pattern and the diffraction phenomenon by the light irradiated to the holographic storage medium under the control of the controller Including a holographic output module for outputting a holographic image,
The control unit is characterized in that for controlling the output of the first holographic image including the first information is set in advance to inform the user of the emergency situation. The method of claim 1,
The preset plurality of trigger events include a specific key input event, a touch input event of a specific pattern, a voice recognition event, a motion recognition event, a fingerprint recognition event, an eye-tracking recognition event, and a wind recognition event. Mobile terminal. The method of claim 1,
Further comprising a wireless communication unit,
The control unit controls to output the first holographic image when a call connection attempt or a message is received from a preset object through the wireless communication unit. The method of claim 1,
Sensing unit; And
Further comprising a wireless communication unit,
And the first information is voice information of the user recognized through the sensing unit or message information received from a preset object through the wireless communication unit. 5. The method of claim 4,
The controller controls the first information to be the voice information or the message information when the voice information or the message information includes at least a part of preset keyword information. The method of claim 1,
The controller controls the first holographic image to be output according to at least one preset holographic pattern.
The at least one holographic pattern is determined by at least one of a distance difference between the holographic output module and the output holographic image and a shape of the output holographic image.
The distance difference and the shape of the output holographic image may be changed over time, the mobile terminal. The method of claim 1,
The controller controls the first holographic image to be output according to at least one preset holographic pattern.
The at least one holographic pattern is determined by at least one of the movement, rotation, color change, size change, and blinking of the output holographic image.
The movement, rotation, color change, size change, flashing may be changed over time, the mobile terminal. The method of claim 1,
An alarm unit; And
Further comprising a wireless communication unit,
When the first holographic image is output, the controller outputs a signal for notifying an emergency situation of the user through the alarm unit, or controls to transmit a call connection attempt or a preset message to a preset object through the wireless communication unit. Mobile terminal, characterized in that. The method of claim 8,
Further comprises a location information module,
The control unit,
And transmitting the location information of the mobile terminal obtained through the location information module when the call connection attempt or the preset message is transmitted to the preset object. The method of claim 1,
Further comprising a wireless communication unit,
The control unit establishes a data path with at least one external device through the wireless communication unit, and controls to transmit the first information to the at least one external device through the constructed data path. . The method of claim 10,
And the control unit divides the first information into a plurality of pieces of information, and controls the mobile terminal and the at least one external device to output each of the separated pieces of information as a holographic image. The method of claim 1,
Further comprising a camera configured to face the same direction as the holographic output module,
When the predetermined shape is recognized by the camera, the controller is characterized in that the control to not output the first holographic image, the mobile terminal. 13. The method of claim 12,
And when the predetermined shape is not recognized through the camera, controlling the first holographic image to be output again. The method of claim 1,
When the distance difference between the mobile terminal and the user exceeds a preset threshold distance,
The controller controls the first holographic image to be output. Presetting a plurality of trigger events and first information for informing an emergency of a user;
Generating at least one of the plurality of trigger events; And
And outputting, by the holographic output module, a first holographic image including the first information. 16. The method of claim 15,
The plurality of trigger events include a specific key input event, a touch input event of a specific pattern, a voice recognition event, a motion recognition event, a fingerprint recognition event, an eye-tracking recognition event, a wind recognition event, Control method of a mobile terminal. 16. The method of claim 15,
And the first information is voice information of the user recognized through a sensing unit or message information received from a preset object through a wireless communication unit. 18. The method of claim 17,
And the first information is the voice information or the message information when the voice information or the message information includes at least a part of preset keyword information. 16. The method of claim 15,
When the first holographic image is output, the method further includes outputting a signal for notifying the emergency situation of the user through an alarm unit or transmitting a call connection attempt or a preset message to a preset object through a wireless communication unit. Terminal control method. 16. The method of claim 15,
Establishing a data path with at least one external device through a wireless communication unit; And
And transmitting the first information to the at least one external device through the established data path.

Images