KR101663375B1 - Wearable device, mobile terminal and system - Google Patents

Abstract

The mobile terminal includes a wearable device having a first wireless communication device, an audio output unit and at least one camera, a second wireless communication device performing wireless communication with the wearable device, a touch screen capable of displaying information and receiving a touch input The touch screen having an icon for displaying a control screen for controlling the wearable device, a control screen for displaying the control screen when the icon is selected, a control area for controlling the first area for controlling the sound, And controls the second area to be displayed at the same time.

Description

[0001] WEARABLE DEVICE, MOBILE TERMINAL AND SYSTEM [0002]

The present invention relates to a wearable device, a mobile terminal, and a system that enable the use of a terminal to be realized with further consideration of user convenience.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal according to whether the user can directly carry the mobile terminal.

The functions of mobile terminals are diversified. For example, there is data and voice communication, photo image and video shooting through a camera, voice recording, music file playback through a speaker system, and output of an image or video on a display unit (screen). Some terminals are equipped with an electronic game play function or a multimedia player function. In particular, recent mobile terminals can receive multicast signals that provide visual content such as broadcast programs and video.

Such a terminal has various functions, for example, a multimedia player having a combination of functions such as photographing an image or moving picture, playing music or a moving picture file, playing a game, receiving a broadcast, .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

As a kind of terminal, there is a wireless sound device.

The wireless sound device may be worn on the user's neck and various functions may be implemented by interlocking with the mobile terminal.

A wireless sound device is worn on a user's neck and is not required to be held separately by a user, and is attracting attention as a wearable device.

Various functional additions have been made to the wireless acoustic apparatus, and studies on a configuration and / or user experience (UX) optimized for a wireless acoustic apparatus are actively underway.

The present invention is directed to solving the above-mentioned problems and other problems. Another object of the present invention is to provide a wearable device, a mobile terminal and a system that can improve user convenience by using a camera function.

According to a first aspect of the present invention, there is provided a mobile terminal comprising: a wearable device having a first wireless communication device, an audio output unit, and at least one camera; A second wireless communication device for performing wireless communication with the wearable device; a touch screen capable of displaying information and receiving a touch input, the touch screen having an icon for displaying a control screen for controlling the wearable device; And a control unit for displaying the control screen when the icon is selected, wherein the control screen controls a first area for controlling the sound and a second area for controlling the camera to be simultaneously displayed.

According to a second aspect of the present invention, a mobile terminal includes a wearable device having a first wireless communication device, an audio output unit, and at least one camera; A second wireless communication device that performs wireless communication with the wearable device; A touch screen capable of displaying information and receiving a touch input, the touch screen having an icon for displaying a control screen for controlling the wearable device; And a controller for controlling the display of the control screen when the icon is selected and the control screen to simultaneously display a sound control screen for controlling the sound and a button for controlling the at least one camera.

The effects of the wearable device, the mobile terminal and the system according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the user can listen to the radio broadcast while listening to the radio broadcast, and check the surrounding motion or danger in real time through the screen of the mobile terminal on which the forward and / or backward images provided from the wearable device are displayed So that the safety of the user can be secured.

In addition, according to at least one embodiment of the present invention, the forward and / or backward images provided from the wearable device are recorded in real time, so that the user can view the video corresponding to a specific time zone in the recorded image at any time, It has the advantage of providing important evidence for contact accidents or crime scenes.

In addition, according to at least one embodiment of the present invention, it is possible to easily find the name of the user or a place where the user wants to go using the forward and / or backward images provided from the wearable device and the current position information of the user There is an advantage that it can be.

In addition, according to at least one embodiment of the present invention, it is possible to provide a guide route to the user based on the forward image and / or the backward image provided from the wearable device, It has the advantage of providing memories of travel.

According to at least one of the embodiments of the present invention, when the control screen for the wearable device is displayed in the area where the widget icon is displayed, the other icons are not disturbed by the control screen for the wearable device, So that it is possible to maximize the user's convenience by detecting the forward or backward situation through the control screen for the wearable device as well as music reproduction and radio listening, and utilizing the functions assigned to the icon through execution of the icon.

According to at least one of the embodiments of the present invention, even in a locked state, music playback, radio listening, shooting for a forward or backward object in a wearable device or shooting forward or backward in a wearable device using a music control screen or a camera control screen It is not necessary to control the wearable device on the home screen through unlocking, thereby improving the security reliability of the user.

In addition, according to at least one of the embodiments of the present invention, the user can view not only the front photograph image but also the photographic images in all directions at the same time, It is possible to provide a pleasure of a photographic image.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood that the specific embodiments, such as the detailed description and the preferred embodiments of the present invention, are given by way of example only.

1 is a schematic diagram showing a system including a wearable device and a mobile terminal according to the present invention.
2 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.
3 is a block diagram illustrating a wearable device according to an embodiment of the present invention.
4 is a view showing a use state of a wearable device with a mobile terminal according to the present invention.
5 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device according to the first embodiment of the present invention on a mobile terminal.
FIG. 6 is a diagram illustrating a method of displaying a control screen for controlling a wearable device according to the first embodiment of the present invention on a mobile terminal.
FIG. 7 is a view showing a first screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.
8 is a view showing the current viewing angle of the rear camera of the rear camera module.
9 is a view showing a state in which the rear camera of the rear camera module is adjusted to vary the viewing angle.
FIG. 10 is a view illustrating a preview screen displayed when all the buttons displayed on the camera control screen shown in FIG. 6C are selected.
FIG. 11 is a view showing a third screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.
FIG. 12 is a view showing a fourth screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.
FIG. 13 is a view showing a fifth screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.
FIG. 14 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a second embodiment of the present invention.
FIG. 15 is a diagram for explaining a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a second embodiment of the present invention.
16 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a third embodiment of the present invention.
17 is a diagram illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a third embodiment of the present invention.
18 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a fourth embodiment of the present invention.
FIG. 19 is a diagram for explaining a method for displaying a control screen for controlling a wearable device on a mobile terminal according to a fourth embodiment of the present invention; FIG.
20 is a diagram illustrating a method of selectively activating the front camera module and the rear camera module according to the number of touches of the wearable device.
FIG. 21 is a view showing a screen showing a method for selectively activating the front camera module and the rear camera module according to the distance from the wearable device.
22 is a flowchart illustrating a method of automatically photographing a wearable device according to the present invention in a specific situation.
23 is a diagram illustrating a first screen for explaining a method of automatically photographing a wearable device according to the present invention in a specific situation.
24 is a diagram illustrating a second screen illustrating a method of automatically photographing a wearable apparatus according to the present invention in a specific situation.
25 is a flowchart illustrating a method of automatically photographing a wearable device according to the present invention in a specific situation.
26 is a flowchart illustrating a method of photographing a photographic image when a camera module is shaken in a wearable device according to the present invention.
27 is a diagram illustrating a screen for explaining a method of photographing a photographic image when a camera module is shaken in a wearable device according to the present invention.
28 is a view showing a moving picture composed of a plurality of frame images.
29 is a flowchart illustrating a method of recording a forward video and a backward video using the wearable device according to the present invention.
30 is a diagram for explaining a method of displaying a video image recorded by a wearable device according to the present invention on a mobile terminal.
31 is a diagram for explaining a method of switching the forward and backward video playback regions shown in FIG. 30 to each other.
32 is a diagram illustrating a first screen for explaining a method of varying the forward image playback area shown in FIG.
FIG. 33 is a diagram illustrating a second screen for explaining a method of varying the forward image reproduction area shown in FIG. 30. FIG.
FIG. 34 is a flowchart illustrating a method of easily finding a building at a specific place by a user using the wearable device according to the present invention.
35 is a diagram illustrating a screen for explaining a method of registering a destination including a place and a name;
36 is a flowchart illustrating a method of displaying a list of photographic images photographed by the wearable device of the present invention on a road view map on a mobile terminal.
37 is a diagram for explaining a method of displaying a photographic image provided from a wearable device on a mobile terminal.
38 is a diagram for explaining a method of displaying a road view map on a mobile terminal.
FIG. 39 is another exemplary screen illustrating a method of displaying a road view map on a mobile terminal. FIG.
40 is a schematic view showing a system including a wearable device and a glass device according to the present invention.
FIG. 41 shows a state in which the front camera module and the rear camera module as well as the left camera module and the right camera module are additionally mounted on the wearable device.
42 is a diagram illustrating a screen for explaining a selective display method of a music control screen and a preview screen.
FIG. 43 is a flowchart showing a method of photographing with a mobile terminal instead of a wearable device.
44 is a view showing a screen in which a front camera module of a wearable device is blocked by a mobile terminal;

Hereinafter, a wearable device according to an embodiment of the present invention will be described in detail with reference to the drawings.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

1 is a schematic diagram showing a system including a wearable device and a mobile terminal according to the present invention.

Referring to FIG. 1, a system according to a first embodiment of the present invention includes a wearable device 200 and a mobile terminal 100 capable of wireless communication with the wearable device 200.

The wearable device 200 may be a component of the mobile terminal 100, but is not limited thereto.

Here, the wearable device 200 may be referred to as a first terminal and the mobile terminal 100 may be referred to as a second terminal, or vice versa. The plurality of wearable devices and the plurality of mobile terminals may be interlocked with each other as the third terminal and the fourth terminal. This naming can be applied to all of the following embodiments in which the wearable device 200 and the mobile terminal 100 are connected to each other to exchange information.

The wearable device 200 described in the present invention may be a wearable device worn on the user's neck and capable of performing various functions such as music playing, radio broadcast listening, video call, and video shooting.

The wearable device 200 described in the present invention may be equipped with a plurality of camera modules. Accordingly, the wearable device 200 can photograph or monitor objects existing in the front, rear, or upper direction of the wearable device 200 using a plurality of camera modules. This will be described later in detail.

The wearable device 200 described in the present invention may perform its own function or function to support the mobile terminal 100 using the wireless communication of the wearable device 200.

When the wearable device 200 performs a function of supporting the mobile terminal 100, some functions of the wearable device 200 may overlap with those of the mobile terminal 100. [ In this case, only the functions of the wearable device 200 or the functions of the mobile terminal 100 among the functions common to the wearable device 200 and the mobile terminal 100 by the wearable device 200 or the mobile terminal 100 May be controlled to be performed, but it is not limited thereto.

The mobile terminal 100 described in the present specification may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) slate PCs, tablet PCs, ultrabooks, wearable devices (e.g., smartwatches, smart glass, HMDs (head mounted displays), etc.) And all devices that display the screen are also included.

However, it should be noted that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, A person skilled in the art will readily appreciate.

The mobile terminal 100 and the wearable device 200 can exchange information with each other using wireless communication. To this end, the mobile terminal 100 and the wearable device 200 may be equipped with communication modules 114 and 201c, respectively.

For example, the mobile terminal 100 can control the wearable device 200 using the communication modules 114 and 201c to enable music playback or radio listening through the wearable device 200. [ In addition, the mobile terminal 100 can control the wearable device 200 using the wireless Internet to enable music playback or radio listening through the wearable device 200. [

For example, the mobile terminal 100 may control the wearable device 200 using wireless communication so that the wearable device 200 can make a telephone conversation with the other party.

For example, the mobile terminal 100 may control the wearable device 200 using wireless communication to shoot a forward video and / or a backward video through the wearable device 200. To this end, the wearable apparatus 200 may include a front camera module for photographing a front image and a rear camera module for photographing a rear image.

For example, the mobile terminal 100 may control the wearable apparatus 200 by using wireless communication so that the photographed image through the wearable apparatus 200 is received and stored or displayed on the mobile terminal 100. The image may be a still image, a photo image, or a moving image.

For example, the mobile terminal 100 may control the wearable device 200 using wireless communication to activate the front camera module and / or the rear camera module mounted on the wearable device 200 so as to monitor forward or backward . Depending on the situation or needs of the user, it is possible to display through a plurality of cameras.

2 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.

2, a mobile terminal 100 according to an embodiment of the present invention includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, A memory 170, a control unit 180, a USIM unit 130, a power supply unit 190, and the like. The components disclosed in FIG. 2 may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected to the portable terminal 100 and the wearable device 200 or between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100. [ 100, or between the mobile terminal 100 and the external server. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a communication module 114, and a location information module 115.

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal or an audio input unit, a user input unit 123 for receiving information from a user, A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal 100, surrounding environment information surrounding the mobile terminal 100, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, a red-green-blue sensor, an infrared sensor, a finger scan sensor, An ultrasonic sensor, an optical sensor (e.g., a camera 121), a microphone 122, a battery gauge, an environmental sensor (e.g., a barometer, a hygrometer , A thermometer, a radioactivity sensor, a thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal 100 disclosed in this specification can combine and utilize the information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 may include an interface module such as a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a USIM card 130, An audio input / output port, a video I / O port, and an earphone port, which are connected to the apparatus, can do. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

The memory 170 stores data supporting various functions of the mobile terminal 100. [ The memory 170 may store a plurality of application programs or applications driven by the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. In addition to the basic functions, the mobile terminal 100 can store data generated in a device capable of being additionally provided. The application program may be stored in the memory 170 and installed on the mobile terminal 100 and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal 100.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components to drive an application program stored in the memory 170. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 may include a battery, which may be an internal battery or a replaceable battery, or may be a wireless type battery.

At least some of the above components may operate in cooperation with each other to implement a method of operation, control, or control of the mobile terminal 100 according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal 100 may be implemented on the mobile terminal 100 by driving at least one application program stored in the memory 170.

Meanwhile, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 111 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching of at least two broadcast channels.

Although not shown, the wireless communication unit 110 may further include a radio receiving module. The radio receiving module may receive the radio signal provided by the broadcasting station and provide the radio signal to the user.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).

The wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, Umbrella Cell, Hyper Cell, Macro Cell Micro Cell, Pico Cell, Wireless LAN, Wi-Fi, Wireless Fidelity Direct, DLNA (HSDPA), Long Term Evolution (LTE), Long Term Evolution (LTE), and Long Term Evolution (LTE). Term Evolution-Advanced). The wireless Internet module 113 transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above. Umbrella Cell has a radius of more than 100 km and can be applied to satellite communications. Hyper Cell has a radius of 20 km or more and can be applied to urban suburbs. The Macro Cell has a radius of less than 20 km and can be used around highways. The Micro Cell has a length of less than 300m and can be applied to urban areas. The pico cell is within 100m and can be applied in the building.

 The communication module 114 is for short range communication and may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), a UWB (Ultra Wideband), a ZigBee, an NFC Field Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technology. The communication module 114 may communicate with the mobile terminal 100 and the wearable device 200 through the wireless communication network or between the mobile terminal 100 and the wireless communication system, And may support wireless communication between the terminals 100 or between the mobile terminal 100 and another mobile terminal 100 (or an external server). The wireless communication network may be a Wireless Personal Area Network or a Wireless Body Area Network.

Herein, another mobile terminal 100 is a wearable device capable of interchanging (or interlocking) data with the mobile terminal 100 according to the present invention, for example, a wearable device according to an embodiment of the present invention Device 200, smart watch, smart glass, HMD (head mounted display)). The communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. Further, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of data processed in the mobile terminal 100 to the communication module 114 ) To the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The wearable device 200 may also be a wearable device, so that when a call is received at the mobile terminal 100, the user can make a phone call through the wearable device 200 or wear the music files of the mobile terminal 100 To the device 200, so that the wearable device 200 can reproduce the music files.

The position information module 115 is a module for obtaining the position (or the current position) of the mobile terminal 100. Examples of the module include a Global Positioning System (GPS) module, a wireless communication chip (ScenSor), or a wireless fidelity (WiFi) There is a module. The wireless communication chip (ScenSor) may be a chip for indoor location information obtained in 2013 as a standard (IEEE 802.14.4 wireless protocol). For example, when the mobile terminal 100 utilizes the GPS module, it can acquire the position of the mobile terminal 100 using a signal transmitted from the GPS satellite. As another example, when the mobile terminal 100 utilizes the Wi-Fi module, the location of the mobile terminal 100 is determined based on the information of the wireless AP (wireless access point) transmitting or receiving the wireless signal with the Wi- Can be obtained. Optionally, the location information module 115 may substitute or additionally perform any of the other modules of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal 100. The position information module 115 is a module used for obtaining the position (or the current position) of the mobile terminal 100, and is not limited to a module for directly calculating or acquiring the position of the mobile terminal 100. [

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. For example, the mobile terminal 100 may include a front camera disposed on the front surface of the body of the mobile terminal 100 and a rear surface camera disposed on the rear surface of the body. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or may be stored in the memory 170. A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal 100, surrounding environment information surrounding the mobile terminal 100, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or in the vicinity thereof without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner region of the mobile terminal 100 wrapped by the touch screen as described above or in proximity to the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts a photo diode and a transistor (TR) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photodiode . That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. Typical examples of the haptic effect generated by the haptic module 153 may be vibration and temperature. The intensity, pattern, temperature difference, and the like of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output by the optical output unit 154 is implemented as the mobile terminal 100 emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated when the mobile terminal 100 detects an event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM) ), Electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The mobile terminal 100 may operate in association with a web storage and a cloud system that perform a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal 100 satisfies a set condition, the controller 180 may execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing that can recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

Meanwhile, the wearable device 200 is an audio device capable of wirelessly receiving and listening to music or radio broadcasts reproduced by the mobile terminal 100 while wearing the wearable device 200, and a plurality of camera modules Can be mounted.

The camera module mounted on the wearable device 200 can operate the photographing button provided on the wearable device 200 by directly operating the user and can also display an application or an application program provided in the mobile terminal 100 So that the camera module can be operated wirelessly. For example, when an application installed in the mobile terminal 100 is executed and a camera focus adjustment or a direction adjustment and a shooting instruction of a camera lens are inputted, the instruction is transmitted to the wearable device 200 wirelessly, It is possible for the camera module to operate.

The images or moving images photographed through the camera module provided in the wearable device 200 may be wirelessly transmitted to the mobile terminal 100 and displayed on the display unit 151 of the mobile terminal 100, 100). ≪ / RTI >

In addition, an image formed on the camera of the wearable device 200 is displayed in a pre-view form on the display unit 151 of the mobile terminal 100, The image formed on the camera module can be checked in real time through the camera module 151.

The appearance of the wearable device 200 will be schematically described below.

The wearable apparatus 200 includes a band 210 that is hooked to a user's neck, a pair of housings 220a and 220b coupled to both ends of the band 210, A pair of earphones 240 that can be pulled out from the earphones 220a and 220b and can be inserted into a user's ear to listen to music or radio broadcasts and one or a plurality of camera modules for photographing. The one or more camera modules include a front camera module 280 mounted on one or both of the pair of housings 220a and 220b and a rear camera module 290 mounted on the center of the band part 210 ).

1, the front camera module 280 is mounted on one side of the first and second housings 220a and 220b or on both sides of the first and second housings 220a and 220b, At least one can be mounted.

The band 210 includes a first band 210a placed on the right neck portion and a shoulder portion of the user and a second band 210b placed on the left neck portion and the shoulder portion of the user, One end of the band 210a and one end of the second band 210b are connected together by the rear camera module 290 to form the band portion 210. [ The pair of housings 220a and 220b are connected to the other ends of the first band 210a and the second band 210b, respectively.

One or a plurality of illuminance sensors 260 may be mounted on the outer circumferential surface of the band portion 210. For example, a brightness change may be detected from the brightness sensor 260 and a warning sound may be output to the user. For example, when the user approaches the user while walking while listening to music while the earphone 240 is plugged into the ear, the illuminance sensor 260 detects the light emitted from the headlight of the vehicle. Then, a warning sound or vibration is generated through the earphone 240, so that the user can promptly detect an accident risk.

The front camera module 280 is mounted on one of the first and second housings 220a and 220b and the lens unit of the front camera module 280 is mounted on the first and second housings 220a and 220b As shown in FIG. A play button 223 for playing and stopping music may be disposed on the upper surfaces of the first and second housings 220a and 220b corresponding to a certain point spaced apart from the front camera module 280. [ A button for operating the rear camera module 290 may be provided on the upper surfaces of the first and second housings 220a and 220b corresponding to a position separated from the play button 223. The buttons for operating the rear camera module 290 may include a photographing button 233 and an angle adjusting button 233a disposed at the front and rear of the photographing button 233, respectively. The angle adjusting button 233a is a button for rotating the rear camera module 290 in the vertical direction. When the button located in front of the photographing button 233 is pressed, the rear camera module 290 rotates upward , The rear camera module 290 can be rotated downward by pressing the button located at the rear side.

In addition to the buttons described above, various buttons may be provided on one side of the first and second housings 220a and 220b. For example, a mode selection button 235 for selecting one of music and radio broadcast, a channel selection button 232 for selecting a broadcast station channel when a radio broadcast is selected, and the front camera module 280 A volume button 224 for adjusting the size of the sound output through the earphone 240 and a reel button 234 for automatically winding the earphone 240 sound cable ). The buttons may be installed to expose or protrude from the outer circumferences of the first and second housings 220a and 220b. The buttons may be a push-button type in which a user presses a dome switch of a circuit board by a finger, a wheel-shaped type in which a command is inputted by rotating a predetermined amount forward or backward, a touch- Various types of button structures including a vibration detection button type using a haptic module that receives a command by sensing the vibration generated when the robot is knocked on the robot can be applied.

Similarly to the angle adjusting button 233a for rotating the rear camera module 290 in the up and down direction, the angle adjusting button for rotating the front camera module 280 in the up and down direction is disposed in the first and second housings 220a, 220b, respectively.

The angle adjusting button 233a is a button for rotating the rear camera module 290 in the vertical direction. When the button located in front of the photographing button 233 is pressed, the rear camera module 290 rotates upward , The rear camera module 290 can be rotated downward by pressing the button located at the rear side.

In addition, the other of the pair of housings 220a and 220b includes a call button 223a, a volume button 224a for adjusting the volume of the call volume, and an audio cable connected to the earphone 240, A reel button 234 may be provided.

The volume button 224a and the reel button 234 may be disposed on the sides of the housings 220a and 220b, and the volume button 224a and the reel button 234 may be disposed on the sides of the housings 220a and 220b. . A power switch 229 is provided on a side surface of the housings 220a and 220b to turn the power of the wearable device 200 on and off so that when the wearable device 200 is not in use, Can be minimized.

In addition, an interface such as a USB port 228 may be provided on one side of the first and second housings 220a and 220b. When the USB port 228 is not in use, the USB port 228 is kept blocked by the cover. In order to connect the USB cable for charging, the cover 226 may be opened to insert the cable terminal. Alternatively, the USB memory may be inserted into the USB port 228 to play back, for example, an audio file stored in the USB memory.

Here, it is noted that the positions of the buttons are not limited to the positions shown in the drawings of the present invention, and can be installed at appropriate positions to maximize the convenience of the user.

Meanwhile, a speaker hole 241 may be formed on one upper surface of the first and second housings 220a and 220b so that sound is output to the outside during voice communication. That is, a voice message can be output to either the earphone 240 or the speaker hole 241 by a user's selection, and a button for selecting the voice can be output to the first and second housings 220a and 220b As shown in FIG. A speaker module may be installed in one side of the first and second housings 220a and 220b corresponding to the lower side of the speaker hole 241. [

In addition, a microphone hole 221c is formed on one side of the outer circumferential surface of the first and second housings 220a and 220b, specifically, on one side of the upper surface, so that a user's own voice can be input during a telephone conversation.

Hereinafter, the internal configuration system of the wearable device 200 having the above-described external configuration will be described in detail. All of the components disclosed only in the system may be provided in a module form or an electric device form on a circuit board installed in the first and second housings 220a and 220b of the wearable devices 200 according to the embodiment of the present invention, Or a component that can be electrically connected to the circuit board in the form of a component.

3 is a block diagram illustrating a wearable device according to an embodiment of the present invention.

Referring to FIG. 3, the configurations of the wearable device 200 according to the embodiment of the present invention described below may be a configuration commonly provided to the wearable devices 200 according to all the embodiments described below .

In addition, some of the components described below may be components having the same function and operation as the components included in the mobile terminal 100. [

The description of the components that are the same as those of the components of the mobile terminal 100 and those that operate in the mobile terminal 100 will be omitted from the following description of the mobile terminal 100 Can be easily understood.

In detail, the wearable device 200 according to the embodiment of the present invention includes a wireless communication unit 201, an input unit 202, a sensing unit 204, an output unit 205, an interface unit 206, a memory 207, A control unit 208, a USIM unit 203, a power supply unit 209, and the like.

The wireless communication unit 201 may include one or more modules that enable wireless communication between the wearable device 200 and the mobile terminal 100 or between the wearable device 200 and an external server.

The wireless communication unit 201 may include at least one of a radio receiving module 201a, a mobile communication module 201b, a communication module 201c, and a location information module 201d.

The input unit 202 may include a camera 202a or an image input unit for inputting a video signal, a microphone 202b or an audio input unit for inputting an audio signal, and a user input unit 202c for receiving information from a user . The camera 202a includes a front camera module 280 and a rear camera module 290 included in the wearable device 200 according to an embodiment of the present invention. The user input units 202c include various buttons described above. The microphone 202b includes a microphone provided in the wearable device 200. [

The sensing unit 204 may include a proximity sensor 204a, an illuminance sensor 204b (260 in FIG. 1), a touch sensor, an acceleration sensor, a magnetic sensor, a G- And may include at least one of a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, and an ultrasonic sensor. have. The sensors may be the same sensors as the sensors provided in the mobile terminal 100. Particularly, the illuminance sensor 204b may include an illuminance sensor 260 provided in the band 210 of the wearable device 200. FIG.

The proximity sensor 204a refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or in the vicinity thereof without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 204a of the wearable device 200 may be disposed on a part of the upper surface of the housings 220a and 220b of the wearable device 200. [

The output unit 205 may include at least one of an acoustic output unit 205a, a haptic module 205b, and a light output unit 205c. The sound output unit 205a may include speakers included in the housings 220a and 220b of the wearable device 200 and speakers included in the earphone 240. [

The interface unit 206 serves as a communication path with various kinds of external devices connected to the wearable device 200. The interface unit 206 may include an external charger port, a data port such as the USB port 228, a memory card port, a device having an identification module such as the USIM unit 203, And a port for connecting the first terminal and the second terminal.

In addition, the memory 207 stores data supporting various functions of the wearable device 200. The memory 207 may store a plurality of application programs driven by the wearable device 200, data for operating the wearable device 200, and commands. At least some of these applications may be downloaded from an external server via wireless communication.

The control unit 208 controls the overall operation of the wearable device 200 in addition to the operations associated with the application program. The control unit 208 processes signals, data, and information input or output through the above-mentioned components, or drives an application program stored in the memory 207 to provide or process appropriate information or functions to the user have.

Under the control of the controller 208, the power supply unit 209 supplies power to the components included in the wearable device 200 by receiving external power or internal power. The power supply unit 209 includes a battery, which may be an internal battery or a replaceable battery.

Meanwhile, the radio receiving module 201a of the radio communication unit 201 receives radio information received through a radio broadcasting channel. More than one such radio receiving module may be provided to the wearable device 200 for simultaneous broadcast reception or radio broadcast channel switching for at least two radio broadcast channels.

The mobile communication module 201b may be a mobile communication module or a mobile communication module that can be used in a mobile communication system such as a mobile communication system, (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE (High Speed Downlink Packet Access) A (Long Term Evolution-Advanced), or the like), the mobile terminal transmits and receives a radio signal to at least one of a base station, an external terminal, and a server. The mobile communication module 201b and the USIM card are installed in the wearable device 200 so that the wearable device 200 itself can perform the function of the mobile phone.

The wearable device 200 can make direct telephone conversation with the other party without passing through the mobile terminal 100 using the mobile communication module 201b and the USIM card.

If the mobile communication module 201b and the USIM card are not provided in the wearable device 200, the wearable device 200 can make a telephone conversation with the other party via the mobile terminal 100. [

The wireless signal may include various types of data according to a voice call signal or a text / multimedia message transmission / reception. If the wearable device 200 is provided with a display window, transmission / reception of text / multimedia messages will also be possible.

The communication module 201c is for short range communication and may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), a UWB (Ultra Wideband), a ZigBee, an NFC (Wi-Fi), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

The positional information module 201d is a module for acquiring the position of the wearable device 200, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module.

Next, the input unit 202 is for inputting image information, audio information (or signal), data, or information input from a user. For inputting image information, the wearable device 200 may include one or A plurality of camera modules may be provided.

The one or more camera modules process image frames such as still images or moving images obtained by the image sensor in the photographing mode. The processed image frame may be stored in the memory 207. The processed image frame 207 may be transmitted to the mobile terminal 100 through the communication module 201c and stored in the memory 170. [ In other words, a stereo structure may be arranged to acquire a left image and a right image for implementing a stereoscopic image through a camera 202a of the mobile terminal 100, that is, a plurality of camera modules.

The microphone 202b processes the user's voice signal input during the call process as electrical voice data. The processed voice data is transmitted to the mobile terminal 100 and transmitted from the mobile terminal 100 to the mobile terminal 100 of the other party. Meanwhile, various noise elimination algorithms may be implemented in the microphone 202b to remove noise generated in receiving an external sound signal.

The user input unit 202c may include a button, a dome switch, a jog wheel, a jog switch, and a touch type input unit.

Meanwhile, the sensing unit 204 senses at least one of information in the wearable device 200, surrounding environment information surrounding the wearable device 200, and user information, and generates a corresponding sensing signal. The control unit 208 may control the driving or operation of the wearable device 200 or perform data processing, function or operation related to the application program installed in the wearable device 200 based on the sensing signal. The sensing unit 204 may correspond to a sensing unit having the same concept as that of the sensing unit included in the mobile terminal 100.

The camera 202a includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The sound output unit 205a may output audio data received from the wireless communication unit 201 or stored in the memory 207 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 205a also outputs a sound signal related to a function (e.g., a call signal reception sound) performed by the mobile terminal 100. [ The sound output unit 205a may include an earphone 240 and a speaker.

The haptic module 205b generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 205b may be vibration. The intensity and pattern of the vibration generated in the haptic module 205b can be controlled by the user's selection or setting of the control unit 208. [ For example, vibration may be generated by tapping the housings 220a and 220b of the wearable device 200 with a finger, and the vibration may be sensed by the haptic module 205b to perform a photographing operation of an image or an image have.

The haptic module 205b can transmit a tactile effect through direct contact, and can be implemented so that a user can feel a tactile effect through a muscular sense such as a finger or an arm. At least two haptic modules 205b may be provided according to the configuration of the mobile terminal 100. [

The light output unit 205c may output a signal for notifying the occurrence of an event by using light emitted from a light source provided in the wearable device 200. [ For example, a call signal reception, a missed call, an alarm, and the like may be included in the notification event.

Meanwhile, the identification module including the USIM unit 130 includes a user identification module (UIM), a subscriber identity module (SIM), and the like in addition to the universal subscriber identity module (USIM) can do. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the wearable device 200 through the interface part 206. [

The memory 207 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk.

Various embodiments that may be implemented by a system configured as described above will be described.

According to the wearable apparatus of the present invention, when the power is turned on, the music is reproduced by the play button 223 of the wearable device 200, the music file stored in the memory 207 of the wearable device 200, The music file stored in the memory 170 of the wearable device 100 may be wirelessly transmitted to the wearable device 200 and output through the speaker of the wearable device 200.

According to the wearable device of the present invention, the camera modules 280 and 290 of the wearable device 200 automatically switch on and off at least one of the front camera module 280 and the rear camera module 290 The image can be instantly turned off after one or more pictures are taken.

According to the wearable apparatus of the present invention, when it is recognized that the position change is changed by a certain distance through the position information module 201d of the wearable device 200, that is, the GPS, the front camera module 280 and the rear camera module 290 At least one of the images is turned on instantaneously and then one or more images are taken and then turned off.

According to the wearable device of the present invention, at least one of the front camera module 280 and the rear camera module 290 is turned on by recognizing the surrounding situation through a sensor, for example, the proximity sensor 204a and / or the infrared sensor, May be turned off after one or plural photographs are taken. Peripheral conditions may include sensing a change in the size of the ambient sound or sensing an approaching object.

According to the wearable device of the present invention, as another example, a touch input of the wearable device 200 is sensed through a touch sensor, a geomagnetic sensor, or the like, and an instruction to instantly perform shooting through the camera may be issued. According to this command, at least one of the front camera module 280 and the rear camera module 290 is turned on, and one or a plurality of images are taken instantaneously and then turned off.

According to the wearable apparatus of the present invention, the surrounding situation can be photographed by using the photographing button 233 provided in the wearable apparatus 200. [

According to the wearable apparatus of the present invention, the front camera module 280 and / or the rear camera module 290 can automatically capture images without user's manipulation while playing music. The captured image may not be displayed on the screen largely, and an image captured in an edge area of the screen may be notified to the user by using an alarm or the like.

According to the wearable device of the present invention, when the user moves in conjunction with the mobile terminal, a preview screen for the rear camera of the mobile terminal and the front camera of the wearable device can be selectively displayed on the mobile terminal.

According to the wearable device of the present invention, when the mobile terminal is recognized to be held by the user, a preview screen for the front camera and / or the rear camera of the wearable device can be automatically displayed on the mobile terminal.

According to the wearable apparatus of the present invention, when a user is unable to hear external sounds or noises by amplifying music, when an external sound is micro-input from a wearable device, Red flashing screen) to inform the user of the danger. At this time, the sensitivity according to the external sound or noise can be adjusted by the user, so that it can be adjusted according to the user's environment or preference.

FIG. 4 is a view showing the use of a wearable device with a mobile terminal according to the present invention.

As shown in Fig. 4, the mobile terminal 100 may be held in the user's hand, and the wearable device 200 may be mounted to lie on the user's neck or be fixed.

The wearable device 200 can perform various functions by itself or under the control of the mobile terminal 100.

For example, the wearable device 200 may be controlled by the mobile terminal 100 and reproduce a music file stored in its own memory 207 or provided from a specific server through the mobile terminal 100 or the network.

For example, the wearable device 200 may receive radio broadcasts received by the mobile terminal 100 under the control of the mobile terminal 100, and may allow the user to listen to the radio broadcasts. Alternatively, when the radio receiving module is mounted on the wearable device 200, the wearable device 200 itself can receive radio broadcasts without being controlled by the mobile terminal 100, so that the user can listen to the radio broadcasts.

For example, the wearable device 200 can drive the camera modules 280 and 290 mounted on the wearable device 200 under the control of the mobile terminal 100.

As described above, the camera modules 280 and 290 mounted on the wearable device 200 include a front camera module 280 capable of receiving an image of a forward object, And a rear camera module 290. In this case, the wearable device 200 controls only the front camera module 280, the rear camera module 290 or the front camera module 280 and the rear camera module 290 simultaneously under the control of the mobile terminal 100 .

The camera modules 280 and 290 described in the present invention may include an accessory including a camera, such as a housing, a circuit board, and / or an electronic component.

The wearable apparatus 200 may be configured to transmit music using various buttons 223, 223a, 224, 224a, 232, 233, 233a, and 234 attached to the wearable apparatus 200 without being controlled by the mobile terminal 100 Reproduce, receive a radio broadcast, or drive the camera module 280, 290.

According to the present invention, the user can listen to the radio broadcast while listening to the music and check the movement or risk of the surroundings on the screen of the mobile terminal 100 on which the forward and / or backward images provided from the wearable device 200 are displayed So that the safety of the user can be secured.

According to the present invention, the forward and / or backward images provided from the wearable device 200 are recorded in real time so that the user can view images corresponding to a specific time period in the recorded images at any time, And to provide important evidence for this.

According to the present invention, it is possible to easily search for a user's desired business name or a place where the user wants to go to, using the forward and / or backward images provided from the wearable device 200 and the current position information of the user.

According to the present invention, it is possible to provide the user with a guide to the path traveled to the user based on the forward image and / or the backward image provided from the wearable device 200, Can be provided.

5 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device according to the first embodiment of the present invention on a mobile terminal.

Referring to FIG. 5, the mobile terminal 100 may perform pairing with the wearable device 200 (S311).

The wearable device 200 may be a component of the mobile terminal 100, but is not limited thereto.

In one embodiment, when the wearable device 200 approaches within a certain distance, the mobile terminal 100 can be automatically paired between the mobile terminal 100 and the wearable device 200.

In another embodiment, after the mobile terminal 100 activates the pairing function, pairing between the mobile terminal 100 and the wearable device 200 may be performed. This operation is to prevent the battery consumption of the mobile terminal 100 from being increased by activating the pairing function of the mobile terminal 100 at all times.

As another embodiment, after the wearable device 200 is powered on, pairing between the mobile terminal 100 and the wearable device 200 may be performed. This operation is to prevent the battery consumption of the wearable device 200 from being increased by activating the pairing function of the wearable device 200 at all times.

 On the other hand, an authentication process may be included in the pairing operation. The pairing can be performed only for the wearable device 200 in which the identification information is registered in the mobile terminal 100 in advance. When there is no pre-registration process in the mobile terminal 100, the mobile terminal 100 tries to pair with another mobile terminal 100 or a wearable device in the vicinity, and battery consumption of the mobile terminal 100 increases.

In order to perform the pairing operation, each of the mobile terminal 100 and the wearable device 200 may include communication modules 114 and 201c.

When the pairing with the wearable apparatus 200 is completed, the mobile terminal 100 controls the display unit 151 to display a wearable apparatus exclusive icon (1009 in FIG. 6) (S312).

Here, the completion of the pairing may mean that the authentication is successful and the wearable device 200 is connected to the mobile terminal 100. [ When the pairing is completed as described above, information and commands can be exchanged between the mobile terminal 100 and the wearable device 200. The wearable device exclusive icon (1009 in Fig. 6) may be displayed on any area of the display unit 151 of the mobile terminal 100 or displayed on a predetermined area. The icon for the wearable device can be forcibly installed by the manufacturer, but the invention is not limited thereto.

If the pairing between the wearable apparatus 200 and the mobile terminal 100 is canceled, the wearable apparatus exclusive icon (1009 in FIG. 6) may disappear on the display unit 151 of the mobile terminal 100, Do not.

An icon (1009 in Fig. 6) dedicated to the wearable device may be an application application capable of controlling the wearable device 200 using the mobile terminal 100. [ In particular, the icon (1009 in Fig. 6) dedicated to the wearable device may be an application that can control the music playback of the wearable device 200 or the camera modules 280 and 290 using the mobile terminal 100 .

The mobile terminal 100 can execute the wearable device exclusive icon (1009 in Fig. 6) (S313). For example, when a touch for the wearable device exclusive icon (1009 in Fig. 6) is input from the user, the mobile terminal 100 can execute the wearable device exclusive icon (1009 in Fig. 6).

6) is executed, the mobile terminal 100 controls the display unit 151 to display the control screen for the wearable apparatus (1015 in FIG. 6) (S314).

The control screen for the wearable apparatus (1015 in Fig. 6) may include a music control screen 1011 and a camera control screen 1013. [ The music control screen 1011 can be switched to the radio control screen. That is, the music control screen 1011 and the radio control screen can be switched to each other.

It may be named as a sound control screen instead of the music control screen 1011. [ The sound control screen can reproduce not only music but also other sounds.

The mobile terminal 100 confirms whether a music reproduction command is inputted (S315), and controls to reproduce the music according to the result (S316). For example, when a selection command for the stop and play button 1017 displayed on the music control screen 1011 is input, the mobile terminal 100 can recognize the selection command as a music reproduction command and reproduce the music.

The mobile terminal 100 can control to photograph an image from the front camera module 280 and / or the rear camera module 290 of the wearable device 200 using the control screen 1015 for the wearable device.

6) of the control screen 1015 for the wearable device for driving the front camera module 280 and / or the rear camera module 290 It is confirmed whether any one is selected (S317). Button may be a front camera button 1021, a rear camera button 1023 and an all button 1025 for driving both the front camera 1021 and the rear camera 1023. [

If a selection command for any one of the buttons 1021, 1023, and 1025 displayed on the wearable control screen 1015 is input, the mobile terminal 100 controls the wearable device 200 to select And a preview screen for an image input from the camera is displayed (S318).

For example, when the selection command for the all button 1025 is input, both the front camera module 280 and the rear camera module 290 are driven so that the front preview screen (1026 in Fig. 7) for the backward image input to the backward camera module 290 and the backward preview image (1026 in Fig. 7) for the backward image input to the backward camera module 290 can be displayed.

When a photographing command is inputted from a user, the mobile terminal 100 controls the wearable device 200 to photograph an image input to the camera (S319).

On the other hand, when the pairing is completed, the control bar can be displayed on the screen. The control bar may be a fold display state display area, or a control window may be displayed in which another layer is formed through a touch drag operation from the upper or lower bezel, and a control window for controlling the wearable device may be displayed on the display window. For example, a window for controlling the audio and camera of the wearable device can be displayed on the control window.

FIG. 6 is a diagram illustrating a method of displaying a control screen for controlling a wearable device according to the first embodiment of the present invention on a mobile terminal.

A widget icon 1003 and a plurality of icons 1005 may be displayed on the home screen 1001 of the display unit 151 of the mobile terminal 100 as shown in FIG. A soft key 1007 including a previous button, a home button, and a menu button is displayed on a lower area of the home screen 1001, and a status bar (not shown) on the upper area of the home screen 1001 1051 are displayed.

The previous button is a member for moving from the current screen to the previous screen. The home button is a member for moving the current screen directly to the home screen 1001. The menu button is a member for executing various menus such as setting, storing, moving, Lt; / RTI >

When the status display bar 1051 is dragged in a downward direction, for example, various functions or status information such as a quick setting function icon, a status or notification of a currently executed function, and the like can be displayed. Quick setting function icons can be displayed, for example, Q memo, Q slide, vibration / sound mode, WiFi, rotation, position information, Bluetooth, airplane mode, synchronization, NFC, Q voice, Q remote, editing and the like.

The widget icon 1003 may include, for example, time information and weather information. The widget icons 1003 may exist in various ways on the network, and these various widget icons 1003 may be downloaded and displayed on the mobile terminal 100. Accordingly, the user can change the widget icon 1003 displayed on the display unit 151 of the mobile terminal 100 to another widget icon.

The icon 1005 is an application that can execute a specific function. For example, various icons such as a phone icon, an email icon, a game icon, a map icon, a camera icon, a set icon, a shopping icon, and a newspaper icon may exist.

Here, the camera icon may be a camera 121 mounted on the mobile terminal 100, for example, a front camera mounted on the front surface of the mobile terminal 100 and a rear camera mounted on the rear surface of the mobile terminal 100 have.

The front camera module 280 and / or the rear camera module 290 mounted on the wearable device 200 as well as the camera 121 mounted on the mobile terminal 100 may be driven . The front camera module 280 and / or the rear camera module 290 can be driven by the wearable device 200 itself or under the control of the mobile terminal 200. [

6B, when the mobile terminal 100 completes the pairing with the wearable device 200, an icon dedicated to the wearable device 100 is displayed on an arbitrary area or predetermined area of the home screen 1001 of the mobile terminal 100, (1009) can be displayed.

The wearable device dedicated icon 1009 can be processed differently from the other icon 1005. [ For example, the wearable device exclusive icon 1009 can be enlarged and displayed larger than the other icon 1005. [ For example, the border of the wearable device exclusive icon 1009 is highlighted and can be distinguished from other icons 1005. [ For example, the wearable device exclusive icon 1009 may be displayed so as to flash in a constant cycle.

When the touch is input to the wearable apparatus exclusive icon 1009, the wearable apparatus exclusive icon 1009 is executed to display a control screen for the wearable apparatus 100 on the display unit 151 of the mobile terminal 100 as shown in Fig. (1015) can be displayed.

The control screen 1015 for a wearable apparatus may be a screen different from the home screen 1001, but the control screen 1015 is not limited thereto.

The wearable device control screen 1015 is displayed on a partial area of the home screen 1001, but the present invention is not limited thereto.

The control screen 1015 for a wearable apparatus can be displayed by replacing the widget icon 1003 displayed on the home screen 1001 of the mobile terminal 100 but is not limited thereto. When the control screen 1015 for the wearable apparatus is displayed in the area where the widget icon 1003 is displayed, the icon 1005 is not disturbed by the control screen 1015 for the wearable apparatus, To detect the forward or backward situation through the control screen 1015 for the wearable device as well as music reproduction and radio listening, and utilize the functions assigned to the icon through the execution of the icon, thereby maximizing the user's convenience .

The wearable apparatus control screen 1015 may include, for example, a music control screen 1011 and a camera control screen 1013.

For example, the music control screen 1011 and the camera control screen 1013 may be displayed as separate windows from the home screen 1001.

As another example, the home screen 1001 may be divided into a first area and a second area, and the music control screen 1011 may be displayed on the first area and the camera control screen 1013 may be displayed on the second area have. The first and second regions may be divided along the left-right direction or the vertical direction, or may be divided around the diagonal line of the home screen 1001.

As an example, the entire area of the home screen 1001 may be filled with the first and second areas. For example, the first area may be disposed on the upper side of the home screen 1001, and the second area may be disposed on the lower side of the home screen 1001.

As another example, the first and second areas may be disposed in a part of the area of the home screen 1001. A partial area of the home screen 1001 may be divided into a first area and a second area.

The music control screen 1011 may include a previous button 1016, a next button 1018, a stop and play button 1017, a list view button 1019, and a toggle button 1020. The stop and play button 1017 is a member for stopping or reproducing the music currently being reproduced. The previous button 1016 may be a member for moving the currently played music to music displayed on the left side of the stop and play button 1017. Next button 1018 may be a member that moves the currently played music to the next music. The list view button 1019 may be a member for searching and selecting a music file list existing in the network server connected to the mobile terminal 100, the wearable device 200, or the mobile terminal 100 via the network.

Although the previous button 1016, the stop and play button 1017, the next button 1018, the list view button 1019 and the toggle button 1020 are displayed as general mark images in the drawing, May be used.

The switch button 1020 can change the music control screen 1011 to a radio control screen. For example, when a touch to the toggle button 1020 is input, the music control screen 1011 can be changed to a radio control screen. When the touch for the changeover button 1020 is inputted in the state of being changed to the radio control screen, the radio control screen may be changed to the music control screen 1011. [

When the radio control screen is changed to the radio control screen, the previous button 1016 and the next button 1018 may have a function of finding a radio channel having a frequency lower or higher than the frequency of the current radio channel. In addition, the stop and play button 1017 may cause the listening of the currently listened radio channel to be stopped or replayed. The list view button 1019 can be a member for searching and selecting a list of various radio stations at home and abroad.

On the other hand, the camera control screen 1013 may include a front camera button 1021, a rear camera button 1023, and a button 1025 all. The front camera button 1021 is a member for driving only the front camera module 280 and the rear camera button 1023 is a member for driving only the rear camera module 290. The all button 1025 is a member that simultaneously drives the front camera module 280 and the rear camera module 290. If the left camera module 1503 (FIG. 41) and the right camera module (1501 of FIG. 41) are additionally mounted to the wearable device 200 in addition to the front camera module 280 and the rear camera module 290, 1013, a left camera button and a right camera button may be further displayed.

For example, when a touch on the forward camera button 1021 is input, the forward camera module 280 is driven so that an image of the forward object can be displayed on the display unit 151 of the mobile terminal 100 in a preview state have.

For example, when a touch on the rear camera button 1023 is input, the rear camera module 290 is driven to display an image of the rear object on the display unit 151 of the mobile terminal 100 in a preview state have.

For example, when a touch on the all button 1025 is input, an image for an object of each of the front camera module 280 and the rear camera module 290 is displayed in a preview state on the display unit 151 of the mobile terminal 100 Can be displayed.

For example, the image for the forward object and the image for the backward object may be displayed in a separate window from the home screen 1001, but the present invention is not limited thereto.

As another example, the image for the forward object and the image for the backward object may be displayed on the camera control screen 1013.

3C, only a camera button (not shown) is displayed on the camera control screen 1013 and the front camera module 280, the rear camera module 290, or the front camera module 290, Both the rear camera module 280 and the rear camera module 290 may be driven. For example, when a touch is input to the camera button once, only the front camera module 280 is driven so that an image of the object ahead can be displayed in a preview state. For example, when a touch is input twice to the camera button, only the rear camera module 290 is driven so that an image of the rear object can be displayed in a preview state. For example, when three touches are inputted to the camera button, both the front camera module 280 and the rear camera module 290 are simultaneously driven so that not only the image of the forward object but also the image of the rear object are displayed .

It is apparent that various user interfaces for driving the front camera module 280 and the rear camera module 290 alone or simultaneously are possible in addition to the above embodiments, and such user interface is also included within the scope of the technical idea of the present invention.

For example, when the wearable device 200 is paired with the mobile terminal 100 or a touch for a previous button or a home button of the soft key 1007 is input, the control screen 1015 for a wearable device disappears .

As another example, when an end button (not shown) is added to the control screen 1015 for a wearable device and a touch for this end button is input, the control screen 1015 for a wearable device may disappear.

The forward button 1016, the stop and play button 1017, the next button 1018, the list view button 1019, the toggle button 1020, the forward camera button 1021, the rear camera button 1023, 1025 may be an opaque member, a transparent member, or a translucent member.

The buttons 1016, 1017, 1018, 1019, 1020, 1021, 1023, and 1025 displayed on the control screen 1015 for a wearable apparatus described in the present invention can be changed from an opaque member to a transparent member Or from a transparent member to an opaque member.

As another example, in the case of a wearable device capable of simultaneous image capturing or simultaneous capturing of an image with one key of the front camera button 1021, the rear camera button 1023, and the all button 1025, 360 degree panorama can be shot at the same time.

As another example, GPS information may be stored together with the photographed image or moving image.

As another example, an audio related control window may be formed in the first area, and a camera and associated control window may be formed in the second area. In addition, the first area may be disposed on an upper side of the display unit of the terminal, the second area being located closer to the lower side of the display unit. Alternatively, the first region may be disposed in a region close to the lower side and the second region may be disposed in a region close to the upper side.

FIG. 7 is a view illustrating a preview screen displayed when the all button 1025 displayed on the camera control screen 1013 shown in FIG. 6C is selected.

7, when a touch to the all button 1025 displayed on the camera control screen 1013 is inputted, the front camera module 280 and the rear camera module 290 are driven to move the mobile terminal The front preview screen 1024 and the rear preview screen 1026 may be displayed on the display of the display unit 100. [

In addition, a simultaneous photographing button 1044 and a screen selecting button 1046 may be displayed on a separate screen 1040 connected to the rear preview screen 1026, for example. The forward image and the backward image can be simultaneously photographed by the touch operation of the simultaneous photographing button. Only the front preview screen 1024 or the rear preview screen 1026 can be controlled to be displayed by the touch operation of the screen selection button 1046. [

On the forward preview screen 1024, the forward camera module 280 is activated, and a forward preview image for the forward object can be displayed. In addition, the rear camera module 290 is activated on the rear preview screen 1026, and a rear preview image of the rear object can be displayed.

Here, the activation means that the front camera module 280 and / or the rear camera module 290 are driven so that an image for a forward or rearward object is transmitted through the front camera module 280 and / or the rear camera module 290 May be a state in which an image of a forward or rearward object can be captured by the front camera module 280 and / or the rear camera module 290, which are driven according to a user's photographing command have.

The rear preview screen 1026 may be disposed on the lower side of the forward preview screen 1024, but conversely, the rear preview screen 1026 may be disposed on the upper side of the forward preview screen 1024. [

The front preview screen 1024 and the rear preview screen 1026 may be windows separate from the wearable apparatus control screen 1015 or the home screen 1001, but the present invention is not limited thereto.

As another example, the home screen 1001 may be divided into a first area and a second area, a forward preview screen may be displayed on the first area, and a rear preview screen 1026 may be displayed on the second area. The first and second regions may be divided along the left-right direction or the vertical direction, or may be divided around the diagonal line of the home screen 1001.

Each of the front preview screen 1024 and the rear preview screen 1026 includes setting buttons 1025 and 1035, angle adjusting buttons 1027 and 1037, shooting buttons 1031 and 1041, and image switching buttons 1033 and 1043 can do.

It is possible to control the image shooting and the moving picture shooting through switching between the image shooting mode and the moving image shooting mode by the image switching buttons 1033 and 1043 using one image shooting button 1031. [ Likewise, image shooting and moving image shooting can be controlled by using one moving image shooting button 1041. [

The setting buttons 1025 and 1035 are members for setting various functions such as voice shooting, brightness, focus, resolution, ISO, white balance, filter, timer, position information display, volume key, shooting sound, help,

The angle adjustment buttons 1027 and 1037 can adjust the viewing angles of the front camera of the front camera module 280 or the rear camera of the rear camera module 290.

The photographed image shows the shooting direction, GPS information, time and weather, and so on. That is, information such as forward direction or backward direction is displayed together with the captured position.

Or whether the image was taken in the east, west, south, or north direction at the photographed position. The photographed information can be displayed together with information on whether the photographed image was photographed instantly or stopped while moving.

Is stored together with music information reproduced at the time of photographing, and when the photographed image is displayed on the display unit, the related music can be reproduced through the music information. Or an associated music file is displayed when the icon is selected by the touch operation.

For example, as shown in Fig. 8, the current viewing angle of the rear camera of the rear camera module 290 can be directed to the horizontal direction.

In this case, when the first area 1039a of the angle adjustment buttons 1027, 1037 displayed on the rear preview screen 1026 is pressed, the viewing angle of the rear camera of the rear camera module 290 Can be adjusted up by the set angle?. The adjustment of the viewing angle may be possible by rotating the rear camera module 290 clockwise or counterclockwise.

Although not shown, the viewing angle of the rear camera of the rear camera module 290 can be adjusted downward when the second area 1039b of the angle adjustment buttons 1027, 1037 is pressed.

As another example, while the first area 1039a or the second area 1039b of the angle adjustment buttons 1027 and 1037 is being touched and held, the viewing angle of the rear camera of the rear camera module 290 may be up or down When the hold of the angle adjusting buttons 1027 and 1037 with respect to the first area 1039a or the second area 1039b is released, the viewing angle of the rear camera module 290 to the rear camera Movement can be stopped. Accordingly, the user can adjust the duration of pressing the first area 1039a or the second area 1039b of the angle adjusting buttons 1027 and 1037 to move the rear camera of the rear camera module 290 to a desired viewing angle .

Although not shown, the viewing angle of the front camera of the front camera module 280 may also be adjusted in the same manner as the rear camera of the rear camera module 290. [ That is, by touching or pressing the first area 1029a or the second area 1029b of the angle adjustment button 1027 displayed on the front preview screen 1024, The viewing angle can be adjusted.

Although not shown, an automatic leveling sensor is mounted on the wearable device 200 to allow the front camera module 280 of the wearable device 200 to move forward The forward image displayed on the preview screen 1024 may be constantly displayed and the rear image displayed on the rear preview screen 1026 by the rear camera module 290 may be adjusted to be constantly displayed.

The photographing angle adjustment of the front camera module 280 or the rear camera module 290 can be adjusted by a button or manually by adjusting the angle. In addition, the front camera module 280 or the rear camera module 290 can be automatically adjusted so that a moving object can be photographed in the center of the photographing operation.

The shooting buttons 1031 and 1041 allow an image of a forward object or an image of a rear object to be photographed.

For example, when a touch to the shooting buttons 1031 and 1041 is input, an image of a forward object or a backward object may be captured.

For example, in the case of movie shooting, when a touch to the shooting buttons 1031 and 1041 is input, a moving image of the forward object or the backward object is shot, and when a touch to the shooting buttons 1031 and 1041 is input again, The shooting of the moving picture for the object or the object at the rear may be terminated.

The image changeover buttons 1033 and 1043 can switch the image capturing mode to the moving image capturing mode or the moving image capturing mode to the image capturing mode.

The image is basically set to be photographed and the moving image is changed to the moving image switching mode by touching the image switching buttons 1033 and 1043 so that the moving image can be photographed.

In the drawing, the front preview screen 1024 and the rear preview screen 1026 are in contact with each other. However, the forward preview screen 1024 and the rear preview screen 1026 may be displayed so as to be spaced apart from each other. For example, the forward preview screen 1024 is displayed on the first area of the home screen 1001, that is, on the upper side, the rear preview screen 1026 is displayed on the second area of the home screen 1001, A part of the screen 1001 may be displayed in a third area between the front preview screen 1024 and the rear preview screen 1026. [

FIG. 10 is a view illustrating a preview screen displayed when the all button 1025 displayed on the camera control screen shown in FIG. 6C is selected.

10, a preview screen including a forward preview screen 1024 and a rear preview screen 1026 may be displayed on the home screen 1001 when a touch to all of the buttons 1025 is input.

At this time, the forward preview screen 1024 and the rear preview screen 1026 may be displayed in an area corresponding to the camera control screen 1013 or on a larger area than the area shown in FIG.

The preview screens 1024 and 1026 shown in Fig. 7 and the preview screens 1024 and 1026 shown in Fig. 10 are different from each other.

That is, the front preview screen 1024 and the rear preview screen 1026 shown in FIG. 7 can be displayed in a new window separate from the control screen 1015 for the wearable apparatus. 10, the front preview screen 1024 and the rear preview screen 1026 correspond to the camera control screen 1013 (FIG. 10) which touches the music control screen 1011 included in the control screen 1015 for the wearable apparatus ) Or may be displayed in a larger area. In other words, the front preview screen 1024 and the rear preview screen 1026 are not separate from the wearable apparatus control screen 1015 but on the area included in the wearable apparatus control screen 1015, that is, on the camera control screen 1013 Lt; / RTI > By creating the forward preview screen 1024 and the rear preview screen 1026 in the area included in the wearable apparatus control screen 1015 without creating a window separate from the wearable apparatus control screen 1015 as described above, It is possible to solve the problem that the drive that is generated when the screen 1024 or the rear preview screen 1026 is created as a separate new window becomes complicated and battery consumption becomes large.

The music control screen 1011 is arranged on the first area of the home screen 1001 and the front preview screen 1024 and the rear preview screen 1026 can be arranged on the second area of the home screen 1001 .

7, since the front preview screen 1024 and the rear preview screen 1026 are displayed in contact with the music control screen 1011, the user can enjoy the forward preview screen 1024 or the rear preview screen 1026, it is possible to photograph a specific object or to monitor the forward or backward direction, thereby maximizing user convenience.

On the other hand, a preview window (called a first preview window) by the camera 121 mounted on the mobile terminal 100 itself and a front camera module 280 and a rear camera module 290 mounted on the wearable device 200 The first preview window 1024 (referred to as a second preview window) and the rear preview window 1026 (referred to as a third preview window) may be displayed. In this case, the first through third preview windows may be simultaneously displayed, For example, when the first preview window is enlarged and displayed, and the first gesture operation from the user is input, the first to third preview windows are simultaneously displayed on the display screen When the second gesture operation from the user is input, only the second preview window is enlarged and displayed, or only the first preview window is enlarged greatly, Ray may be.

FIG. 11 is a view showing a third screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.

The front preview screen 1024 and the rear preview screen 1026 can be displayed in contact with the music control screen 1011 as shown in FIG. That is, both the front preview screen 1024 and the rear preview screen 1026 can be displayed in contact with the lower side of the music control screen 1011.

The front preview screen 1024 and the rear preview screen 1026 can be displayed along the length direction of the music control screen 1011, that is, the horizontal direction.

As described above, the front preview screen 1024 and the rear preview screen 1026 are displayed along the longitudinal direction of the music control screen 1011, that is, the horizontal direction, The area occupied on the display unit 151 is reduced so that the icon 1005 is displayed to the user without being disturbed by the front preview screen 1024 or the rear preview screen 1026. Thus, , Forward or backward surveillance, and icon execution can be performed at the same time, thereby improving the convenience of the user.

On the other hand, as shown in Fig. 11, a notification transmission button 1022 can be displayed on the music control screen 1011. Fig.

The alert transmission button 1022 may be displayed on the forward preview screen 1024 or the rear preview screen 1026. [

The alert transmission button 1022 may perform a function of transmitting an alert message regarding an emergency situation or a dangerous situation to a predetermined acquaintance or an organization. The acquaintance can be a close friend, parent or sibling, and the agency can be a fire department or a police station.

For example, if the user inputs a selection command for the notification transmission button 1022 in the face of an emergency situation or a dangerous situation, the preset notification message may be transmitted to a friend or an institution. Risk situations can be violence by third parties, car accidents, etc. In the emergency situation, when the user passes through a certain area, a selection command for the notification button 1022 is inputted and the corresponding notification message is transmitted, so that the fire truck can be dispatched quickly.

The notify transmission button 1022 can be interlocked with the position information module 115. In this case, when a selection command for the notification transmission button 1022 is input, notification information including location information included in the location information of the user based on the location information module 115 in the notification message is transmitted to an acquaintance Lt; / RTI >

FIG. 12 is a view showing a fourth screen showing a preview screen displayed when all buttons displayed on the camera control screen shown in FIG. 6C are selected.

The front preview screen 1024 and the rear preview screen 1026 can be displayed in contact with the music control screen 1011 as shown in FIG. That is, both the front preview screen 1024 and the rear preview screen 1026 can be displayed in contact with the lower side of the music control screen 1011.

Specifically, for example, the size of the forward preview screen 1024 may be displayed larger than the size of the rear preview screen 1026. [ The rear preview screen 1026 can be surrounded by a music control screen 1011 and a front preview screen 1024. [ The length of the lower side of the music control screen 1011 may be equal to the total length of the length of the upper side of the front preview screen 1024 and the length of the upper side of the rear preview screen 1026.

FIG. 13 is a view showing a fifth screen showing a preview screen displayed when the all button 1025 displayed on the camera control screen shown in FIG. 6C is selected.

As shown in FIG. 13A, the forward preview screen 1024 can be displayed in contact with the music control screen 1011. The size of the forward preview screen 1024 may be equal to or larger than the size of the music control screen 1011, but this is not limitative.

A queue 1045 may be displayed on one side of the front preview screen 1024. [ The queue 1045 may be an event command that causes the rear preview screen 1026 to be displayed.

The rear preview screen 1026 may be hidden in the queue 1045. [

The queue 1045 may be displayed on one corner area of the forward preview screen 1024, that is, on the upper right corner area.

The queue 1045 is represented by a triangular black image, but is not limited thereto.

When a flick touch is input from the user along a specific direction, e.g., a diagonal direction, to the queue 1045, the rear preview screen 1026 is displayed on one area of the front preview screen 1024 Lt; / RTI > That is, the rear preview screen 1026 may be slide-in on the forward preview screen 1024 along the diagonal direction from the cue 1045.

The slide-in rear preview screen 1026 can be displayed so as to occupy half the size of the front preview screen 1024, but the present invention is not limited thereto.

As another example, the slide-in rear preview screen 1026 is enclosed by the forward preview screen 1024 and the music control screen 1011 as shown in FIG. 12, and is smaller than the size of the forward preview screen 1024 .

The size of the slide-in rear preview screen 1026 can be set by the manufacturer or the user.

On the other hand, when a flick touch is input along the area where the original cue 1045 was displayed from a specific point on the slide-in rear preview screen 1026, the rear preview screen 1026 disappears, A queue 1045 may be displayed in one corner area of the forward preview screen 1024. [

42A, when the music is not reproduced, the front preview screen 1024 and the rear preview screen 1026 are displayed, but the music control screen is not displayed and the music window is displayed in a separate window 1040, A playback button 1048 can be displayed. When a touch command to the music playback button 1048 is input, a music preview screen 1024 and a music preview screen 1026 as well as a music control screen 1011 can be displayed as shown in FIG. Accordingly, if the music control screen 1011 is not displayed, the sizes of the front preview screen 1024 and the rear preview screen 1026 can be further enlarged by the area where the music control screen 1011 is displayed.

As another example, the music control screen 1011 is displayed, but the forward preview screen 1024 and the rear preview screen 1026 are not displayed and a screen selection button (not shown) is displayed in a separate window 1040 1050 may be displayed. In this case, the size of the music control screen 1011 may be enlarged by an area where the front preview screen 1024 and the rear preview screen 1026 are displayed. The front preview screen 1024 and the rear preview screen 1026 can be displayed according to the operation of the screen selection button 1050. [ For example, when a one-touch command to the screen selection button 1050 is input, only the front preview screen 1024 can be displayed. For example, when a touch command is inputted twice continuously for the screen selection button 1050, only the rear preview screen 1026 can be displayed. For example, when a touch and hold command is input to the screen selection button 1050 for 0.5 seconds or more, for example, the forward preview screen 1024 and the rear preview screen 1026 can be simultaneously displayed.

FIG. 14 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a second embodiment of the present invention.

Since the second embodiment is the same as the first embodiment shown in Fig. 5 except for the floating icon display step S322 and the floating icon execution step S323, S322 and S323 will be mainly described.

Referring to FIG. 14, the mobile terminal 100 can perform pairing with the wearable device 200 (S321).

If the identification information of the wearable device 200 is registered in advance in the mobile terminal 100 and the communication modules 114 and 201c are provided in the wearable device 200 and the mobile terminal 100 respectively, The pairing process may be performed between the mobile terminal 100 and the wearable device 200 when the mobile terminal 100 is within a predetermined distance from the mobile terminal 100, but the present invention is not limited thereto.

Then, when the pairing with the wearable device 200 is completed, the mobile terminal 100 controls the display unit 151 to display a floating icon (S322).

The floating icon is an icon for controlling the wearable device 200 and may have a combination of a specific character such as a camera character or a note character and a camera character.

The floating icon displayed on the display unit 151 of the mobile terminal 100 can be wandered within the whole area or a part of the area of the display unit 151 at random without being fixed to one area unlike the icon fixed to one area . For example, the floating icon may move in a clockwise or counterclockwise direction adjacent to the edge of the screen of the display unit 151. [

For example, the floating icon may be enlarged and displayed larger than other icons fixed in one area. For example, the border of the floating icon may be highlighted and distinguished from other icons fixed in one area. For example, the floating icon may be displayed to be flashing at regular intervals.

When a touch on the floating icon that is floating on the screen of the display unit 151 is inputted, the mobile terminal 100 can execute the floating icon (S323).

When the floating icon is executed in this way, the mobile terminal 100 can display the control screen for the wearable device by controlling the display unit 151 (S324).

The control screen for the wearable apparatus may include a music control screen 1011 and a camera control screen 1013. The music control screen 1011 can be switched to the radio control screen. That is, the music control screen 1011 and the radio control screen can be switched to each other.

S325 to S329 are the same as S315 to S319 of the first embodiment shown in Fig. 5, and a description thereof will be omitted.

FIG. 15 is a diagram for explaining a method of displaying a control screen for controlling the wearable device on the mobile terminal 100 according to the second embodiment of the present invention.

The description of FIG. 15, which is consistent with the description shown in FIG. 6, will be omitted, and such omitted description can be easily understood from the description shown in FIG.

A home screen 1001 is displayed on the display unit 151 of the mobile terminal 100 and a widget icon 1003, an icon 1005 and a soft key (1007) can be displayed.

When the wearable device 200 is paired with the mobile terminal 100, a floating icon 1047 may be additionally displayed on the home screen 1001.

The floating icon 1047 is an icon for controlling the wearable device 200, and can be wandered on the home screen 1001 at random.

For example, the floating icon 1047 is generated and displayed in one area of the left edge of the home screen 1001, then is moved in the lower direction adjacent to the left edge of the home screen 1001, It can be wandered in the right direction from the side edge.

When the floating icon 1047 is wandering, the floating icon 1047 may or may not pass through the status display bar displayed above the icon 1005, the soft key 1007 or the home screen 1001.

15B, a control screen 1015 for a wearable apparatus can be displayed on the display unit 151 of the mobile terminal 100. [0064] As shown in FIG.

The control screen 1015 for a wearable apparatus may be a screen different from the home screen 1001, but the control screen 1015 is not limited thereto.

The control screen 1015 for the wearable apparatus can be displayed by replacing the widget icon 1003 displayed on the home screen 1001 of the mobile terminal 100. [ That is, when the size of the control screen 1015 for a wearable device is the same as the size of the widget icon 1003, a control screen 1015 for a wearable device is displayed on the area where the widget icon 1003 is displayed instead of the widget icon 1003 Can be displayed.

When the control screen 1015 for the wearable apparatus is displayed in the area where the widget icon 1003 is displayed, the icon 1005 is not disturbed by the control screen 1015 for the wearable apparatus, ) To detect a forward or backward situation through a control screen 1015 for a wearable device as well as music playback or radio listening and to use the function assigned to the corresponding icon 1047 through the execution of the floating icon 1047 So that the convenience of the user can be maximized.

The wearable apparatus control screen 1015 may include, for example, a music control screen 1011 and a camera control screen 1013.

The music control screen 1011 and the camera control screen 1013 can be displayed as windows separate from the home screen 1001. [

As another example, the home screen 1001 may be divided into a first area and a second area, and the music control screen 1011 may be displayed on the first area and the camera control screen 1013 may be displayed on the second area have. The first and second regions may be divided along the left-right direction or the vertical direction, or may be divided around the diagonal line of the home screen 1001.

16 is a flowchart illustrating a method of displaying a control screen for controlling the wearable device on the mobile terminal 100 according to the third embodiment of the present invention.

Referring to FIG. 16, the mobile terminal 100 may perform pairing with the wearable device 200 (S331).

Then, when the pairing with the wearable device 200 is completed, the mobile terminal 100 controls the display unit 151 to hide the wearable device control screen 1015 in the status display bar (S332).

The control screen 1015 for a wearable apparatus is not normally displayed on the screen but can be displayed when a specific command from the user, for example, a drag touch, is input.

A status display bar may be displayed above the display unit 151 of the mobile terminal 100. The status bar may be maintained on the upper side of the display unit 151 even if the screens on the display unit 151 are changed.

When a flick touch is input to the status display bar (S333), the mobile terminal 100 controls the display unit 151 to display the control screen 1015 for the wearable device (S334).

For example, the user can input a flick touch along the lower direction from the status display bar. In response to such flick touch, the status display window can be displayed slide-in along the downward direction.

A control screen 1015 for a wearable apparatus can be displayed on the status display window.

The control screen 1015 for the wearable apparatus may include a music control screen 1011 for listening to radio and a camera control screen 1013 for video shooting or surveillance through driving of the camera modules 280 and 290 have.

S335 to S339 are the same as S315 to S319 of the first embodiment shown in Fig. 5, and a description thereof will be omitted.

17 is a diagram for explaining a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a third embodiment of the present invention.

17A, a home screen 1001 is displayed on the display unit 151 of the mobile terminal 100, and a widget icon 1003, an icon 1005, and a soft key 1005 are displayed on the home screen 1001. [ (1007) can be displayed.

In addition, a status display bar 1051 can be displayed on the upper side of the display unit 151. The status display bar 1051 may be a member for displaying functions currently being used by the mobile terminal 100. For example, the status display bar 1051 may include a vibration or bell sound indication, a battery remaining amount indication, a reception intensity display time indication, and the like.

When the wearable device 200 is paired with the mobile terminal 100, the control screen 1015 for the wearable device can be hidden in the status display bar 1051 although it is not displayed on the display unit 151. [

When a drag touch is input from the status display bar 1051, for example, in the downward direction, a status display window 1059 including the first to third areas 1053, 1055, and 1057 may be displayed.

In this case, a quick setting function icon may be displayed on the first area 1053 of the status display window 1059 and a screen brightness / volume control status bar may be displayed on the second area 1055 of the status display window 1059 .

The quick setting function icon may include a Q memo icon 1061, a vibration icon 1063, a WiFi icon 1065, a Bluetooth icon 1067, a position information icon 1069, and the like.

These icons 1061, 1063, 1065, 1067, and 1069 can be changed in function and changed in color each time they are touched.

For example, the Q memo icon 1061 activates the Q memo function when a touch is input, and the Q memo function may be deactivated when the Q memo icon 1061 is touched again.

For example, the location information icon 1069 is activated when the touch is input, and the location information tracking may be deactivated when the location information icon 1069 is touched again.

The brightness adjustment unit 1071 and the vibration intensity adjustment unit 1073 may be displayed on the second area 1055 of the status display window 1059. [ For example, the brightness of the screen can be varied by adjusting the brightness controller 1071. [

The control screen 1015 for the wearable apparatus can be displayed on the third area 1057 of the status display window 1059. [ The size of the control screen 1015 for a wearable apparatus may be at least smaller than the size of the status display window 1059. [

The control screen 1015 for the wearable apparatus can be displayed on the third area 1057 as a window fixed to the third area 1057 of the status display window 1059 or different from the third area 1057. [

The detailed description of the control screen 1015 for a wearable apparatus has been described above with reference to FIG. 6C, and therefore, a further description thereof will be omitted.

18 is a flowchart illustrating a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a fourth embodiment of the present invention.

Referring to FIG. 18, the mobile terminal 100 may perform pairing with the wearable device 200 (S341).

At this time, the display unit 151 of the mobile terminal 100 may be in a screen off state because power is not applied thereto.

Even if the display unit 151 of the mobile terminal 100 is in the screen off state, the communication module 114 of the mobile terminal 100 is activated, so that the pairing between the mobile terminal 100 and the wearable device 200 Can be normally performed.

Subsequently, when the pairing with the wearable device 200 is completed, the mobile terminal 100 can wait for the wearable device control screen 1015 without displaying it. This is because the power applied to the display unit 151 of the mobile terminal 100 is cut off and the screen is in the off state and the control screen 1015 for the wearable apparatus can not be displayed on the display unit 151. [

If a tap for tapping the display unit 151 of the mobile terminal 100 twice is input from the user, the mobile terminal 100 supplies power to the display unit 151 to display a screen on the display unit 151 (Step S342).

Even if the screen is changed to the on state, the display unit 151 of the mobile terminal 100 can be kept locked (S343). That is, when the user sets the locked state in the mobile terminal 100, the user can be kept locked even if the screen is turned on to the display unit 151 of the mobile terminal 100, The home screen 1001 may be displayed on the display unit 151 as a reference.

When the screen of the display unit 151 is kept in the locked state, when the user inputs a flick touch in a specific direction (S344), the mobile terminal 100 controls the display unit 151 to display the control screen for the wearable device (Step S345).

Here, the flick touch in a specific direction may mean a flick touch from an arbitrary point on the screen of the display unit 151 to the left, but the present invention is not limited thereto.

S346 to S350 are the same as S315 to S319 of the first embodiment shown in FIG. 5, and a description thereof will be omitted.

19 is a diagram for explaining a method of displaying a control screen for controlling a wearable device on a mobile terminal according to a fourth embodiment of the present invention.

As shown in FIG. 19A, the display unit 151 of the mobile terminal 100 may be in a screen-off state in which power is not applied.

When the screen is in the off state, the display unit 151 of the mobile terminal 100 has black color, so no information is displayed on the display unit 151.

Since the communication module 114 of the mobile terminal 100 is in an activated state even if the display unit 151 of the mobile terminal 100 is in the off-screen state, pairing is performed between the mobile terminal 100 and the wearable apparatus 200 .

That is, when the wearable device 200 is accessed within a certain distance of the mobile terminal 100 while the identification information of the wearable device 200 is registered in advance in the mobile terminal 100, A pairing operation can be performed between the mobile station 200 and the base station 200.

In some circumstances, even if the wearable device 200 approaches within a certain distance of the mobile terminal 100, pairing between the mobile terminal 100 and the wearable device 200 can not be performed. That is, when the pairing function is not activated in the mobile terminal 100 or the power of the wearable device 200 is not turned on, the pairing between the mobile terminal 100 and the wearable device 200 may not be performed. Accordingly, when the pairing function is activated in the mobile terminal 100 or when the power of the wearable device 200 is turned on, pairing can be performed between the mobile terminal 100 and the wearable device 200.

19A, since the display unit 151 of the mobile terminal 100 is in a screen off state, in this case, pairing is performed between the mobile terminal 100 and the wearable device 200 when the power of the wearable device 200 is turned on .

As an example, the mobile terminal 100 may be in a lock state and an unlock state depending on whether the user is allowed to enter the control command of the mobile terminal 100. [

Basically, when the screen is changed from the OFF state to the ON state, a lock screen that is locked can be displayed. When a gesture operation from the user is received for this lock screen, it can be unlocked.

For example, when the user performs a touch input in a specific direction with respect to the lock screen, the execution screen of the first application displayed on the lock screen disappears based on the touch input detected on the lock screen, .

After the pairing between the mobile terminal 100 and the wearable device 200 is completed, the display unit 151 may be turned on. That is, when the user touches the power button, the power source is applied to the display unit 151 as shown in FIG. 19B, and the lock screen 1075 can be displayed on the display unit 151.

A widget icon 1003 and a lock pattern 1077 may be displayed on the lock screen 1075. [ The slice according to the lock pattern 1077 preset by the user The present invention can easily control the music reproduction of the wearable device 200 or the driving of the camera modules 280 and 290 without releasing the lock state.

For example, when a flick touch is input along a left direction from an arbitrary point in an area where a widget icon 1003 is displayed, a control screen 1015 for a wearable apparatus can be displayed as shown in Fig. 19C. The control screen 1015 for the wearable apparatus can be displayed on the area where the widget icon 1003 is displayed, but the present invention is not limited thereto.

The size of the control screen 1015 for a wearable device may be the same as or larger than the area where the widget icon 1003 is displayed.

The wearable apparatus control screen 1015 may include a music control screen 1011 and a camera control screen 1013.

The camera control screen 1013 may include a front camera button 1021, a rear camera button 1023, and a button 1025 all.

For example, when a touch on all buttons 1025 of the camera control screen 1013 is input, a forward preview screen 1024 and a rear preview screen 1026 are displayed instead of the camera control screen 1013 as shown in Fig. Can be displayed. That is, the camera control screen 1013 can be replaced with the camera control screen 1013 in the front preview screen 1024 and the rear preview screen 1026. [

The total size of the size of the forward preview screen 1024 and the size of the rear preview screen 1026 may be equal to or larger than the size of the camera control screen 1013. [

As an example, the size of the forward preview screen 1024 and the size of the rear preview screen 1026 may be the same.

As another example, the size of the forward preview screen 1024 may be larger than the size of the rear preview screen 1026. [

As another example, the rear preview screen 1026 may not be initially displayed, but a queue may be displayed in some corner areas of the forward preview screen 1024. [ When a flick touch is input along the diagonal direction from the queue, for example, the rear preview screen 1026 may be displayed on the front preview screen 1024. [ In other words, the rear preview screen 1026 may be slide-in on the forward preview screen 1024 along the diagonal direction from the queue.

19D, even if the front preview screen 1024 or the rear preview screen 1026 is displayed in the locked state and then unlocked, the forward preview screen 1024 and the rear preview screen 1026 and the music control screen 1026, The display unit 1011 may be displayed on the home screen 1001 of the display unit 151 without limitation.

According to the fourth embodiment of the present invention, even in the locked state, music playback in the wearable device 200, listening to the radio, shooting for the forward or backward object in the wearable device 200 using the music control screen 1011 or the camera control screen 1013 It is not necessary to control the wearable device 200 on the home screen 1001 through the unlocking, thereby improving the security reliability of the user.

Although not described in detail above, when a touch on the front camera button 1021 or the rear camera button 1023 of the camera control screen 1013 is input, the front preview screen 1024 is brought into contact with the music control screen 1011, Or a rear preview screen 1026 can be displayed.

A method of activating the camera modules 280 and 290 of the wearable device 200 in the mobile terminal 100 has been described above.

Alternatively, the wearable device 200 may activate the camera module 280, 290 by itself.

As an example of the first example, an activation button 250 for activating the front camera module 280 and the rear camera module 290 may be provided on the upper surface of the housings 220a and 220b of the wearable device 200 of FIG. have. The user can activate both the front camera module 280, the rear camera module 290 or the front camera module 280 and the rear camera module 290 by pressing the activation button 250. Here, the activation means that the front camera module 280 and / or the rear camera module 290 are driven so that an image for a forward or rearward object is transmitted through the front camera module 280 and / or the rear camera module 290 Or may be a state in which an image of a forward or rearward object can be photographed by the front camera module 280 and / or the rear camera module 290 according to a user's photographing command.

If the activation button 250 is pressed again, both the rear camera module 290 or the front camera module 280 and the rear camera module 290 may be deactivated.

As another example, when the activation button 250 is pressed once, both the front camera module 280 and the rear camera module 290 are activated, and when the activation button 250 is pressed twice, the front camera module 280 is activated If the activation button 250 is pressed three times, the rear camera module 290 is activated. If the activation button 250 is pressed, for example, for at least 0.5 second or more, the front camera module 280 and / Camera module 290 may be deactivated, but this is not limiting. That is, the front camera module 280 may be activated when the activation button 250 is pressed once, and the rear camera module 290 may be activated when the activation button 250 is pressed once. In other words, the number of times the activation button 250 is pressed to activate or deactivate each or both of the front camera module 280 and the rear camera module 290 may be varied in various ways.

As a second example, if a certain number of touches are inputted to a vibration detection button (not shown) provided on the upper surface of the housings 220a and 220b of the wearable device 200, The module 280 and the rear camera module 290 can be activated. For example, as shown in FIG. 20A, when a touch is input to the vibration detection button once, both the front camera module 280 and the rear camera module 290 can be activated at the same time. For example, as shown in FIG. 20B, when a touch is input twice to the vibration detection button, only the front camera module 280 can be activated. For example, as shown in FIG. 20C, when a touch is input to the vibration detection button three times, only the rear camera module 290 can be activated.

As a third example, the front camera module 280, the rear camera module 290, or the front camera module 290, depending on the degree of proximity to the proximity sensor 204a provided on the upper surface of the housings 220a, 220b of the wearable device 200, Both the rear camera module 280 and the rear camera module 290 can be activated. 21, when the user's finger is positioned at the first distance d1 from the proximity sensor 204a of the wearable device 200, both the front camera module 280 and the rear camera module 290 Can be activated. For example, if the user's finger is positioned at the second distance d2 from the proximity sensor 204a of the wearable device 200, the front camera module 280 can be activated. For example, if the user's finger is positioned at the third distance d3 from the proximity sensor 204a of the wearable device 200, the rear camera module 290 can be activated.

Hereinafter, various user interface implementations using the system including the wearable device 200, the mobile terminal 100, the wearable device 200, and the mobile terminal 100 will be described.

FIGS. 22 to 25 show a method of automatically photographing a wearable device in a specific situation.

22 is a flowchart illustrating a method of automatically photographing a wearable device according to the present invention in a specific situation.

Referring to FIG. 22, the wearable device 200 sets and registers a situation to be automatically photographed by a user (S411).

The situation to be automatically photographed may be, for example, voice, sound, specific sensor value, position, face recognition, etc., but is not limited thereto. That is, it is clear that any situation can be recognized by the wearable device 200, and if the situation is registered in the wearable device 200, it is included within the scope of the technical idea of the present invention.

A voice can be a specific word used by a person or a specific intensity of the word. If the voice of a person is more than a certain intensity, it can be taken automatically.

Sound can be the intensity of a particular sound or sound in a person, animal, or inanimate object.

The specific sensor value may be a specific sensor value in the proximity sensor 204a or the illuminance sensor 204b (260 in FIG. 1).

A location can be a specific location from the ground or a certain altitude value. For example, when the user wears the wearable apparatus 200 and is at a specific altitude, for example, 1500 M or more, the front camera module 280 and / or the rear camera module 290 of the wearable device 200 automatically shoot .

In order to detect such a position, an altitude sensor or a position sensor may be mounted on the wearable device 200.

In the case where a specific person or an animal's face is registered in advance in the wearable device 200 and the face is recognized by the wearable device 200, the face recognition is performed by the front camera module 280 of the wearable device 200 and / And can be automatically photographed by the rear camera module 290.

For example, it can be seen that children wearing a wearable device 200 walk on the street, for example, wear a wearable device 200 and walk on the street, while the children are laughing. In this case, when the word 'Ha ha ha', which is a word laughing by children, is preset and registered in the wearable device 200, it is automatically photographed by the front camera module 280 and / or the rear camera module 290 of the wearable device 200 .

For example, when wearing the wearable device 200 and walking the street, a scream of a person can be heard from behind. At this time, if the screaming sound is a certain intensity or more, it can be automatically photographed by the front camera module 280 and / or the rear camera module 290 of the wearable device 200.

For example, when a certain sensor value of the proximity sensor 204a at that time is greater than a preset threshold value registered in the wearable device 200 when an object including a person approaches within a predetermined distance, The front camera module 280 and / or the rear camera module 290 of the camera 100 can automatically take a picture. The threshold value may be set by the manufacturer or the user.

The user worn by the wearable device 200 may be in a specific place in a state in which the setting for automatically shooting is registered (S412).

Here, the specific place may be a place where a situation to be photographed automatically occurs. Thus, a particular place may be any place in the world, such as a house, a company, a street, a restaurant, a mountain, or a sea.

When the user is in a specific place, the control unit 208 of the wearable device 200 responds to the user's request to display the front camera module 280 mounted on the wearable device 200 worn by the user and / The camera module 290 can be activated (S413).

6) on the camera control screen (1013 in Fig. 6) displayed on the mobile terminal 100 or by the pushing operation of the activation button (250 in Fig. 1) mounted on the wearable device 200, By a touch operation on the touch panel 1025 of FIG.

6) on the camera control screen (1013 in Fig. 6) displayed on the mobile terminal 100, the mobile terminal 100 displays an activation command corresponding to the touch operation The control unit 208 of the wearable device 200 may activate the front camera module 280 and / or the rear camera module 290 in response to the activation command.

The control unit 208 of the wearable device 200 sets the front camera module 280 and / or the rear camera module 290 in a state in which the user is in a specific place and is registered in the wearable apparatus 200 (S414) And automatically captures an image input to the front camera module 280 and / or the rear camera module 290 (S415).

If a left camera module 1503 and a right camera module 1501 are further provided, an image can be taken through these camera modules 1501 and 1503 as well.

The time of automatically shooting may be a moment when it is recognized that a situation registered and registered in the wearable device 200 occurs, but the present invention is not limited thereto.

The automatic photographing may be a still image photographing, a moving picture photographing, a continuous photographing, a panoramic photographing, and the like.

The motion picture shooting may be continued for a predetermined time or while the setting registered state is occurring.

The front camera module 280 and / or the rear camera module 290, which are panoramic photographing, can be rotated in the second direction in the first direction. For example, the front camera module 280 and / or the rear camera module 290 may be rotated from the left direction to the right direction.

The automatic photographing is performed only when the front camera module 280 is performed or when only the rear camera module 290 is performed or both the front camera module 280 and the rear camera module 290 are performed .

Basically, both the front camera module 280 and the rear camera module 290 are set to be automatically photographed, and only the front camera module 280 or the rear camera module 290 may be automatically photographed by the user.

The wearable apparatus 200 may store the automatically photographed image in the memory 207 (S416).

In addition, the wearable apparatus 200 can be automatically stored and transmitted to the user's mobile terminal 100, the mobile terminal 100 of another user, a specific server or an associated institution.

The mobile terminal 100 of the user, the mobile terminal 100 of another user, the specific server or the related organization can be set and registered in the wearable device 200 in advance to receive the automatically photographed image. In this case, the automatically photographed image can be automatically transmitted to the mobile terminal 100 of the user, the mobile terminal 100 of the other user, the specific server or the related organization even if there is no additional request from the user.

For example, when a user wears the wearable device 200 and is in a specific place, a collision accident between automobiles occurs at a specific place, and an image of such a collision accident is automatically photographed so that an automatic photographing image can be obtained. In this case, the automatically photographed image can be automatically transmitted to a police station, a traffic control center, or an insurance company close to a specific place, even if there is no additional request from the user. At this time, the transmitted automatic photographing image may include information on a specific place, for example, a location, an address name, and / or a nearby famous building. Here, the location and address names can be obtained by the location information module 201d.

Accordingly, the police station, the traffic control center or the insurance company can easily recognize the place where the car collision occurred through the information about the specific place together with the automatic photographing image transmitted from the user's wearable device 200, .

For example, when the user wears the wearable device 200 and is in a specific place, when an injury accident due to a weapon is generated at a specific place and the image of the injury accident is automatically photographed, To the nearest police station or police station. At this time, the transmitted automatic photographing image may include information on a specific place, for example, a location, an address name, and / or a nearby famous building. Accordingly, the police station or the police control center can easily identify a place where an injury has occurred through information on a specific place together with the automatic photographing image transmitted from the wearable apparatus 200 of the user, so that the police can be arrested promptly. Even if the shooter escapes from the scene of the crime, the shooter can be easily arrested based on the face of the shooter included in the automatic shot image.

23 is a diagram illustrating a first screen for explaining a method of automatically photographing a wearable device according to the present invention in a specific situation.

As shown in Fig. 23, a wearer wearing the wearable device 200 may be walking in a specific place.

For example, when a situation in which a wearer is laid out in front of the wearable apparatus 200 occurs while the user is walking, that is, when a human laughter sound such as a 'ha ha' is heard, An image for the object ahead can be automatically photographed by the module 280.

As another example, when a person laughs like 'hahaha' at the front is heard and the user looks in the direction in which the laugh sound is heard to see the object making the laugh sound, the front camera module The image for the object ahead can be automatically photographed by the photographing device 280.

For example, the position of the front camera module 280 of the wearable device 200 may coincide with the user's eyes in the vertical direction. In this case, when the user rotates the face in the direction in which the user's eyes see, and the corresponding image is automatically photographed, an image of the object desired by the user can be obtained.

The front camera module 280 and / or the rear camera module 290 can be activated before a situation in which preset registration in the wearable device 200 occurs.

Basically, both the front camera module 280 and the rear camera module 290 are activated at the same time, and only the front camera module 280 or the rear camera module 290 may be activated according to the user's setting change command.

As another example, when a sound detection sensor (not shown) is attached to the wearable device 200, when a laugh sound of a person set and registered in the wearable device 200 is heard from the front, The control unit 208 of the wearable device 200 controls the front camera module 280 so that the front camera module 280 is controlled so that the viewing angle of the front camera module 280 is directed toward the direction of the human laughter sound Can be rotated. Then, the control unit 208 of the wearable device 200 controls the front camera module 280 to automatically photograph an image of a forward object.

The automatically photographed image is stored in the wearable device 200 and may be transmitted to and stored in the mobile terminal 100 paired with the wearable device 200 or another mobile terminal 100 connected to the network or a specific server .

FIG. 24 is a diagram illustrating a second screen illustrating a method of automatically photographing a wearable device according to the present invention in a specific situation. FIG.

As shown in Fig. 24, a wearer wearing the wearable device 200 may be walking in a specific place.

For example, in a case where a condition registered in advance in the wearable device 200 occurs in the rear while the user is walking, that is, when a bump of cars banging is heard, the front camera module 200 of the wearable device 200 An image of the object behind the object can be automatically photographed.

Pre-registered settings can share data between online markets and users, and can be set up to respond to heterogeneous sounds that are difficult to hear in a specific situation or work environment that the user is in, through shared information.

As another example, when a sound detection sensor (not shown) is mounted on the wearable device 200, when the sound of a bump between the cars registered and registered in the wearable device 200 in front is heard, The control unit 208 of the wearable device 200 controls the rear camera module 290 so that the rear camera module 290 is controlled so that the viewing angle of the rear camera module 290 faces the direction in which the sound of the bumps between the cars Can be rotated. Then, the control unit 208 of the wearable device 200 controls the rear camera module 290 to automatically photograph an image of the rear object.

The automatically photographed image is stored in the wearable device 200 and may be transmitted to the mobile terminal 100 paired with the wearable device 200, the police station, the traffic control center, or the insurance company, for example.

Images taken at the time of collision between cars can be used as important evidence for estimating damages and negligence among drivers of dispatched vehicles, which may lead to unjust damaging persons.

25 is a diagram illustrating a third screen illustrating a method of automatically photographing a wearable device according to the present invention in a specific situation.

As shown in FIG. 25, when a user wearing a wearable device 200 approaches a criminal who has a knife in the rear when he / she is walking at a specific place, the rear camera module 290 of the wearable device 200 An image of an object behind it can be automatically photographed. The object at the rear may be a criminal with a sword.

The user can automatically notify the user of the alarm sound such as voice or vibration through the wearable device 200 as well as capture the image of the criminal automatically when the criminal approaches the criminal with the knife in the back. That is, an alarm or a whistle may be generated to alert the criminal to the attention of others. Also, the same operation may be performed when the wearable device 200 is suddenly removed from the user's neck.

The automatically photographed image can be stored in the wearable device 200 or transmitted to the mobile terminal 100 paired with the wearable device 200 and stored. In addition, the automatically photographed image may be transmitted to an associate or an organization concerned, such as a user's family or a police station

The automatic photographing method of the wireless acoustic apparatus according to the present invention can be applied to various fields other than the fields shown in FIG. 23 to FIG.

26 to 28 show a method of photographing a photograph when the camera module is shaken in a wearable device.

FIG. 26 is a flowchart illustrating a method of photographing a photographic image when the camera module is shaken in a wearable device according to the present invention. FIG. 27 is a view illustrating a method of photographing a photographic image when the camera module is shaken in the wearable device according to the present invention Fig.

Referring to FIGS. 26 and 27, the wearable device 200 activates the front camera module 280 and the rear camera module 290 (S421).

As an example, the front camera module 280 and the rear camera module 290 can be activated when the activation button 250 mounted on the wearable device 200 is pressed. Accordingly, an image of the forward object and an image of the rear object are input to the front camera module 280 and the rear camera module 290, respectively, An image may be formed on the lens provided.

As another example, when a touch operation to all the buttons (1025 in Fig. 6) on the camera control screen (1013 in Fig. 6) displayed on the mobile terminal 100 is input, the mobile terminal 100 displays The control unit 208 of the wearable device 200 may activate the front camera module 280 and / or the rear camera module 290 in response to this activation command .

When the user inputs a photographic image shooting command (S422), the wearable device 200 detects whether the front and rear camera modules 280 and 290 are shaking (S423).

The photographic image capturing instruction can be generated by the user pressing the photographic buttons 231 and 233 mounted on the wearable device 200 as shown in Fig. 27A.

Here, the photographic image may be a still image representing an image of one frame.

When the user pushes the photographing buttons 231 and 233, the wearable device 200 to which the photographing buttons 231 and 233 are attached is shaken as shown in Fig. 27B, The camera module 280 and / or the rear camera module 290 may also be shaken.

The wobble of the wearable device 200 or the front camera module 280 and / or the rear camera module 290 can be sensed by the haptic module 205b of the wearable device 200. [

The control unit 208 of the wearable device 200 grasps the shake intensity of the wearable device 200 or the front camera module 280 and / or the rear camera module 290 sensed by the haptic module 205b, It can be determined whether or not the shaking intensity is greater than the preset value. The default value can be set by the manufacturer or the user.

If the shake intensity of the front camera module 280 and / or the rear camera module 290 is smaller than the preset value, the control unit 208 of the wearable device 200 controls the front camera module 280 and / The control unit 290 controls the front camera module 280 and / or the rear camera module 290 to capture a photographic image of the input image (S424).

If the shake intensity of the front camera module 280 and / or the rear camera module 290 is greater than a preset value, the control unit 208 of the wearable device 200 controls the front camera module 280 and / The control unit 290 controls the front camera module 280 and / or the rear camera module 290 to capture a moving image of the input image (S425).

If the photograph image is photographed while the front camera module 280 and / or the rear camera module 290 are being shaken in response to the wobble of the wearable device 200, the shape of the object of the photographic image becomes indefinite. Therefore, the photographed photographic image is discarded, and valuable memories can be lost.

In the present invention, when the shake intensity of the front camera module 280 and / or the rear camera module 290 is larger than the preset value, the photographic image photographing mode is changed to the moving image photographing mode as shown in Fig. Instead of taking a picture, a movie can be taken.

The photographed moving image may be temporarily stored in the memory 207.

The moving picture can be photographed for a predetermined time, for example, for about 5 seconds to 10 seconds.

When the moving image is photographed for 5 to 10 seconds in this manner, the shaking of the front camera module 280 and / or the rear camera module 290 is reduced during this period, so that a frame image (1083 in Fig. 28) may exist.

A moving image photographed in the moving image shooting mode may be composed of a plurality of frame images 1081, 1082, 1083, and 1084 as shown in FIG. Here, each of the frame images 1081, 1082, 1083, and 1084 may be a still image.

Of the plurality of frame images 1081, 1082, 1083, and 1084, a specific frame area 1083 may be a clean image without shaking.

The control unit 208 of the wearable apparatus 200 can select the frame image with the least shake from among the plurality of frame images 1081, 1082, 1083, and 1084 shown in Fig. 28 as a photograph image that the user wants to photograph ( S426). Then, the control unit 208 of the wearable device 200 may store the selected photographic image in the memory 207 or transmit the selected photographic image to the mobile terminal 100.

Meanwhile, the moving image temporarily stored in the memory 207 may be automatically deleted after a preset period of time, for example, one day, but the present invention is not limited thereto.

29 is a flowchart illustrating a method of recording a forward video and a backward video using the wearable device according to the present invention.

29, the control unit 208 of the wearable device 200 activates the front camera module 280 and the rear camera module 290 (S431).

Activation of the front camera module 280 and / or the rear camera module 290 may be enabled by pressing the activation button 250 attached to the wearable device 200 or by pressing the camera control screen 1013 By touching all buttons (1025 in Fig. 6) on the touch panel. More details can be easily understood by the description with reference to FIG. 26 described above.

When the video recording command is input (S433), the controller 208 of the wearable device 200 records the forward and backward images for a preset time, and stores the position information of the forward and backward images at step S435.

The forward image may be recorded from the front camera module 280 and the rear image may be recorded from the rear camera module 290. [

Basically, the forward video and the backward video can be simultaneously recorded, but only the forward video or the backward video can be recorded according to the user's selection.

The position information of the front image and / or the rear image can be obtained by the position information module 201d.

For example, when the user operates the vehicle while wearing the wearable device 200, images of the front and rear of the vehicle on the way of the car can be recorded.

For example, when the wearer walks while wearing the wearable apparatus 200, images of the front and rear of the wearer on the way to the wearer can be recorded.

The recording time of the forward video and / or the backward video may be set to, for example, one day. If the storage space allocated for recording is sufficient in the memory 207 of the wearable device 200, the whole image and / or the backward video is recorded for several days unless the user forcibly cuts off the power of the wearable device 200 .

If the storage space allocated for recording in the memory 207 is completely filled up during the recording of the forward video and / or the backward video, the first recorded video is erased and the forward video and / / ≪ / RTI > or backward images can be recorded and stored.

Such location information can be used later when constructing a route map when the recorded image is reproduced.

The recorded image and location information stored in the wearable device 200 may be transferred to the mobile terminal 100 or stored automatically or by a user's selection. Also, when the mobile terminal 100 is preset, the video and location information may be automatically transmitted to an external server and stored.

30 is a diagram for explaining a method of displaying a video image recorded by a wearable device according to the present invention on a mobile terminal.

As shown in FIG. 30A, a specific icon capable of playing back the recorded video image recorded on the wearable device 200 shown in FIG. 29 on the home screen 1001 of the mobile terminal 100 can be displayed.

The specific icon may be generated when the recorded image is received from the wearable device 200, but it is not limited thereto.

The particular icon may be, but is not limited to, a tie machine icon 1091, for example.

When a touch on the tie-machine icon 1091 is input, the recorded image can be reproduced on the display unit 151 as shown in FIG. 30B.

The recorded video may be recorded in the wearable device 200 and transmitted to the mobile terminal 100 together with the positional information and stored in the memory 170 of the mobile terminal 100. [

The recorded image may include a forward image recorded by the front camera module 280 of the wearable device 200 and a rear image recorded by the rear camera module 290 of the wearable device 200. [

The screen of the display unit 151 of the mobile terminal 100 may include a forward video playback region 1101, a backward video playback region 1103, a recorded video control region 1109, and a route map display region 1105 .

The forward image of the recorded image can be reproduced in the forward image reproduction region 1101 and the backward image of the recorded image can be reproduced in the rear image reproduction region 1103. [

The size of the forward image reproducing area 1101 may be larger than the size of the rear image reproducing area 1103, but the present invention is not limited thereto.

The rear image reproduction area 1103 and the route map display area 1105 are arranged on the right side of the front image reproduction area 1101 and the recorded image control area 1109 is arranged on the front image reproduction area 1101, (1105). ≪ / RTI > The path map display area 1105 can be disposed between the rear image playback area 1103 and the recorded image control area 1109, but this is not restrictive.

Based on the positional information transmitted together with the recording image from the wearable device 200 on the path map display area 1105, a forward image reproduced on the current forward image reproduction area 1101 and a backward image reproduced on the current forward image reproduction area 1101, The position of the user in the rear image reproduced on the image reproduction area 1103 can be displayed.

For example, when the user's movement path included in the recording area is moved from the A position to the B position, map information including at least the A position and the B position may be displayed on the route map display area 1105. [ In addition, when the forward video when the user is at the A position on the forward video playback region 1101 and the backward video when the user is at the A position on the backward video playback region 1103 is currently played back, The current position mark 1107 of the user can be displayed at position A on the map information displayed on the path map display area 1105. [

The user can display the current position mark 1107 of the user displayed on the route map display area 1105 together with the forward image reproduced on the forward image reproduction area 1101 and the backward image reproduced on the backward image reproduction area 1103, It is possible to easily grasp the user's own route through the network.

The recording image control area 1109 includes a progress guide 1110 for guiding the reproduction progress state of the recording image, that is, the forward and backward images progressing in time, the forward image guide area 1110 located on the progress guide 1110, And a progress bar 1112 indicating a current reproduction progress position of a forward image reproduced on the display area 1101 and a rear image reproduced on the rear image reproduction area 1103.

The progress bar 1112 can be moved from the left side of the progress guide 1110 to the right as the recorded video, i.e., the forward video and the backward video, are reproduced in time.

The leftmost point of the progress bar 1112 indicates the start point of the recorded video and the rightmost point of the progress bar 112 indicates the end point of the recorded video.

A thumbnail image 1116 of the first group and a thumbnail image 1116 of the second group are displayed on the upper side of the progress guide 1110 in the recorded image control area 1109 and on the upper side of the first group of thumbnail images 1114 Can be displayed.

The first group of thumbnail images 1114 may be a frame image corresponding to a predetermined section among a plurality of frame images constituting the forward image.

The second group of thumbnail images 1116 may be a frame image corresponding to a predetermined section among a plurality of frame images constituting a rear image.

30 includes the frame images of the first group of thumbnail images 1114 and the second group of thumbnail images 1116, respectively, but the present invention is not limited thereto.

The thumbnail image 1114 of the first group and the thumbnail image 1116 of the second group are not normally displayed and when a touch and hold operation is input from the user to the progress bar 1112, 1109, but it is not limited thereto.

If a hold release is entered for the progress bar 1112 from the user, the first group of thumbnail images 1114 and the second group of thumbnail images 1116 may disappear.

The frame image 1114a of the first group of thumbnail images 1114 and the frame image 1116a of the second group of thumbnail images 1116 corresponding to the point where the progress bar 1112 is located are highlighted or shaded Or may be displayed in a specific color and distinguished from other frame images.

On the other hand, when the user touches and holds the progress bar 1112 and is dragged and touched at a desired time along the right direction and then the touch release is input, the progress bar 1112 Can be moved to a point in time desired by the user.

In this case, the forward image corresponding to the position where the progress bar 1112 is shifted is reproduced on the forward image reproduction area 1101, and the forward image corresponding to the point where the progress bar 1112 is moved on the backward image reproduction area 1103 Can be reproduced.

In addition, the current position mark 1107 may be moved to the position of the user in the forward and backward images corresponding to the point where the progress bar 1112 is moved on the path map display area 1105. [

In addition, the frame image 1114b of the first group of thumbnail images 1114 and the frame image 1116b of the second group of thumbnail images 1116 corresponding to the point where the progress bar 1112 is moved are highlighted Or may be displayed in a specific color and distinguished from other frame images. In contrast, the frame image 1114a of the first group of thumbnail images 1114 and the frame image 1116a of the second group of thumbnail images 1116, which were previously highlighted, shaded, or displayed in a particular color, It can be the same as the image.

31 is a diagram for explaining a method of switching the forward and backward video playback regions shown in FIG. 30 to each other.

31A, when a touch and a drag operation are inputted from an arbitrary point of the forward image reproduction region 1101 to an arbitrary point of the backward image reproduction region 1103, as shown in FIG. 31B, The region 1101 and the rear image reproduction region 1103 can be switched to each other. In this case, the forward image reproduction region 1101 may be newly defined as the rear image reproduction region 1103, and the backward image may be reproduced on the newly defined rear image reproduction region 1103. The rear image reproduction region 1103 may be newly defined as the front image reproduction region 1101 and the forward image reproduction region 1101 may be reproduced on the newly defined rear image reproduction region 1103. [

32 is a diagram illustrating a first screen for explaining a method of varying the forward image playback area shown in FIG.

32A, when a touch and a drag operation are inputted from an arbitrary point of the forward image reproduction area 1101 to an arbitrary area of the path map display area 1105, for example, as shown in FIG. 32B, The route image display area 1105 and the route map display area 1105 as well as the video image control area 1109. The forward image playback area 1101 is divided into the backward image playback area 1103, Area 1109. [0086] In other words, the forward image playback area 1101 can be extended to the entire area of the screen of the display unit 151. [

As described above, in the state where the forward image reproduction region 1101 is extended to the entire region of the screen of the display unit 151, a single tap or two times of tapping at an arbitrary point in the forward image reproduction region 1101 When the tapping double tap is inputted, it can be restored to the original area as shown in Fig. 32C. That is, the front image reproduction region 1101 extended to the entire region of the screen of the display unit 151 is reduced to its original size, while the rear image reproduction region 1103, The display area 1105 and the recorded image control area 1109 may appear in the original area of the screen of the display part 151. [

FIG. 33 is a diagram illustrating a second screen for explaining a method of varying the forward image reproduction area shown in FIG. 30. FIG.

When a touch and a drag operation are inputted from an arbitrary point of the forward image playback area 1101 to an arbitrary area of the path map display area 1105 (see Fig. 32A), the backward image playback area 1103 and the route map display area 1105 may disappear, the forward image reproduction area 1101 may be extended to the rear image reproduction area 1103 and the route map display area 1105. [

In this case, since the rear image reproduction region 1103 in which the rear image is reproduced disappears and the rear image is no longer reproduced, the second group of thumbnail images 1116 displayed in the recording image control region 1109 is also recorded in the recording image control region 0.0 > 1109 < / RTI >

The forward image playback area 1101 can be further extended by the area where the thumbnail image 1116 of the second group disappears, so that the user can view the forward image in a larger size.

When a single tap or a double-tapping double tap is input to an arbitrary point in the forward video playback region 1101 in a state where the forward video playback region 1101 is extended, As shown in FIG. That is, the backward image reproduction area 1103 and the route map display area 1105, which have disappeared on the screen of the display unit 151, 151 in the original area of the screen.

In addition, a second group of thumbnail images 1116 corresponding to the disappeared rear image playback region 1103 may appear on the recorded image control region 1109. FIG.

29 to 33, the user can view an image at a desired point in time at any time.

FIG. 34 is a flowchart illustrating a method of easily finding a building at a specific place by a user using the wearable device according to the present invention.

Referring to FIG. 34, the wearable device 200 registers destination information including a place and a name received from the mobile terminal 100 in the memory 207 (S441).

Since there is no input means for inputting characters to the wearable device 200, the wearable device 200 can receive the destination information including the place and the name from the mobile terminal 100.

Specifically, the destination search icon 1118 may be displayed on the home screen 1001 of the mobile terminal 100 as shown in FIG. 35A.

When a user touches the destination search icon 1118, the input window 1121 and a keyboard 1123 for inputting letters, numbers, and special characters can be displayed as shown in FIG. 35B.

The input window 1121 may include a name input window 1125 for inputting a name and a place input window 1127 for inputting a place.

The user can input the name into the name input window 1125 and input the place into the place input window 1127 using the keyboard 1123. [

The name can be the name of the building or the name of the store the user is looking for. The location is the location to which the user wishes to go, e.g., an address.

When a name is input into the name input window 1125 and a place is input in the place input window 1127 and a touch is input from the user to the transmission button 1129, destination information including the place and name input from the user And transmitted to the wearable device 200.

As another example, a building name, a place name, and the like that can be represented in the vicinity even if the user does not necessarily input the information may be automatically input.

The wearable device 200 may register the destination information including the place and name received from the mobile terminal 100 in the memory 207. [

Referring again to FIG. 34, the wearable device 200 activates the position information module 201d (S442).

The position information module 201d may be activated when the movement of the user is detected by the wearable device 200 or the mobile terminal 100, but the present invention is not limited thereto.

As the position information module 201d of the wearable device 200 is activated, the wearable device 200 can grasp the position of the user using the position information module 201d.

If the location of the user is within the pre-registered location, the control unit 208 of the wearable device 200 can activate the front camera module 280 (S443).

The wearable device 200 is provided with the activation button 250 but the front camera module 280 may be activated if the user's position is within the pre-registered location even though the activation button 250 is not pressed by the user .

Here, the neighborhood may be a radius separated from the previously registered place. The radius can be, for example, about 500 m or 1 km. This radius can be preset by the user.

As the front camera module 280 is activated, the control unit 208 of the wearable device 200 controls the front camera module 280 to take a forward image input to the front camera module 280 (S444).

The user is turned around to find the pre-registered name in the vicinity of the place, and a forward image having different viewing angles input to the front camera module 280 according to the user's surroundings can be photographed.

As another example, in addition to the front camera module 280, the rear camera module 290, the left camera module (1503 in FIG. 41) and the right camera module 1501 are activated and the camera modules 280, 290, 1501, The corresponding image can be photographed from all.

The control unit 208 of the wearable device 200 extracts text from the photographed forward image (S445).

The captured forward image may include a plurality of texts, characters, images, graphics, and the like.

The control unit 208 of the wearable device 200 can extract text from these.

The method of extracting text from a video image can be easily understood from the conventional periodic technology, and thus a further explanation will be omitted.

The control unit 208 of the wearable device 200 compares the text extracted from the photographed forward image with the pre-registered name to check whether the extracted text is the same as the previously registered name (S446).

If the extracted text is not the same as the previously registered name, the process proceeds to S444 and S445 and S446 may be repeatedly performed.

If the extracted text is the same as the previously registered name, the control unit 208 of the wearable device 200 informs the user that the destination has been found (S447).

For example, the control unit 208 of the wearable device 200 notifies the user through the sound output unit 205a of the wearable device 200 that the destination has been found or through the optical output unit 205c of the wearable device 200 .

The control unit 208 of the wearable device 200 may notify the user of the search of the destination through a text message through the display unit 151 of the mobile terminal 100 or may notify the sound output unit 152 of the mobile terminal 100, Or inform the user through the optical output unit 154 of the mobile terminal 100.

36 to 38 show a method of displaying a list of photographic images photographed by the wearable device of the present invention on a road view map on a mobile terminal.

36 is a flowchart illustrating a method of displaying a list of photographic images photographed by the wearable device of the present invention on a road view map on the mobile terminal 100. [

Referring to FIG. 36, the mobile terminal 100 receives a photographic image list photographed by using the location information from the wearable device 200 together with the voice file (S451).

The front camera module 280 and / or the rear camera module 290 of the wearable device 200 may be activated in order for the photographic image to be captured. For example, when the user presses the activation button 250, the front camera module 280 and / or the rear camera module 290 can be activated, but can be activated by the mobile terminal 100 as described above .

In addition, when the photograph image is photographed using the wearable device 200, the positional information module 201d and the microphone 202b of the wearable device 200 can be activated.

The position information module 201d and the microphone 202b may be activated by a user's button operation or may be activated together with the activation of the front camera module 280 and / or the rear camera module 290. [

Although not shown, when the left camera module and the right camera module are mounted on the wearable device 200 as well as the front camera module 280 and / or the rear camera module 290, the front camera module 280 and / The left camera module and the right camera module as well as the rear camera module 290 can be activated.

In this case, the panoramic photograph image or the road view photograph image can be generated as the front camera module 280, the rear camera module 290, the left camera module, and the right camera module are simultaneously photographed. That is, an image of an object in all 360 degrees around the user can be generated as a photographic image of one frame unit.

The front camera module 280, the rear camera module 290, the left camera module 1503 and the right camera module 280 are mounted on the wearable device 200. The front camera module 280 and the rear camera module 290 are mounted on the wearable device 200, And all of the camera modules 1501 are mounted (see FIG. 41).

Hereinafter, it is assumed that both the front camera module 280, the rear camera module 290, the left camera module 1503, and the right camera module 1501 are mounted on the wearable device 200.

37, the wearable device 200 includes a front camera module 280, a rear camera module 290, a left camera module 1503, 1135, 1136, and 1137 based on the images photographed from the camera modules 180, 290, 1501, and 1503 by capturing images input to the right camera module 1501 and the right camera module 1501, A photographed image 1033 of one frame as shown in Fig.

For example, the first area 1134 may be a forward image captured by the front camera module 280, and the second area 1135 may be a right image captured by the right camera module 1501. The third region 1136 may be a rear image photographed by the rear camera module 290 and the fourth region 1137 may be a left image photographed by the left camera module 1503. [ It can be preset by the manufacturer or set by the user to set an area of the first to fourth areas 1134, 1135, 1136, and 1137 that are photographed by the respective camera modules 280, 290 and 1501 1503 have.

In this case, the first area 1134 of the photographic image 1133 can be displayed on a single screen of the mobile terminal 100, as shown in Fig. 37A. When the touch drag is input along the left direction from the user in the state that the first area 1134 of the photographic image 1133 is displayed, the first area 1134 of the photographic image 1133 is displayed as shown in FIG. The second area 1135 of the photographic image 1133 can be switched and displayed. When the second region 1135 of the photographic image 1133 is displayed and the touch drag is inputted from the user along the left direction, the second region 1135 of the photographic image 1133 is photographed as shown in Fig. May be switched to a third area 1136 of the image 1133 and displayed. When a third region 1136 of the photographic image 1133 is displayed and a touch drag is inputted along the left direction from the user, the third region 1136 of the photographic image 1133 is photographed as shown in Fig. May be switched to a fourth area 1137 of the image 1133 and displayed.

On the contrary, the fourth area 1137 corresponds to the third area 1136, and the third area 1136 corresponds to the third area 1136 when the drag touch is input along the right direction in the state where the fourth area 1137 of the photographic image 1133 is displayed. 1136 may be switched to the second region 1135 and the second region 1135 to be switched to the first region 1134 to be displayed.

Accordingly, the user can view the load view image through the photographic image 1133. [ In other words, the user can view not only the front photograph image but also the front photograph image as well as the photographic images in all directions at the same time through the photographic image 1133, thereby providing the user with the pleasure of the photographic image .

In other words, when ordinary people view a picture, they only see objects in the front direction. However, in the past, only the objects in the front direction were viewed as photographs, so the user was not able to solve the question.

The present invention can view an image of an object in all directions as well as a front direction at the time of photographing, thereby eliminating the user's curiosity about the surrounding situation.

However, the present invention can be applied to a moving image photographed simultaneously by the front camera module 280, the rear camera module 290, the left camera module 1503, and the right camera module 1501 Lt; / RTI >

For example, the first to fourth moving images, which are simultaneously photographed by the front camera module 280, the rear camera module 290, the left camera module 1503, and the right camera module 1501, The first moving picture can be played back. In this case, the first moving picture may be switched to the second moving picture, the second moving picture to the third moving picture and the third moving picture to be switched to the fourth moving picture every time another drag touch is inputted in the left direction from the user.

Referring again to FIG. 36, the photo image list may include a plurality of photo images accumulated by the user at various places. The photographic image list may be stored in the memory 207 of the wearable device 200 and then transmitted to the mobile terminal 100.

Voice files can be linked with each photo image. For example, at the time of photographing, there may be a voice of a person, an animal voice or surrounding noise. These can be recorded together with a photo file when a picture is taken. The generated voice file may be linked to the photographic image, stored in the memory 207 of the wearable device 200, and then transmitted to the mobile terminal 100 together with the photographic image list.

For example, when a specific photo image is touched at the mobile terminal 100, a voice file linked with a specific photo image may be reproduced, but the present invention is not limited thereto.

On the other hand, the photographic image may include positional information. That is, when the camera modules 280, 290, 1501 and 1503 and the position information module 201d are activated, the wearable device 200 always grasps the position of the user, while the camera modules 280, 290, 1501, 1503 to confirm that the photograph is taken.

When the user presses the photographing buttons 231 and 233, the wearable device 200 detects the position information and displays the currently recognized position information on the images photographed by the camera modules 280, 290, 1501 and 1503 And the like.

The position information reflected in the photographic image can be arranged at the corresponding position on the road view map based on the position information included in the photographic images when the road view map is generated in the mobile terminal 100. [

The mobile terminal 100 generates a road view map based on the photographic image list received from the wearable device 200 and stores the generated road view map in the memory 170 (S453).

As described above, the photographic image list includes a plurality of one-frame photographic images, and each photographic image may include positional information.

The mobile terminal 100 can generate a road view map in which the respective photographic images are arranged according to the positional information based on the map data previously provided.

The mobile terminal 100 controls the display unit 151 to display a road view map (S455).

For example, a road view gallery icon 1141 may be displayed on the home screen 1001 of the mobile terminal 100 as shown in FIG. 38A.

When a user touches the load view gallery icon 1141, a road view map 1143 can be displayed on the screen of the display unit 151 as shown in FIG. 38B.

The screen may be divided into a first area and a second area. The map information may be displayed in the first area, and the photo image corresponding to the specific position of the map information may be displayed in the second area. If there is music that is heard at the time of shooting of the photographic image when the photographic image is displayed, the music may be reproduced. Meanwhile, the screen may further include a third area, and in the third area, Information about place names or famous places obtained from the information, such as shops, restaurants, historical sites, etc., may be displayed. These famous places can be obtained, for example, from a web server.

The road view map 1143 may include a thumbnail photograph image 1145 that is placed at a place visited by the user and photographed.

If at least one photographic image is photographed at a particular location, the thumbnail photographic image 1145 disposed at that location may have a shape in which at least one photographic image overlaps. A numeric mark indicating the number of photographed photographic images may be displayed on the thumbnail photographic image 1145. [

Although not shown, the path that the user travels on the roudy view map 1143 may be displayed, and this path may have a different color or hatch from the path. An arrow indicating the direction of travel may be displayed on the path so that the direction of travel may be known.

For example, when a touch for a specific thumbnail image is input, photographic images corresponding to a numeric mark displayed on a specific thumbnail image are expanded, and when a specific photographic image is selected and dragged through a drag touch, a specific photographic image is displayed in a separate window Meanwhile, a music file linked to a specific photographic image is reproduced so that a user can hear the surrounding photographic image at the time of photographing a specific photographic image while viewing a specific photographic image.

At this time, the specific photo image may correspond to the first area of the photographic image shown in FIG. That is, a specific photo image photographed by the front camera module 280 may be displayed. In this case, every time a drag touch is inputted along the left direction from the user as described above, another photographic image photographed by the right camera module 1501, another photographic image photographed by the rear camera module 290, Another photographic image photographed by the camera module 1503 can be sequentially displayed.

Accordingly, the user does not only look at the specific photograph image photographed by the front camera module 280 but also the other photograph images taken by the right camera module 1501, the rear camera module 290 and the left camera module 1503 You can see the road view photos as if you can.

For example, it may be photographed in accordance with a time period or a distance by the front camera module 280, the rear camera module 290, the right camera module 1501 and the left camera module 1503. [ The time bar may also be displayed when the road view map is displayed in the mobile terminal 100. In this case, when a specific time is selected using the time bar, The moving distance and the photographic image shot at that specific time can be displayed as a window or sun nail image.

On the other hand, along with the photographed image, GPS information at the time of photographing, moving direction information of the user, music information heard at the time of photographing, weather information, and surrounding sounds at the time of photographing are stored as tag information, May be displayed as an image or an icon. In this case, when the corresponding icon is selected, the photographed image is displayed and GPS information, moving direction information, and weather information are displayed together, and a music file corresponding to the music information is reproduced or a surrounding sound at the time of photographing is reproduced have. The music that was heard at the time of shooting may be stored in the memory 170 of the mobile terminal 100 or may be present on the web server.

As another example, the music that was being heard at the time of shooting may be stored in association with the photographic image. In this case, the photo image tag information may be added to the music file. Therefore, when the music file is reproduced, photographic images photographed at the time of the music being played can be displayed. Photo images can be displayed as slides.

As another example, the pictures photographed when a specific music is heard are linked with a specific music, so that the pictures can be displayed when a specific music is heard. When one picture is taken when a specific music is heard, the picture can be displayed in a separate window when listening to a specific music. When a plurality of pictures are taken when a specific music is heard, a plurality of pictures can be displayed as a slide when listening to specific music.

FIG. 39 is another exemplary screen illustrating a method of displaying a road view map on a mobile terminal. FIG.

39A, the screen of the display unit 151 of the mobile terminal 100 is divided into first and second areas, an image display window is displayed in the first area, and a map display window is displayed in the second area .

The photographic images are reproduced as slides in the image display window, and the map map information can be displayed on the map display window.

For example, as shown in FIG. 39A, when the first photographic image is displayed on the image display window, the marker may be displayed at the first position of the map map displayed on the map display window. From this, it can be seen that the first photographic image displayed on the image display window is photographed at the first position of the map map.

For example, as shown in FIG. 39B, when the second photographic image is displayed on the image display window, the marker displayed on the map display window can be moved to the second position and displayed. From this, it can be seen that the second photographic image displayed on the image display window is photographed at the second position of the map map.

According to the present invention, a location or a place where photographic images are photographed can be confirmed in real time through a map map.

The above embodiments can be applied to a glass device.

40 is a schematic view showing a system including a wearable device and a glass device according to the present invention.

As shown in FIG. 40, an image input to the front camera module 280 and / or the rear camera module 290 mounted on the wearable device 200 can be photographed.

41) and the right camera module (1501 of FIG. 41) are additionally mounted to the wearable device 200, the front camera module 280 and the rear camera module 290 are provided in addition to the front camera module 280 and the rear camera module 290, 280, the rear camera module 290, the left camera module 1503, and / or the right camera module 1501 can be photographed.

At this time, the image may be a still image, a moving image, a list of photographic images, a panorama, or the like.

The photographed image can be transmitted to the glass device 1300 using the communication module 114 of the wearable device 200. The glass device 1300 may also include a communication module to receive the photographed image transmitted from the wearable device 200 using the communication module.

The glass device 1300 may be provided with a prism 1313 for displaying an image.

And the prism 1313 can be fixed by the body 1311 to be supported. The prism 1313 may include a transparent optical element.

An image of the image is formed on the prism 1313, so that the user can view the image.

The glass device 1300 may further include a light source (not shown) for irradiating the image with the prism 1313.

In addition, the glass device 1300 may be provided with a camera 1315 capable of photographing a forward image.

The glass device 1300 may irradiate the image on the prism 1313 so that the user can view the image received from the wearable device 200. [

Pairing can be performed between the wearable device 200 and the glass device 1300 before the image photographed from the wearable device 200 is transmitted to the glass device 1300. [

An image photographed from the wearable device 200 can be transmitted to the glass device 1300 at a real time or at regular intervals.

The user wears the image taken from each of the camera modules 280 and 290 (1501 and 1503 in Fig. 41) of the wearable device 200 to the glass device 1300 while wearing the glass device 1300 and the wearable device 200, It is possible to easily cope with the dangerous situation from the surroundings.

FIG. 43 is a flowchart showing a method of photographing with a mobile terminal instead of a wearable device.

Referring to FIG. 43, the mobile terminal 100 may perform pairing with the wearable device 200 (S461).

When the pairing is completed, the front camera module 280 of the wearable device 200 may be driven (S463). The driving of the front camera module 280 may be driven by the control of the mobile terminal or may be driven by the wearable device 200 when the pairing is completed.

44, if the front camera module 280 of the wearable device 200 is blocked by the mobile terminal 100 (S465), the forward image is photographed by the camera 121 of the mobile terminal 100 .

Specifically, the wearable device 200 can detect whether the front camera module 280 is blocked by the mobile terminal 100 using the brightness change of the forward image input to the front camera module 280. When the front camera module 280 is blocked by the mobile terminal 100, the wearable device 200 may transmit the photographing command to the mobile terminal 100. [ The mobile terminal 100 having received the photographing command may control the camera 121 to photograph a forward image.

According to the wearable device of the present invention, a widget icon capable of driving the wearable device on the mobile terminal can be displayed. The wearable device 200 may be driven according to a touch command to the widget icon. At this time, the driving of the wearable device 200 may mean driving the front camera module 280 and the rear camera module 290, but the invention is not limited thereto. The widget icon may be an application that can directly execute a specific function without using a web browser in the mobile terminal 100 or the like.

Meanwhile, the wearable device 200 of the present invention can prevent a wearer from hitting a front obstacle or falling from an obstacle when the user walks while watching a movie, a photo image, or a broadcast program using the mobile terminal 100 Can be solved. That is, when the user walks while viewing the movie, photo image, or broadcast program using the mobile terminal 100, if the obstacle ahead approaches within a certain distance, the proximity sensor 204a of the wearable device 200 detects the obstacle The user can be provided with an effect sound or an alarm sound. At this time, the closer to the obstacle in front, the larger the effect sound or alarm sound.

Such an effect sound or alarm sound may be generated in the wearable device 200 itself. Or the obstacle information detected by the proximity sensor 204a of the wearable device 200 may be transmitted to the mobile terminal 100 so that the mobile terminal 100 may generate an effect sound or an alarm sound.

An obstacle can be anything that can harm a user, such as a stairway, a wall, a door, a car, a bicycle, a person, an animal, and the like.

As shown in FIGS. 3 and 7 to 10, a method of avoiding obstacles while walking while viewing the mobile terminal 100 may include a method of avoiding obstacles in front of the mobile terminal 100, There is a method of displaying a preview image input to the camera module 280 and / or the rear camera module 290 on the front preview screen 1024 and / or the rear preview screen 1026. As described above, even if the user walks while viewing the movie or the broadcast program using the mobile terminal 100, the user can easily view the forward preview image and / or the rear preview image displayed on the forward preview screen 1024 and / or the rear preview screen 1026 By checking, it is possible to easily check whether the obstacles exist in the front and rear, thereby avoiding the obstacle.

In the above description, the front camera module 280 and the rear camera module 290 are mounted on the wearable device 200 to capture a forward image and a rearward image.

41, the left camera module 1503 mounted on the left side of the wearable device 200 and the right camera module 1501 mounted on the right side of the wearable device 200 are not limited to the present invention, ) Is added to the image of the user in the left direction and the image of the user in the right direction as well as the image in the forward direction and the image in the backward direction are obtained so that images in all directions around the user are obtained, The convenience can be further maximized.

The present invention may be implemented such that more camera modules than the four camera modules 280, 290, 1501, and 1503 shown in FIG. 41 are mounted on some acoustic devices.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a control unit 180 of the mobile terminal 100. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: Input unit
140: sensing unit 150: output unit
160: interface unit 170: memory
180: control unit 190: power supply unit
200: Wearable device

Claims (21)

1. A mobile terminal capable of wireless communication with a wearable device having an audio output unit and at least one camera,
A wireless communication device performing wireless communication with the wearable device;
A touch screen capable of displaying information and receiving touch input;
And a control unit,
Wherein,
Displaying an icon on the touch screen to control the wearable device,
A music control screen for controlling reproduction of music to be output through the wearable device and a camera control screen for controlling the at least one camera of the wearable device in response to the selection of the displayed icon are displayed on the touch screen Simultaneously display
The screen on the touch screen is divided into a first area and a second area,
A photographic image is reproduced as a slide on the first area,
And controls to display data including a marker indicating a position where the reproduced photographic image is photographed on the second area. delete The method according to claim 1,
Wherein the camera control screen includes an angle adjustment button for adjusting a rotation angle of the at least one camera. The method according to claim 1,
Wherein the camera control screen includes a camera button for activating the at least one camera individually or collectively. 5. The method of claim 4,
Wherein,
Wherein when the touch of the camera button is input, the touch screen is controlled to display a preview screen corresponding to the corresponding camera button. 6. The method of claim 5,
Wherein the preview screen is displayed on the camera control screen or in a separate window from the camera control screen. The method according to claim 6,
Wherein at least one preview screen is displayed along a vertical direction or a horizontal direction with respect to the music control screen when at least one preview screen is displayed on the camera control screen. The method according to claim 6,
When at least one preview screen is displayed on the camera control screen, a first preview screen of the at least one preview screen is displayed and a second preview screen is hidden in a queue displayed on one side of the first preview screen,
And a second preview screen hidden in the queue is displayed on one area of the first preview screen when a flick touch is input to the queue. delete The method according to claim 1,
Wherein the camera of the wearable device acquires at least one photographic image,
Wherein,
Displaying the at least one photographic image on the touch screen,
And controls to reproduce the music that was heard at the time of shooting the specific photographic image when selecting a specific photographic image among the at least one photographic images. The method according to claim 1,
The wearable device obtains a photographed photographic image according to a time period or a distance,
Wherein,
Displaying a time bar on the touch screen,
Wherein when the user selects a specific time from the time instant, the moving distance and the photographic image photographed at the specific time are displayed on the touch screen. 12. The method of claim 11,
Tag information related to music being played back at the time of shooting is added to the photographed image,
Wherein,
Displaying an icon associated with the tag information on the touch screen,
And controls to reproduce music being played at the time of photographing when an icon associated with the tag information is selected. delete delete delete delete delete delete delete delete delete

Images